Sep 16 01:15:50.545658 ip-10-0-135-225 systemd[1]: Starting Kubernetes Kubelet...
Sep 16 01:15:50.974638 ip-10-0-135-225 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 01:15:50.974638 ip-10-0-135-225 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 16 01:15:50.974638 ip-10-0-135-225 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 01:15:50.974638 ip-10-0-135-225 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 16 01:15:50.974638 ip-10-0-135-225 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 01:15:50.976316 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.976225    2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 16 01:15:50.982503 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982475    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 01:15:50.982503 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982498    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 01:15:50.982503 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982503    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 01:15:50.982503 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982507    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 01:15:50.982503 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982511    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 01:15:50.982807 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982516    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 01:15:50.982807 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982520    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 01:15:50.982807 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982528    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 01:15:50.982807 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982536    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 01:15:50.982807 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982540    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 01:15:50.982807 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982543    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 01:15:50.982807 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982547    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 01:15:50.982807 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982551    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 01:15:50.982807 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982555    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 01:15:50.982807 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982558    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 01:15:50.982807 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982562    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 01:15:50.982807 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982565    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 01:15:50.982807 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982570    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 01:15:50.982807 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982573    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 01:15:50.982807 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982577    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 01:15:50.982807 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982581    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 01:15:50.982807 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982584    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 01:15:50.982807 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982588    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 01:15:50.982807 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982592    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 01:15:50.982807 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982596    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 01:15:50.983612 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982600    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 01:15:50.983612 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982604    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 01:15:50.983612 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982607    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 01:15:50.983612 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982611    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 01:15:50.983612 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982615    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 01:15:50.983612 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982625    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 01:15:50.983612 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982631    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 01:15:50.983612 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982636    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 01:15:50.983612 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982641    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 01:15:50.983612 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982645    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 01:15:50.983612 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982648    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 01:15:50.983612 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982652    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 01:15:50.983612 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982657    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 01:15:50.983612 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982662    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 01:15:50.983612 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982666    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 01:15:50.983612 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982670    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 01:15:50.983612 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982674    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 01:15:50.983612 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982678    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 01:15:50.983612 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982682    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 01:15:50.984432 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982686    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 01:15:50.984432 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982690    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 01:15:50.984432 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982694    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 01:15:50.984432 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982698    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 01:15:50.984432 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982702    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 01:15:50.984432 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982707    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 01:15:50.984432 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982713    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 01:15:50.984432 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982717    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 01:15:50.984432 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982722    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 01:15:50.984432 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982728    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 01:15:50.984432 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982734    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 01:15:50.984432 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982740    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 01:15:50.984432 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982745    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 01:15:50.984432 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982749    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 01:15:50.984432 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982754    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 01:15:50.984432 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982758    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 01:15:50.984432 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982762    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 01:15:50.984432 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982766    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 01:15:50.984432 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982771    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 01:15:50.984432 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982775    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 01:15:50.985217 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982779    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 01:15:50.985217 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982783    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 01:15:50.985217 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982787    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 01:15:50.985217 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982791    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 01:15:50.985217 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982796    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 01:15:50.985217 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982801    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 01:15:50.985217 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982805    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 01:15:50.985217 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982808    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 01:15:50.985217 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982812    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 01:15:50.985217 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982816    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 01:15:50.985217 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982820    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 01:15:50.985217 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982824    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 01:15:50.985217 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982829    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 01:15:50.985217 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982833    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 01:15:50.985217 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982837    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 01:15:50.985217 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982841    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 01:15:50.985217 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982846    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 01:15:50.985217 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982850    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 01:15:50.985217 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982854    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 01:15:50.985217 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982859    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 01:15:50.986066 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982864    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 01:15:50.986066 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982868    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 01:15:50.986066 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982871    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 01:15:50.986066 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982882    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 01:15:50.986066 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982887    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 01:15:50.986066 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982892    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 01:15:50.986066 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982896    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 01:15:50.986066 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982900    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 01:15:50.986066 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982904    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 01:15:50.986066 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982909    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 01:15:50.986066 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982913    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 01:15:50.986066 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982917    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 01:15:50.986066 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982921    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 01:15:50.986066 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982925    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 01:15:50.986066 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.982929    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 01:15:50.986066 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984107    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 01:15:50.986066 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984117    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 01:15:50.986066 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984122    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 01:15:50.986066 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984126    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 01:15:50.986876 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984130    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 01:15:50.986876 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984135    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 01:15:50.986876 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984139    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 01:15:50.986876 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984143    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 01:15:50.986876 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984148    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 01:15:50.986876 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984152    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 01:15:50.986876 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984156    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 01:15:50.986876 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984160    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 01:15:50.986876 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984163    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 01:15:50.986876 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984167    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 01:15:50.986876 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984172    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 01:15:50.986876 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984176    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 01:15:50.986876 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984180    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 01:15:50.986876 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984185    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 01:15:50.986876 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984189    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 01:15:50.986876 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984193    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 01:15:50.986876 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984200    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 01:15:50.986876 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984206    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 01:15:50.986876 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984211    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 01:15:50.987639 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984215    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 01:15:50.987639 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984219    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 01:15:50.987639 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984225    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 01:15:50.987639 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984229    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 01:15:50.987639 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984233    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 01:15:50.987639 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984238    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 01:15:50.987639 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984241    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 01:15:50.987639 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984245    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 01:15:50.987639 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984250    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 01:15:50.987639 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984253    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 01:15:50.987639 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984259    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 01:15:50.987639 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984265    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 01:15:50.987639 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984270    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 01:15:50.987639 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984274    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 01:15:50.987639 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984278    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 01:15:50.987639 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984282    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 01:15:50.987639 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984286    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 01:15:50.987639 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984290    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 01:15:50.987639 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984294    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 01:15:50.987639 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984298    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 01:15:50.988162 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984303    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 01:15:50.988162 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984307    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 01:15:50.988162 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984311    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 01:15:50.988162 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984315    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 01:15:50.988162 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984319    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 01:15:50.988162 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984323    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 01:15:50.988162 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984352    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 01:15:50.988162 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984359    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 01:15:50.988162 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984363    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 01:15:50.988162 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984367    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 01:15:50.988162 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984372    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 01:15:50.988162 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984375    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 01:15:50.988162 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984379    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 01:15:50.988162 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984383    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 01:15:50.988162 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984387    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 01:15:50.988162 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984391    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 01:15:50.988162 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984395    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 01:15:50.988162 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984399    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 01:15:50.988162 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984403    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 01:15:50.988162 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984407    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 01:15:50.988757 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984411    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 01:15:50.988757 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984415    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 01:15:50.988757 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984419    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 01:15:50.988757 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984424    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 01:15:50.988757 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984428    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 01:15:50.988757 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984432    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 01:15:50.988757 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984436    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 01:15:50.988757 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984440    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 01:15:50.988757 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984444    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 01:15:50.988757 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984448    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 01:15:50.988757 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984452    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 01:15:50.988757 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984456    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 01:15:50.988757 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984460    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 01:15:50.988757 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984466    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 01:15:50.988757 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984471    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 01:15:50.988757 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984475    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 01:15:50.988757 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984479    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 01:15:50.988757 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984483    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 01:15:50.988757 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984487    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 01:15:50.988757 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984491    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 01:15:50.989367 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984496    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 01:15:50.989367 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984500    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 01:15:50.989367 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984505    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 01:15:50.989367 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984509    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 01:15:50.989367 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984513    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 01:15:50.989367 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984516    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 01:15:50.989367 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984521    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 01:15:50.989367 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984525    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 01:15:50.989367 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984531    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 01:15:50.989367 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984537    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 01:15:50.989367 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984541    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 01:15:50.989367 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984545    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 01:15:50.989367 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984550    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 01:15:50.989367 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984554    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 01:15:50.989367 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984560    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 01:15:50.989367 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.984564    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 01:15:50.989367 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985193    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 01:15:50.989367 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985201    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 01:15:50.989367 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985206    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 01:15:50.989367 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985210    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 01:15:50.989937 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985214    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 01:15:50.989937 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985219    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 01:15:50.989937 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985223    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 01:15:50.989937 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985227    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 01:15:50.989937 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985230    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 01:15:50.989937 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985235    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 01:15:50.989937 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985239    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 01:15:50.989937 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985243    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 01:15:50.989937 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985247    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 01:15:50.989937 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985251    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 01:15:50.989937 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985255    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 01:15:50.989937 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985259    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 01:15:50.989937 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985264    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 01:15:50.989937 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985269    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 01:15:50.989937 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985274    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 01:15:50.989937 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985278    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 01:15:50.989937 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985282    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 01:15:50.989937 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985286    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 01:15:50.989937 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985290    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 01:15:50.989937 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985295    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 01:15:50.990528 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985299    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 01:15:50.990528 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985302    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 01:15:50.990528 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985307    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 01:15:50.990528 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985311    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 01:15:50.990528 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985315    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 01:15:50.990528 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985319    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 01:15:50.990528 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985323    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 01:15:50.990528 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985327    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 01:15:50.990528 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985331    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 01:15:50.990528 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985354    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 01:15:50.990528 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985358    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 01:15:50.990528 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985362    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 01:15:50.990528 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985366    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 01:15:50.990528 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985370    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 01:15:50.990528 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985374    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 01:15:50.990528 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985379    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 01:15:50.990528 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985383    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 01:15:50.990528 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985387    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 01:15:50.990528 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985390    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 01:15:50.990528 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985394    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 01:15:50.991005 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985398    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 01:15:50.991005 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985402    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 01:15:50.991005 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985407    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 01:15:50.991005 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985411    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 01:15:50.991005 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985415    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 01:15:50.991005 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985420    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 01:15:50.991005 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985424    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 01:15:50.991005 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985428    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 01:15:50.991005 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985432    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 01:15:50.991005 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985437    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 01:15:50.991005 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985443    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 01:15:50.991005 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985448    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 01:15:50.991005 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985452    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 01:15:50.991005 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985456    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 01:15:50.991005 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985460    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 01:15:50.991005 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985467    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 01:15:50.991005 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985472    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 01:15:50.991005 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985477    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 01:15:50.991005 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985481    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 01:15:50.991494 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985485    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 01:15:50.991494 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985490    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 01:15:50.991494 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985494    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 01:15:50.991494 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985498    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 01:15:50.991494 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985503    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 01:15:50.991494 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985507    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 01:15:50.991494 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985513    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 01:15:50.991494 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985517    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 01:15:50.991494 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985521    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 01:15:50.991494 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985525    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 01:15:50.991494 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985529    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 01:15:50.991494 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985533    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 01:15:50.991494 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985537    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 01:15:50.991494 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985541    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 01:15:50.991494 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985545    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 01:15:50.991494 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985550    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 01:15:50.991494 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985554    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 01:15:50.991494 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985558    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 01:15:50.991494 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985562    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 01:15:50.991949 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985569    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 01:15:50.991949 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985599    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 01:15:50.991949 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985608    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 01:15:50.991949 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985614    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 01:15:50.991949 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985619    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 01:15:50.991949 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985623    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 01:15:50.991949 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985627    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 01:15:50.991949 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985632    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 01:15:50.991949 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985636    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 01:15:50.991949 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985641    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 01:15:50.991949 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985646    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 01:15:50.991949 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985650    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 01:15:50.991949 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985654    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 01:15:50.991949 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985658    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 01:15:50.991949 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985662    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 01:15:50.991949 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985666    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 01:15:50.991949 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.985670    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 01:15:50.991949 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.985774    2565 flags.go:64] FLAG: --address="0.0.0.0"
Sep 16 01:15:50.991949 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.985826    2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 16 01:15:50.991949 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.985837    2565 flags.go:64] FLAG: --anonymous-auth="true"
Sep 16 01:15:50.992470 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.985844    2565 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 16 01:15:50.992470 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.985850    2565 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 16 01:15:50.992470 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.985855    2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 16 01:15:50.992470 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.985862    2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 16 01:15:50.992470 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.985868    2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 16 01:15:50.992470 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.985873    2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 16 01:15:50.992470 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.985878    2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 16 01:15:50.992470 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.985884    2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 16 01:15:50.992470 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.985889    2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 16 01:15:50.992470 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.985894    2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 16 01:15:50.992470 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.985899    2565 flags.go:64] FLAG: --cgroup-root=""
Sep 16 01:15:50.992470 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.985906    2565 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 16 01:15:50.992470 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.985911    2565 flags.go:64] FLAG: --client-ca-file=""
Sep 16 01:15:50.992470 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.985917    2565 flags.go:64] FLAG: --cloud-provider="external"
Sep 16 01:15:50.992470 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.985922    2565 flags.go:64] FLAG: --cluster-dns="[]"
Sep 16 01:15:50.992470 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.985928    2565 flags.go:64] FLAG: --cluster-domain=""
Sep 16 01:15:50.992470 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.985933    2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 16 01:15:50.992470 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.985938    2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 16 01:15:50.992470 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.985943    2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 16 01:15:50.992470 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.985948    2565 flags.go:64] FLAG: --container-log-max-files="5"
Sep 16 01:15:50.992470 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.985954    2565 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 16 01:15:50.992470 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.985959    2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 16 01:15:50.992470 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.985964    2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 16 01:15:50.993001 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.985969    2565 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 16 01:15:50.993001 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.985973    2565 flags.go:64] FLAG: --contention-profiling="false"
Sep 16 01:15:50.993001 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.985978    2565 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 16 01:15:50.993001 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.985983    2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 16 01:15:50.993001 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.985987    2565 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 16 01:15:50.993001 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.985992    2565 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 16 01:15:50.993001 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.985999    2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 16 01:15:50.993001 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986004    2565 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 16 01:15:50.993001 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986008    2565 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 16 01:15:50.993001 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986013    2565 flags.go:64] FLAG: --enable-load-reader="false"
Sep 16 01:15:50.993001 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986018    2565 flags.go:64] FLAG: --enable-server="true"
Sep 16 01:15:50.993001 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986022    2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 16 01:15:50.993001 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986030    2565 flags.go:64] FLAG: --event-burst="100"
Sep 16 01:15:50.993001 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986034    2565 flags.go:64] FLAG: --event-qps="50"
Sep 16 01:15:50.993001 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986039    2565 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 16 01:15:50.993001 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986044    2565 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 16 01:15:50.993001 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986048    2565 flags.go:64] FLAG: --eviction-hard=""
Sep 16 01:15:50.993001 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986054    2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 16 01:15:50.993001 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986059    2565 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 16 01:15:50.993001 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986063    2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 16 01:15:50.993001 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986070    2565 flags.go:64] FLAG: --eviction-soft=""
Sep 16 01:15:50.993001 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986075    2565 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 16 01:15:50.993001 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986079    2565 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 16 01:15:50.993001 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986085    2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 16 01:15:50.993001 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986090    2565 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 16 01:15:50.993648 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986095    2565 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 16 01:15:50.993648 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986099    2565 flags.go:64] FLAG: --fail-swap-on="true"
Sep 16 01:15:50.993648 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986104    2565 flags.go:64] FLAG: --feature-gates=""
Sep 16 01:15:50.993648 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986110    2565 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 16 01:15:50.993648 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986114    2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 16 01:15:50.993648 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986121    2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 16 01:15:50.993648 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986126    2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 16 01:15:50.993648 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986131    2565 flags.go:64] FLAG: --healthz-port="10248"
Sep 16 01:15:50.993648 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986136    2565 flags.go:64] FLAG: --help="false"
Sep 16 01:15:50.993648 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986140    2565 flags.go:64] FLAG: --hostname-override="ip-10-0-135-225.ec2.internal"
Sep 16 01:15:50.993648 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986145    2565 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 16 01:15:50.993648 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986150    2565 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 16 01:15:50.993648 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986155    2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 16 01:15:50.993648 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986160    2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 16 01:15:50.993648 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986166    2565 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 16 01:15:50.993648 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986171    2565 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 16 01:15:50.993648 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986176    2565 flags.go:64] FLAG: --image-service-endpoint=""
Sep 16 01:15:50.993648 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986180    2565 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 16 01:15:50.993648 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986185    2565 flags.go:64] FLAG: --kube-api-burst="100"
Sep 16 01:15:50.993648 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986190    2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 16 01:15:50.993648 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986195    2565 flags.go:64] FLAG: --kube-api-qps="50"
Sep 16 01:15:50.993648 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986199    2565 flags.go:64] FLAG: --kube-reserved=""
Sep 16 01:15:50.993648 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986204    2565 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 16 01:15:50.993648 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986210    2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 16 01:15:50.994223 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986215    2565 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 16 01:15:50.994223 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986220    2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 16 01:15:50.994223 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986224    2565 flags.go:64] FLAG: --lock-file=""
Sep 16 01:15:50.994223 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986230    2565 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 16 01:15:50.994223 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986236    2565 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 16 01:15:50.994223 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986240    2565 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 16 01:15:50.994223 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986249    2565 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 16 01:15:50.994223 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986254    2565 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 16 01:15:50.994223 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986259    2565 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 16 01:15:50.994223 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986264    2565 flags.go:64] FLAG: --logging-format="text"
Sep 16 01:15:50.994223 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986268    2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 16 01:15:50.994223 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986273    2565 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 16 01:15:50.994223 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986278    2565 flags.go:64] FLAG: --manifest-url=""
Sep 16 01:15:50.994223 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986282    2565 flags.go:64] FLAG: --manifest-url-header=""
Sep 16 01:15:50.994223 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986289    2565 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 16 01:15:50.994223 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986293    2565 flags.go:64] FLAG: --max-open-files="1000000"
Sep 16 01:15:50.994223 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986300    2565 flags.go:64] FLAG: --max-pods="110"
Sep 16 01:15:50.994223 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986304    2565 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 16 01:15:50.994223 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986309    2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 16 01:15:50.994223 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986313    2565 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 16 01:15:50.994223 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986318    2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 16 01:15:50.994223 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986323    2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 16 01:15:50.994223 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986328    2565 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 16 01:15:50.994223 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986332    2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 16 01:15:50.994223 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986361    2565 flags.go:64] FLAG: --node-status-max-images="50"
Sep 16 01:15:50.994839 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986366    2565 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 16 01:15:50.994839 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986371    2565 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 16 01:15:50.994839 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986375    2565 flags.go:64] FLAG: --pod-cidr=""
Sep 16 01:15:50.994839 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986380    2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 16 01:15:50.994839 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986389    2565 flags.go:64] FLAG: --pod-manifest-path=""
Sep 16 01:15:50.994839 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986393    2565 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 16 01:15:50.994839 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986400    2565 flags.go:64] FLAG: --pods-per-core="0"
Sep 16 01:15:50.994839 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986405    2565 flags.go:64] FLAG: --port="10250"
Sep 16 01:15:50.994839 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986409    2565 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 16 01:15:50.994839 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986415    2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d84392e2559dec3f"
Sep 16 01:15:50.994839 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986420    2565 flags.go:64] FLAG: --qos-reserved=""
Sep 16 01:15:50.994839 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986426    2565 flags.go:64] FLAG: --read-only-port="10255"
Sep 16 01:15:50.994839 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986431    2565 flags.go:64] FLAG: --register-node="true"
Sep 16 01:15:50.994839 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986436    2565 flags.go:64] FLAG: --register-with-taints=""
Sep 16 01:15:50.994839 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986442    2565 flags.go:64] FLAG: --registry-burst="10"
Sep 16 01:15:50.994839 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986447    2565 flags.go:64] FLAG: --registry-qps="5"
Sep 16 01:15:50.994839 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986452    2565 flags.go:64] FLAG: --reserved-cpus=""
Sep 16 01:15:50.994839 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986456    2565 flags.go:64] FLAG: --reserved-memory=""
Sep 16 01:15:50.994839 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986462    2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 16 01:15:50.994839 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986467    2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 16 01:15:50.994839 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986471    2565 flags.go:64] FLAG: --rotate-certificates="false"
Sep 16 01:15:50.994839 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986476    2565 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 16 01:15:50.994839 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986480    2565 flags.go:64] FLAG: --runonce="false"
Sep 16 01:15:50.994839 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986486    2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 16 01:15:50.994839 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986491    2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 16 01:15:50.995453 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986495    2565 flags.go:64] FLAG: --seccomp-default="false"
Sep 16 01:15:50.995453 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986500    2565 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 16 01:15:50.995453 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986504    2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 16 01:15:50.995453 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986509    2565 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 16 01:15:50.995453 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986514    2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 16 01:15:50.995453 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986519    2565 flags.go:64] FLAG: --storage-driver-password="root"
Sep 16 01:15:50.995453 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986523    2565 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 16 01:15:50.995453 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986528    2565 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 16 01:15:50.995453 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986532    2565 flags.go:64] FLAG: --storage-driver-user="root"
Sep 16 01:15:50.995453 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986537    2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 16 01:15:50.995453 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986541    2565 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 16 01:15:50.995453 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986546    2565 flags.go:64] FLAG: --system-cgroups=""
Sep 16 01:15:50.995453 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986550    2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 16 01:15:50.995453 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986564    2565 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 16 01:15:50.995453 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986568    2565 flags.go:64] FLAG: --tls-cert-file=""
Sep 16 01:15:50.995453 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986573    2565 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 16 01:15:50.995453 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986579    2565 flags.go:64] FLAG: --tls-min-version=""
Sep 16 01:15:50.995453 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986583    2565 flags.go:64] FLAG: --tls-private-key-file=""
Sep 16 01:15:50.995453 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986590    2565 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 16 01:15:50.995453 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986594    2565 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 16 01:15:50.995453 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986599    2565 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 16 01:15:50.995453 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986604    2565 flags.go:64] FLAG: --v="2"
Sep 16 01:15:50.995453 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986610    2565 flags.go:64] FLAG: --version="false"
Sep 16 01:15:50.995453 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986617    2565 flags.go:64] FLAG: --vmodule=""
Sep 16 01:15:50.995453 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986623    2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 16 01:15:50.996087 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.986628    2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 16 01:15:50.996087 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.986812    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 01:15:50.996087 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.986819    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 01:15:50.996087 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.986823    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 01:15:50.996087 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.986829    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 01:15:50.996087 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.986834    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 01:15:50.996087 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.986838    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 01:15:50.996087 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.986843    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 01:15:50.996087 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.986848    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 01:15:50.996087 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.986853    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 01:15:50.996087 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.986858    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 01:15:50.996087 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.986862    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 01:15:50.996087 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.986867    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 01:15:50.996087 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.986873    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 01:15:50.996087 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.986878    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 01:15:50.996087 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.986883    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 01:15:50.996087 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.986888    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 01:15:50.996087 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.986893    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 01:15:50.996087 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.986897    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 01:15:50.996087 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.986901    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 01:15:50.996630 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.986908    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 01:15:50.996630 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.986913    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 01:15:50.996630 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.986918    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 01:15:50.996630 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.986923    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 01:15:50.996630 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.986927    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 01:15:50.996630 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.986933    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 01:15:50.996630 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.986938    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 01:15:50.996630 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.986943    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 01:15:50.996630 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.986947    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 01:15:50.996630 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.986952    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 01:15:50.996630 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.986956    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 01:15:50.996630 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.986962    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 01:15:50.996630 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.986966    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 01:15:50.996630 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.986970    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 01:15:50.996630 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.986974    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 01:15:50.996630 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.986978    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 01:15:50.996630 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.986982    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 01:15:50.996630 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.986986    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 01:15:50.996630 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.986990    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 01:15:50.996630 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.986994    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 01:15:50.997117 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.986998    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 01:15:50.997117 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987002    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 01:15:50.997117 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987006    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 01:15:50.997117 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987011    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 01:15:50.997117 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987015    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 01:15:50.997117 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987019    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 01:15:50.997117 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987023    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 01:15:50.997117 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987027    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 01:15:50.997117 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987031    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 01:15:50.997117 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987035    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 01:15:50.997117 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987038    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 01:15:50.997117 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987042    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 01:15:50.997117 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987049    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 01:15:50.997117 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987053    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 01:15:50.997117 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987057    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 01:15:50.997117 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987061    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 01:15:50.997117 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987065    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 01:15:50.997117 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987075    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 01:15:50.997117 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987080    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 01:15:50.997117 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987085    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 01:15:50.997609 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987090    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 01:15:50.997609 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987094    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 01:15:50.997609 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987098    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 01:15:50.997609 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987102    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 01:15:50.997609 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987108    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 01:15:50.997609 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987112    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 01:15:50.997609 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987116    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 01:15:50.997609 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987120    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 01:15:50.997609 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987125    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 01:15:50.997609 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987129    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 01:15:50.997609 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987133    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 01:15:50.997609 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987139    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 01:15:50.997609 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987144    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 01:15:50.997609 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987148    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 01:15:50.997609 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987152    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 01:15:50.997609 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987156    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 01:15:50.997609 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987160    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 01:15:50.997609 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987164    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 01:15:50.997609 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987168    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 01:15:50.998073 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987172    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 01:15:50.998073 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987177    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 01:15:50.998073 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987181    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 01:15:50.998073 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987185    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 01:15:50.998073 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987189    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 01:15:50.998073 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987194    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 01:15:50.998073 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987198    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 01:15:50.998073 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987202    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 01:15:50.998073 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987207    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 01:15:50.998073 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987210    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 01:15:50.998073 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987218    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 01:15:50.998073 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987225    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 01:15:50.998073 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987229    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 01:15:50.998073 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987234    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 01:15:50.998073 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987239    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 01:15:50.998073 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987243    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 01:15:50.998073 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987248    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 01:15:50.998073 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987252    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 01:15:50.998073 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987257    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 01:15:50.998544 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987261    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 01:15:50.998544 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.987266    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 01:15:50.998544 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.987273    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 01:15:50.998544 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.995560    2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 16 01:15:50.998544 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.995577    2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 16 01:15:50.998544 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.995600    2565 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 16 01:15:50.998544 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.995610    2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 16 01:15:50.998544 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995667    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 01:15:50.998544 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995672    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 01:15:50.998544 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995675    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 01:15:50.998544 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995678    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 01:15:50.998544 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995682    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 01:15:50.998544 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995685    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 01:15:50.998544 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995687    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 01:15:50.998895 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995690    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 01:15:50.998895 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995693    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 01:15:50.998895 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995696    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 01:15:50.998895 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995699    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 01:15:50.998895 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995702    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 01:15:50.998895 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995705    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 01:15:50.998895 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995707    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 01:15:50.998895 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995710    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 01:15:50.998895 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995712    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 01:15:50.998895 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995715    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 01:15:50.998895 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995718    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 01:15:50.998895 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995720    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 01:15:50.998895 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995723    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 01:15:50.998895 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995726    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 01:15:50.998895 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995728    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 01:15:50.998895 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995730    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 01:15:50.998895 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995733    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 01:15:50.998895 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995736    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 01:15:50.998895 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995738    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 01:15:50.998895 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995741    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 01:15:50.999430 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995743    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 01:15:50.999430 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995746    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 01:15:50.999430 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995750    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 01:15:50.999430 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995753    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 01:15:50.999430 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995756    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 01:15:50.999430 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995758    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 01:15:50.999430 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995761    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 01:15:50.999430 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995764    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 01:15:50.999430 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995766    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 01:15:50.999430 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995769    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 01:15:50.999430 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995771    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 01:15:50.999430 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995774    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 01:15:50.999430 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995776    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 01:15:50.999430 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995779    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 01:15:50.999430 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995781    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 01:15:50.999430 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995784    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 01:15:50.999430 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995786    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 01:15:50.999430 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995788    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 01:15:50.999430 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995791    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 01:15:50.999899 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995794    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 01:15:50.999899 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995796    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 01:15:50.999899 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995799    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 01:15:50.999899 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995801    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 01:15:50.999899 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995804    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 01:15:50.999899 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995808    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 01:15:50.999899 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995813    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 01:15:50.999899 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995817    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 01:15:50.999899 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995820    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 01:15:50.999899 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995823    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 01:15:50.999899 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995825    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 01:15:50.999899 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995828    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 01:15:50.999899 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995830    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 01:15:50.999899 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995833    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 01:15:50.999899 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995836    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 01:15:50.999899 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995838    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 01:15:50.999899 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995849    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 01:15:50.999899 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995853    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 01:15:50.999899 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995855    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 01:15:51.000371 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995858    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 01:15:51.000371 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995860    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 01:15:51.000371 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995863    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 01:15:51.000371 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995865    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 01:15:51.000371 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995868    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 01:15:51.000371 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995870    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 01:15:51.000371 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995874    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 01:15:51.000371 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995878    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 01:15:51.000371 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995880    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 01:15:51.000371 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995884    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 01:15:51.000371 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995887    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 01:15:51.000371 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995889    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 01:15:51.000371 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995891    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 01:15:51.000371 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995894    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 01:15:51.000371 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995897    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 01:15:51.000371 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995899    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 01:15:51.000371 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995902    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 01:15:51.000371 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995904    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 01:15:51.000371 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995907    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 01:15:51.000371 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995910    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 01:15:51.000846 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995913    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 01:15:51.000846 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995915    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 01:15:51.000846 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995918    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 01:15:51.000846 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995920    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 01:15:51.000846 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995923    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 01:15:51.000846 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995927    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 01:15:51.000846 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995930    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 01:15:51.000846 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995933    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 01:15:51.000846 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995936    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 01:15:51.000846 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995938    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 01:15:51.000846 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995941    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 01:15:51.000846 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995944    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 01:15:51.000846 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995947    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 01:15:51.000846 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.995949    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 01:15:51.000846 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.995954    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 01:15:51.001206 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996069    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 01:15:51.001206 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996074    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 01:15:51.001206 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996077    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 01:15:51.001206 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996080    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 01:15:51.001206 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996082    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 01:15:51.001206 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996085    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 01:15:51.001206 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996089    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 01:15:51.001206 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996092    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 01:15:51.001206 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996095    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 01:15:51.001206 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996098    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 01:15:51.001206 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996101    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 01:15:51.001206 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996104    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 01:15:51.001206 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996106    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 01:15:51.001206 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996109    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 01:15:51.001206 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996111    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 01:15:51.001206 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996114    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 01:15:51.001206 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996116    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 01:15:51.001206 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996119    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 01:15:51.001206 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996121    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 01:15:51.001206 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996124    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 01:15:51.001687 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996126    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 01:15:51.001687 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996129    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 01:15:51.001687 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996132    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 01:15:51.001687 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996134    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 01:15:51.001687 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996137    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 01:15:51.001687 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996139    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 01:15:51.001687 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996141    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 01:15:51.001687 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996144    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 01:15:51.001687 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996147    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 01:15:51.001687 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996149    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 01:15:51.001687 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996152    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 01:15:51.001687 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996154    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 01:15:51.001687 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996157    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 01:15:51.001687 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996159    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 01:15:51.001687 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996162    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 01:15:51.001687 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996164    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 01:15:51.001687 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996167    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 01:15:51.001687 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996169    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 01:15:51.001687 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996171    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 01:15:51.001687 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996174    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 01:15:51.002164 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996176    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 01:15:51.002164 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996179    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 01:15:51.002164 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996181    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 01:15:51.002164 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996183    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 01:15:51.002164 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996186    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 01:15:51.002164 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996189    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 01:15:51.002164 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996191    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 01:15:51.002164 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996194    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 01:15:51.002164 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996196    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 01:15:51.002164 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996199    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 01:15:51.002164 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996201    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 01:15:51.002164 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996205    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 01:15:51.002164 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996209    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 01:15:51.002164 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996212    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 01:15:51.002164 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996214    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 01:15:51.002164 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996217    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 01:15:51.002164 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996220    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 01:15:51.002164 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996222    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 01:15:51.002164 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996225    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 01:15:51.002629 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996228    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 01:15:51.002629 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996230    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 01:15:51.002629 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996233    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 01:15:51.002629 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996235    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 01:15:51.002629 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996238    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 01:15:51.002629 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996240    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 01:15:51.002629 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996243    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 01:15:51.002629 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996247    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 01:15:51.002629 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996250    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 01:15:51.002629 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996253    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 01:15:51.002629 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996255    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 01:15:51.002629 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996258    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 01:15:51.002629 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996261    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 01:15:51.002629 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996263    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 01:15:51.002629 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996266    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 01:15:51.002629 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996270    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 01:15:51.002629 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996272    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 01:15:51.002629 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996275    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 01:15:51.002629 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996277    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 01:15:51.003108 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996280    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 01:15:51.003108 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996282    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 01:15:51.003108 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996285    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 01:15:51.003108 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996287    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 01:15:51.003108 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996290    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 01:15:51.003108 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996293    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 01:15:51.003108 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996295    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 01:15:51.003108 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996298    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 01:15:51.003108 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996300    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 01:15:51.003108 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996303    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 01:15:51.003108 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996305    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 01:15:51.003108 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996308    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 01:15:51.003108 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996310    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 01:15:51.003108 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996312    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 01:15:51.003108 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996315    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 01:15:51.003108 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996317    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 01:15:51.003108 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996320    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 01:15:51.003108 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996323    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 01:15:51.003108 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996325    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 01:15:51.003108 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996327    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 01:15:51.003599 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:50.996330    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 01:15:51.003599 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.996350    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 01:15:51.003599 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.996474    2565 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 16 01:15:51.003599 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.998439    2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 16 01:15:51.003599 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.999769    2565 server.go:1019] "Starting client certificate rotation"
Sep 16 01:15:51.003599 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.999871    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 16 01:15:51.003599 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:50.999931    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 16 01:15:51.003599 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.003128    2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 16 01:15:51.004271 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.004255    2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 16 01:15:51.018056 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.018037    2565 log.go:25] "Validated CRI v1 runtime API"
Sep 16 01:15:51.022188 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.022171    2565 log.go:25] "Validated CRI v1 image API"
Sep 16 01:15:51.024478 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.024459    2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 16 01:15:51.027161 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.027141    2565 fs.go:135] Filesystem UUIDs: map[20043513-716c-4e95-9bf7-e3d3af6179b1:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 8f558f19-181f-4d76-8452-e1d6187238c3:/dev/nvme0n1p4]
Sep 16 01:15:51.027207 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.027161    2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 16 01:15:51.029083 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.029064    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 16 01:15:51.033170 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.033054    2565 manager.go:216] Machine: {Timestamp:2026-09-16 01:15:51.031720247 +0000 UTC m=+0.355188815 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3200833 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a7c5458f8fcba4ab8a699a70bcfb4 SystemUUID:ec2a7c54-58f8-fcba-4ab8-a699a70bcfb4 BootID:62a3b796-6c37-4bbc-9941-00e263d1265f Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:f6:17:4f:7b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:f6:17:4f:7b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c2:2d:c5:ce:3a:c2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 16 01:15:51.033170 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.033161    2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 16 01:15:51.033281 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.033249    2565 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 16 01:15:51.036375 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.036326    2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 16 01:15:51.036527 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.036380    2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-225.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 16 01:15:51.037531 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.037519    2565 topology_manager.go:138] "Creating topology manager with none policy"
Sep 16 01:15:51.037566 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.037534    2565 container_manager_linux.go:309] "Creating device plugin manager"
Sep 16 01:15:51.037566 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.037542    2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 16 01:15:51.038160 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.038149    2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 16 01:15:51.038978 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.038968    2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 16 01:15:51.042193 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.042181    2565 state_mem.go:36] "Initialized new in-memory state store"
Sep 16 01:15:51.042345 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.042327    2565 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 16 01:15:51.042375 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.042369    2565 kubelet.go:486] "Attempting to sync node with API server"
Sep 16 01:15:51.042407 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.042385    2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 16 01:15:51.042407 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.042402    2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 16 01:15:51.042462 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.042415    2565 kubelet.go:398] "Adding apiserver pod source"
Sep 16 01:15:51.042462 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.042425    2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 16 01:15:51.042808 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.042795    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 16 01:15:51.042884 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.042821    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 16 01:15:51.045324 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.045304    2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 16 01:15:51.047548 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.047534    2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 16 01:15:51.047605 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.047565    2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 16 01:15:51.049558 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.049543    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 16 01:15:51.049614 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.049564    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 16 01:15:51.049614 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.049572    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 16 01:15:51.049614 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.049579    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 16 01:15:51.049614 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.049592    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 16 01:15:51.049614 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.049599    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 16 01:15:51.049786 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.049620    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 16 01:15:51.049786 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.049628    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 16 01:15:51.049786 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.049639    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 16 01:15:51.049786 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.049647    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 16 01:15:51.049786 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.049659    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 16 01:15:51.049786 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.049665    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 16 01:15:51.050391 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.050381    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 16 01:15:51.050391 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.050389    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 16 01:15:51.051451 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:51.051421    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-225.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 16 01:15:51.051529 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:51.051468    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 16 01:15:51.054199 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.054182    2565 server.go:1268] "Started kubelet"
Sep 16 01:15:51.054300 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.054269    2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 16 01:15:51.054498 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.054270    2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 16 01:15:51.054575 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.054536    2565 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 16 01:15:51.055205 ip-10-0-135-225 systemd[1]: Started Kubernetes Kubelet.
Sep 16 01:15:51.055675 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.055658    2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 16 01:15:51.061159 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.061088    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-djktg"
Sep 16 01:15:51.061568 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:51.061543    2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 16 01:15:51.062097 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.062077    2565 server.go:310] "Adding debug handlers to kubelet server"
Sep 16 01:15:51.063959 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.063942    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-djktg"
Sep 16 01:15:51.065576 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.065561    2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-225.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 16 01:15:51.066477 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:51.065476    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-225.ec2.internal.18d5a82fff8f4ac5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-225.ec2.internal,UID:ip-10-0-135-225.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-225.ec2.internal,},FirstTimestamp:2026-09-16 01:15:51.054150341 +0000 UTC m=+0.377618907,LastTimestamp:2026-09-16 01:15:51.054150341 +0000 UTC m=+0.377618907,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-225.ec2.internal,}"
Sep 16 01:15:51.068297 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.068281    2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 16 01:15:51.068403 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.068294    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 16 01:15:51.068403 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:51.068368    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-225.ec2.internal\" not found"
Sep 16 01:15:51.069017 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.068996    2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 16 01:15:51.069017 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.068996    2565 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 16 01:15:51.069163 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.069023    2565 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 16 01:15:51.069163 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.069130    2565 reconstruct.go:97] "Volume reconstruction finished"
Sep 16 01:15:51.069163 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.069140    2565 reconciler.go:29] "Reconciler: start to sync state"
Sep 16 01:15:51.069254 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.069222    2565 factory.go:55] Registering systemd factory
Sep 16 01:15:51.069254 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.069237    2565 factory.go:223] Registration of the systemd container factory successfully
Sep 16 01:15:51.069501 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.069468    2565 factory.go:153] Registering CRI-O factory
Sep 16 01:15:51.069501 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.069482    2565 factory.go:223] Registration of the crio container factory successfully
Sep 16 01:15:51.069632 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.069532    2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 16 01:15:51.069632 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.069550    2565 factory.go:103] Registering Raw factory
Sep 16 01:15:51.069632 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.069564    2565 manager.go:1196] Started watching for new ooms in manager
Sep 16 01:15:51.070247 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:51.070220    2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-225.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 16 01:15:51.070443 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.070426    2565 manager.go:349] Starting recovery of all containers
Sep 16 01:15:51.078822 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.078792    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 01:15:51.082118 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.082096    2565 manager.go:354] Recovery completed
Sep 16 01:15:51.087084 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.086947    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 01:15:51.089119 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.089097    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-225.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 01:15:51.089204 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.089135    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-225.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 01:15:51.089204 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.089147    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-225.ec2.internal" event="NodeHasSufficientPID"
Sep 16 01:15:51.089808 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.089793    2565 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 16 01:15:51.089808 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.089806    2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 16 01:15:51.089943 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.089821    2565 state_mem.go:36] "Initialized new in-memory state store"
Sep 16 01:15:51.089943 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.089836    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 01:15:51.090658 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.090641    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-225.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 01:15:51.090719 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.090672    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-225.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 01:15:51.090719 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.090686    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-225.ec2.internal" event="NodeHasSufficientPID"
Sep 16 01:15:51.091395 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.091382    2565 policy_none.go:49] "None policy: Start"
Sep 16 01:15:51.091452 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.091401    2565 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 16 01:15:51.091452 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.091415    2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 16 01:15:51.092562 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.092548    2565 policy_none.go:47] "Start"
Sep 16 01:15:51.138187 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.124750    2565 manager.go:337] "Starting Device Plugin manager"
Sep 16 01:15:51.138187 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:51.124786    2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 16 01:15:51.138187 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.124796    2565 server.go:87] "Starting device plugin registration server"
Sep 16 01:15:51.138187 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.125112    2565 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 16 01:15:51.138187 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.125122    2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 16 01:15:51.138187 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.125318    2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 16 01:15:51.138187 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.125412    2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 16 01:15:51.138187 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.125422    2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 16 01:15:51.138187 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:51.126577    2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 16 01:15:51.138187 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:51.126623    2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-225.ec2.internal\" not found"
Sep 16 01:15:51.161612 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.161573    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 16 01:15:51.162785 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.162760    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 16 01:15:51.162878 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.162814    2565 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 16 01:15:51.162878 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.162842    2565 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 16 01:15:51.162982 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:51.162937    2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 16 01:15:51.164658 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.164639    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 01:15:51.225884 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.225779    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 01:15:51.226945 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.226926    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-225.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 01:15:51.227026 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.226964    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-225.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 01:15:51.227026 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.226979    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-225.ec2.internal" event="NodeHasSufficientPID"
Sep 16 01:15:51.227026 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.227016    2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-225.ec2.internal"
Sep 16 01:15:51.234652 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.234637    2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-225.ec2.internal"
Sep 16 01:15:51.234721 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:51.234659    2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-225.ec2.internal\": node \"ip-10-0-135-225.ec2.internal\" not found"
Sep 16 01:15:51.247792 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:51.247773    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-225.ec2.internal\" not found"
Sep 16 01:15:51.263395 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.263367    2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-225.ec2.internal"]
Sep 16 01:15:51.263470 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.263435    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 01:15:51.265112 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.265099    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-225.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 01:15:51.265175 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.265129    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-225.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 01:15:51.265175 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.265141    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-225.ec2.internal" event="NodeHasSufficientPID"
Sep 16 01:15:51.266488 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.266475    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 01:15:51.266634 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.266622    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.ec2.internal"
Sep 16 01:15:51.266666 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.266649    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 01:15:51.267258 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.267245    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-225.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 01:15:51.267312 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.267257    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-225.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 01:15:51.267312 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.267270    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-225.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 01:15:51.267312 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.267277    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-225.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 01:15:51.267312 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.267283    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-225.ec2.internal" event="NodeHasSufficientPID"
Sep 16 01:15:51.267441 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.267286    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-225.ec2.internal" event="NodeHasSufficientPID"
Sep 16 01:15:51.268472 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.268455    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-225.ec2.internal"
Sep 16 01:15:51.268563 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.268479    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 01:15:51.269137 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.269122    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-225.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 01:15:51.269215 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.269146    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-225.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 01:15:51.269215 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.269155    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-225.ec2.internal" event="NodeHasSufficientPID"
Sep 16 01:15:51.270398 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.270381    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/10d8ee1502cbd13392fb8e9a4ec64b99-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-225.ec2.internal\" (UID: \"10d8ee1502cbd13392fb8e9a4ec64b99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.ec2.internal"
Sep 16 01:15:51.270451 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.270413    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/10d8ee1502cbd13392fb8e9a4ec64b99-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-225.ec2.internal\" (UID: \"10d8ee1502cbd13392fb8e9a4ec64b99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.ec2.internal"
Sep 16 01:15:51.270451 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.270441    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dc733c4b3ec8f9e22d85736adcd9ed91-config\") pod \"kube-apiserver-proxy-ip-10-0-135-225.ec2.internal\" (UID: \"dc733c4b3ec8f9e22d85736adcd9ed91\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-225.ec2.internal"
Sep 16 01:15:51.292071 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:51.292047    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-225.ec2.internal\" not found" node="ip-10-0-135-225.ec2.internal"
Sep 16 01:15:51.295350 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:51.295321    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-225.ec2.internal\" not found" node="ip-10-0-135-225.ec2.internal"
Sep 16 01:15:51.348714 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:51.348677    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-225.ec2.internal\" not found"
Sep 16 01:15:51.371030 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.371004    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/10d8ee1502cbd13392fb8e9a4ec64b99-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-225.ec2.internal\" (UID: \"10d8ee1502cbd13392fb8e9a4ec64b99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.ec2.internal"
Sep 16 01:15:51.371198 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.371043    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/10d8ee1502cbd13392fb8e9a4ec64b99-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-225.ec2.internal\" (UID: \"10d8ee1502cbd13392fb8e9a4ec64b99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.ec2.internal"
Sep 16 01:15:51.371198 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.371066    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dc733c4b3ec8f9e22d85736adcd9ed91-config\") pod \"kube-apiserver-proxy-ip-10-0-135-225.ec2.internal\" (UID: \"dc733c4b3ec8f9e22d85736adcd9ed91\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-225.ec2.internal"
Sep 16 01:15:51.371198 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.371108    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dc733c4b3ec8f9e22d85736adcd9ed91-config\") pod \"kube-apiserver-proxy-ip-10-0-135-225.ec2.internal\" (UID: \"dc733c4b3ec8f9e22d85736adcd9ed91\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-225.ec2.internal"
Sep 16 01:15:51.371198 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.371111    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/10d8ee1502cbd13392fb8e9a4ec64b99-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-225.ec2.internal\" (UID: \"10d8ee1502cbd13392fb8e9a4ec64b99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.ec2.internal"
Sep 16 01:15:51.371198 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.371113    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/10d8ee1502cbd13392fb8e9a4ec64b99-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-225.ec2.internal\" (UID: \"10d8ee1502cbd13392fb8e9a4ec64b99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.ec2.internal"
Sep 16 01:15:51.448968 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:51.448933    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-225.ec2.internal\" not found"
Sep 16 01:15:51.549732 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:51.549641    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-225.ec2.internal\" not found"
Sep 16 01:15:51.595161 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.595114    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.ec2.internal"
Sep 16 01:15:51.597874 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.597855    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-225.ec2.internal"
Sep 16 01:15:51.649984 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:51.649949    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-225.ec2.internal\" not found"
Sep 16 01:15:51.756279 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:51.756249    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-225.ec2.internal\" not found"
Sep 16 01:15:51.862437 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:51.862337    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-225.ec2.internal\" not found"
Sep 16 01:15:51.964426 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:51.964389    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-225.ec2.internal\" not found"
Sep 16 01:15:51.999792 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.999761    2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 16 01:15:52.000262 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.999921    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 16 01:15:52.000262 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:51.999951    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 16 01:15:52.064508 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:52.064472    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-225.ec2.internal\" not found"
Sep 16 01:15:52.068219 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:52.068170    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-15 01:10:51 +0000 UTC" deadline="2028-04-18 19:08:14.078165295 +0000 UTC"
Sep 16 01:15:52.068219 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:52.068218    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13937h52m22.009951904s"
Sep 16 01:15:52.164871 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:52.164830    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-225.ec2.internal\" not found"
Sep 16 01:15:52.191453 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:52.191412    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc733c4b3ec8f9e22d85736adcd9ed91.slice/crio-d16decfa884476aab23fdd46e1dc8025d9aafd1372106472576551dc1760cb07 WatchSource:0}: Error finding container d16decfa884476aab23fdd46e1dc8025d9aafd1372106472576551dc1760cb07: Status 404 returned error can't find the container with id d16decfa884476aab23fdd46e1dc8025d9aafd1372106472576551dc1760cb07
Sep 16 01:15:52.192280 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:52.192257    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10d8ee1502cbd13392fb8e9a4ec64b99.slice/crio-a97d40526445c33b0e52733c5782eb058e8d7a9f467bfa51ad5058f6ca0abb4b WatchSource:0}: Error finding container a97d40526445c33b0e52733c5782eb058e8d7a9f467bfa51ad5058f6ca0abb4b: Status 404 returned error can't find the container with id a97d40526445c33b0e52733c5782eb058e8d7a9f467bfa51ad5058f6ca0abb4b
Sep 16 01:15:52.196469 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:52.196446    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 01:15:52.224199 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:52.224159    2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 01:15:52.267239 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:52.267191    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-225.ec2.internal\" not found"
Sep 16 01:15:52.374883 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:52.374847    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-225.ec2.internal\" not found"
Sep 16 01:15:52.475266 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:52.475177    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-225.ec2.internal\" not found"
Sep 16 01:15:52.576414 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:52.576377    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-225.ec2.internal\" not found"
Sep 16 01:15:52.579455 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:52.579438    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 01:15:52.669131 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:52.669094    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.ec2.internal"
Sep 16 01:15:52.680441 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:52.680405    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 16 01:15:52.681502 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:52.681487    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-225.ec2.internal"
Sep 16 01:15:52.687945 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:52.687926    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 16 01:15:53.030473 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.030437    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 01:15:53.043745 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.043717    2565 apiserver.go:52] "Watching apiserver"
Sep 16 01:15:53.052799 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.052770    2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 16 01:15:53.053324 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.053297    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hvsv","openshift-cluster-node-tuning-operator/tuned-wzt2x","openshift-image-registry/node-ca-h9vzm","openshift-multus/multus-additional-cni-plugins-z24pg","openshift-multus/multus-bxmkv","kube-system/kube-apiserver-proxy-ip-10-0-135-225.ec2.internal","openshift-dns/node-resolver-dksqw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.ec2.internal","openshift-multus/network-metrics-daemon-lxzjg","openshift-network-diagnostics/network-check-target-gvqfk","openshift-network-operator/iptables-alerter-2t558","openshift-ovn-kubernetes/ovnkube-node-fqnhz","kube-system/global-pull-secret-syncer-vzwdx","kube-system/konnectivity-agent-t9knx"]
Sep 16 01:15:53.054890 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.054864    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dksqw"
Sep 16 01:15:53.056318 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.056288    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzwdx"
Sep 16 01:15:53.056443 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:53.056422    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzwdx" podUID="f7c423cc-710d-49fa-835f-518fc794dfb0"
Sep 16 01:15:53.057860 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.057836    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 16 01:15:53.059126 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.058106    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 16 01:15:53.059126 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.058116    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h9vzm"
Sep 16 01:15:53.059126 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.058230    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-98ht7\""
Sep 16 01:15:53.061227 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.059551    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z24pg"
Sep 16 01:15:53.061327 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.061268    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bxmkv"
Sep 16 01:15:53.061783 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.061619    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 16 01:15:53.061872 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.061862    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bxwm5\""
Sep 16 01:15:53.061935 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.061870    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 16 01:15:53.062637 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.062590    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 16 01:15:53.063243 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.063223    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t9knx"
Sep 16 01:15:53.063904 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.063750    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 16 01:15:53.063904 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.063772    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 16 01:15:53.063904 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.063871    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 16 01:15:53.064103 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.063991    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 16 01:15:53.064103 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.064018    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 16 01:15:53.064713 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.064168    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-x6tx4\""
Sep 16 01:15:53.064713 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.064213    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 16 01:15:53.064713 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.064467    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ttcvx\""
Sep 16 01:15:53.065303 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.065284    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxzjg"
Sep 16 01:15:53.065489 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:53.065383    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxzjg" podUID="4112bee2-636b-4e14-a5ba-fd2bb43fffaf"
Sep 16 01:15:53.066549 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.066293    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 16 01:15:53.066549 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.066392    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xnqcw\""
Sep 16 01:15:53.066690 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.066646    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 16 01:15:53.067528 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.066924    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hvsv"
Sep 16 01:15:53.068221 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.068076    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wzt2x"
Sep 16 01:15:53.069898 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.069111    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 16 01:15:53.069898 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.069289    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 16 01:15:53.069898 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.069432    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvqfk"
Sep 16 01:15:53.069898 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:53.069485    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvqfk" podUID="8519201e-63ce-4c38-a45a-b9e0624fd8b5"
Sep 16 01:15:53.069898 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.069437    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-chz9k\""
Sep 16 01:15:53.069898 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.069628    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 16 01:15:53.069898 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.069809    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 16 01:15:53.071523 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.070717    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 16 01:15:53.071523 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.070717    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 16 01:15:53.071523 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.070803    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2t558"
Sep 16 01:15:53.071523 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.070718    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-f7cx7\""
Sep 16 01:15:53.072447 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.072421    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.073571 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.073552    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 16 01:15:53.073669 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.073614    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jmhnr\""
Sep 16 01:15:53.073895 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.073874    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 16 01:15:53.074103 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.074086    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 16 01:15:53.074795 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.074774    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 16 01:15:53.075396 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.075238    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 16 01:15:53.076633 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.076610    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 16 01:15:53.077514 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.076831    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8s45n\""
Sep 16 01:15:53.077514 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.076969    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 16 01:15:53.077514 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.076973    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 16 01:15:53.077514 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.077026    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 16 01:15:53.080368 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.079986    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d141010c-add9-48d2-8171-49f314ea3938-etc-modprobe-d\") pod \"tuned-wzt2x\" (UID: \"d141010c-add9-48d2-8171-49f314ea3938\") " pod="openshift-cluster-node-tuning-operator/tuned-wzt2x"
Sep 16 01:15:53.080485 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.080397    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d141010c-add9-48d2-8171-49f314ea3938-etc-systemd\") pod \"tuned-wzt2x\" (UID: \"d141010c-add9-48d2-8171-49f314ea3938\") " pod="openshift-cluster-node-tuning-operator/tuned-wzt2x"
Sep 16 01:15:53.080485 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.080450    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/63a0c126-4c73-480d-aa3c-6de4e96c4b69-system-cni-dir\") pod \"multus-bxmkv\" (UID: \"63a0c126-4c73-480d-aa3c-6de4e96c4b69\") " pod="openshift-multus/multus-bxmkv"
Sep 16 01:15:53.080485 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.080477    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3078201b-cbfe-423a-9505-d7431f30c7c7-socket-dir\") pod \"aws-ebs-csi-driver-node-7hvsv\" (UID: \"3078201b-cbfe-423a-9505-d7431f30c7c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hvsv"
Sep 16 01:15:53.080651 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.080500    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7c405cb2-c373-496e-84e5-055abf68c46c-cnibin\") pod \"multus-additional-cni-plugins-z24pg\" (UID: \"7c405cb2-c373-496e-84e5-055abf68c46c\") " pod="openshift-multus/multus-additional-cni-plugins-z24pg"
Sep 16 01:15:53.080651 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.080526    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7c405cb2-c373-496e-84e5-055abf68c46c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z24pg\" (UID: \"7c405cb2-c373-496e-84e5-055abf68c46c\") " pod="openshift-multus/multus-additional-cni-plugins-z24pg"
Sep 16 01:15:53.080651 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.080552    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/63a0c126-4c73-480d-aa3c-6de4e96c4b69-host-run-netns\") pod \"multus-bxmkv\" (UID: \"63a0c126-4c73-480d-aa3c-6de4e96c4b69\") " pod="openshift-multus/multus-bxmkv"
Sep 16 01:15:53.080651 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.080575    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/63a0c126-4c73-480d-aa3c-6de4e96c4b69-cnibin\") pod \"multus-bxmkv\" (UID: \"63a0c126-4c73-480d-aa3c-6de4e96c4b69\") " pod="openshift-multus/multus-bxmkv"
Sep 16 01:15:53.080846 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.080657    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7c405cb2-c373-496e-84e5-055abf68c46c-cni-binary-copy\") pod \"multus-additional-cni-plugins-z24pg\" (UID: \"7c405cb2-c373-496e-84e5-055abf68c46c\") " pod="openshift-multus/multus-additional-cni-plugins-z24pg"
Sep 16 01:15:53.080846 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.080691    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d141010c-add9-48d2-8171-49f314ea3938-var-lib-kubelet\") pod \"tuned-wzt2x\" (UID: \"d141010c-add9-48d2-8171-49f314ea3938\") " pod="openshift-cluster-node-tuning-operator/tuned-wzt2x"
Sep 16 01:15:53.080846 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.080762    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/63a0c126-4c73-480d-aa3c-6de4e96c4b69-cni-binary-copy\") pod \"multus-bxmkv\" (UID: \"63a0c126-4c73-480d-aa3c-6de4e96c4b69\") " pod="openshift-multus/multus-bxmkv"
Sep 16 01:15:53.080846 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.080808    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4112bee2-636b-4e14-a5ba-fd2bb43fffaf-metrics-certs\") pod \"network-metrics-daemon-lxzjg\" (UID: \"4112bee2-636b-4e14-a5ba-fd2bb43fffaf\") " pod="openshift-multus/network-metrics-daemon-lxzjg"
Sep 16 01:15:53.081047 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.080858    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f7c423cc-710d-49fa-835f-518fc794dfb0-kubelet-config\") pod \"global-pull-secret-syncer-vzwdx\" (UID: \"f7c423cc-710d-49fa-835f-518fc794dfb0\") " pod="kube-system/global-pull-secret-syncer-vzwdx"
Sep 16 01:15:53.081047 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.080887    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fmg7\" (UniqueName: \"kubernetes.io/projected/9b5e1f55-e4cc-46aa-919c-c50324c38ce0-kube-api-access-5fmg7\") pod \"node-ca-h9vzm\" (UID: \"9b5e1f55-e4cc-46aa-919c-c50324c38ce0\") " pod="openshift-image-registry/node-ca-h9vzm"
Sep 16 01:15:53.081047 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.080914    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63a0c126-4c73-480d-aa3c-6de4e96c4b69-etc-kubernetes\") pod \"multus-bxmkv\" (UID: \"63a0c126-4c73-480d-aa3c-6de4e96c4b69\") " pod="openshift-multus/multus-bxmkv"
Sep 16 01:15:53.081047 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.080939    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzn4k\" (UniqueName: \"kubernetes.io/projected/cec37c8f-d1ef-47fc-9e34-58c4f9c4e26d-kube-api-access-gzn4k\") pod \"node-resolver-dksqw\" (UID: \"cec37c8f-d1ef-47fc-9e34-58c4f9c4e26d\") " pod="openshift-dns/node-resolver-dksqw"
Sep 16 01:15:53.081047 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.080963    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7c405cb2-c373-496e-84e5-055abf68c46c-system-cni-dir\") pod \"multus-additional-cni-plugins-z24pg\" (UID: \"7c405cb2-c373-496e-84e5-055abf68c46c\") " pod="openshift-multus/multus-additional-cni-plugins-z24pg"
Sep 16 01:15:53.081293 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.081063    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d141010c-add9-48d2-8171-49f314ea3938-etc-tuned\") pod \"tuned-wzt2x\" (UID: \"d141010c-add9-48d2-8171-49f314ea3938\") " pod="openshift-cluster-node-tuning-operator/tuned-wzt2x"
Sep 16 01:15:53.081293 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.081143    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx8rz\" (UniqueName: \"kubernetes.io/projected/4112bee2-636b-4e14-a5ba-fd2bb43fffaf-kube-api-access-tx8rz\") pod \"network-metrics-daemon-lxzjg\" (UID: \"4112bee2-636b-4e14-a5ba-fd2bb43fffaf\") " pod="openshift-multus/network-metrics-daemon-lxzjg"
Sep 16 01:15:53.081293 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.081170    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d141010c-add9-48d2-8171-49f314ea3938-etc-sysctl-conf\") pod \"tuned-wzt2x\" (UID: \"d141010c-add9-48d2-8171-49f314ea3938\") " pod="openshift-cluster-node-tuning-operator/tuned-wzt2x"
Sep 16 01:15:53.081293 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.081203    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d141010c-add9-48d2-8171-49f314ea3938-etc-sysctl-d\") pod \"tuned-wzt2x\" (UID: \"d141010c-add9-48d2-8171-49f314ea3938\") " pod="openshift-cluster-node-tuning-operator/tuned-wzt2x"
Sep 16 01:15:53.081293 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.081232    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjxkk\" (UniqueName: \"kubernetes.io/projected/63a0c126-4c73-480d-aa3c-6de4e96c4b69-kube-api-access-wjxkk\") pod \"multus-bxmkv\" (UID: \"63a0c126-4c73-480d-aa3c-6de4e96c4b69\") " pod="openshift-multus/multus-bxmkv"
Sep 16 01:15:53.081293 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.081275    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5q89f\" (UniqueName: \"kubernetes.io/projected/3078201b-cbfe-423a-9505-d7431f30c7c7-kube-api-access-5q89f\") pod \"aws-ebs-csi-driver-node-7hvsv\" (UID: \"3078201b-cbfe-423a-9505-d7431f30c7c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hvsv"
Sep 16 01:15:53.081566 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.081306    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7c423cc-710d-49fa-835f-518fc794dfb0-original-pull-secret\") pod \"global-pull-secret-syncer-vzwdx\" (UID: \"f7c423cc-710d-49fa-835f-518fc794dfb0\") " pod="kube-system/global-pull-secret-syncer-vzwdx"
Sep 16 01:15:53.081566 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.081335    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9b5e1f55-e4cc-46aa-919c-c50324c38ce0-serviceca\") pod \"node-ca-h9vzm\" (UID: \"9b5e1f55-e4cc-46aa-919c-c50324c38ce0\") " pod="openshift-image-registry/node-ca-h9vzm"
Sep 16 01:15:53.081566 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.081367    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlqjt\" (UniqueName: \"kubernetes.io/projected/d141010c-add9-48d2-8171-49f314ea3938-kube-api-access-hlqjt\") pod \"tuned-wzt2x\" (UID: \"d141010c-add9-48d2-8171-49f314ea3938\") " pod="openshift-cluster-node-tuning-operator/tuned-wzt2x"
Sep 16 01:15:53.081566 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.081419    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3078201b-cbfe-423a-9505-d7431f30c7c7-registration-dir\") pod \"aws-ebs-csi-driver-node-7hvsv\" (UID: \"3078201b-cbfe-423a-9505-d7431f30c7c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hvsv"
Sep 16 01:15:53.081566 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.081461    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3078201b-cbfe-423a-9505-d7431f30c7c7-etc-selinux\") pod \"aws-ebs-csi-driver-node-7hvsv\" (UID: \"3078201b-cbfe-423a-9505-d7431f30c7c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hvsv"
Sep 16 01:15:53.081566 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.081554    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3078201b-cbfe-423a-9505-d7431f30c7c7-sys-fs\") pod \"aws-ebs-csi-driver-node-7hvsv\" (UID: \"3078201b-cbfe-423a-9505-d7431f30c7c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hvsv"
Sep 16 01:15:53.081858 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.081594    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cec37c8f-d1ef-47fc-9e34-58c4f9c4e26d-hosts-file\") pod \"node-resolver-dksqw\" (UID: \"cec37c8f-d1ef-47fc-9e34-58c4f9c4e26d\") " pod="openshift-dns/node-resolver-dksqw"
Sep 16 01:15:53.081858 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.081618    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d141010c-add9-48d2-8171-49f314ea3938-tmp\") pod \"tuned-wzt2x\" (UID: \"d141010c-add9-48d2-8171-49f314ea3938\") " pod="openshift-cluster-node-tuning-operator/tuned-wzt2x"
Sep 16 01:15:53.081858 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.081654    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/63a0c126-4c73-480d-aa3c-6de4e96c4b69-multus-conf-dir\") pod \"multus-bxmkv\" (UID: \"63a0c126-4c73-480d-aa3c-6de4e96c4b69\") " pod="openshift-multus/multus-bxmkv"
Sep 16 01:15:53.081858 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.081676    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9b5e1f55-e4cc-46aa-919c-c50324c38ce0-host\") pod \"node-ca-h9vzm\" (UID: \"9b5e1f55-e4cc-46aa-919c-c50324c38ce0\") " pod="openshift-image-registry/node-ca-h9vzm"
Sep 16 01:15:53.081858 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.081728    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d141010c-add9-48d2-8171-49f314ea3938-lib-modules\") pod \"tuned-wzt2x\" (UID: \"d141010c-add9-48d2-8171-49f314ea3938\") " pod="openshift-cluster-node-tuning-operator/tuned-wzt2x"
Sep 16 01:15:53.081858 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.081779    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d141010c-add9-48d2-8171-49f314ea3938-host\") pod \"tuned-wzt2x\" (UID: \"d141010c-add9-48d2-8171-49f314ea3938\") " pod="openshift-cluster-node-tuning-operator/tuned-wzt2x"
Sep 16 01:15:53.081858 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.081813    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/63a0c126-4c73-480d-aa3c-6de4e96c4b69-multus-socket-dir-parent\") pod \"multus-bxmkv\" (UID: \"63a0c126-4c73-480d-aa3c-6de4e96c4b69\") " pod="openshift-multus/multus-bxmkv"
Sep 16 01:15:53.081858 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.081849    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/63a0c126-4c73-480d-aa3c-6de4e96c4b69-host-run-k8s-cni-cncf-io\") pod \"multus-bxmkv\" (UID: \"63a0c126-4c73-480d-aa3c-6de4e96c4b69\") " pod="openshift-multus/multus-bxmkv"
Sep 16 01:15:53.082218 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.081875    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/63a0c126-4c73-480d-aa3c-6de4e96c4b69-host-var-lib-cni-bin\") pod \"multus-bxmkv\" (UID: \"63a0c126-4c73-480d-aa3c-6de4e96c4b69\") " pod="openshift-multus/multus-bxmkv"
Sep 16 01:15:53.082218 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.081945    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/63a0c126-4c73-480d-aa3c-6de4e96c4b69-multus-daemon-config\") pod \"multus-bxmkv\" (UID: \"63a0c126-4c73-480d-aa3c-6de4e96c4b69\") " pod="openshift-multus/multus-bxmkv"
Sep 16 01:15:53.082218 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.081978    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cec37c8f-d1ef-47fc-9e34-58c4f9c4e26d-tmp-dir\") pod \"node-resolver-dksqw\" (UID: \"cec37c8f-d1ef-47fc-9e34-58c4f9c4e26d\") " pod="openshift-dns/node-resolver-dksqw"
Sep 16 01:15:53.082218 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.082000    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7c405cb2-c373-496e-84e5-055abf68c46c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z24pg\" (UID: \"7c405cb2-c373-496e-84e5-055abf68c46c\") " pod="openshift-multus/multus-additional-cni-plugins-z24pg"
Sep 16 01:15:53.082218 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.082046    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7c405cb2-c373-496e-84e5-055abf68c46c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z24pg\" (UID: \"7c405cb2-c373-496e-84e5-055abf68c46c\") " pod="openshift-multus/multus-additional-cni-plugins-z24pg"
Sep 16 01:15:53.082218 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.082089    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfkzm\" (UniqueName: \"kubernetes.io/projected/7c405cb2-c373-496e-84e5-055abf68c46c-kube-api-access-nfkzm\") pod \"multus-additional-cni-plugins-z24pg\" (UID: \"7c405cb2-c373-496e-84e5-055abf68c46c\") " pod="openshift-multus/multus-additional-cni-plugins-z24pg"
Sep 16 01:15:53.082218 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.082116    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/63a0c126-4c73-480d-aa3c-6de4e96c4b69-multus-cni-dir\") pod \"multus-bxmkv\" (UID: \"63a0c126-4c73-480d-aa3c-6de4e96c4b69\") " pod="openshift-multus/multus-bxmkv"
Sep 16 01:15:53.082218 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.082160    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3078201b-cbfe-423a-9505-d7431f30c7c7-device-dir\") pod \"aws-ebs-csi-driver-node-7hvsv\" (UID: \"3078201b-cbfe-423a-9505-d7431f30c7c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hvsv"
Sep 16 01:15:53.082218 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.082184    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 16 01:15:53.082218 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.082202    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f7c423cc-710d-49fa-835f-518fc794dfb0-dbus\") pod \"global-pull-secret-syncer-vzwdx\" (UID: \"f7c423cc-710d-49fa-835f-518fc794dfb0\") " pod="kube-system/global-pull-secret-syncer-vzwdx"
Sep 16 01:15:53.082719 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.082244    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d141010c-add9-48d2-8171-49f314ea3938-etc-kubernetes\") pod \"tuned-wzt2x\" (UID: \"d141010c-add9-48d2-8171-49f314ea3938\") " pod="openshift-cluster-node-tuning-operator/tuned-wzt2x"
Sep 16 01:15:53.082719 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.082273    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d141010c-add9-48d2-8171-49f314ea3938-run\") pod \"tuned-wzt2x\" (UID: \"d141010c-add9-48d2-8171-49f314ea3938\") " pod="openshift-cluster-node-tuning-operator/tuned-wzt2x"
Sep 16 01:15:53.082719 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.082307    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sl2ft\" (UniqueName: \"kubernetes.io/projected/8519201e-63ce-4c38-a45a-b9e0624fd8b5-kube-api-access-sl2ft\") pod \"network-check-target-gvqfk\" (UID: \"8519201e-63ce-4c38-a45a-b9e0624fd8b5\") " pod="openshift-network-diagnostics/network-check-target-gvqfk"
Sep 16 01:15:53.082719 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.082366    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d5fdc95b-8eaa-401f-a9a9-50bea6a5ffc8-agent-certs\") pod \"konnectivity-agent-t9knx\" (UID: \"d5fdc95b-8eaa-401f-a9a9-50bea6a5ffc8\") " pod="kube-system/konnectivity-agent-t9knx"
Sep 16 01:15:53.082719 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.082396    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d5fdc95b-8eaa-401f-a9a9-50bea6a5ffc8-konnectivity-ca\") pod \"konnectivity-agent-t9knx\" (UID: \"d5fdc95b-8eaa-401f-a9a9-50bea6a5ffc8\") " pod="kube-system/konnectivity-agent-t9knx"
Sep 16 01:15:53.082719 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.082425    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/63a0c126-4c73-480d-aa3c-6de4e96c4b69-host-run-multus-certs\") pod \"multus-bxmkv\" (UID: \"63a0c126-4c73-480d-aa3c-6de4e96c4b69\") " pod="openshift-multus/multus-bxmkv"
Sep 16 01:15:53.082719 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.082463    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3078201b-cbfe-423a-9505-d7431f30c7c7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7hvsv\" (UID: \"3078201b-cbfe-423a-9505-d7431f30c7c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hvsv"
Sep 16 01:15:53.082719 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.082493    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/63a0c126-4c73-480d-aa3c-6de4e96c4b69-host-var-lib-cni-multus\") pod \"multus-bxmkv\" (UID: \"63a0c126-4c73-480d-aa3c-6de4e96c4b69\") " pod="openshift-multus/multus-bxmkv"
Sep 16 01:15:53.082719 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.082525    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63a0c126-4c73-480d-aa3c-6de4e96c4b69-host-var-lib-kubelet\") pod \"multus-bxmkv\" (UID: \"63a0c126-4c73-480d-aa3c-6de4e96c4b69\") " pod="openshift-multus/multus-bxmkv"
Sep 16 01:15:53.082719 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.082550    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/63a0c126-4c73-480d-aa3c-6de4e96c4b69-hostroot\") pod \"multus-bxmkv\" (UID: \"63a0c126-4c73-480d-aa3c-6de4e96c4b69\") " pod="openshift-multus/multus-bxmkv"
Sep 16 01:15:53.082719 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.082581    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d141010c-add9-48d2-8171-49f314ea3938-etc-sysconfig\") pod \"tuned-wzt2x\" (UID: \"d141010c-add9-48d2-8171-49f314ea3938\") " pod="openshift-cluster-node-tuning-operator/tuned-wzt2x"
Sep 16 01:15:53.082719 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.082616    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d141010c-add9-48d2-8171-49f314ea3938-sys\") pod \"tuned-wzt2x\" (UID: \"d141010c-add9-48d2-8171-49f314ea3938\") " pod="openshift-cluster-node-tuning-operator/tuned-wzt2x"
Sep 16 01:15:53.101812 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.101787    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cdkq7"
Sep 16 01:15:53.110041 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.110015    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cdkq7"
Sep 16 01:15:53.169764 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.169736    2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 16 01:15:53.170373 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.170306    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-225.ec2.internal" event={"ID":"dc733c4b3ec8f9e22d85736adcd9ed91","Type":"ContainerStarted","Data":"d16decfa884476aab23fdd46e1dc8025d9aafd1372106472576551dc1760cb07"}
Sep 16 01:15:53.171956 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.171893    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.ec2.internal" event={"ID":"10d8ee1502cbd13392fb8e9a4ec64b99","Type":"ContainerStarted","Data":"a97d40526445c33b0e52733c5782eb058e8d7a9f467bfa51ad5058f6ca0abb4b"}
Sep 16 01:15:53.183804 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.183764    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/47481dec-b718-4041-827a-aa8dd51a98d0-run-ovn\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.183950 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.183814    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/63a0c126-4c73-480d-aa3c-6de4e96c4b69-host-var-lib-cni-multus\") pod \"multus-bxmkv\" (UID: \"63a0c126-4c73-480d-aa3c-6de4e96c4b69\") " pod="openshift-multus/multus-bxmkv"
Sep 16 01:15:53.183950 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.183843    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63a0c126-4c73-480d-aa3c-6de4e96c4b69-host-var-lib-kubelet\") pod \"multus-bxmkv\" (UID: \"63a0c126-4c73-480d-aa3c-6de4e96c4b69\") " pod="openshift-multus/multus-bxmkv"
Sep 16 01:15:53.183950 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.183905    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63a0c126-4c73-480d-aa3c-6de4e96c4b69-host-var-lib-kubelet\") pod \"multus-bxmkv\" (UID: \"63a0c126-4c73-480d-aa3c-6de4e96c4b69\") " pod="openshift-multus/multus-bxmkv"
Sep 16 01:15:53.183950 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.183906    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/63a0c126-4c73-480d-aa3c-6de4e96c4b69-host-var-lib-cni-multus\") pod \"multus-bxmkv\" (UID: \"63a0c126-4c73-480d-aa3c-6de4e96c4b69\") " pod="openshift-multus/multus-bxmkv"
Sep 16 01:15:53.183950 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.183934    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/63a0c126-4c73-480d-aa3c-6de4e96c4b69-hostroot\") pod \"multus-bxmkv\" (UID: \"63a0c126-4c73-480d-aa3c-6de4e96c4b69\") " pod="openshift-multus/multus-bxmkv"
Sep 16 01:15:53.184215 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.183971    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/63a0c126-4c73-480d-aa3c-6de4e96c4b69-hostroot\") pod \"multus-bxmkv\" (UID: \"63a0c126-4c73-480d-aa3c-6de4e96c4b69\") " pod="openshift-multus/multus-bxmkv"
Sep 16 01:15:53.184215 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.183977    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d141010c-add9-48d2-8171-49f314ea3938-etc-sysconfig\") pod \"tuned-wzt2x\" (UID: \"d141010c-add9-48d2-8171-49f314ea3938\") " pod="openshift-cluster-node-tuning-operator/tuned-wzt2x"
Sep 16 01:15:53.184215 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.184010    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d141010c-add9-48d2-8171-49f314ea3938-sys\") pod \"tuned-wzt2x\" (UID: \"d141010c-add9-48d2-8171-49f314ea3938\") " pod="openshift-cluster-node-tuning-operator/tuned-wzt2x"
Sep 16 01:15:53.184215 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.184031    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d141010c-add9-48d2-8171-49f314ea3938-etc-sysconfig\") pod \"tuned-wzt2x\" (UID: \"d141010c-add9-48d2-8171-49f314ea3938\") " pod="openshift-cluster-node-tuning-operator/tuned-wzt2x"
Sep 16 01:15:53.184215 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.184039    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54tvs\" (UniqueName: \"kubernetes.io/projected/35c37798-a9dc-419f-b80a-b3dd9ed22caa-kube-api-access-54tvs\") pod \"iptables-alerter-2t558\" (UID: \"35c37798-a9dc-419f-b80a-b3dd9ed22caa\") " pod="openshift-network-operator/iptables-alerter-2t558"
Sep 16 01:15:53.184215 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.184085    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d141010c-add9-48d2-8171-49f314ea3938-sys\") pod \"tuned-wzt2x\" (UID: \"d141010c-add9-48d2-8171-49f314ea3938\") " pod="openshift-cluster-node-tuning-operator/tuned-wzt2x"
Sep 16 01:15:53.184215 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.184106    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d141010c-add9-48d2-8171-49f314ea3938-etc-modprobe-d\") pod \"tuned-wzt2x\" (UID: \"d141010c-add9-48d2-8171-49f314ea3938\") " pod="openshift-cluster-node-tuning-operator/tuned-wzt2x"
Sep 16 01:15:53.184215 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.184145    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d141010c-add9-48d2-8171-49f314ea3938-etc-systemd\") pod \"tuned-wzt2x\" (UID: \"d141010c-add9-48d2-8171-49f314ea3938\") " pod="openshift-cluster-node-tuning-operator/tuned-wzt2x"
Sep 16 01:15:53.184215 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.184169    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/63a0c126-4c73-480d-aa3c-6de4e96c4b69-system-cni-dir\") pod \"multus-bxmkv\" (UID: \"63a0c126-4c73-480d-aa3c-6de4e96c4b69\") " pod="openshift-multus/multus-bxmkv"
Sep 16 01:15:53.184215 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.184194    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3078201b-cbfe-423a-9505-d7431f30c7c7-socket-dir\") pod \"aws-ebs-csi-driver-node-7hvsv\" (UID: \"3078201b-cbfe-423a-9505-d7431f30c7c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hvsv"
Sep 16 01:15:53.184215 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.184218    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7c405cb2-c373-496e-84e5-055abf68c46c-cnibin\") pod \"multus-additional-cni-plugins-z24pg\" (UID: \"7c405cb2-c373-496e-84e5-055abf68c46c\") " pod="openshift-multus/multus-additional-cni-plugins-z24pg"
Sep 16 01:15:53.184776 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.184243    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7c405cb2-c373-496e-84e5-055abf68c46c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z24pg\" (UID: \"7c405cb2-c373-496e-84e5-055abf68c46c\") " pod="openshift-multus/multus-additional-cni-plugins-z24pg"
Sep 16 01:15:53.184776 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.184269    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/47481dec-b718-4041-827a-aa8dd51a98d0-host-slash\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.184776 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.184280    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d141010c-add9-48d2-8171-49f314ea3938-etc-modprobe-d\") pod \"tuned-wzt2x\" (UID: \"d141010c-add9-48d2-8171-49f314ea3938\") " pod="openshift-cluster-node-tuning-operator/tuned-wzt2x"
Sep 16 01:15:53.184776 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.184293    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sblwj\" (UniqueName: \"kubernetes.io/projected/47481dec-b718-4041-827a-aa8dd51a98d0-kube-api-access-sblwj\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.184776 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.184322    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/63a0c126-4c73-480d-aa3c-6de4e96c4b69-host-run-netns\") pod \"multus-bxmkv\" (UID: \"63a0c126-4c73-480d-aa3c-6de4e96c4b69\") " pod="openshift-multus/multus-bxmkv"
Sep 16 01:15:53.184776 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.184346    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47481dec-b718-4041-827a-aa8dd51a98d0-run-openvswitch\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.184776 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.184367    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d141010c-add9-48d2-8171-49f314ea3938-etc-systemd\") pod \"tuned-wzt2x\" (UID: \"d141010c-add9-48d2-8171-49f314ea3938\") " pod="openshift-cluster-node-tuning-operator/tuned-wzt2x"
Sep 16 01:15:53.184776 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.184388    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/63a0c126-4c73-480d-aa3c-6de4e96c4b69-cnibin\") pod \"multus-bxmkv\" (UID: \"63a0c126-4c73-480d-aa3c-6de4e96c4b69\") " pod="openshift-multus/multus-bxmkv"
Sep 16 01:15:53.184776 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.184413    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7c405cb2-c373-496e-84e5-055abf68c46c-cni-binary-copy\") pod \"multus-additional-cni-plugins-z24pg\" (UID: \"7c405cb2-c373-496e-84e5-055abf68c46c\") " pod="openshift-multus/multus-additional-cni-plugins-z24pg"
Sep 16 01:15:53.184776 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.184445    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d141010c-add9-48d2-8171-49f314ea3938-var-lib-kubelet\") pod \"tuned-wzt2x\" (UID: \"d141010c-add9-48d2-8171-49f314ea3938\") " pod="openshift-cluster-node-tuning-operator/tuned-wzt2x"
Sep 16 01:15:53.184776 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.184452    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/63a0c126-4c73-480d-aa3c-6de4e96c4b69-system-cni-dir\") pod \"multus-bxmkv\" (UID: \"63a0c126-4c73-480d-aa3c-6de4e96c4b69\") " pod="openshift-multus/multus-bxmkv"
Sep 16 01:15:53.184776 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.184472    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47481dec-b718-4041-827a-aa8dd51a98d0-etc-openvswitch\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.184776 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.184499    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/47481dec-b718-4041-827a-aa8dd51a98d0-ovnkube-config\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.184776 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.184522    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/47481dec-b718-4041-827a-aa8dd51a98d0-env-overrides\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.184776 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.184548    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/47481dec-b718-4041-827a-aa8dd51a98d0-ovn-node-metrics-cert\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.184776 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.184574    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/63a0c126-4c73-480d-aa3c-6de4e96c4b69-cni-binary-copy\") pod \"multus-bxmkv\" (UID: \"63a0c126-4c73-480d-aa3c-6de4e96c4b69\") " pod="openshift-multus/multus-bxmkv"
Sep 16 01:15:53.184776 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.184600    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4112bee2-636b-4e14-a5ba-fd2bb43fffaf-metrics-certs\") pod \"network-metrics-daemon-lxzjg\" (UID: \"4112bee2-636b-4e14-a5ba-fd2bb43fffaf\") " pod="openshift-multus/network-metrics-daemon-lxzjg"
Sep 16 01:15:53.185391 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.184607    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3078201b-cbfe-423a-9505-d7431f30c7c7-socket-dir\") pod \"aws-ebs-csi-driver-node-7hvsv\" (UID: \"3078201b-cbfe-423a-9505-d7431f30c7c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hvsv"
Sep 16 01:15:53.185391 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.184624    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/47481dec-b718-4041-827a-aa8dd51a98d0-node-log\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.185391 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.184650    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/47481dec-b718-4041-827a-aa8dd51a98d0-host-kubelet\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.185391 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.184660    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7c405cb2-c373-496e-84e5-055abf68c46c-cnibin\") pod \"multus-additional-cni-plugins-z24pg\" (UID: \"7c405cb2-c373-496e-84e5-055abf68c46c\") " pod="openshift-multus/multus-additional-cni-plugins-z24pg"
Sep 16 01:15:53.185391 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.184680    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f7c423cc-710d-49fa-835f-518fc794dfb0-kubelet-config\") pod \"global-pull-secret-syncer-vzwdx\" (UID: \"f7c423cc-710d-49fa-835f-518fc794dfb0\") " pod="kube-system/global-pull-secret-syncer-vzwdx"
Sep 16 01:15:53.185391 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.184717    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fmg7\" (UniqueName: \"kubernetes.io/projected/9b5e1f55-e4cc-46aa-919c-c50324c38ce0-kube-api-access-5fmg7\") pod \"node-ca-h9vzm\" (UID: \"9b5e1f55-e4cc-46aa-919c-c50324c38ce0\") " pod="openshift-image-registry/node-ca-h9vzm"
Sep 16 01:15:53.185391 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.184758    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f7c423cc-710d-49fa-835f-518fc794dfb0-kubelet-config\") pod \"global-pull-secret-syncer-vzwdx\" (UID: \"f7c423cc-710d-49fa-835f-518fc794dfb0\") " pod="kube-system/global-pull-secret-syncer-vzwdx"
Sep 16 01:15:53.185391 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.184800    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/63a0c126-4c73-480d-aa3c-6de4e96c4b69-host-run-netns\") pod \"multus-bxmkv\" (UID: \"63a0c126-4c73-480d-aa3c-6de4e96c4b69\") " pod="openshift-multus/multus-bxmkv"
Sep 16 01:15:53.185391 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.184892    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/63a0c126-4c73-480d-aa3c-6de4e96c4b69-cnibin\") pod \"multus-bxmkv\" (UID: \"63a0c126-4c73-480d-aa3c-6de4e96c4b69\") " pod="openshift-multus/multus-bxmkv"
Sep 16 01:15:53.185391 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:53.184908    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 01:15:53.185391 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:53.184981    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4112bee2-636b-4e14-a5ba-fd2bb43fffaf-metrics-certs podName:4112bee2-636b-4e14-a5ba-fd2bb43fffaf nodeName:}" failed. No retries permitted until 2026-09-16 01:15:53.684957323 +0000 UTC m=+3.008425884 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4112bee2-636b-4e14-a5ba-fd2bb43fffaf-metrics-certs") pod "network-metrics-daemon-lxzjg" (UID: "4112bee2-636b-4e14-a5ba-fd2bb43fffaf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 01:15:53.185391 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.185075    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d141010c-add9-48d2-8171-49f314ea3938-var-lib-kubelet\") pod \"tuned-wzt2x\" (UID: \"d141010c-add9-48d2-8171-49f314ea3938\") " pod="openshift-cluster-node-tuning-operator/tuned-wzt2x"
Sep 16 01:15:53.185391 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.184760    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/47481dec-b718-4041-827a-aa8dd51a98d0-systemd-units\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.185391 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.185200    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47481dec-b718-4041-827a-aa8dd51a98d0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.185391 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.185229    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63a0c126-4c73-480d-aa3c-6de4e96c4b69-etc-kubernetes\") pod \"multus-bxmkv\" (UID: \"63a0c126-4c73-480d-aa3c-6de4e96c4b69\") " pod="openshift-multus/multus-bxmkv"
Sep 16 01:15:53.185391 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.185254    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzn4k\" (UniqueName: \"kubernetes.io/projected/cec37c8f-d1ef-47fc-9e34-58c4f9c4e26d-kube-api-access-gzn4k\") pod \"node-resolver-dksqw\" (UID: \"cec37c8f-d1ef-47fc-9e34-58c4f9c4e26d\") " pod="openshift-dns/node-resolver-dksqw"
Sep 16 01:15:53.185391 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.185278    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7c405cb2-c373-496e-84e5-055abf68c46c-system-cni-dir\") pod \"multus-additional-cni-plugins-z24pg\" (UID: \"7c405cb2-c373-496e-84e5-055abf68c46c\") " pod="openshift-multus/multus-additional-cni-plugins-z24pg"
Sep 16 01:15:53.185956 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.185295    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7c405cb2-c373-496e-84e5-055abf68c46c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z24pg\" (UID: \"7c405cb2-c373-496e-84e5-055abf68c46c\") " pod="openshift-multus/multus-additional-cni-plugins-z24pg"
Sep 16 01:15:53.185956 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.185302    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d141010c-add9-48d2-8171-49f314ea3938-etc-tuned\") pod \"tuned-wzt2x\" (UID: \"d141010c-add9-48d2-8171-49f314ea3938\") " pod="openshift-cluster-node-tuning-operator/tuned-wzt2x"
Sep 16 01:15:53.185956 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.185347    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7c405cb2-c373-496e-84e5-055abf68c46c-cni-binary-copy\") pod \"multus-additional-cni-plugins-z24pg\" (UID: \"7c405cb2-c373-496e-84e5-055abf68c46c\") " pod="openshift-multus/multus-additional-cni-plugins-z24pg"
Sep 16 01:15:53.185956 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.185363    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/47481dec-b718-4041-827a-aa8dd51a98d0-ovnkube-script-lib\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.185956 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.185384    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx8rz\" (UniqueName: \"kubernetes.io/projected/4112bee2-636b-4e14-a5ba-fd2bb43fffaf-kube-api-access-tx8rz\") pod \"network-metrics-daemon-lxzjg\" (UID: \"4112bee2-636b-4e14-a5ba-fd2bb43fffaf\") " pod="openshift-multus/network-metrics-daemon-lxzjg"
Sep 16 01:15:53.185956 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.185388    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7c405cb2-c373-496e-84e5-055abf68c46c-system-cni-dir\") pod \"multus-additional-cni-plugins-z24pg\" (UID: \"7c405cb2-c373-496e-84e5-055abf68c46c\") " pod="openshift-multus/multus-additional-cni-plugins-z24pg"
Sep 16 01:15:53.185956 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.185427    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d141010c-add9-48d2-8171-49f314ea3938-etc-sysctl-conf\") pod \"tuned-wzt2x\" (UID: \"d141010c-add9-48d2-8171-49f314ea3938\") " pod="openshift-cluster-node-tuning-operator/tuned-wzt2x"
Sep 16 01:15:53.185956 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.185474    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63a0c126-4c73-480d-aa3c-6de4e96c4b69-etc-kubernetes\") pod \"multus-bxmkv\" (UID: \"63a0c126-4c73-480d-aa3c-6de4e96c4b69\") " pod="openshift-multus/multus-bxmkv"
Sep 16 01:15:53.185956 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.185501    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47481dec-b718-4041-827a-aa8dd51a98d0-var-lib-openvswitch\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.185956 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.185528    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d141010c-add9-48d2-8171-49f314ea3938-etc-sysctl-d\") pod \"tuned-wzt2x\" (UID: \"d141010c-add9-48d2-8171-49f314ea3938\") " pod="openshift-cluster-node-tuning-operator/tuned-wzt2x"
Sep 16 01:15:53.185956 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.185560    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjxkk\" (UniqueName: \"kubernetes.io/projected/63a0c126-4c73-480d-aa3c-6de4e96c4b69-kube-api-access-wjxkk\") pod \"multus-bxmkv\" (UID: \"63a0c126-4c73-480d-aa3c-6de4e96c4b69\") " pod="openshift-multus/multus-bxmkv"
Sep 16 01:15:53.185956 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.185585    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5q89f\" (UniqueName: \"kubernetes.io/projected/3078201b-cbfe-423a-9505-d7431f30c7c7-kube-api-access-5q89f\") pod \"aws-ebs-csi-driver-node-7hvsv\" (UID: \"3078201b-cbfe-423a-9505-d7431f30c7c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hvsv"
Sep 16 01:15:53.185956 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.185613    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7c423cc-710d-49fa-835f-518fc794dfb0-original-pull-secret\") pod \"global-pull-secret-syncer-vzwdx\" (UID: \"f7c423cc-710d-49fa-835f-518fc794dfb0\") " pod="kube-system/global-pull-secret-syncer-vzwdx"
Sep 16 01:15:53.185956 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.185632    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9b5e1f55-e4cc-46aa-919c-c50324c38ce0-serviceca\") pod \"node-ca-h9vzm\" (UID: \"9b5e1f55-e4cc-46aa-919c-c50324c38ce0\") " pod="openshift-image-registry/node-ca-h9vzm"
Sep 16 01:15:53.185956 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.185645    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d141010c-add9-48d2-8171-49f314ea3938-etc-sysctl-conf\") pod \"tuned-wzt2x\" (UID: \"d141010c-add9-48d2-8171-49f314ea3938\") " pod="openshift-cluster-node-tuning-operator/tuned-wzt2x"
Sep 16 01:15:53.185956 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.185690    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlqjt\" (UniqueName: \"kubernetes.io/projected/d141010c-add9-48d2-8171-49f314ea3938-kube-api-access-hlqjt\") pod \"tuned-wzt2x\" (UID: \"d141010c-add9-48d2-8171-49f314ea3938\") " pod="openshift-cluster-node-tuning-operator/tuned-wzt2x"
Sep 16 01:15:53.185956 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.185698    2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 16 01:15:53.186649 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.185730    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/47481dec-b718-4041-827a-aa8dd51a98d0-run-systemd\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.186649 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.185741    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/63a0c126-4c73-480d-aa3c-6de4e96c4b69-cni-binary-copy\") pod \"multus-bxmkv\" (UID: \"63a0c126-4c73-480d-aa3c-6de4e96c4b69\") " pod="openshift-multus/multus-bxmkv"
Sep 16 01:15:53.186649 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.185762    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3078201b-cbfe-423a-9505-d7431f30c7c7-registration-dir\") pod \"aws-ebs-csi-driver-node-7hvsv\" (UID: \"3078201b-cbfe-423a-9505-d7431f30c7c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hvsv"
Sep 16 01:15:53.186649 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.185787    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3078201b-cbfe-423a-9505-d7431f30c7c7-etc-selinux\") pod \"aws-ebs-csi-driver-node-7hvsv\" (UID: \"3078201b-cbfe-423a-9505-d7431f30c7c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hvsv"
Sep 16 01:15:53.186649 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.185826    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3078201b-cbfe-423a-9505-d7431f30c7c7-sys-fs\") pod \"aws-ebs-csi-driver-node-7hvsv\" (UID: \"3078201b-cbfe-423a-9505-d7431f30c7c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hvsv"
Sep 16 01:15:53.186649 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.185848    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cec37c8f-d1ef-47fc-9e34-58c4f9c4e26d-hosts-file\") pod \"node-resolver-dksqw\" (UID: \"cec37c8f-d1ef-47fc-9e34-58c4f9c4e26d\") " pod="openshift-dns/node-resolver-dksqw"
Sep 16 01:15:53.186649 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.185870    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d141010c-add9-48d2-8171-49f314ea3938-tmp\") pod \"tuned-wzt2x\" (UID: \"d141010c-add9-48d2-8171-49f314ea3938\") " pod="openshift-cluster-node-tuning-operator/tuned-wzt2x"
Sep 16 01:15:53.186649 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.185892    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/35c37798-a9dc-419f-b80a-b3dd9ed22caa-host-slash\") pod \"iptables-alerter-2t558\" (UID: \"35c37798-a9dc-419f-b80a-b3dd9ed22caa\") " pod="openshift-network-operator/iptables-alerter-2t558"
Sep 16 01:15:53.186649 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.185913    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/47481dec-b718-4041-827a-aa8dd51a98d0-log-socket\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.186649 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.185935    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/47481dec-b718-4041-827a-aa8dd51a98d0-host-cni-bin\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.186649 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.185978    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d141010c-add9-48d2-8171-49f314ea3938-etc-sysctl-d\") pod \"tuned-wzt2x\" (UID: \"d141010c-add9-48d2-8171-49f314ea3938\") " pod="openshift-cluster-node-tuning-operator/tuned-wzt2x"
Sep 16 01:15:53.186649 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.186017    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9b5e1f55-e4cc-46aa-919c-c50324c38ce0-serviceca\") pod \"node-ca-h9vzm\" (UID: \"9b5e1f55-e4cc-46aa-919c-c50324c38ce0\") " pod="openshift-image-registry/node-ca-h9vzm"
Sep 16 01:15:53.186649 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.186039    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3078201b-cbfe-423a-9505-d7431f30c7c7-registration-dir\") pod \"aws-ebs-csi-driver-node-7hvsv\" (UID: \"3078201b-cbfe-423a-9505-d7431f30c7c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hvsv"
Sep 16 01:15:53.186649 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.186098    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3078201b-cbfe-423a-9505-d7431f30c7c7-etc-selinux\") pod \"aws-ebs-csi-driver-node-7hvsv\" (UID: \"3078201b-cbfe-423a-9505-d7431f30c7c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hvsv"
Sep 16 01:15:53.186649 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.186182    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3078201b-cbfe-423a-9505-d7431f30c7c7-sys-fs\") pod \"aws-ebs-csi-driver-node-7hvsv\" (UID: \"3078201b-cbfe-423a-9505-d7431f30c7c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hvsv"
Sep 16 01:15:53.186649 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.186241    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/63a0c126-4c73-480d-aa3c-6de4e96c4b69-multus-conf-dir\") pod \"multus-bxmkv\" (UID: \"63a0c126-4c73-480d-aa3c-6de4e96c4b69\") " pod="openshift-multus/multus-bxmkv"
Sep 16 01:15:53.186649 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.186241    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cec37c8f-d1ef-47fc-9e34-58c4f9c4e26d-hosts-file\") pod \"node-resolver-dksqw\" (UID: \"cec37c8f-d1ef-47fc-9e34-58c4f9c4e26d\") " pod="openshift-dns/node-resolver-dksqw"
Sep 16 01:15:53.187364 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.186272    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9b5e1f55-e4cc-46aa-919c-c50324c38ce0-host\") pod \"node-ca-h9vzm\" (UID: \"9b5e1f55-e4cc-46aa-919c-c50324c38ce0\") " pod="openshift-image-registry/node-ca-h9vzm"
Sep 16 01:15:53.187364 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:53.186245    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 01:15:53.187364 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.186292    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/63a0c126-4c73-480d-aa3c-6de4e96c4b69-multus-conf-dir\") pod \"multus-bxmkv\" (UID: \"63a0c126-4c73-480d-aa3c-6de4e96c4b69\") " pod="openshift-multus/multus-bxmkv"
Sep 16 01:15:53.187364 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.186323    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d141010c-add9-48d2-8171-49f314ea3938-lib-modules\") pod \"tuned-wzt2x\" (UID: \"d141010c-add9-48d2-8171-49f314ea3938\") " pod="openshift-cluster-node-tuning-operator/tuned-wzt2x"
Sep 16 01:15:53.187364 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.186369    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d141010c-add9-48d2-8171-49f314ea3938-host\") pod \"tuned-wzt2x\" (UID: \"d141010c-add9-48d2-8171-49f314ea3938\") " pod="openshift-cluster-node-tuning-operator/tuned-wzt2x"
Sep 16 01:15:53.187364 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.186394    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9b5e1f55-e4cc-46aa-919c-c50324c38ce0-host\") pod \"node-ca-h9vzm\" (UID: \"9b5e1f55-e4cc-46aa-919c-c50324c38ce0\") " pod="openshift-image-registry/node-ca-h9vzm"
Sep 16 01:15:53.187364 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:53.186400    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7c423cc-710d-49fa-835f-518fc794dfb0-original-pull-secret podName:f7c423cc-710d-49fa-835f-518fc794dfb0 nodeName:}" failed. No retries permitted until 2026-09-16 01:15:53.686379919 +0000 UTC m=+3.009848493 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7c423cc-710d-49fa-835f-518fc794dfb0-original-pull-secret") pod "global-pull-secret-syncer-vzwdx" (UID: "f7c423cc-710d-49fa-835f-518fc794dfb0") : object "kube-system"/"original-pull-secret" not registered
Sep 16 01:15:53.187364 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.186423    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d141010c-add9-48d2-8171-49f314ea3938-lib-modules\") pod \"tuned-wzt2x\" (UID: \"d141010c-add9-48d2-8171-49f314ea3938\") " pod="openshift-cluster-node-tuning-operator/tuned-wzt2x"
Sep 16 01:15:53.187364 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.186441    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/47481dec-b718-4041-827a-aa8dd51a98d0-host-run-netns\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.187364 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.186459    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d141010c-add9-48d2-8171-49f314ea3938-host\") pod \"tuned-wzt2x\" (UID: \"d141010c-add9-48d2-8171-49f314ea3938\") " pod="openshift-cluster-node-tuning-operator/tuned-wzt2x"
Sep 16 01:15:53.187364 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.186477    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/63a0c126-4c73-480d-aa3c-6de4e96c4b69-multus-socket-dir-parent\") pod \"multus-bxmkv\" (UID: \"63a0c126-4c73-480d-aa3c-6de4e96c4b69\") " pod="openshift-multus/multus-bxmkv"
Sep 16 01:15:53.187364 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.186541    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/63a0c126-4c73-480d-aa3c-6de4e96c4b69-multus-socket-dir-parent\") pod \"multus-bxmkv\" (UID: \"63a0c126-4c73-480d-aa3c-6de4e96c4b69\") " pod="openshift-multus/multus-bxmkv"
Sep 16 01:15:53.187364 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.186542    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/63a0c126-4c73-480d-aa3c-6de4e96c4b69-host-run-k8s-cni-cncf-io\") pod \"multus-bxmkv\" (UID: \"63a0c126-4c73-480d-aa3c-6de4e96c4b69\") " pod="openshift-multus/multus-bxmkv"
Sep 16 01:15:53.187364 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.186627    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/63a0c126-4c73-480d-aa3c-6de4e96c4b69-host-run-k8s-cni-cncf-io\") pod \"multus-bxmkv\" (UID: \"63a0c126-4c73-480d-aa3c-6de4e96c4b69\") " pod="openshift-multus/multus-bxmkv"
Sep 16 01:15:53.187364 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.186658    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/63a0c126-4c73-480d-aa3c-6de4e96c4b69-host-var-lib-cni-bin\") pod \"multus-bxmkv\" (UID: \"63a0c126-4c73-480d-aa3c-6de4e96c4b69\") " pod="openshift-multus/multus-bxmkv"
Sep 16 01:15:53.187364 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.186686    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/63a0c126-4c73-480d-aa3c-6de4e96c4b69-multus-daemon-config\") pod \"multus-bxmkv\" (UID: \"63a0c126-4c73-480d-aa3c-6de4e96c4b69\") " pod="openshift-multus/multus-bxmkv"
Sep 16 01:15:53.187364 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.186734    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/63a0c126-4c73-480d-aa3c-6de4e96c4b69-host-var-lib-cni-bin\") pod \"multus-bxmkv\" (UID: \"63a0c126-4c73-480d-aa3c-6de4e96c4b69\") " pod="openshift-multus/multus-bxmkv"
Sep 16 01:15:53.187364 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.186771    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cec37c8f-d1ef-47fc-9e34-58c4f9c4e26d-tmp-dir\") pod \"node-resolver-dksqw\" (UID: \"cec37c8f-d1ef-47fc-9e34-58c4f9c4e26d\") " pod="openshift-dns/node-resolver-dksqw"
Sep 16 01:15:53.188261 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.186823    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7c405cb2-c373-496e-84e5-055abf68c46c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z24pg\" (UID: \"7c405cb2-c373-496e-84e5-055abf68c46c\") " pod="openshift-multus/multus-additional-cni-plugins-z24pg"
Sep 16 01:15:53.188261 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.186865    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7c405cb2-c373-496e-84e5-055abf68c46c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z24pg\" (UID: \"7c405cb2-c373-496e-84e5-055abf68c46c\") " pod="openshift-multus/multus-additional-cni-plugins-z24pg"
Sep 16 01:15:53.188261 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.186894    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfkzm\" (UniqueName: \"kubernetes.io/projected/7c405cb2-c373-496e-84e5-055abf68c46c-kube-api-access-nfkzm\") pod \"multus-additional-cni-plugins-z24pg\" (UID: \"7c405cb2-c373-496e-84e5-055abf68c46c\") " pod="openshift-multus/multus-additional-cni-plugins-z24pg"
Sep 16 01:15:53.188261 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.186919    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/63a0c126-4c73-480d-aa3c-6de4e96c4b69-multus-cni-dir\") pod \"multus-bxmkv\" (UID: \"63a0c126-4c73-480d-aa3c-6de4e96c4b69\") " pod="openshift-multus/multus-bxmkv"
Sep 16 01:15:53.188261 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.186947    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3078201b-cbfe-423a-9505-d7431f30c7c7-device-dir\") pod \"aws-ebs-csi-driver-node-7hvsv\" (UID: \"3078201b-cbfe-423a-9505-d7431f30c7c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hvsv"
Sep 16 01:15:53.188261 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.186970    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f7c423cc-710d-49fa-835f-518fc794dfb0-dbus\") pod \"global-pull-secret-syncer-vzwdx\" (UID: \"f7c423cc-710d-49fa-835f-518fc794dfb0\") " pod="kube-system/global-pull-secret-syncer-vzwdx"
Sep 16 01:15:53.188261 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.186996    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d141010c-add9-48d2-8171-49f314ea3938-etc-kubernetes\") pod \"tuned-wzt2x\" (UID: \"d141010c-add9-48d2-8171-49f314ea3938\") " pod="openshift-cluster-node-tuning-operator/tuned-wzt2x"
Sep 16 01:15:53.188261 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.187021    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d141010c-add9-48d2-8171-49f314ea3938-run\") pod \"tuned-wzt2x\" (UID: \"d141010c-add9-48d2-8171-49f314ea3938\") " pod="openshift-cluster-node-tuning-operator/tuned-wzt2x"
Sep 16 01:15:53.188261 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.187053    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/35c37798-a9dc-419f-b80a-b3dd9ed22caa-iptables-alerter-script\") pod \"iptables-alerter-2t558\" (UID: \"35c37798-a9dc-419f-b80a-b3dd9ed22caa\") " pod="openshift-network-operator/iptables-alerter-2t558"
Sep 16 01:15:53.188261 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.187100    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47481dec-b718-4041-827a-aa8dd51a98d0-host-run-ovn-kubernetes\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.188261 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.187125    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/47481dec-b718-4041-827a-aa8dd51a98d0-host-cni-netd\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.188261 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.187151    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/63a0c126-4c73-480d-aa3c-6de4e96c4b69-multus-daemon-config\") pod \"multus-bxmkv\" (UID: \"63a0c126-4c73-480d-aa3c-6de4e96c4b69\") " pod="openshift-multus/multus-bxmkv"
Sep 16 01:15:53.188261 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.187155    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl2ft\" (UniqueName: \"kubernetes.io/projected/8519201e-63ce-4c38-a45a-b9e0624fd8b5-kube-api-access-sl2ft\") pod \"network-check-target-gvqfk\" (UID: \"8519201e-63ce-4c38-a45a-b9e0624fd8b5\") " pod="openshift-network-diagnostics/network-check-target-gvqfk"
Sep 16 01:15:53.188261 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.187186    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d5fdc95b-8eaa-401f-a9a9-50bea6a5ffc8-agent-certs\") pod \"konnectivity-agent-t9knx\" (UID: \"d5fdc95b-8eaa-401f-a9a9-50bea6a5ffc8\") " pod="kube-system/konnectivity-agent-t9knx"
Sep 16 01:15:53.188261 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.187201    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cec37c8f-d1ef-47fc-9e34-58c4f9c4e26d-tmp-dir\") pod \"node-resolver-dksqw\" (UID: \"cec37c8f-d1ef-47fc-9e34-58c4f9c4e26d\") " pod="openshift-dns/node-resolver-dksqw"
Sep 16 01:15:53.188261 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.187257    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7c405cb2-c373-496e-84e5-055abf68c46c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z24pg\" (UID: \"7c405cb2-c373-496e-84e5-055abf68c46c\") " pod="openshift-multus/multus-additional-cni-plugins-z24pg"
Sep 16 01:15:53.188261 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.187293    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f7c423cc-710d-49fa-835f-518fc794dfb0-dbus\") pod \"global-pull-secret-syncer-vzwdx\" (UID: \"f7c423cc-710d-49fa-835f-518fc794dfb0\") " pod="kube-system/global-pull-secret-syncer-vzwdx"
Sep 16 01:15:53.189135 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.187296    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/63a0c126-4c73-480d-aa3c-6de4e96c4b69-multus-cni-dir\") pod \"multus-bxmkv\" (UID: \"63a0c126-4c73-480d-aa3c-6de4e96c4b69\") " pod="openshift-multus/multus-bxmkv"
Sep 16 01:15:53.189135 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.187322    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3078201b-cbfe-423a-9505-d7431f30c7c7-device-dir\") pod \"aws-ebs-csi-driver-node-7hvsv\" (UID: \"3078201b-cbfe-423a-9505-d7431f30c7c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hvsv"
Sep 16 01:15:53.189135 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.187334    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d5fdc95b-8eaa-401f-a9a9-50bea6a5ffc8-konnectivity-ca\") pod \"konnectivity-agent-t9knx\" (UID: \"d5fdc95b-8eaa-401f-a9a9-50bea6a5ffc8\") " pod="kube-system/konnectivity-agent-t9knx"
Sep 16 01:15:53.189135 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.187365    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/63a0c126-4c73-480d-aa3c-6de4e96c4b69-host-run-multus-certs\") pod \"multus-bxmkv\" (UID: \"63a0c126-4c73-480d-aa3c-6de4e96c4b69\") " pod="openshift-multus/multus-bxmkv"
Sep 16 01:15:53.189135 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.187406    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3078201b-cbfe-423a-9505-d7431f30c7c7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7hvsv\" (UID: \"3078201b-cbfe-423a-9505-d7431f30c7c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hvsv"
Sep 16 01:15:53.189135 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.187515    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/63a0c126-4c73-480d-aa3c-6de4e96c4b69-host-run-multus-certs\") pod \"multus-bxmkv\" (UID: \"63a0c126-4c73-480d-aa3c-6de4e96c4b69\") " pod="openshift-multus/multus-bxmkv"
Sep 16 01:15:53.189135 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.187572    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d141010c-add9-48d2-8171-49f314ea3938-etc-kubernetes\") pod \"tuned-wzt2x\" (UID: \"d141010c-add9-48d2-8171-49f314ea3938\") " pod="openshift-cluster-node-tuning-operator/tuned-wzt2x"
Sep 16 01:15:53.189135 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.187565    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d141010c-add9-48d2-8171-49f314ea3938-run\") pod \"tuned-wzt2x\" (UID: \"d141010c-add9-48d2-8171-49f314ea3938\") " pod="openshift-cluster-node-tuning-operator/tuned-wzt2x"
Sep 16 01:15:53.189135 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.187733    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3078201b-cbfe-423a-9505-d7431f30c7c7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7hvsv\" (UID: \"3078201b-cbfe-423a-9505-d7431f30c7c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hvsv"
Sep 16 01:15:53.189135 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.187784    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7c405cb2-c373-496e-84e5-055abf68c46c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z24pg\" (UID: \"7c405cb2-c373-496e-84e5-055abf68c46c\") " pod="openshift-multus/multus-additional-cni-plugins-z24pg"
Sep 16 01:15:53.189135 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.188007    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d5fdc95b-8eaa-401f-a9a9-50bea6a5ffc8-konnectivity-ca\") pod \"konnectivity-agent-t9knx\" (UID: \"d5fdc95b-8eaa-401f-a9a9-50bea6a5ffc8\") " pod="kube-system/konnectivity-agent-t9knx"
Sep 16 01:15:53.190112 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.190085    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d141010c-add9-48d2-8171-49f314ea3938-tmp\") pod \"tuned-wzt2x\" (UID: \"d141010c-add9-48d2-8171-49f314ea3938\") " pod="openshift-cluster-node-tuning-operator/tuned-wzt2x"
Sep 16 01:15:53.190213 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.190126    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d141010c-add9-48d2-8171-49f314ea3938-etc-tuned\") pod \"tuned-wzt2x\" (UID: \"d141010c-add9-48d2-8171-49f314ea3938\") " pod="openshift-cluster-node-tuning-operator/tuned-wzt2x"
Sep 16 01:15:53.190811 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.190748    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d5fdc95b-8eaa-401f-a9a9-50bea6a5ffc8-agent-certs\") pod \"konnectivity-agent-t9knx\" (UID: \"d5fdc95b-8eaa-401f-a9a9-50bea6a5ffc8\") " pod="kube-system/konnectivity-agent-t9knx"
Sep 16 01:15:53.196247 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:53.195933    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 01:15:53.196247 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:53.195956    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 01:15:53.196247 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:53.195970    2565 projected.go:196] Error preparing data for projected volume kube-api-access-sl2ft for pod openshift-network-diagnostics/network-check-target-gvqfk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 01:15:53.196247 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:53.196038    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8519201e-63ce-4c38-a45a-b9e0624fd8b5-kube-api-access-sl2ft podName:8519201e-63ce-4c38-a45a-b9e0624fd8b5 nodeName:}" failed. No retries permitted until 2026-09-16 01:15:53.69602063 +0000 UTC m=+3.019489201 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-sl2ft" (UniqueName: "kubernetes.io/projected/8519201e-63ce-4c38-a45a-b9e0624fd8b5-kube-api-access-sl2ft") pod "network-check-target-gvqfk" (UID: "8519201e-63ce-4c38-a45a-b9e0624fd8b5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 01:15:53.197506 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.197098    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzn4k\" (UniqueName: \"kubernetes.io/projected/cec37c8f-d1ef-47fc-9e34-58c4f9c4e26d-kube-api-access-gzn4k\") pod \"node-resolver-dksqw\" (UID: \"cec37c8f-d1ef-47fc-9e34-58c4f9c4e26d\") " pod="openshift-dns/node-resolver-dksqw"
Sep 16 01:15:53.197506 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.197223    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fmg7\" (UniqueName: \"kubernetes.io/projected/9b5e1f55-e4cc-46aa-919c-c50324c38ce0-kube-api-access-5fmg7\") pod \"node-ca-h9vzm\" (UID: \"9b5e1f55-e4cc-46aa-919c-c50324c38ce0\") " pod="openshift-image-registry/node-ca-h9vzm"
Sep 16 01:15:53.199519 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.199495    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjxkk\" (UniqueName: \"kubernetes.io/projected/63a0c126-4c73-480d-aa3c-6de4e96c4b69-kube-api-access-wjxkk\") pod \"multus-bxmkv\" (UID: \"63a0c126-4c73-480d-aa3c-6de4e96c4b69\") " pod="openshift-multus/multus-bxmkv"
Sep 16 01:15:53.199991 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.199968    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfkzm\" (UniqueName: \"kubernetes.io/projected/7c405cb2-c373-496e-84e5-055abf68c46c-kube-api-access-nfkzm\") pod \"multus-additional-cni-plugins-z24pg\" (UID: \"7c405cb2-c373-496e-84e5-055abf68c46c\") " pod="openshift-multus/multus-additional-cni-plugins-z24pg"
Sep 16 01:15:53.200701 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.200614    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5q89f\" (UniqueName: \"kubernetes.io/projected/3078201b-cbfe-423a-9505-d7431f30c7c7-kube-api-access-5q89f\") pod \"aws-ebs-csi-driver-node-7hvsv\" (UID: \"3078201b-cbfe-423a-9505-d7431f30c7c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hvsv"
Sep 16 01:15:53.200796 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.200782    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlqjt\" (UniqueName: \"kubernetes.io/projected/d141010c-add9-48d2-8171-49f314ea3938-kube-api-access-hlqjt\") pod \"tuned-wzt2x\" (UID: \"d141010c-add9-48d2-8171-49f314ea3938\") " pod="openshift-cluster-node-tuning-operator/tuned-wzt2x"
Sep 16 01:15:53.201223 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.201181    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx8rz\" (UniqueName: \"kubernetes.io/projected/4112bee2-636b-4e14-a5ba-fd2bb43fffaf-kube-api-access-tx8rz\") pod \"network-metrics-daemon-lxzjg\" (UID: \"4112bee2-636b-4e14-a5ba-fd2bb43fffaf\") " pod="openshift-multus/network-metrics-daemon-lxzjg"
Sep 16 01:15:53.282306 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.282208    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 01:15:53.288561 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.288519    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/47481dec-b718-4041-827a-aa8dd51a98d0-systemd-units\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.288717 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.288574    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47481dec-b718-4041-827a-aa8dd51a98d0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.288717 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.288600    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/47481dec-b718-4041-827a-aa8dd51a98d0-ovnkube-script-lib\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.288717 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.288629    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47481dec-b718-4041-827a-aa8dd51a98d0-var-lib-openvswitch\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.288717 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.288637    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47481dec-b718-4041-827a-aa8dd51a98d0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.288717 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.288598    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/47481dec-b718-4041-827a-aa8dd51a98d0-systemd-units\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.288717 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.288672    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/47481dec-b718-4041-827a-aa8dd51a98d0-run-systemd\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.288717 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.288693    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47481dec-b718-4041-827a-aa8dd51a98d0-var-lib-openvswitch\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.288717 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.288702    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/35c37798-a9dc-419f-b80a-b3dd9ed22caa-host-slash\") pod \"iptables-alerter-2t558\" (UID: \"35c37798-a9dc-419f-b80a-b3dd9ed22caa\") " pod="openshift-network-operator/iptables-alerter-2t558"
Sep 16 01:15:53.289009 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.288726    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/47481dec-b718-4041-827a-aa8dd51a98d0-log-socket\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.289009 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.288751    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/47481dec-b718-4041-827a-aa8dd51a98d0-host-cni-bin\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.289009 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.288763    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/35c37798-a9dc-419f-b80a-b3dd9ed22caa-host-slash\") pod \"iptables-alerter-2t558\" (UID: \"35c37798-a9dc-419f-b80a-b3dd9ed22caa\") " pod="openshift-network-operator/iptables-alerter-2t558"
Sep 16 01:15:53.289009 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.288729    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/47481dec-b718-4041-827a-aa8dd51a98d0-run-systemd\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.289009 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.288779    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/47481dec-b718-4041-827a-aa8dd51a98d0-host-run-netns\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.289009 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.288813    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/35c37798-a9dc-419f-b80a-b3dd9ed22caa-iptables-alerter-script\") pod \"iptables-alerter-2t558\" (UID: \"35c37798-a9dc-419f-b80a-b3dd9ed22caa\") " pod="openshift-network-operator/iptables-alerter-2t558"
Sep 16 01:15:53.289009 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.288815    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/47481dec-b718-4041-827a-aa8dd51a98d0-log-socket\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.289009 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.288849    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/47481dec-b718-4041-827a-aa8dd51a98d0-host-cni-bin\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.289009 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.288878    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47481dec-b718-4041-827a-aa8dd51a98d0-host-run-ovn-kubernetes\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.289009 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.288885    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/47481dec-b718-4041-827a-aa8dd51a98d0-host-run-netns\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.289009 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.288910    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47481dec-b718-4041-827a-aa8dd51a98d0-host-run-ovn-kubernetes\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.289009 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.288914    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/47481dec-b718-4041-827a-aa8dd51a98d0-host-cni-netd\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.289009 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.288957    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/47481dec-b718-4041-827a-aa8dd51a98d0-run-ovn\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.289009 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.288985    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54tvs\" (UniqueName: \"kubernetes.io/projected/35c37798-a9dc-419f-b80a-b3dd9ed22caa-kube-api-access-54tvs\") pod \"iptables-alerter-2t558\" (UID: \"35c37798-a9dc-419f-b80a-b3dd9ed22caa\") " pod="openshift-network-operator/iptables-alerter-2t558"
Sep 16 01:15:53.289009 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.289014    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/47481dec-b718-4041-827a-aa8dd51a98d0-host-slash\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.289591 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.289038    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sblwj\" (UniqueName: \"kubernetes.io/projected/47481dec-b718-4041-827a-aa8dd51a98d0-kube-api-access-sblwj\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.289591 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.289065    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47481dec-b718-4041-827a-aa8dd51a98d0-run-openvswitch\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.289591 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.289093    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47481dec-b718-4041-827a-aa8dd51a98d0-etc-openvswitch\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.289591 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.289116    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/47481dec-b718-4041-827a-aa8dd51a98d0-ovnkube-config\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.289591 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.289143    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/47481dec-b718-4041-827a-aa8dd51a98d0-env-overrides\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.289591 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.289169    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/47481dec-b718-4041-827a-aa8dd51a98d0-ovn-node-metrics-cert\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.289591 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.289170    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/47481dec-b718-4041-827a-aa8dd51a98d0-host-slash\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.289591 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.289219    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/47481dec-b718-4041-827a-aa8dd51a98d0-node-log\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.289591 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.289245    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/47481dec-b718-4041-827a-aa8dd51a98d0-host-kubelet\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.289591 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.289252    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/47481dec-b718-4041-827a-aa8dd51a98d0-ovnkube-script-lib\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.289591 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.289317    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/47481dec-b718-4041-827a-aa8dd51a98d0-run-ovn\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.289591 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.289328    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/47481dec-b718-4041-827a-aa8dd51a98d0-node-log\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.289591 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.289348    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/47481dec-b718-4041-827a-aa8dd51a98d0-host-cni-netd\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.289591 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.289379    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/47481dec-b718-4041-827a-aa8dd51a98d0-host-kubelet\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.289591 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.289514    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/35c37798-a9dc-419f-b80a-b3dd9ed22caa-iptables-alerter-script\") pod \"iptables-alerter-2t558\" (UID: \"35c37798-a9dc-419f-b80a-b3dd9ed22caa\") " pod="openshift-network-operator/iptables-alerter-2t558"
Sep 16 01:15:53.289591 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.289526    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47481dec-b718-4041-827a-aa8dd51a98d0-etc-openvswitch\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.289591 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.289568    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47481dec-b718-4041-827a-aa8dd51a98d0-run-openvswitch\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.290407 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.289815    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/47481dec-b718-4041-827a-aa8dd51a98d0-env-overrides\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.290407 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.289860    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/47481dec-b718-4041-827a-aa8dd51a98d0-ovnkube-config\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.291987 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.291961    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/47481dec-b718-4041-827a-aa8dd51a98d0-ovn-node-metrics-cert\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.297280 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.297251    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54tvs\" (UniqueName: \"kubernetes.io/projected/35c37798-a9dc-419f-b80a-b3dd9ed22caa-kube-api-access-54tvs\") pod \"iptables-alerter-2t558\" (UID: \"35c37798-a9dc-419f-b80a-b3dd9ed22caa\") " pod="openshift-network-operator/iptables-alerter-2t558"
Sep 16 01:15:53.297876 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.297856    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sblwj\" (UniqueName: \"kubernetes.io/projected/47481dec-b718-4041-827a-aa8dd51a98d0-kube-api-access-sblwj\") pod \"ovnkube-node-fqnhz\" (UID: \"47481dec-b718-4041-827a-aa8dd51a98d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.368874 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.368837    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dksqw"
Sep 16 01:15:53.379293 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.379267    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h9vzm"
Sep 16 01:15:53.389073 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.389048    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z24pg"
Sep 16 01:15:53.395129 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.395105    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bxmkv"
Sep 16 01:15:53.403142 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.403120    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t9knx"
Sep 16 01:15:53.411850 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.411825    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hvsv"
Sep 16 01:15:53.423769 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.423743    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wzt2x"
Sep 16 01:15:53.431780 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.431757    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2t558"
Sep 16 01:15:53.439670 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.439648    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:15:53.693804 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.693763    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4112bee2-636b-4e14-a5ba-fd2bb43fffaf-metrics-certs\") pod \"network-metrics-daemon-lxzjg\" (UID: \"4112bee2-636b-4e14-a5ba-fd2bb43fffaf\") " pod="openshift-multus/network-metrics-daemon-lxzjg"
Sep 16 01:15:53.694027 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.693825    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7c423cc-710d-49fa-835f-518fc794dfb0-original-pull-secret\") pod \"global-pull-secret-syncer-vzwdx\" (UID: \"f7c423cc-710d-49fa-835f-518fc794dfb0\") " pod="kube-system/global-pull-secret-syncer-vzwdx"
Sep 16 01:15:53.694027 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:53.693948    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 01:15:53.694027 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:53.694015    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7c423cc-710d-49fa-835f-518fc794dfb0-original-pull-secret podName:f7c423cc-710d-49fa-835f-518fc794dfb0 nodeName:}" failed. No retries permitted until 2026-09-16 01:15:54.69399399 +0000 UTC m=+4.017462561 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7c423cc-710d-49fa-835f-518fc794dfb0-original-pull-secret") pod "global-pull-secret-syncer-vzwdx" (UID: "f7c423cc-710d-49fa-835f-518fc794dfb0") : object "kube-system"/"original-pull-secret" not registered
Sep 16 01:15:53.694190 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:53.693948    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 01:15:53.694190 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:53.694108    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4112bee2-636b-4e14-a5ba-fd2bb43fffaf-metrics-certs podName:4112bee2-636b-4e14-a5ba-fd2bb43fffaf nodeName:}" failed. No retries permitted until 2026-09-16 01:15:54.694084865 +0000 UTC m=+4.017553435 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4112bee2-636b-4e14-a5ba-fd2bb43fffaf-metrics-certs") pod "network-metrics-daemon-lxzjg" (UID: "4112bee2-636b-4e14-a5ba-fd2bb43fffaf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 01:15:53.794861 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:53.794816    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl2ft\" (UniqueName: \"kubernetes.io/projected/8519201e-63ce-4c38-a45a-b9e0624fd8b5-kube-api-access-sl2ft\") pod \"network-check-target-gvqfk\" (UID: \"8519201e-63ce-4c38-a45a-b9e0624fd8b5\") " pod="openshift-network-diagnostics/network-check-target-gvqfk"
Sep 16 01:15:53.795054 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:53.795035    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 01:15:53.795103 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:53.795062    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 01:15:53.795103 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:53.795073    2565 projected.go:196] Error preparing data for projected volume kube-api-access-sl2ft for pod openshift-network-diagnostics/network-check-target-gvqfk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 01:15:53.795183 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:53.795156    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8519201e-63ce-4c38-a45a-b9e0624fd8b5-kube-api-access-sl2ft podName:8519201e-63ce-4c38-a45a-b9e0624fd8b5 nodeName:}" failed. No retries permitted until 2026-09-16 01:15:54.795135138 +0000 UTC m=+4.118603711 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-sl2ft" (UniqueName: "kubernetes.io/projected/8519201e-63ce-4c38-a45a-b9e0624fd8b5-kube-api-access-sl2ft") pod "network-check-target-gvqfk" (UID: "8519201e-63ce-4c38-a45a-b9e0624fd8b5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 01:15:54.112871 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:54.112764    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-15 01:10:53 +0000 UTC" deadline="2028-03-31 10:53:08.412282744 +0000 UTC"
Sep 16 01:15:54.112871 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:54.112818    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13497h37m14.299468859s"
Sep 16 01:15:54.163450 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:54.163361    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxzjg"
Sep 16 01:15:54.163628 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:54.163578    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxzjg" podUID="4112bee2-636b-4e14-a5ba-fd2bb43fffaf"
Sep 16 01:15:54.308183 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:54.307604    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd141010c_add9_48d2_8171_49f314ea3938.slice/crio-edde6a19dceb7d0a67f487cecfba0f1924128afa05665b76123213e3fc60ec81 WatchSource:0}: Error finding container edde6a19dceb7d0a67f487cecfba0f1924128afa05665b76123213e3fc60ec81: Status 404 returned error can't find the container with id edde6a19dceb7d0a67f487cecfba0f1924128afa05665b76123213e3fc60ec81
Sep 16 01:15:54.310495 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:54.310439    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47481dec_b718_4041_827a_aa8dd51a98d0.slice/crio-c693e3d8d0fb16869d80cb24b53c6df6d1bc8fbad3150c46072688487597c5e2 WatchSource:0}: Error finding container c693e3d8d0fb16869d80cb24b53c6df6d1bc8fbad3150c46072688487597c5e2: Status 404 returned error can't find the container with id c693e3d8d0fb16869d80cb24b53c6df6d1bc8fbad3150c46072688487597c5e2
Sep 16 01:15:54.314681 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:54.314654    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcec37c8f_d1ef_47fc_9e34_58c4f9c4e26d.slice/crio-f06d9e547803ecb593dff2229d9ddadce07fca00b2c5453eb70d028ba67b7dcf WatchSource:0}: Error finding container f06d9e547803ecb593dff2229d9ddadce07fca00b2c5453eb70d028ba67b7dcf: Status 404 returned error can't find the container with id f06d9e547803ecb593dff2229d9ddadce07fca00b2c5453eb70d028ba67b7dcf
Sep 16 01:15:54.316717 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:54.316690    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c405cb2_c373_496e_84e5_055abf68c46c.slice/crio-3d2921d4df8d52fbdd73ce96a56f49b5abe6bbdb65fc63d9fc664521c17547ba WatchSource:0}: Error finding container 3d2921d4df8d52fbdd73ce96a56f49b5abe6bbdb65fc63d9fc664521c17547ba: Status 404 returned error can't find the container with id 3d2921d4df8d52fbdd73ce96a56f49b5abe6bbdb65fc63d9fc664521c17547ba
Sep 16 01:15:54.318171 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:54.318139    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35c37798_a9dc_419f_b80a_b3dd9ed22caa.slice/crio-9e8ff424ab5bd67e32fb3af4ae3246cb578b491b70d4b04fed768b726a103c3f WatchSource:0}: Error finding container 9e8ff424ab5bd67e32fb3af4ae3246cb578b491b70d4b04fed768b726a103c3f: Status 404 returned error can't find the container with id 9e8ff424ab5bd67e32fb3af4ae3246cb578b491b70d4b04fed768b726a103c3f
Sep 16 01:15:54.319429 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:54.319390    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3078201b_cbfe_423a_9505_d7431f30c7c7.slice/crio-ecaea08bcebfa2bd2ec9c2abfcbc56a44c4440a1319651f6f24426391e47f45c WatchSource:0}: Error finding container ecaea08bcebfa2bd2ec9c2abfcbc56a44c4440a1319651f6f24426391e47f45c: Status 404 returned error can't find the container with id ecaea08bcebfa2bd2ec9c2abfcbc56a44c4440a1319651f6f24426391e47f45c
Sep 16 01:15:54.320489 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:54.319967    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5fdc95b_8eaa_401f_a9a9_50bea6a5ffc8.slice/crio-0552cf42f059d841def85b02f35b5d33cdaf3050589985fc591c2fb01e330fab WatchSource:0}: Error finding container 0552cf42f059d841def85b02f35b5d33cdaf3050589985fc591c2fb01e330fab: Status 404 returned error can't find the container with id 0552cf42f059d841def85b02f35b5d33cdaf3050589985fc591c2fb01e330fab
Sep 16 01:15:54.321148 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:54.321127    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63a0c126_4c73_480d_aa3c_6de4e96c4b69.slice/crio-59e4dff431a39856f76f5eee5013cc3729cdc2e7b95107b03b398464bbec1c8b WatchSource:0}: Error finding container 59e4dff431a39856f76f5eee5013cc3729cdc2e7b95107b03b398464bbec1c8b: Status 404 returned error can't find the container with id 59e4dff431a39856f76f5eee5013cc3729cdc2e7b95107b03b398464bbec1c8b
Sep 16 01:15:54.324084 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:15:54.322888    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b5e1f55_e4cc_46aa_919c_c50324c38ce0.slice/crio-dfb60e39a33387139d5371f952d12648457a481b9f2e8803da6764ffba03e9f3 WatchSource:0}: Error finding container dfb60e39a33387139d5371f952d12648457a481b9f2e8803da6764ffba03e9f3: Status 404 returned error can't find the container with id dfb60e39a33387139d5371f952d12648457a481b9f2e8803da6764ffba03e9f3
Sep 16 01:15:54.702197 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:54.701981    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4112bee2-636b-4e14-a5ba-fd2bb43fffaf-metrics-certs\") pod \"network-metrics-daemon-lxzjg\" (UID: \"4112bee2-636b-4e14-a5ba-fd2bb43fffaf\") " pod="openshift-multus/network-metrics-daemon-lxzjg"
Sep 16 01:15:54.702410 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:54.702221    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7c423cc-710d-49fa-835f-518fc794dfb0-original-pull-secret\") pod \"global-pull-secret-syncer-vzwdx\" (UID: \"f7c423cc-710d-49fa-835f-518fc794dfb0\") " pod="kube-system/global-pull-secret-syncer-vzwdx"
Sep 16 01:15:54.702410 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:54.702146    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 01:15:54.702410 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:54.702361    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 01:15:54.702410 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:54.702374    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4112bee2-636b-4e14-a5ba-fd2bb43fffaf-metrics-certs podName:4112bee2-636b-4e14-a5ba-fd2bb43fffaf nodeName:}" failed. No retries permitted until 2026-09-16 01:15:56.702352141 +0000 UTC m=+6.025820711 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4112bee2-636b-4e14-a5ba-fd2bb43fffaf-metrics-certs") pod "network-metrics-daemon-lxzjg" (UID: "4112bee2-636b-4e14-a5ba-fd2bb43fffaf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 01:15:54.702621 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:54.702414    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7c423cc-710d-49fa-835f-518fc794dfb0-original-pull-secret podName:f7c423cc-710d-49fa-835f-518fc794dfb0 nodeName:}" failed. No retries permitted until 2026-09-16 01:15:56.702403667 +0000 UTC m=+6.025872242 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7c423cc-710d-49fa-835f-518fc794dfb0-original-pull-secret") pod "global-pull-secret-syncer-vzwdx" (UID: "f7c423cc-710d-49fa-835f-518fc794dfb0") : object "kube-system"/"original-pull-secret" not registered
Sep 16 01:15:54.803984 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:54.803575    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl2ft\" (UniqueName: \"kubernetes.io/projected/8519201e-63ce-4c38-a45a-b9e0624fd8b5-kube-api-access-sl2ft\") pod \"network-check-target-gvqfk\" (UID: \"8519201e-63ce-4c38-a45a-b9e0624fd8b5\") " pod="openshift-network-diagnostics/network-check-target-gvqfk"
Sep 16 01:15:54.803984 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:54.803750    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 01:15:54.803984 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:54.803772    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 01:15:54.803984 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:54.803787    2565 projected.go:196] Error preparing data for projected volume kube-api-access-sl2ft for pod openshift-network-diagnostics/network-check-target-gvqfk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 01:15:54.803984 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:54.803851    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8519201e-63ce-4c38-a45a-b9e0624fd8b5-kube-api-access-sl2ft podName:8519201e-63ce-4c38-a45a-b9e0624fd8b5 nodeName:}" failed. No retries permitted until 2026-09-16 01:15:56.803832771 +0000 UTC m=+6.127301331 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-sl2ft" (UniqueName: "kubernetes.io/projected/8519201e-63ce-4c38-a45a-b9e0624fd8b5-kube-api-access-sl2ft") pod "network-check-target-gvqfk" (UID: "8519201e-63ce-4c38-a45a-b9e0624fd8b5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 01:15:55.113505 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:55.113359    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-15 01:10:53 +0000 UTC" deadline="2028-05-04 14:43:13.119227607 +0000 UTC"
Sep 16 01:15:55.113505 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:55.113424    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14317h27m18.005808867s"
Sep 16 01:15:55.164564 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:55.164526    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzwdx"
Sep 16 01:15:55.164744 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:55.164665    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzwdx" podUID="f7c423cc-710d-49fa-835f-518fc794dfb0"
Sep 16 01:15:55.165518 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:55.165495    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvqfk"
Sep 16 01:15:55.165635 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:55.165603    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvqfk" podUID="8519201e-63ce-4c38-a45a-b9e0624fd8b5"
Sep 16 01:15:55.193024 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:55.192985    2565 generic.go:356] "Generic (PLEG): container finished" podID="10d8ee1502cbd13392fb8e9a4ec64b99" containerID="ae279c8b5b45084ad3d7b67ba6f853370415dc2cb32cbbda1cc93adf4b181278" exitCode=0
Sep 16 01:15:55.193198 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:55.193075    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.ec2.internal" event={"ID":"10d8ee1502cbd13392fb8e9a4ec64b99","Type":"ContainerDied","Data":"ae279c8b5b45084ad3d7b67ba6f853370415dc2cb32cbbda1cc93adf4b181278"}
Sep 16 01:15:55.203392 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:55.203300    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hvsv" event={"ID":"3078201b-cbfe-423a-9505-d7431f30c7c7","Type":"ContainerStarted","Data":"ecaea08bcebfa2bd2ec9c2abfcbc56a44c4440a1319651f6f24426391e47f45c"}
Sep 16 01:15:55.216647 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:55.216614    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dksqw" event={"ID":"cec37c8f-d1ef-47fc-9e34-58c4f9c4e26d","Type":"ContainerStarted","Data":"f06d9e547803ecb593dff2229d9ddadce07fca00b2c5453eb70d028ba67b7dcf"}
Sep 16 01:15:55.237121 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:55.237081    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz" event={"ID":"47481dec-b718-4041-827a-aa8dd51a98d0","Type":"ContainerStarted","Data":"c693e3d8d0fb16869d80cb24b53c6df6d1bc8fbad3150c46072688487597c5e2"}
Sep 16 01:15:55.252455 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:55.252394    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-225.ec2.internal" event={"ID":"dc733c4b3ec8f9e22d85736adcd9ed91","Type":"ContainerStarted","Data":"a20b42f3c6444abf5186010db373d43a022f29a5932c1783c903dd33ab0eda60"}
Sep 16 01:15:55.266344 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:55.266284    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-225.ec2.internal" podStartSLOduration=2.266252248 podStartE2EDuration="2.266252248s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 01:15:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:15:55.265768493 +0000 UTC m=+4.589237072" watchObservedRunningTime="2026-09-16 01:15:55.266252248 +0000 UTC m=+4.589720827"
Sep 16 01:15:55.278950 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:55.278795    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bxmkv" event={"ID":"63a0c126-4c73-480d-aa3c-6de4e96c4b69","Type":"ContainerStarted","Data":"59e4dff431a39856f76f5eee5013cc3729cdc2e7b95107b03b398464bbec1c8b"}
Sep 16 01:15:55.289124 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:55.288946    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t9knx" event={"ID":"d5fdc95b-8eaa-401f-a9a9-50bea6a5ffc8","Type":"ContainerStarted","Data":"0552cf42f059d841def85b02f35b5d33cdaf3050589985fc591c2fb01e330fab"}
Sep 16 01:15:55.297449 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:55.297400    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h9vzm" event={"ID":"9b5e1f55-e4cc-46aa-919c-c50324c38ce0","Type":"ContainerStarted","Data":"dfb60e39a33387139d5371f952d12648457a481b9f2e8803da6764ffba03e9f3"}
Sep 16 01:15:55.304903 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:55.304871    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2t558" event={"ID":"35c37798-a9dc-419f-b80a-b3dd9ed22caa","Type":"ContainerStarted","Data":"9e8ff424ab5bd67e32fb3af4ae3246cb578b491b70d4b04fed768b726a103c3f"}
Sep 16 01:15:55.315936 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:55.315857    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z24pg" event={"ID":"7c405cb2-c373-496e-84e5-055abf68c46c","Type":"ContainerStarted","Data":"3d2921d4df8d52fbdd73ce96a56f49b5abe6bbdb65fc63d9fc664521c17547ba"}
Sep 16 01:15:55.331582 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:55.331506    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wzt2x" event={"ID":"d141010c-add9-48d2-8171-49f314ea3938","Type":"ContainerStarted","Data":"edde6a19dceb7d0a67f487cecfba0f1924128afa05665b76123213e3fc60ec81"}
Sep 16 01:15:56.164113 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:56.164076    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxzjg"
Sep 16 01:15:56.164771 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:56.164249    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxzjg" podUID="4112bee2-636b-4e14-a5ba-fd2bb43fffaf"
Sep 16 01:15:56.343280 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:56.343235    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.ec2.internal" event={"ID":"10d8ee1502cbd13392fb8e9a4ec64b99","Type":"ContainerStarted","Data":"65f71b03b17a9b208797749b33bc5c906cd7cf0f103048dfada76df8aee26ea4"}
Sep 16 01:15:56.726328 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:56.726277    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7c423cc-710d-49fa-835f-518fc794dfb0-original-pull-secret\") pod \"global-pull-secret-syncer-vzwdx\" (UID: \"f7c423cc-710d-49fa-835f-518fc794dfb0\") " pod="kube-system/global-pull-secret-syncer-vzwdx"
Sep 16 01:15:56.726557 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:56.726416    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4112bee2-636b-4e14-a5ba-fd2bb43fffaf-metrics-certs\") pod \"network-metrics-daemon-lxzjg\" (UID: \"4112bee2-636b-4e14-a5ba-fd2bb43fffaf\") " pod="openshift-multus/network-metrics-daemon-lxzjg"
Sep 16 01:15:56.726624 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:56.726560    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 01:15:56.726681 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:56.726629    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4112bee2-636b-4e14-a5ba-fd2bb43fffaf-metrics-certs podName:4112bee2-636b-4e14-a5ba-fd2bb43fffaf nodeName:}" failed. No retries permitted until 2026-09-16 01:16:00.726608277 +0000 UTC m=+10.050076840 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4112bee2-636b-4e14-a5ba-fd2bb43fffaf-metrics-certs") pod "network-metrics-daemon-lxzjg" (UID: "4112bee2-636b-4e14-a5ba-fd2bb43fffaf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 01:15:56.727238 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:56.727092    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 01:15:56.727238 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:56.727154    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7c423cc-710d-49fa-835f-518fc794dfb0-original-pull-secret podName:f7c423cc-710d-49fa-835f-518fc794dfb0 nodeName:}" failed. No retries permitted until 2026-09-16 01:16:00.727136362 +0000 UTC m=+10.050604921 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7c423cc-710d-49fa-835f-518fc794dfb0-original-pull-secret") pod "global-pull-secret-syncer-vzwdx" (UID: "f7c423cc-710d-49fa-835f-518fc794dfb0") : object "kube-system"/"original-pull-secret" not registered
Sep 16 01:15:56.827460 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:56.827417    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl2ft\" (UniqueName: \"kubernetes.io/projected/8519201e-63ce-4c38-a45a-b9e0624fd8b5-kube-api-access-sl2ft\") pod \"network-check-target-gvqfk\" (UID: \"8519201e-63ce-4c38-a45a-b9e0624fd8b5\") " pod="openshift-network-diagnostics/network-check-target-gvqfk"
Sep 16 01:15:56.827696 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:56.827645    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 01:15:56.827696 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:56.827670    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 01:15:56.827696 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:56.827682    2565 projected.go:196] Error preparing data for projected volume kube-api-access-sl2ft for pod openshift-network-diagnostics/network-check-target-gvqfk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 01:15:56.827899 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:56.827744    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8519201e-63ce-4c38-a45a-b9e0624fd8b5-kube-api-access-sl2ft podName:8519201e-63ce-4c38-a45a-b9e0624fd8b5 nodeName:}" failed. No retries permitted until 2026-09-16 01:16:00.827725325 +0000 UTC m=+10.151193901 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-sl2ft" (UniqueName: "kubernetes.io/projected/8519201e-63ce-4c38-a45a-b9e0624fd8b5-kube-api-access-sl2ft") pod "network-check-target-gvqfk" (UID: "8519201e-63ce-4c38-a45a-b9e0624fd8b5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 01:15:57.165991 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:57.165961    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzwdx"
Sep 16 01:15:57.166352 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:57.166094    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzwdx" podUID="f7c423cc-710d-49fa-835f-518fc794dfb0"
Sep 16 01:15:57.166535 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:57.166499    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvqfk"
Sep 16 01:15:57.166627 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:57.166603    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvqfk" podUID="8519201e-63ce-4c38-a45a-b9e0624fd8b5"
Sep 16 01:15:58.163544 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:58.163507    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxzjg"
Sep 16 01:15:58.163721 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:58.163668    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxzjg" podUID="4112bee2-636b-4e14-a5ba-fd2bb43fffaf"
Sep 16 01:15:59.163356 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:59.163305    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvqfk"
Sep 16 01:15:59.163832 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:59.163471    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvqfk" podUID="8519201e-63ce-4c38-a45a-b9e0624fd8b5"
Sep 16 01:15:59.163832 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:15:59.163490    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzwdx"
Sep 16 01:15:59.163832 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:15:59.163624    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzwdx" podUID="f7c423cc-710d-49fa-835f-518fc794dfb0"
Sep 16 01:16:00.163687 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:00.163628    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxzjg"
Sep 16 01:16:00.164306 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:00.163791    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxzjg" podUID="4112bee2-636b-4e14-a5ba-fd2bb43fffaf"
Sep 16 01:16:00.764939 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:00.764838    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7c423cc-710d-49fa-835f-518fc794dfb0-original-pull-secret\") pod \"global-pull-secret-syncer-vzwdx\" (UID: \"f7c423cc-710d-49fa-835f-518fc794dfb0\") " pod="kube-system/global-pull-secret-syncer-vzwdx"
Sep 16 01:16:00.765145 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:00.764947    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4112bee2-636b-4e14-a5ba-fd2bb43fffaf-metrics-certs\") pod \"network-metrics-daemon-lxzjg\" (UID: \"4112bee2-636b-4e14-a5ba-fd2bb43fffaf\") " pod="openshift-multus/network-metrics-daemon-lxzjg"
Sep 16 01:16:00.765145 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:00.765082    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 01:16:00.765259 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:00.765150    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4112bee2-636b-4e14-a5ba-fd2bb43fffaf-metrics-certs podName:4112bee2-636b-4e14-a5ba-fd2bb43fffaf nodeName:}" failed. No retries permitted until 2026-09-16 01:16:08.76512851 +0000 UTC m=+18.088597087 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4112bee2-636b-4e14-a5ba-fd2bb43fffaf-metrics-certs") pod "network-metrics-daemon-lxzjg" (UID: "4112bee2-636b-4e14-a5ba-fd2bb43fffaf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 01:16:00.765545 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:00.765456    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 01:16:00.765545 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:00.765525    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7c423cc-710d-49fa-835f-518fc794dfb0-original-pull-secret podName:f7c423cc-710d-49fa-835f-518fc794dfb0 nodeName:}" failed. No retries permitted until 2026-09-16 01:16:08.765506754 +0000 UTC m=+18.088975329 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7c423cc-710d-49fa-835f-518fc794dfb0-original-pull-secret") pod "global-pull-secret-syncer-vzwdx" (UID: "f7c423cc-710d-49fa-835f-518fc794dfb0") : object "kube-system"/"original-pull-secret" not registered
Sep 16 01:16:00.865533 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:00.865488    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl2ft\" (UniqueName: \"kubernetes.io/projected/8519201e-63ce-4c38-a45a-b9e0624fd8b5-kube-api-access-sl2ft\") pod \"network-check-target-gvqfk\" (UID: \"8519201e-63ce-4c38-a45a-b9e0624fd8b5\") " pod="openshift-network-diagnostics/network-check-target-gvqfk"
Sep 16 01:16:00.865699 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:00.865652    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 01:16:00.865699 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:00.865678    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 01:16:00.865699 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:00.865692    2565 projected.go:196] Error preparing data for projected volume kube-api-access-sl2ft for pod openshift-network-diagnostics/network-check-target-gvqfk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 01:16:00.865839 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:00.865752    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8519201e-63ce-4c38-a45a-b9e0624fd8b5-kube-api-access-sl2ft podName:8519201e-63ce-4c38-a45a-b9e0624fd8b5 nodeName:}" failed. No retries permitted until 2026-09-16 01:16:08.865730968 +0000 UTC m=+18.189199550 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-sl2ft" (UniqueName: "kubernetes.io/projected/8519201e-63ce-4c38-a45a-b9e0624fd8b5-kube-api-access-sl2ft") pod "network-check-target-gvqfk" (UID: "8519201e-63ce-4c38-a45a-b9e0624fd8b5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 01:16:01.163820 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:01.163785    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzwdx"
Sep 16 01:16:01.165521 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:01.165010    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvqfk"
Sep 16 01:16:01.165521 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:01.165126    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvqfk" podUID="8519201e-63ce-4c38-a45a-b9e0624fd8b5"
Sep 16 01:16:01.165700 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:01.165543    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzwdx" podUID="f7c423cc-710d-49fa-835f-518fc794dfb0"
Sep 16 01:16:02.163603 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:02.163561    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxzjg"
Sep 16 01:16:02.163789 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:02.163721    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxzjg" podUID="4112bee2-636b-4e14-a5ba-fd2bb43fffaf"
Sep 16 01:16:03.163536 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:03.163501    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzwdx"
Sep 16 01:16:03.163970 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:03.163501    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvqfk"
Sep 16 01:16:03.163970 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:03.163640    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzwdx" podUID="f7c423cc-710d-49fa-835f-518fc794dfb0"
Sep 16 01:16:03.163970 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:03.163757    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvqfk" podUID="8519201e-63ce-4c38-a45a-b9e0624fd8b5"
Sep 16 01:16:04.163695 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:04.163661    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxzjg"
Sep 16 01:16:04.164158 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:04.163786    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxzjg" podUID="4112bee2-636b-4e14-a5ba-fd2bb43fffaf"
Sep 16 01:16:05.163977 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:05.163939    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvqfk"
Sep 16 01:16:05.164414 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:05.164080    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvqfk" podUID="8519201e-63ce-4c38-a45a-b9e0624fd8b5"
Sep 16 01:16:05.164414 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:05.163939    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzwdx"
Sep 16 01:16:05.164560 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:05.164535    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzwdx" podUID="f7c423cc-710d-49fa-835f-518fc794dfb0"
Sep 16 01:16:06.163539 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:06.163505    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxzjg"
Sep 16 01:16:06.163717 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:06.163623    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxzjg" podUID="4112bee2-636b-4e14-a5ba-fd2bb43fffaf"
Sep 16 01:16:07.163130 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:07.163099    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzwdx"
Sep 16 01:16:07.163569 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:07.163226    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzwdx" podUID="f7c423cc-710d-49fa-835f-518fc794dfb0"
Sep 16 01:16:07.163569 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:07.163289    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvqfk"
Sep 16 01:16:07.163569 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:07.163417    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvqfk" podUID="8519201e-63ce-4c38-a45a-b9e0624fd8b5"
Sep 16 01:16:08.163849 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:08.163813    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxzjg"
Sep 16 01:16:08.164290 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:08.163952    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxzjg" podUID="4112bee2-636b-4e14-a5ba-fd2bb43fffaf"
Sep 16 01:16:08.829173 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:08.829154    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7c423cc-710d-49fa-835f-518fc794dfb0-original-pull-secret\") pod \"global-pull-secret-syncer-vzwdx\" (UID: \"f7c423cc-710d-49fa-835f-518fc794dfb0\") " pod="kube-system/global-pull-secret-syncer-vzwdx"
Sep 16 01:16:08.829236 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:08.829202    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4112bee2-636b-4e14-a5ba-fd2bb43fffaf-metrics-certs\") pod \"network-metrics-daemon-lxzjg\" (UID: \"4112bee2-636b-4e14-a5ba-fd2bb43fffaf\") " pod="openshift-multus/network-metrics-daemon-lxzjg"
Sep 16 01:16:08.829288 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:08.829277    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 01:16:08.829332 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:08.829289    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 01:16:08.829332 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:08.829323    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4112bee2-636b-4e14-a5ba-fd2bb43fffaf-metrics-certs podName:4112bee2-636b-4e14-a5ba-fd2bb43fffaf nodeName:}" failed. No retries permitted until 2026-09-16 01:16:24.829310422 +0000 UTC m=+34.152778976 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4112bee2-636b-4e14-a5ba-fd2bb43fffaf-metrics-certs") pod "network-metrics-daemon-lxzjg" (UID: "4112bee2-636b-4e14-a5ba-fd2bb43fffaf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 01:16:08.829430 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:08.829355    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7c423cc-710d-49fa-835f-518fc794dfb0-original-pull-secret podName:f7c423cc-710d-49fa-835f-518fc794dfb0 nodeName:}" failed. No retries permitted until 2026-09-16 01:16:24.829329429 +0000 UTC m=+34.152797984 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7c423cc-710d-49fa-835f-518fc794dfb0-original-pull-secret") pod "global-pull-secret-syncer-vzwdx" (UID: "f7c423cc-710d-49fa-835f-518fc794dfb0") : object "kube-system"/"original-pull-secret" not registered
Sep 16 01:16:08.929548 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:08.929526    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl2ft\" (UniqueName: \"kubernetes.io/projected/8519201e-63ce-4c38-a45a-b9e0624fd8b5-kube-api-access-sl2ft\") pod \"network-check-target-gvqfk\" (UID: \"8519201e-63ce-4c38-a45a-b9e0624fd8b5\") " pod="openshift-network-diagnostics/network-check-target-gvqfk"
Sep 16 01:16:08.929646 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:08.929626    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 01:16:08.929646 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:08.929638    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 01:16:08.929646 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:08.929647    2565 projected.go:196] Error preparing data for projected volume kube-api-access-sl2ft for pod openshift-network-diagnostics/network-check-target-gvqfk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 01:16:08.929759 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:08.929684    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8519201e-63ce-4c38-a45a-b9e0624fd8b5-kube-api-access-sl2ft podName:8519201e-63ce-4c38-a45a-b9e0624fd8b5 nodeName:}" failed. No retries permitted until 2026-09-16 01:16:24.929674231 +0000 UTC m=+34.253142786 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-sl2ft" (UniqueName: "kubernetes.io/projected/8519201e-63ce-4c38-a45a-b9e0624fd8b5-kube-api-access-sl2ft") pod "network-check-target-gvqfk" (UID: "8519201e-63ce-4c38-a45a-b9e0624fd8b5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 01:16:09.163986 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:09.163952    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzwdx"
Sep 16 01:16:09.164500 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:09.163952    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvqfk"
Sep 16 01:16:09.164500 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:09.164093    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzwdx" podUID="f7c423cc-710d-49fa-835f-518fc794dfb0"
Sep 16 01:16:09.164500 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:09.164172    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvqfk" podUID="8519201e-63ce-4c38-a45a-b9e0624fd8b5"
Sep 16 01:16:10.163237 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:10.163209    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxzjg"
Sep 16 01:16:10.163422 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:10.163371    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxzjg" podUID="4112bee2-636b-4e14-a5ba-fd2bb43fffaf"
Sep 16 01:16:11.164284 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:11.164252    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzwdx"
Sep 16 01:16:11.164692 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:11.164330    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvqfk"
Sep 16 01:16:11.164692 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:11.164358    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzwdx" podUID="f7c423cc-710d-49fa-835f-518fc794dfb0"
Sep 16 01:16:11.164692 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:11.164441    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvqfk" podUID="8519201e-63ce-4c38-a45a-b9e0624fd8b5"
Sep 16 01:16:12.163991 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:12.163959    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxzjg"
Sep 16 01:16:12.164154 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:12.164084    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxzjg" podUID="4112bee2-636b-4e14-a5ba-fd2bb43fffaf"
Sep 16 01:16:13.164392 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:13.164084    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzwdx"
Sep 16 01:16:13.164948 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:13.164155    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvqfk"
Sep 16 01:16:13.164948 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:13.164466    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzwdx" podUID="f7c423cc-710d-49fa-835f-518fc794dfb0"
Sep 16 01:16:13.164948 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:13.164541    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvqfk" podUID="8519201e-63ce-4c38-a45a-b9e0624fd8b5"
Sep 16 01:16:13.382095 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:13.382066    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bxmkv" event={"ID":"63a0c126-4c73-480d-aa3c-6de4e96c4b69","Type":"ContainerStarted","Data":"9f7ef813c0fc7f9ccd86915302a3d79aaf12bd820de525f7571d4e3e50f1e66c"}
Sep 16 01:16:13.383347 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:13.383316    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t9knx" event={"ID":"d5fdc95b-8eaa-401f-a9a9-50bea6a5ffc8","Type":"ContainerStarted","Data":"34b16552b2b0a1003ca12fd0a39465bd2f798a455749059176386d466c43d171"}
Sep 16 01:16:13.384682 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:13.384654    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h9vzm" event={"ID":"9b5e1f55-e4cc-46aa-919c-c50324c38ce0","Type":"ContainerStarted","Data":"40dc9cfd073c9905223ba154ca1a0a63cb0025b0db0328abdff934604bb82c2d"}
Sep 16 01:16:13.386153 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:13.386131    2565 generic.go:356] "Generic (PLEG): container finished" podID="7c405cb2-c373-496e-84e5-055abf68c46c" containerID="0064ca5b5118ae71f099214e500cd8e6b51109baa0f1911f52166fc13fbf4af8" exitCode=0
Sep 16 01:16:13.386246 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:13.386210    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z24pg" event={"ID":"7c405cb2-c373-496e-84e5-055abf68c46c","Type":"ContainerDied","Data":"0064ca5b5118ae71f099214e500cd8e6b51109baa0f1911f52166fc13fbf4af8"}
Sep 16 01:16:13.387739 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:13.387723    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wzt2x" event={"ID":"d141010c-add9-48d2-8171-49f314ea3938","Type":"ContainerStarted","Data":"37458f57a25d7f377924898d122fb7f708468c09031e756b88981e30edf04bba"}
Sep 16 01:16:13.389241 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:13.389222    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hvsv" event={"ID":"3078201b-cbfe-423a-9505-d7431f30c7c7","Type":"ContainerStarted","Data":"807afdcf9976523f2b135549a90bb7859ad543bcad5e30438a1dd2c7a75376b2"}
Sep 16 01:16:13.390637 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:13.390606    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dksqw" event={"ID":"cec37c8f-d1ef-47fc-9e34-58c4f9c4e26d","Type":"ContainerStarted","Data":"20d5edec465729b34fa8469c33b6dbab282e64ee0673a4e6b18b9baa511fc0e8"}
Sep 16 01:16:13.393775 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:13.393755    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz" event={"ID":"47481dec-b718-4041-827a-aa8dd51a98d0","Type":"ContainerStarted","Data":"fa7cbfffea641aa77cf4629718505655d36f5be681c30808efb7d37dc8f914de"}
Sep 16 01:16:13.393857 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:13.393815    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz" event={"ID":"47481dec-b718-4041-827a-aa8dd51a98d0","Type":"ContainerStarted","Data":"6a0432b0df7807d9f140cb7000c2b8ccecf3fb8a3e7fb3faa824379effd16614"}
Sep 16 01:16:13.393857 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:13.393847    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz" event={"ID":"47481dec-b718-4041-827a-aa8dd51a98d0","Type":"ContainerStarted","Data":"71bdebfb51b10d9de65a581082ea64221abbde40b035f56502163feba9fdd4b9"}
Sep 16 01:16:13.393929 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:13.393874    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz" event={"ID":"47481dec-b718-4041-827a-aa8dd51a98d0","Type":"ContainerStarted","Data":"429c94bb1d4cb38c14134b59065fb484e8e979ef8482449e3efb3566a4a0f314"}
Sep 16 01:16:13.393929 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:13.393909    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz" event={"ID":"47481dec-b718-4041-827a-aa8dd51a98d0","Type":"ContainerStarted","Data":"48d0d1a8fde13a7ed5dfd108f4a5db71ff13e48fb51b3fefad6208ef2ce15425"}
Sep 16 01:16:13.393993 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:13.393935    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz" event={"ID":"47481dec-b718-4041-827a-aa8dd51a98d0","Type":"ContainerStarted","Data":"6aa1ffaf476122e2f2fad5657335d74029c63a135f5b745a9690aaead98798d0"}
Sep 16 01:16:13.397733 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:13.397693    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.ec2.internal" podStartSLOduration=20.397677631 podStartE2EDuration="20.397677631s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 01:15:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:15:56.358702159 +0000 UTC m=+5.682170739" watchObservedRunningTime="2026-09-16 01:16:13.397677631 +0000 UTC m=+22.721146208"
Sep 16 01:16:13.421651 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:13.421607    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-h9vzm" podStartSLOduration=3.159682321 podStartE2EDuration="21.421590147s" totalImagesPullingTime="18.261907826s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 01:15:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:16:13.421424145 +0000 UTC m=+22.744892721" watchObservedRunningTime="2026-09-16 01:16:13.421590147 +0000 UTC m=+22.745058723"
Sep 16 01:16:13.421868 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:13.421842    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-bxmkv" podStartSLOduration=2.82108962 podStartE2EDuration="21.421791344s" totalImagesPullingTime="18.600701724s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 01:15:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:16:13.404808831 +0000 UTC m=+22.728277407" watchObservedRunningTime="2026-09-16 01:16:13.421791344 +0000 UTC m=+22.745259914"
Sep 16 01:16:13.453774 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:13.453735    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-t9knx" podStartSLOduration=3.272290434 podStartE2EDuration="21.453722989s" totalImagesPullingTime="18.181432555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:15:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:16:13.453071099 +0000 UTC m=+22.776539676" watchObservedRunningTime="2026-09-16 01:16:13.453722989 +0000 UTC m=+22.777191564"
Sep 16 01:16:13.466070 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:13.466021    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dksqw" podStartSLOduration=3.195772553 podStartE2EDuration="21.466011338s" totalImagesPullingTime="18.270238785s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 01:15:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:16:13.465868943 +0000 UTC m=+22.789337520" watchObservedRunningTime="2026-09-16 01:16:13.466011338 +0000 UTC m=+22.789479913"
Sep 16 01:16:13.481251 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:13.481219    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wzt2x" podStartSLOduration=3.201189126 podStartE2EDuration="21.48120941s" totalImagesPullingTime="18.280020284s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 01:15:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:16:13.481032647 +0000 UTC m=+22.804501222" watchObservedRunningTime="2026-09-16 01:16:13.48120941 +0000 UTC m=+22.804677986"
Sep 16 01:16:14.164033 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:14.164008    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxzjg"
Sep 16 01:16:14.164178 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:14.164119    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxzjg" podUID="4112bee2-636b-4e14-a5ba-fd2bb43fffaf"
Sep 16 01:16:14.235829 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:14.235803    2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 16 01:16:14.397385 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:14.397300    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2t558" event={"ID":"35c37798-a9dc-419f-b80a-b3dd9ed22caa","Type":"ContainerStarted","Data":"6c603b11d1ca7db43e1333be3bf7a7f08c91e075f651378fc3d77738a0a07eda"}
Sep 16 01:16:14.399375 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:14.399347    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hvsv" event={"ID":"3078201b-cbfe-423a-9505-d7431f30c7c7","Type":"ContainerStarted","Data":"9b26ce7ceb7bd1c60a6fe0facb0a80c9ea583bd0c1a285045d28d49d3ff19eb5"}
Sep 16 01:16:14.410641 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:14.410602    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2t558" podStartSLOduration=4.138900292 podStartE2EDuration="22.410587897s" totalImagesPullingTime="18.271687605s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 01:15:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:16:14.410296764 +0000 UTC m=+23.733765340" watchObservedRunningTime="2026-09-16 01:16:14.410587897 +0000 UTC m=+23.734056492"
Sep 16 01:16:15.138324 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:15.138228    2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-16T01:16:14.235823952Z","UUID":"93616959-7bae-442e-a2a7-00db5e956faa","Handler":null,"Name":"","Endpoint":""}
Sep 16 01:16:15.139985 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:15.139951    2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 16 01:16:15.139985 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:15.139984    2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 16 01:16:15.163803 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:15.163777    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzwdx"
Sep 16 01:16:15.163803 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:15.163788    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvqfk"
Sep 16 01:16:15.163966 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:15.163898    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvqfk" podUID="8519201e-63ce-4c38-a45a-b9e0624fd8b5"
Sep 16 01:16:15.164051 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:15.164030    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzwdx" podUID="f7c423cc-710d-49fa-835f-518fc794dfb0"
Sep 16 01:16:15.404288 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:15.404252    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hvsv" event={"ID":"3078201b-cbfe-423a-9505-d7431f30c7c7","Type":"ContainerStarted","Data":"3a7b5dfbb116a4c5d65de59ac78c965245a69251a3e7092911c9b276a6b00776"}
Sep 16 01:16:15.423103 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:15.423053    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hvsv" podStartSLOduration=2.972147724 podStartE2EDuration="23.423039047s" totalImagesPullingTime="20.450891323s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 01:15:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:16:15.422698957 +0000 UTC m=+24.746167541" watchObservedRunningTime="2026-09-16 01:16:15.423039047 +0000 UTC m=+24.746507622"
Sep 16 01:16:16.163850 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:16.163818    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxzjg"
Sep 16 01:16:16.163997 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:16.163929    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxzjg" podUID="4112bee2-636b-4e14-a5ba-fd2bb43fffaf"
Sep 16 01:16:16.410056 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:16.409864    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz" event={"ID":"47481dec-b718-4041-827a-aa8dd51a98d0","Type":"ContainerStarted","Data":"b35a6ba80a961962d807703e25664780bc56fab8ac91e55b7556872f232e66e5"}
Sep 16 01:16:17.163766 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:17.163732    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzwdx"
Sep 16 01:16:17.163937 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:17.163732    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvqfk"
Sep 16 01:16:17.163937 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:17.163861    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzwdx" podUID="f7c423cc-710d-49fa-835f-518fc794dfb0"
Sep 16 01:16:17.164068 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:17.163933    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvqfk" podUID="8519201e-63ce-4c38-a45a-b9e0624fd8b5"
Sep 16 01:16:17.189987 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:17.189964    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-t9knx"
Sep 16 01:16:17.190911 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:17.190881    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-t9knx"
Sep 16 01:16:17.411836 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:17.411807    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-t9knx"
Sep 16 01:16:17.412284 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:17.412253    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-t9knx"
Sep 16 01:16:18.163403 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:18.163223    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxzjg"
Sep 16 01:16:18.163525 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:18.163474    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxzjg" podUID="4112bee2-636b-4e14-a5ba-fd2bb43fffaf"
Sep 16 01:16:18.415405 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:18.415378    2565 generic.go:356] "Generic (PLEG): container finished" podID="7c405cb2-c373-496e-84e5-055abf68c46c" containerID="2afa446571909b585d523c49e1826259e525c78e26c319f86a4e4279ba8c0fc5" exitCode=0
Sep 16 01:16:18.415788 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:18.415464    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z24pg" event={"ID":"7c405cb2-c373-496e-84e5-055abf68c46c","Type":"ContainerDied","Data":"2afa446571909b585d523c49e1826259e525c78e26c319f86a4e4279ba8c0fc5"}
Sep 16 01:16:18.419305 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:18.419284    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz" event={"ID":"47481dec-b718-4041-827a-aa8dd51a98d0","Type":"ContainerStarted","Data":"0ca49bdb8bff5b43c287406d92c55ce999561cc3555ab294b3314533a8ab2054"}
Sep 16 01:16:18.419568 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:18.419555    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:16:18.434184 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:18.434166    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:16:18.455667 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:18.455624    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz" podStartSLOduration=8.180557298 podStartE2EDuration="26.455611797s" totalImagesPullingTime="18.275054499s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 01:15:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:16:18.454081909 +0000 UTC m=+27.777550485" watchObservedRunningTime="2026-09-16 01:16:18.455611797 +0000 UTC m=+27.779080373"
Sep 16 01:16:19.163975 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:19.163945    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzwdx"
Sep 16 01:16:19.164225 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:19.163951    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvqfk"
Sep 16 01:16:19.164225 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:19.164087    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzwdx" podUID="f7c423cc-710d-49fa-835f-518fc794dfb0"
Sep 16 01:16:19.164225 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:19.164142    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvqfk" podUID="8519201e-63ce-4c38-a45a-b9e0624fd8b5"
Sep 16 01:16:19.423462 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:19.423376    2565 generic.go:356] "Generic (PLEG): container finished" podID="7c405cb2-c373-496e-84e5-055abf68c46c" containerID="aa4bbdb41be4859b8a10f29bec80755a963381dbba6ea32d5fc0961605d9621a" exitCode=0
Sep 16 01:16:19.423992 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:19.423463    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z24pg" event={"ID":"7c405cb2-c373-496e-84e5-055abf68c46c","Type":"ContainerDied","Data":"aa4bbdb41be4859b8a10f29bec80755a963381dbba6ea32d5fc0961605d9621a"}
Sep 16 01:16:19.424164 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:19.424091    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:16:19.424164 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:19.424155    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:16:19.439015 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:19.438995    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:16:19.698982 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:19.698956    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gvqfk"]
Sep 16 01:16:19.699089 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:19.699052    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvqfk"
Sep 16 01:16:19.699174 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:19.699150    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvqfk" podUID="8519201e-63ce-4c38-a45a-b9e0624fd8b5"
Sep 16 01:16:19.702287 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:19.702262    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lxzjg"]
Sep 16 01:16:19.702405 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:19.702392    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxzjg"
Sep 16 01:16:19.702597 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:19.702569    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxzjg" podUID="4112bee2-636b-4e14-a5ba-fd2bb43fffaf"
Sep 16 01:16:19.702777 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:19.702758    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vzwdx"]
Sep 16 01:16:19.702839 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:19.702830    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzwdx"
Sep 16 01:16:19.702927 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:19.702903    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzwdx" podUID="f7c423cc-710d-49fa-835f-518fc794dfb0"
Sep 16 01:16:21.163792 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:21.163644    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvqfk"
Sep 16 01:16:21.164320 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:21.163710    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxzjg"
Sep 16 01:16:21.164320 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:21.163858    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvqfk" podUID="8519201e-63ce-4c38-a45a-b9e0624fd8b5"
Sep 16 01:16:21.164320 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:21.163733    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzwdx"
Sep 16 01:16:21.164320 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:21.163924    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxzjg" podUID="4112bee2-636b-4e14-a5ba-fd2bb43fffaf"
Sep 16 01:16:21.164320 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:21.164026    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzwdx" podUID="f7c423cc-710d-49fa-835f-518fc794dfb0"
Sep 16 01:16:21.429627 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:21.429545    2565 generic.go:356] "Generic (PLEG): container finished" podID="7c405cb2-c373-496e-84e5-055abf68c46c" containerID="fc54c6bdab4e03beed860236112a16390bc7d0eb595fa9888caec286e8f5df59" exitCode=0
Sep 16 01:16:21.429742 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:21.429627    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z24pg" event={"ID":"7c405cb2-c373-496e-84e5-055abf68c46c","Type":"ContainerDied","Data":"fc54c6bdab4e03beed860236112a16390bc7d0eb595fa9888caec286e8f5df59"}
Sep 16 01:16:23.163524 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:23.163494    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvqfk"
Sep 16 01:16:23.163948 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:23.163506    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxzjg"
Sep 16 01:16:23.163948 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:23.163612    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvqfk" podUID="8519201e-63ce-4c38-a45a-b9e0624fd8b5"
Sep 16 01:16:23.163948 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:23.163615    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzwdx"
Sep 16 01:16:23.163948 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:23.163718    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxzjg" podUID="4112bee2-636b-4e14-a5ba-fd2bb43fffaf"
Sep 16 01:16:23.163948 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:23.163795    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzwdx" podUID="f7c423cc-710d-49fa-835f-518fc794dfb0"
Sep 16 01:16:24.859635 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:24.859600    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4112bee2-636b-4e14-a5ba-fd2bb43fffaf-metrics-certs\") pod \"network-metrics-daemon-lxzjg\" (UID: \"4112bee2-636b-4e14-a5ba-fd2bb43fffaf\") " pod="openshift-multus/network-metrics-daemon-lxzjg"
Sep 16 01:16:24.860234 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:24.859651    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7c423cc-710d-49fa-835f-518fc794dfb0-original-pull-secret\") pod \"global-pull-secret-syncer-vzwdx\" (UID: \"f7c423cc-710d-49fa-835f-518fc794dfb0\") " pod="kube-system/global-pull-secret-syncer-vzwdx"
Sep 16 01:16:24.860234 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:24.859774    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 01:16:24.860234 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:24.859802    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 01:16:24.860234 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:24.859844    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4112bee2-636b-4e14-a5ba-fd2bb43fffaf-metrics-certs podName:4112bee2-636b-4e14-a5ba-fd2bb43fffaf nodeName:}" failed. No retries permitted until 2026-09-16 01:16:56.859823065 +0000 UTC m=+66.183291632 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4112bee2-636b-4e14-a5ba-fd2bb43fffaf-metrics-certs") pod "network-metrics-daemon-lxzjg" (UID: "4112bee2-636b-4e14-a5ba-fd2bb43fffaf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 01:16:24.860234 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:24.859863    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7c423cc-710d-49fa-835f-518fc794dfb0-original-pull-secret podName:f7c423cc-710d-49fa-835f-518fc794dfb0 nodeName:}" failed. No retries permitted until 2026-09-16 01:16:56.859853954 +0000 UTC m=+66.183322512 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7c423cc-710d-49fa-835f-518fc794dfb0-original-pull-secret") pod "global-pull-secret-syncer-vzwdx" (UID: "f7c423cc-710d-49fa-835f-518fc794dfb0") : object "kube-system"/"original-pull-secret" not registered
Sep 16 01:16:24.960177 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:24.960140    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl2ft\" (UniqueName: \"kubernetes.io/projected/8519201e-63ce-4c38-a45a-b9e0624fd8b5-kube-api-access-sl2ft\") pod \"network-check-target-gvqfk\" (UID: \"8519201e-63ce-4c38-a45a-b9e0624fd8b5\") " pod="openshift-network-diagnostics/network-check-target-gvqfk"
Sep 16 01:16:24.960462 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:24.960281    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 01:16:24.960462 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:24.960302    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 01:16:24.960462 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:24.960316    2565 projected.go:196] Error preparing data for projected volume kube-api-access-sl2ft for pod openshift-network-diagnostics/network-check-target-gvqfk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 01:16:24.960462 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:24.960379    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8519201e-63ce-4c38-a45a-b9e0624fd8b5-kube-api-access-sl2ft podName:8519201e-63ce-4c38-a45a-b9e0624fd8b5 nodeName:}" failed. No retries permitted until 2026-09-16 01:16:56.960366158 +0000 UTC m=+66.283834713 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-sl2ft" (UniqueName: "kubernetes.io/projected/8519201e-63ce-4c38-a45a-b9e0624fd8b5-kube-api-access-sl2ft") pod "network-check-target-gvqfk" (UID: "8519201e-63ce-4c38-a45a-b9e0624fd8b5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 01:16:25.163485 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:25.163456    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvqfk"
Sep 16 01:16:25.163681 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:25.163456    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzwdx"
Sep 16 01:16:25.163681 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:25.163586    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvqfk" podUID="8519201e-63ce-4c38-a45a-b9e0624fd8b5"
Sep 16 01:16:25.163681 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:25.163471    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxzjg"
Sep 16 01:16:25.163833 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:25.163678    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzwdx" podUID="f7c423cc-710d-49fa-835f-518fc794dfb0"
Sep 16 01:16:25.163833 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:25.163788    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxzjg" podUID="4112bee2-636b-4e14-a5ba-fd2bb43fffaf"
Sep 16 01:16:25.436778 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:25.436708    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-225.ec2.internal" event="NodeReady"
Sep 16 01:16:25.436926 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:25.436837    2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 16 01:16:25.476836 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:25.476802    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pz7gn"]
Sep 16 01:16:25.492140 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:25.492113    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-tcx6s"]
Sep 16 01:16:25.492271 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:25.492229    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pz7gn"
Sep 16 01:16:25.494545 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:25.494523    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 16 01:16:25.494545 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:25.494541    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sq7hb\""
Sep 16 01:16:25.494838 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:25.494818    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 16 01:16:25.510292 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:25.510273    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pz7gn"]
Sep 16 01:16:25.510385 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:25.510304    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tcx6s"]
Sep 16 01:16:25.510425 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:25.510387    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tcx6s"
Sep 16 01:16:25.512532 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:25.512514    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 16 01:16:25.512635 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:25.512539    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-tgqvm\""
Sep 16 01:16:25.512635 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:25.512542    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 16 01:16:25.512757 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:25.512742    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 16 01:16:25.563930 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:25.563903    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/064dea27-f1a9-4eb9-990b-92d5b4ed0a2c-config-volume\") pod \"dns-default-pz7gn\" (UID: \"064dea27-f1a9-4eb9-990b-92d5b4ed0a2c\") " pod="openshift-dns/dns-default-pz7gn"
Sep 16 01:16:25.563930 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:25.563930    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1bc088f7-5296-4cd4-b845-f56577d3a938-cert\") pod \"ingress-canary-tcx6s\" (UID: \"1bc088f7-5296-4cd4-b845-f56577d3a938\") " pod="openshift-ingress-canary/ingress-canary-tcx6s"
Sep 16 01:16:25.564080 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:25.563951    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/064dea27-f1a9-4eb9-990b-92d5b4ed0a2c-metrics-tls\") pod \"dns-default-pz7gn\" (UID: \"064dea27-f1a9-4eb9-990b-92d5b4ed0a2c\") " pod="openshift-dns/dns-default-pz7gn"
Sep 16 01:16:25.564080 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:25.563966    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/064dea27-f1a9-4eb9-990b-92d5b4ed0a2c-tmp-dir\") pod \"dns-default-pz7gn\" (UID: \"064dea27-f1a9-4eb9-990b-92d5b4ed0a2c\") " pod="openshift-dns/dns-default-pz7gn"
Sep 16 01:16:25.564080 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:25.564012    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frxj4\" (UniqueName: \"kubernetes.io/projected/064dea27-f1a9-4eb9-990b-92d5b4ed0a2c-kube-api-access-frxj4\") pod \"dns-default-pz7gn\" (UID: \"064dea27-f1a9-4eb9-990b-92d5b4ed0a2c\") " pod="openshift-dns/dns-default-pz7gn"
Sep 16 01:16:25.564179 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:25.564123    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwfjb\" (UniqueName: \"kubernetes.io/projected/1bc088f7-5296-4cd4-b845-f56577d3a938-kube-api-access-cwfjb\") pod \"ingress-canary-tcx6s\" (UID: \"1bc088f7-5296-4cd4-b845-f56577d3a938\") " pod="openshift-ingress-canary/ingress-canary-tcx6s"
Sep 16 01:16:25.664754 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:25.664721    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwfjb\" (UniqueName: \"kubernetes.io/projected/1bc088f7-5296-4cd4-b845-f56577d3a938-kube-api-access-cwfjb\") pod \"ingress-canary-tcx6s\" (UID: \"1bc088f7-5296-4cd4-b845-f56577d3a938\") " pod="openshift-ingress-canary/ingress-canary-tcx6s"
Sep 16 01:16:25.664925 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:25.664775    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/064dea27-f1a9-4eb9-990b-92d5b4ed0a2c-config-volume\") pod \"dns-default-pz7gn\" (UID: \"064dea27-f1a9-4eb9-990b-92d5b4ed0a2c\") " pod="openshift-dns/dns-default-pz7gn"
Sep 16 01:16:25.664925 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:25.664798    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1bc088f7-5296-4cd4-b845-f56577d3a938-cert\") pod \"ingress-canary-tcx6s\" (UID: \"1bc088f7-5296-4cd4-b845-f56577d3a938\") " pod="openshift-ingress-canary/ingress-canary-tcx6s"
Sep 16 01:16:25.664925 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:25.664831    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/064dea27-f1a9-4eb9-990b-92d5b4ed0a2c-metrics-tls\") pod \"dns-default-pz7gn\" (UID: \"064dea27-f1a9-4eb9-990b-92d5b4ed0a2c\") " pod="openshift-dns/dns-default-pz7gn"
Sep 16 01:16:25.664925 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:25.664847    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/064dea27-f1a9-4eb9-990b-92d5b4ed0a2c-tmp-dir\") pod \"dns-default-pz7gn\" (UID: \"064dea27-f1a9-4eb9-990b-92d5b4ed0a2c\") " pod="openshift-dns/dns-default-pz7gn"
Sep 16 01:16:25.664925 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:25.664873    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frxj4\" (UniqueName: \"kubernetes.io/projected/064dea27-f1a9-4eb9-990b-92d5b4ed0a2c-kube-api-access-frxj4\") pod \"dns-default-pz7gn\" (UID: \"064dea27-f1a9-4eb9-990b-92d5b4ed0a2c\") " pod="openshift-dns/dns-default-pz7gn"
Sep 16 01:16:25.665138 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:25.664953    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 01:16:25.665138 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:25.665025    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/064dea27-f1a9-4eb9-990b-92d5b4ed0a2c-metrics-tls podName:064dea27-f1a9-4eb9-990b-92d5b4ed0a2c nodeName:}" failed. No retries permitted until 2026-09-16 01:16:26.165005544 +0000 UTC m=+35.488474113 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/064dea27-f1a9-4eb9-990b-92d5b4ed0a2c-metrics-tls") pod "dns-default-pz7gn" (UID: "064dea27-f1a9-4eb9-990b-92d5b4ed0a2c") : secret "dns-default-metrics-tls" not found
Sep 16 01:16:25.665672 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:25.665439    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/064dea27-f1a9-4eb9-990b-92d5b4ed0a2c-tmp-dir\") pod \"dns-default-pz7gn\" (UID: \"064dea27-f1a9-4eb9-990b-92d5b4ed0a2c\") " pod="openshift-dns/dns-default-pz7gn"
Sep 16 01:16:25.666094 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:25.666027    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/064dea27-f1a9-4eb9-990b-92d5b4ed0a2c-config-volume\") pod \"dns-default-pz7gn\" (UID: \"064dea27-f1a9-4eb9-990b-92d5b4ed0a2c\") " pod="openshift-dns/dns-default-pz7gn"
Sep 16 01:16:25.670211 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:25.670189    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1bc088f7-5296-4cd4-b845-f56577d3a938-cert\") pod \"ingress-canary-tcx6s\" (UID: \"1bc088f7-5296-4cd4-b845-f56577d3a938\") " pod="openshift-ingress-canary/ingress-canary-tcx6s"
Sep 16 01:16:25.672071 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:25.672048    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwfjb\" (UniqueName: \"kubernetes.io/projected/1bc088f7-5296-4cd4-b845-f56577d3a938-kube-api-access-cwfjb\") pod \"ingress-canary-tcx6s\" (UID: \"1bc088f7-5296-4cd4-b845-f56577d3a938\") " pod="openshift-ingress-canary/ingress-canary-tcx6s"
Sep 16 01:16:25.672658 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:25.672642    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frxj4\" (UniqueName: \"kubernetes.io/projected/064dea27-f1a9-4eb9-990b-92d5b4ed0a2c-kube-api-access-frxj4\") pod \"dns-default-pz7gn\" (UID: \"064dea27-f1a9-4eb9-990b-92d5b4ed0a2c\") " pod="openshift-dns/dns-default-pz7gn"
Sep 16 01:16:25.818136 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:25.817966    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tcx6s"
Sep 16 01:16:26.129521 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:26.129483    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tcx6s"]
Sep 16 01:16:26.135275 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:16:26.135249    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bc088f7_5296_4cd4_b845_f56577d3a938.slice/crio-db9de4732cc5866f669cbdb5a55378e1411f6c1e426fc48366f1d022cb572367 WatchSource:0}: Error finding container db9de4732cc5866f669cbdb5a55378e1411f6c1e426fc48366f1d022cb572367: Status 404 returned error can't find the container with id db9de4732cc5866f669cbdb5a55378e1411f6c1e426fc48366f1d022cb572367
Sep 16 01:16:26.169562 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:26.169527    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/064dea27-f1a9-4eb9-990b-92d5b4ed0a2c-metrics-tls\") pod \"dns-default-pz7gn\" (UID: \"064dea27-f1a9-4eb9-990b-92d5b4ed0a2c\") " pod="openshift-dns/dns-default-pz7gn"
Sep 16 01:16:26.169690 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:26.169675    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 01:16:26.169761 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:26.169750    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/064dea27-f1a9-4eb9-990b-92d5b4ed0a2c-metrics-tls podName:064dea27-f1a9-4eb9-990b-92d5b4ed0a2c nodeName:}" failed. No retries permitted until 2026-09-16 01:16:27.169728608 +0000 UTC m=+36.493197182 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/064dea27-f1a9-4eb9-990b-92d5b4ed0a2c-metrics-tls") pod "dns-default-pz7gn" (UID: "064dea27-f1a9-4eb9-990b-92d5b4ed0a2c") : secret "dns-default-metrics-tls" not found
Sep 16 01:16:26.440952 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:26.440915    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tcx6s" event={"ID":"1bc088f7-5296-4cd4-b845-f56577d3a938","Type":"ContainerStarted","Data":"db9de4732cc5866f669cbdb5a55378e1411f6c1e426fc48366f1d022cb572367"}
Sep 16 01:16:26.443796 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:26.443766    2565 generic.go:356] "Generic (PLEG): container finished" podID="7c405cb2-c373-496e-84e5-055abf68c46c" containerID="adc908cf0cef422bc9d86c7eb01de590c337e7771da45d103312dd1bb62c400c" exitCode=0
Sep 16 01:16:26.443922 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:26.443815    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z24pg" event={"ID":"7c405cb2-c373-496e-84e5-055abf68c46c","Type":"ContainerDied","Data":"adc908cf0cef422bc9d86c7eb01de590c337e7771da45d103312dd1bb62c400c"}
Sep 16 01:16:27.163810 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:27.163683    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzwdx"
Sep 16 01:16:27.163810 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:27.163683    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvqfk"
Sep 16 01:16:27.163810 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:27.163695    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxzjg"
Sep 16 01:16:27.166842 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:27.166815    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 16 01:16:27.167939 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:27.167917    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 16 01:16:27.167939 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:27.167931    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-w6h4t\""
Sep 16 01:16:27.168101 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:27.167958    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 16 01:16:27.168101 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:27.168008    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 16 01:16:27.168101 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:27.168009    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zwsmz\""
Sep 16 01:16:27.176080 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:27.176055    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/064dea27-f1a9-4eb9-990b-92d5b4ed0a2c-metrics-tls\") pod \"dns-default-pz7gn\" (UID: \"064dea27-f1a9-4eb9-990b-92d5b4ed0a2c\") " pod="openshift-dns/dns-default-pz7gn"
Sep 16 01:16:27.176241 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:27.176224    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 01:16:27.176309 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:27.176297    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/064dea27-f1a9-4eb9-990b-92d5b4ed0a2c-metrics-tls podName:064dea27-f1a9-4eb9-990b-92d5b4ed0a2c nodeName:}" failed. No retries permitted until 2026-09-16 01:16:29.176277611 +0000 UTC m=+38.499746187 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/064dea27-f1a9-4eb9-990b-92d5b4ed0a2c-metrics-tls") pod "dns-default-pz7gn" (UID: "064dea27-f1a9-4eb9-990b-92d5b4ed0a2c") : secret "dns-default-metrics-tls" not found
Sep 16 01:16:27.449190 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:27.449102    2565 generic.go:356] "Generic (PLEG): container finished" podID="7c405cb2-c373-496e-84e5-055abf68c46c" containerID="9352d7ba25489f4c5d75282224f0258ca315ef15167fc38c7d301655e484e52f" exitCode=0
Sep 16 01:16:27.449190 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:27.449166    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z24pg" event={"ID":"7c405cb2-c373-496e-84e5-055abf68c46c","Type":"ContainerDied","Data":"9352d7ba25489f4c5d75282224f0258ca315ef15167fc38c7d301655e484e52f"}
Sep 16 01:16:28.454591 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:28.454555    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z24pg" event={"ID":"7c405cb2-c373-496e-84e5-055abf68c46c","Type":"ContainerStarted","Data":"f41812b6bcfa7a82dc409143ebf2b89b1675377afbba08e6f8fce60f272eed33"}
Sep 16 01:16:28.475385 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:28.475307    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-z24pg" podStartSLOduration=7.889958345 podStartE2EDuration="36.475286296s" totalImagesPullingTime="28.585327951s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 01:15:52 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:16:28.473909267 +0000 UTC m=+37.797377842" watchObservedRunningTime="2026-09-16 01:16:28.475286296 +0000 UTC m=+37.798754872"
Sep 16 01:16:29.190867 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:29.190611    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/064dea27-f1a9-4eb9-990b-92d5b4ed0a2c-metrics-tls\") pod \"dns-default-pz7gn\" (UID: \"064dea27-f1a9-4eb9-990b-92d5b4ed0a2c\") " pod="openshift-dns/dns-default-pz7gn"
Sep 16 01:16:29.191050 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:29.190758    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 01:16:29.191050 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:29.191006    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/064dea27-f1a9-4eb9-990b-92d5b4ed0a2c-metrics-tls podName:064dea27-f1a9-4eb9-990b-92d5b4ed0a2c nodeName:}" failed. No retries permitted until 2026-09-16 01:16:33.190988736 +0000 UTC m=+42.514457291 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/064dea27-f1a9-4eb9-990b-92d5b4ed0a2c-metrics-tls") pod "dns-default-pz7gn" (UID: "064dea27-f1a9-4eb9-990b-92d5b4ed0a2c") : secret "dns-default-metrics-tls" not found
Sep 16 01:16:29.458758 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:29.458679    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tcx6s" event={"ID":"1bc088f7-5296-4cd4-b845-f56577d3a938","Type":"ContainerStarted","Data":"2a4c8a84aae1d902d366ff7d5a79ba8d2a4982773a75bcfc778d47b268027938"}
Sep 16 01:16:29.472633 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:29.472469    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-tcx6s" podStartSLOduration=2.083613864 podStartE2EDuration="4.472448795s" totalImagesPullingTime="2.388834931s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:16:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:16:29.472384455 +0000 UTC m=+38.795853030" watchObservedRunningTime="2026-09-16 01:16:29.472448795 +0000 UTC m=+38.795917371"
Sep 16 01:16:33.217905 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:33.217869    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/064dea27-f1a9-4eb9-990b-92d5b4ed0a2c-metrics-tls\") pod \"dns-default-pz7gn\" (UID: \"064dea27-f1a9-4eb9-990b-92d5b4ed0a2c\") " pod="openshift-dns/dns-default-pz7gn"
Sep 16 01:16:33.218292 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:33.218006    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 01:16:33.218292 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:33.218069    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/064dea27-f1a9-4eb9-990b-92d5b4ed0a2c-metrics-tls podName:064dea27-f1a9-4eb9-990b-92d5b4ed0a2c nodeName:}" failed. No retries permitted until 2026-09-16 01:16:41.218055575 +0000 UTC m=+50.541524129 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/064dea27-f1a9-4eb9-990b-92d5b4ed0a2c-metrics-tls") pod "dns-default-pz7gn" (UID: "064dea27-f1a9-4eb9-990b-92d5b4ed0a2c") : secret "dns-default-metrics-tls" not found
Sep 16 01:16:41.275277 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:41.275236    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/064dea27-f1a9-4eb9-990b-92d5b4ed0a2c-metrics-tls\") pod \"dns-default-pz7gn\" (UID: \"064dea27-f1a9-4eb9-990b-92d5b4ed0a2c\") " pod="openshift-dns/dns-default-pz7gn"
Sep 16 01:16:41.275694 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:41.275418    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 01:16:41.275694 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:41.275521    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/064dea27-f1a9-4eb9-990b-92d5b4ed0a2c-metrics-tls podName:064dea27-f1a9-4eb9-990b-92d5b4ed0a2c nodeName:}" failed. No retries permitted until 2026-09-16 01:16:57.275502015 +0000 UTC m=+66.598970573 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/064dea27-f1a9-4eb9-990b-92d5b4ed0a2c-metrics-tls") pod "dns-default-pz7gn" (UID: "064dea27-f1a9-4eb9-990b-92d5b4ed0a2c") : secret "dns-default-metrics-tls" not found
Sep 16 01:16:49.509178 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.509147    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-dkwxh"]
Sep 16 01:16:49.539657 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.539629    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-lltbx"]
Sep 16 01:16:49.539802 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.539754    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-dkwxh"
Sep 16 01:16:49.542094 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.542068    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 16 01:16:49.542220 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.542109    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 16 01:16:49.542220 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.542114    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-4vq2l\""
Sep 16 01:16:49.554185 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.554164    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dnsvb"]
Sep 16 01:16:49.554304 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.554288    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-lltbx"
Sep 16 01:16:49.556877 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.556855    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-nfkbx\""
Sep 16 01:16:49.556988 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.556855    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 16 01:16:49.556988 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.556897    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 16 01:16:49.569556 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.569532    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-dkwxh"]
Sep 16 01:16:49.569634 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.569564    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-lltbx"]
Sep 16 01:16:49.569634 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.569580    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dnsvb"]
Sep 16 01:16:49.569709 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.569640    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dnsvb"
Sep 16 01:16:49.572010 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.571989    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 16 01:16:49.572118 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.572048    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 16 01:16:49.572118 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.571989    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 16 01:16:49.572118 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.572064    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-pss66\""
Sep 16 01:16:49.572118 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.572113    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 16 01:16:49.621523 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.621497    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-f2nnr"]
Sep 16 01:16:49.628851 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.628825    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/653d2ad6-c615-4dde-a7fb-980f70eb4de7-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-dnsvb\" (UID: \"653d2ad6-c615-4dde-a7fb-980f70eb4de7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dnsvb"
Sep 16 01:16:49.628951 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.628866    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b9dc9cce-c642-4259-83f4-dc9eaac7bbb8-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-dkwxh\" (UID: \"b9dc9cce-c642-4259-83f4-dc9eaac7bbb8\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-dkwxh"
Sep 16 01:16:49.628993 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.628945    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrg2h\" (UniqueName: \"kubernetes.io/projected/baf175e9-9ba3-46e6-926b-d5005b869801-kube-api-access-hrg2h\") pod \"volume-data-source-validator-86695b7cc7-lltbx\" (UID: \"baf175e9-9ba3-46e6-926b-d5005b869801\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-lltbx"
Sep 16 01:16:49.628993 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.628976    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b9dc9cce-c642-4259-83f4-dc9eaac7bbb8-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-dkwxh\" (UID: \"b9dc9cce-c642-4259-83f4-dc9eaac7bbb8\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-dkwxh"
Sep 16 01:16:49.629054 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.628997    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/653d2ad6-c615-4dde-a7fb-980f70eb4de7-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-dnsvb\" (UID: \"653d2ad6-c615-4dde-a7fb-980f70eb4de7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dnsvb"
Sep 16 01:16:49.629054 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.629012    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgpg9\" (UniqueName: \"kubernetes.io/projected/653d2ad6-c615-4dde-a7fb-980f70eb4de7-kube-api-access-mgpg9\") pod \"kube-storage-version-migrator-operator-6c8f84f897-dnsvb\" (UID: \"653d2ad6-c615-4dde-a7fb-980f70eb4de7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dnsvb"
Sep 16 01:16:49.636507 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.636480    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-zkvx6"]
Sep 16 01:16:49.636621 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.636597    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-f2nnr"
Sep 16 01:16:49.639290 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.639265    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-xjm2p\""
Sep 16 01:16:49.648691 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.648672    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-ff46cf8-5t75c"]
Sep 16 01:16:49.648789 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.648779    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-zkvx6"
Sep 16 01:16:49.651238 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.651008    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 16 01:16:49.651238 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.651206    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-t4f8l\""
Sep 16 01:16:49.651396 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.651268    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 16 01:16:49.651447 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.651409    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 16 01:16:49.651853 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.651630    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 16 01:16:49.670929 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.670860    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-f2nnr"]
Sep 16 01:16:49.671006 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.670932    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-ff46cf8-5t75c"
Sep 16 01:16:49.671006 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.670973    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-zkvx6"]
Sep 16 01:16:49.671006 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.670991    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-ff46cf8-5t75c"]
Sep 16 01:16:49.673331 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.673309    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-wznt8\""
Sep 16 01:16:49.673331 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.673322    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 16 01:16:49.673490 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.673348    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 16 01:16:49.673490 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.673353    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 16 01:16:49.673490 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.673331    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 16 01:16:49.673490 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.673324    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 16 01:16:49.673862 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.673720    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 16 01:16:49.729756 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.729734    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b9dc9cce-c642-4259-83f4-dc9eaac7bbb8-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-dkwxh\" (UID: \"b9dc9cce-c642-4259-83f4-dc9eaac7bbb8\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-dkwxh"
Sep 16 01:16:49.729856 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.729762    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmz2d\" (UniqueName: \"kubernetes.io/projected/4755f5d3-0ca0-4282-b40a-d8fb5ba15798-kube-api-access-pmz2d\") pod \"service-ca-operator-cf7c776b7-zkvx6\" (UID: \"4755f5d3-0ca0-4282-b40a-d8fb5ba15798\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-zkvx6"
Sep 16 01:16:49.729856 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.729779    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7rk9\" (UniqueName: \"kubernetes.io/projected/62e020bc-deda-4f89-93a8-e737340375d7-kube-api-access-j7rk9\") pod \"router-default-ff46cf8-5t75c\" (UID: \"62e020bc-deda-4f89-93a8-e737340375d7\") " pod="openshift-ingress/router-default-ff46cf8-5t75c"
Sep 16 01:16:49.729856 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.729798    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgn9h\" (UniqueName: \"kubernetes.io/projected/67d9bdd6-a663-4dac-bdde-4211a351379a-kube-api-access-dgn9h\") pod \"network-check-source-6f8b768455-f2nnr\" (UID: \"67d9bdd6-a663-4dac-bdde-4211a351379a\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-f2nnr"
Sep 16 01:16:49.729856 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.729824    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62e020bc-deda-4f89-93a8-e737340375d7-service-ca-bundle\") pod \"router-default-ff46cf8-5t75c\" (UID: \"62e020bc-deda-4f89-93a8-e737340375d7\") " pod="openshift-ingress/router-default-ff46cf8-5t75c"
Sep 16 01:16:49.730016 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.729854    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/62e020bc-deda-4f89-93a8-e737340375d7-stats-auth\") pod \"router-default-ff46cf8-5t75c\" (UID: \"62e020bc-deda-4f89-93a8-e737340375d7\") " pod="openshift-ingress/router-default-ff46cf8-5t75c"
Sep 16 01:16:49.730016 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.729980    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrg2h\" (UniqueName: \"kubernetes.io/projected/baf175e9-9ba3-46e6-926b-d5005b869801-kube-api-access-hrg2h\") pod \"volume-data-source-validator-86695b7cc7-lltbx\" (UID: \"baf175e9-9ba3-46e6-926b-d5005b869801\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-lltbx"
Sep 16 01:16:49.730016 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.730000    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/62e020bc-deda-4f89-93a8-e737340375d7-default-certificate\") pod \"router-default-ff46cf8-5t75c\" (UID: \"62e020bc-deda-4f89-93a8-e737340375d7\") " pod="openshift-ingress/router-default-ff46cf8-5t75c"
Sep 16 01:16:49.730137 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.730018    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b9dc9cce-c642-4259-83f4-dc9eaac7bbb8-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-dkwxh\" (UID: \"b9dc9cce-c642-4259-83f4-dc9eaac7bbb8\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-dkwxh"
Sep 16 01:16:49.730137 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.730035    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62e020bc-deda-4f89-93a8-e737340375d7-metrics-certs\") pod \"router-default-ff46cf8-5t75c\" (UID: \"62e020bc-deda-4f89-93a8-e737340375d7\") " pod="openshift-ingress/router-default-ff46cf8-5t75c"
Sep 16 01:16:49.730137 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.730069    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/653d2ad6-c615-4dde-a7fb-980f70eb4de7-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-dnsvb\" (UID: \"653d2ad6-c615-4dde-a7fb-980f70eb4de7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dnsvb"
Sep 16 01:16:49.730137 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.730094    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgpg9\" (UniqueName: \"kubernetes.io/projected/653d2ad6-c615-4dde-a7fb-980f70eb4de7-kube-api-access-mgpg9\") pod \"kube-storage-version-migrator-operator-6c8f84f897-dnsvb\" (UID: \"653d2ad6-c615-4dde-a7fb-980f70eb4de7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dnsvb"
Sep 16 01:16:49.730137 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.730123    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4755f5d3-0ca0-4282-b40a-d8fb5ba15798-config\") pod \"service-ca-operator-cf7c776b7-zkvx6\" (UID: \"4755f5d3-0ca0-4282-b40a-d8fb5ba15798\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-zkvx6"
Sep 16 01:16:49.730137 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:49.730128    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 16 01:16:49.730454 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.730166    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/653d2ad6-c615-4dde-a7fb-980f70eb4de7-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-dnsvb\" (UID: \"653d2ad6-c615-4dde-a7fb-980f70eb4de7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dnsvb"
Sep 16 01:16:49.730454 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:49.730188    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9dc9cce-c642-4259-83f4-dc9eaac7bbb8-networking-console-plugin-cert podName:b9dc9cce-c642-4259-83f4-dc9eaac7bbb8 nodeName:}" failed. No retries permitted until 2026-09-16 01:16:50.230169539 +0000 UTC m=+59.553638098 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b9dc9cce-c642-4259-83f4-dc9eaac7bbb8-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-dkwxh" (UID: "b9dc9cce-c642-4259-83f4-dc9eaac7bbb8") : secret "networking-console-plugin-cert" not found
Sep 16 01:16:49.730454 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.730222    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4755f5d3-0ca0-4282-b40a-d8fb5ba15798-serving-cert\") pod \"service-ca-operator-cf7c776b7-zkvx6\" (UID: \"4755f5d3-0ca0-4282-b40a-d8fb5ba15798\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-zkvx6"
Sep 16 01:16:49.730554 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.730528    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b9dc9cce-c642-4259-83f4-dc9eaac7bbb8-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-dkwxh\" (UID: \"b9dc9cce-c642-4259-83f4-dc9eaac7bbb8\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-dkwxh"
Sep 16 01:16:49.730719 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.730704    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/653d2ad6-c615-4dde-a7fb-980f70eb4de7-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-dnsvb\" (UID: \"653d2ad6-c615-4dde-a7fb-980f70eb4de7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dnsvb"
Sep 16 01:16:49.733696 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.733676    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/653d2ad6-c615-4dde-a7fb-980f70eb4de7-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-dnsvb\" (UID: \"653d2ad6-c615-4dde-a7fb-980f70eb4de7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dnsvb"
Sep 16 01:16:49.767267 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.767217    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgpg9\" (UniqueName: \"kubernetes.io/projected/653d2ad6-c615-4dde-a7fb-980f70eb4de7-kube-api-access-mgpg9\") pod \"kube-storage-version-migrator-operator-6c8f84f897-dnsvb\" (UID: \"653d2ad6-c615-4dde-a7fb-980f70eb4de7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dnsvb"
Sep 16 01:16:49.767544 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.767528    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrg2h\" (UniqueName: \"kubernetes.io/projected/baf175e9-9ba3-46e6-926b-d5005b869801-kube-api-access-hrg2h\") pod \"volume-data-source-validator-86695b7cc7-lltbx\" (UID: \"baf175e9-9ba3-46e6-926b-d5005b869801\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-lltbx"
Sep 16 01:16:49.830732 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.830698    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62e020bc-deda-4f89-93a8-e737340375d7-service-ca-bundle\") pod \"router-default-ff46cf8-5t75c\" (UID: \"62e020bc-deda-4f89-93a8-e737340375d7\") " pod="openshift-ingress/router-default-ff46cf8-5t75c"
Sep 16 01:16:49.830732 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.830735    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/62e020bc-deda-4f89-93a8-e737340375d7-stats-auth\") pod \"router-default-ff46cf8-5t75c\" (UID: \"62e020bc-deda-4f89-93a8-e737340375d7\") " pod="openshift-ingress/router-default-ff46cf8-5t75c"
Sep 16 01:16:49.830917 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.830768    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/62e020bc-deda-4f89-93a8-e737340375d7-default-certificate\") pod \"router-default-ff46cf8-5t75c\" (UID: \"62e020bc-deda-4f89-93a8-e737340375d7\") " pod="openshift-ingress/router-default-ff46cf8-5t75c"
Sep 16 01:16:49.830917 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.830872    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62e020bc-deda-4f89-93a8-e737340375d7-metrics-certs\") pod \"router-default-ff46cf8-5t75c\" (UID: \"62e020bc-deda-4f89-93a8-e737340375d7\") " pod="openshift-ingress/router-default-ff46cf8-5t75c"
Sep 16 01:16:49.830917 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.830902    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4755f5d3-0ca0-4282-b40a-d8fb5ba15798-config\") pod \"service-ca-operator-cf7c776b7-zkvx6\" (UID: \"4755f5d3-0ca0-4282-b40a-d8fb5ba15798\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-zkvx6"
Sep 16 01:16:49.831029 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.830937    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4755f5d3-0ca0-4282-b40a-d8fb5ba15798-serving-cert\") pod \"service-ca-operator-cf7c776b7-zkvx6\" (UID: \"4755f5d3-0ca0-4282-b40a-d8fb5ba15798\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-zkvx6"
Sep 16 01:16:49.831029 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:49.830998    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/62e020bc-deda-4f89-93a8-e737340375d7-service-ca-bundle podName:62e020bc-deda-4f89-93a8-e737340375d7 nodeName:}" failed. No retries permitted until 2026-09-16 01:16:50.33097641 +0000 UTC m=+59.654444978 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/62e020bc-deda-4f89-93a8-e737340375d7-service-ca-bundle") pod "router-default-ff46cf8-5t75c" (UID: "62e020bc-deda-4f89-93a8-e737340375d7") : configmap references non-existent config key: service-ca.crt
Sep 16 01:16:49.831141 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.831030    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmz2d\" (UniqueName: \"kubernetes.io/projected/4755f5d3-0ca0-4282-b40a-d8fb5ba15798-kube-api-access-pmz2d\") pod \"service-ca-operator-cf7c776b7-zkvx6\" (UID: \"4755f5d3-0ca0-4282-b40a-d8fb5ba15798\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-zkvx6"
Sep 16 01:16:49.831141 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:49.831051    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 16 01:16:49.831141 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.831067    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7rk9\" (UniqueName: \"kubernetes.io/projected/62e020bc-deda-4f89-93a8-e737340375d7-kube-api-access-j7rk9\") pod \"router-default-ff46cf8-5t75c\" (UID: \"62e020bc-deda-4f89-93a8-e737340375d7\") " pod="openshift-ingress/router-default-ff46cf8-5t75c"
Sep 16 01:16:49.831141 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.831097    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgn9h\" (UniqueName: \"kubernetes.io/projected/67d9bdd6-a663-4dac-bdde-4211a351379a-kube-api-access-dgn9h\") pod \"network-check-source-6f8b768455-f2nnr\" (UID: \"67d9bdd6-a663-4dac-bdde-4211a351379a\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-f2nnr"
Sep 16 01:16:49.831141 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:49.831129    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62e020bc-deda-4f89-93a8-e737340375d7-metrics-certs podName:62e020bc-deda-4f89-93a8-e737340375d7 nodeName:}" failed. No retries permitted until 2026-09-16 01:16:50.331110309 +0000 UTC m=+59.654578867 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/62e020bc-deda-4f89-93a8-e737340375d7-metrics-certs") pod "router-default-ff46cf8-5t75c" (UID: "62e020bc-deda-4f89-93a8-e737340375d7") : secret "router-metrics-certs-default" not found
Sep 16 01:16:49.831586 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.831565    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4755f5d3-0ca0-4282-b40a-d8fb5ba15798-config\") pod \"service-ca-operator-cf7c776b7-zkvx6\" (UID: \"4755f5d3-0ca0-4282-b40a-d8fb5ba15798\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-zkvx6"
Sep 16 01:16:49.833462 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.833437    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/62e020bc-deda-4f89-93a8-e737340375d7-default-certificate\") pod \"router-default-ff46cf8-5t75c\" (UID: \"62e020bc-deda-4f89-93a8-e737340375d7\") " pod="openshift-ingress/router-default-ff46cf8-5t75c"
Sep 16 01:16:49.833603 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.833587    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4755f5d3-0ca0-4282-b40a-d8fb5ba15798-serving-cert\") pod \"service-ca-operator-cf7c776b7-zkvx6\" (UID: \"4755f5d3-0ca0-4282-b40a-d8fb5ba15798\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-zkvx6"
Sep 16 01:16:49.833817 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.833798    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/62e020bc-deda-4f89-93a8-e737340375d7-stats-auth\") pod \"router-default-ff46cf8-5t75c\" (UID: \"62e020bc-deda-4f89-93a8-e737340375d7\") " pod="openshift-ingress/router-default-ff46cf8-5t75c"
Sep 16 01:16:49.839701 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.839672    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmz2d\" (UniqueName: \"kubernetes.io/projected/4755f5d3-0ca0-4282-b40a-d8fb5ba15798-kube-api-access-pmz2d\") pod \"service-ca-operator-cf7c776b7-zkvx6\" (UID: \"4755f5d3-0ca0-4282-b40a-d8fb5ba15798\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-zkvx6"
Sep 16 01:16:49.840354 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.840320    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgn9h\" (UniqueName: \"kubernetes.io/projected/67d9bdd6-a663-4dac-bdde-4211a351379a-kube-api-access-dgn9h\") pod \"network-check-source-6f8b768455-f2nnr\" (UID: \"67d9bdd6-a663-4dac-bdde-4211a351379a\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-f2nnr"
Sep 16 01:16:49.840566 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.840548    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7rk9\" (UniqueName: \"kubernetes.io/projected/62e020bc-deda-4f89-93a8-e737340375d7-kube-api-access-j7rk9\") pod \"router-default-ff46cf8-5t75c\" (UID: \"62e020bc-deda-4f89-93a8-e737340375d7\") " pod="openshift-ingress/router-default-ff46cf8-5t75c"
Sep 16 01:16:49.862858 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.862840    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-lltbx"
Sep 16 01:16:49.878013 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.877995    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dnsvb"
Sep 16 01:16:49.945937 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.945703    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-f2nnr"
Sep 16 01:16:49.958614 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:49.958475    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-zkvx6"
Sep 16 01:16:50.147871 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:50.147846    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-lltbx"]
Sep 16 01:16:50.150684 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:16:50.150664    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaf175e9_9ba3_46e6_926b_d5005b869801.slice/crio-77c847bef7770590e9e7c01f9cc73275f028067bcb047bf614769e3f08174bd4 WatchSource:0}: Error finding container 77c847bef7770590e9e7c01f9cc73275f028067bcb047bf614769e3f08174bd4: Status 404 returned error can't find the container with id 77c847bef7770590e9e7c01f9cc73275f028067bcb047bf614769e3f08174bd4
Sep 16 01:16:50.175374 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:50.175295    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dnsvb"]
Sep 16 01:16:50.179396 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:16:50.179373    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod653d2ad6_c615_4dde_a7fb_980f70eb4de7.slice/crio-8d19cf3d05c60a0688b3009767adb9c434c17c54dcfc47f54743f0229c52737a WatchSource:0}: Error finding container 8d19cf3d05c60a0688b3009767adb9c434c17c54dcfc47f54743f0229c52737a: Status 404 returned error can't find the container with id 8d19cf3d05c60a0688b3009767adb9c434c17c54dcfc47f54743f0229c52737a
Sep 16 01:16:50.229794 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:50.229773    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-f2nnr"]
Sep 16 01:16:50.232138 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:16:50.232118    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67d9bdd6_a663_4dac_bdde_4211a351379a.slice/crio-348579899b9dfa7e248d460dc209e50bf459a6aa0bcc0b8642831f666e02d306 WatchSource:0}: Error finding container 348579899b9dfa7e248d460dc209e50bf459a6aa0bcc0b8642831f666e02d306: Status 404 returned error can't find the container with id 348579899b9dfa7e248d460dc209e50bf459a6aa0bcc0b8642831f666e02d306
Sep 16 01:16:50.234582 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:50.234508    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b9dc9cce-c642-4259-83f4-dc9eaac7bbb8-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-dkwxh\" (UID: \"b9dc9cce-c642-4259-83f4-dc9eaac7bbb8\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-dkwxh"
Sep 16 01:16:50.234679 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:50.234661    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 16 01:16:50.234738 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:50.234726    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9dc9cce-c642-4259-83f4-dc9eaac7bbb8-networking-console-plugin-cert podName:b9dc9cce-c642-4259-83f4-dc9eaac7bbb8 nodeName:}" failed. No retries permitted until 2026-09-16 01:16:51.23470569 +0000 UTC m=+60.558174244 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b9dc9cce-c642-4259-83f4-dc9eaac7bbb8-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-dkwxh" (UID: "b9dc9cce-c642-4259-83f4-dc9eaac7bbb8") : secret "networking-console-plugin-cert" not found
Sep 16 01:16:50.248386 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:50.248364    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-zkvx6"]
Sep 16 01:16:50.251450 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:16:50.251428    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4755f5d3_0ca0_4282_b40a_d8fb5ba15798.slice/crio-d2fbdfb7d0cca952f13d857387c8cba5de47cd5eece387d7cd787bb0e2862a8d WatchSource:0}: Error finding container d2fbdfb7d0cca952f13d857387c8cba5de47cd5eece387d7cd787bb0e2862a8d: Status 404 returned error can't find the container with id d2fbdfb7d0cca952f13d857387c8cba5de47cd5eece387d7cd787bb0e2862a8d
Sep 16 01:16:50.334932 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:50.334882    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62e020bc-deda-4f89-93a8-e737340375d7-service-ca-bundle\") pod \"router-default-ff46cf8-5t75c\" (UID: \"62e020bc-deda-4f89-93a8-e737340375d7\") " pod="openshift-ingress/router-default-ff46cf8-5t75c"
Sep 16 01:16:50.334932 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:50.334926    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62e020bc-deda-4f89-93a8-e737340375d7-metrics-certs\") pod \"router-default-ff46cf8-5t75c\" (UID: \"62e020bc-deda-4f89-93a8-e737340375d7\") " pod="openshift-ingress/router-default-ff46cf8-5t75c"
Sep 16 01:16:50.335037 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:50.335025    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/62e020bc-deda-4f89-93a8-e737340375d7-service-ca-bundle podName:62e020bc-deda-4f89-93a8-e737340375d7 nodeName:}" failed. No retries permitted until 2026-09-16 01:16:51.335010508 +0000 UTC m=+60.658479063 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/62e020bc-deda-4f89-93a8-e737340375d7-service-ca-bundle") pod "router-default-ff46cf8-5t75c" (UID: "62e020bc-deda-4f89-93a8-e737340375d7") : configmap references non-existent config key: service-ca.crt
Sep 16 01:16:50.335074 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:50.335031    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 16 01:16:50.335074 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:50.335070    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62e020bc-deda-4f89-93a8-e737340375d7-metrics-certs podName:62e020bc-deda-4f89-93a8-e737340375d7 nodeName:}" failed. No retries permitted until 2026-09-16 01:16:51.335059615 +0000 UTC m=+60.658528169 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/62e020bc-deda-4f89-93a8-e737340375d7-metrics-certs") pod "router-default-ff46cf8-5t75c" (UID: "62e020bc-deda-4f89-93a8-e737340375d7") : secret "router-metrics-certs-default" not found
Sep 16 01:16:50.509903 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:50.509868    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-lltbx" event={"ID":"baf175e9-9ba3-46e6-926b-d5005b869801","Type":"ContainerStarted","Data":"77c847bef7770590e9e7c01f9cc73275f028067bcb047bf614769e3f08174bd4"}
Sep 16 01:16:50.511039 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:50.511015    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-zkvx6" event={"ID":"4755f5d3-0ca0-4282-b40a-d8fb5ba15798","Type":"ContainerStarted","Data":"d2fbdfb7d0cca952f13d857387c8cba5de47cd5eece387d7cd787bb0e2862a8d"}
Sep 16 01:16:50.512183 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:50.512160    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-f2nnr" event={"ID":"67d9bdd6-a663-4dac-bdde-4211a351379a","Type":"ContainerStarted","Data":"348579899b9dfa7e248d460dc209e50bf459a6aa0bcc0b8642831f666e02d306"}
Sep 16 01:16:50.513176 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:50.513157    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dnsvb" event={"ID":"653d2ad6-c615-4dde-a7fb-980f70eb4de7","Type":"ContainerStarted","Data":"8d19cf3d05c60a0688b3009767adb9c434c17c54dcfc47f54743f0229c52737a"}
Sep 16 01:16:51.248714 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:51.248664    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b9dc9cce-c642-4259-83f4-dc9eaac7bbb8-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-dkwxh\" (UID: \"b9dc9cce-c642-4259-83f4-dc9eaac7bbb8\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-dkwxh"
Sep 16 01:16:51.248911 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:51.248844    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 16 01:16:51.248911 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:51.248907    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9dc9cce-c642-4259-83f4-dc9eaac7bbb8-networking-console-plugin-cert podName:b9dc9cce-c642-4259-83f4-dc9eaac7bbb8 nodeName:}" failed. No retries permitted until 2026-09-16 01:16:53.248887581 +0000 UTC m=+62.572356151 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b9dc9cce-c642-4259-83f4-dc9eaac7bbb8-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-dkwxh" (UID: "b9dc9cce-c642-4259-83f4-dc9eaac7bbb8") : secret "networking-console-plugin-cert" not found
Sep 16 01:16:51.349136 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:51.349100    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62e020bc-deda-4f89-93a8-e737340375d7-service-ca-bundle\") pod \"router-default-ff46cf8-5t75c\" (UID: \"62e020bc-deda-4f89-93a8-e737340375d7\") " pod="openshift-ingress/router-default-ff46cf8-5t75c"
Sep 16 01:16:51.349297 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:51.349173    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62e020bc-deda-4f89-93a8-e737340375d7-metrics-certs\") pod \"router-default-ff46cf8-5t75c\" (UID: \"62e020bc-deda-4f89-93a8-e737340375d7\") " pod="openshift-ingress/router-default-ff46cf8-5t75c"
Sep 16 01:16:51.349297 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:51.349274    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/62e020bc-deda-4f89-93a8-e737340375d7-service-ca-bundle podName:62e020bc-deda-4f89-93a8-e737340375d7 nodeName:}" failed. No retries permitted until 2026-09-16 01:16:53.34925492 +0000 UTC m=+62.672723490 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/62e020bc-deda-4f89-93a8-e737340375d7-service-ca-bundle") pod "router-default-ff46cf8-5t75c" (UID: "62e020bc-deda-4f89-93a8-e737340375d7") : configmap references non-existent config key: service-ca.crt
Sep 16 01:16:51.349460 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:51.349392    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 16 01:16:51.349460 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:51.349447    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62e020bc-deda-4f89-93a8-e737340375d7-metrics-certs podName:62e020bc-deda-4f89-93a8-e737340375d7 nodeName:}" failed. No retries permitted until 2026-09-16 01:16:53.349431026 +0000 UTC m=+62.672899593 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/62e020bc-deda-4f89-93a8-e737340375d7-metrics-certs") pod "router-default-ff46cf8-5t75c" (UID: "62e020bc-deda-4f89-93a8-e737340375d7") : secret "router-metrics-certs-default" not found
Sep 16 01:16:51.441115 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:51.441087    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fqnhz"
Sep 16 01:16:51.518977 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:51.518688    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-lltbx" event={"ID":"baf175e9-9ba3-46e6-926b-d5005b869801","Type":"ContainerStarted","Data":"42218c301b12a58a3dcb813426fe2007c5000891d191e8f2f87ca85e4c82ac16"}
Sep 16 01:16:51.535790 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:51.535732    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-lltbx" podStartSLOduration=1.324977668 podStartE2EDuration="2.535714041s" totalImagesPullingTime="1.210736373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:16:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:16:51.534192182 +0000 UTC m=+60.857660758" watchObservedRunningTime="2026-09-16 01:16:51.535714041 +0000 UTC m=+60.859182618"
Sep 16 01:16:53.266795 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:53.266753    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b9dc9cce-c642-4259-83f4-dc9eaac7bbb8-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-dkwxh\" (UID: \"b9dc9cce-c642-4259-83f4-dc9eaac7bbb8\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-dkwxh"
Sep 16 01:16:53.267230 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:53.266904    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 16 01:16:53.267230 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:53.266971    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9dc9cce-c642-4259-83f4-dc9eaac7bbb8-networking-console-plugin-cert podName:b9dc9cce-c642-4259-83f4-dc9eaac7bbb8 nodeName:}" failed. No retries permitted until 2026-09-16 01:16:57.266953089 +0000 UTC m=+66.590421643 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b9dc9cce-c642-4259-83f4-dc9eaac7bbb8-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-dkwxh" (UID: "b9dc9cce-c642-4259-83f4-dc9eaac7bbb8") : secret "networking-console-plugin-cert" not found
Sep 16 01:16:53.367287 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:53.367245    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62e020bc-deda-4f89-93a8-e737340375d7-service-ca-bundle\") pod \"router-default-ff46cf8-5t75c\" (UID: \"62e020bc-deda-4f89-93a8-e737340375d7\") " pod="openshift-ingress/router-default-ff46cf8-5t75c"
Sep 16 01:16:53.367551 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:53.367315    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62e020bc-deda-4f89-93a8-e737340375d7-metrics-certs\") pod \"router-default-ff46cf8-5t75c\" (UID: \"62e020bc-deda-4f89-93a8-e737340375d7\") " pod="openshift-ingress/router-default-ff46cf8-5t75c"
Sep 16 01:16:53.367551 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:53.367442    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/62e020bc-deda-4f89-93a8-e737340375d7-service-ca-bundle podName:62e020bc-deda-4f89-93a8-e737340375d7 nodeName:}" failed. No retries permitted until 2026-09-16 01:16:57.367419074 +0000 UTC m=+66.690887647 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/62e020bc-deda-4f89-93a8-e737340375d7-service-ca-bundle") pod "router-default-ff46cf8-5t75c" (UID: "62e020bc-deda-4f89-93a8-e737340375d7") : configmap references non-existent config key: service-ca.crt
Sep 16 01:16:53.367551 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:53.367455    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 16 01:16:53.367551 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:53.367513    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62e020bc-deda-4f89-93a8-e737340375d7-metrics-certs podName:62e020bc-deda-4f89-93a8-e737340375d7 nodeName:}" failed. No retries permitted until 2026-09-16 01:16:57.367494958 +0000 UTC m=+66.690963516 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/62e020bc-deda-4f89-93a8-e737340375d7-metrics-certs") pod "router-default-ff46cf8-5t75c" (UID: "62e020bc-deda-4f89-93a8-e737340375d7") : secret "router-metrics-certs-default" not found
Sep 16 01:16:54.235781 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:54.235753    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-bqmz7"]
Sep 16 01:16:54.237829 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:54.237808    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bqmz7"
Sep 16 01:16:54.240096 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:54.240072    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 16 01:16:54.240397 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:54.240377    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 16 01:16:54.240491 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:54.240447    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 16 01:16:54.240576 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:54.240394    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 16 01:16:54.241369 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:54.241329    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ncdjs\""
Sep 16 01:16:54.252402 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:54.252374    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bqmz7"]
Sep 16 01:16:54.376196 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:54.376172    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/57b44225-8ae5-410c-8f44-812c00c972b8-crio-socket\") pod \"insights-runtime-extractor-bqmz7\" (UID: \"57b44225-8ae5-410c-8f44-812c00c972b8\") " pod="openshift-insights/insights-runtime-extractor-bqmz7"
Sep 16 01:16:54.376551 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:54.376205    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cgb4\" (UniqueName: \"kubernetes.io/projected/57b44225-8ae5-410c-8f44-812c00c972b8-kube-api-access-4cgb4\") pod \"insights-runtime-extractor-bqmz7\" (UID: \"57b44225-8ae5-410c-8f44-812c00c972b8\") " pod="openshift-insights/insights-runtime-extractor-bqmz7"
Sep 16 01:16:54.376551 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:54.376242    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/57b44225-8ae5-410c-8f44-812c00c972b8-data-volume\") pod \"insights-runtime-extractor-bqmz7\" (UID: \"57b44225-8ae5-410c-8f44-812c00c972b8\") " pod="openshift-insights/insights-runtime-extractor-bqmz7"
Sep 16 01:16:54.376551 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:54.376310    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57b44225-8ae5-410c-8f44-812c00c972b8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bqmz7\" (UID: \"57b44225-8ae5-410c-8f44-812c00c972b8\") " pod="openshift-insights/insights-runtime-extractor-bqmz7"
Sep 16 01:16:54.376551 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:54.376372    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57b44225-8ae5-410c-8f44-812c00c972b8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bqmz7\" (UID: \"57b44225-8ae5-410c-8f44-812c00c972b8\") " pod="openshift-insights/insights-runtime-extractor-bqmz7"
Sep 16 01:16:54.477241 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:54.477209    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57b44225-8ae5-410c-8f44-812c00c972b8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bqmz7\" (UID: \"57b44225-8ae5-410c-8f44-812c00c972b8\") " pod="openshift-insights/insights-runtime-extractor-bqmz7"
Sep 16 01:16:54.477374 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:54.477265    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57b44225-8ae5-410c-8f44-812c00c972b8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bqmz7\" (UID: \"57b44225-8ae5-410c-8f44-812c00c972b8\") " pod="openshift-insights/insights-runtime-extractor-bqmz7"
Sep 16 01:16:54.477419 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:54.477370    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 01:16:54.477419 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:54.477397    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/57b44225-8ae5-410c-8f44-812c00c972b8-crio-socket\") pod \"insights-runtime-extractor-bqmz7\" (UID: \"57b44225-8ae5-410c-8f44-812c00c972b8\") " pod="openshift-insights/insights-runtime-extractor-bqmz7"
Sep 16 01:16:54.477501 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:54.477414    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 01:16:54.477501 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:54.477428    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57b44225-8ae5-410c-8f44-812c00c972b8-insights-runtime-extractor-tls podName:57b44225-8ae5-410c-8f44-812c00c972b8 nodeName:}" failed. No retries permitted until 2026-09-16 01:16:54.977412872 +0000 UTC m=+64.300881426 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/57b44225-8ae5-410c-8f44-812c00c972b8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bqmz7" (UID: "57b44225-8ae5-410c-8f44-812c00c972b8") : secret "insights-runtime-extractor-tls" not found
Sep 16 01:16:54.477501 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:54.477446    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cgb4\" (UniqueName: \"kubernetes.io/projected/57b44225-8ae5-410c-8f44-812c00c972b8-kube-api-access-4cgb4\") pod \"insights-runtime-extractor-bqmz7\" (UID: \"57b44225-8ae5-410c-8f44-812c00c972b8\") " pod="openshift-insights/insights-runtime-extractor-bqmz7"
Sep 16 01:16:54.477501 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:54.477470    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/57b44225-8ae5-410c-8f44-812c00c972b8-kube-rbac-proxy-cm podName:57b44225-8ae5-410c-8f44-812c00c972b8 nodeName:}" failed. No retries permitted until 2026-09-16 01:16:54.977453667 +0000 UTC m=+64.300922234 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/57b44225-8ae5-410c-8f44-812c00c972b8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bqmz7" (UID: "57b44225-8ae5-410c-8f44-812c00c972b8") : configmap "kube-rbac-proxy" not found
Sep 16 01:16:54.477501 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:54.477471    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/57b44225-8ae5-410c-8f44-812c00c972b8-crio-socket\") pod \"insights-runtime-extractor-bqmz7\" (UID: \"57b44225-8ae5-410c-8f44-812c00c972b8\") " pod="openshift-insights/insights-runtime-extractor-bqmz7"
Sep 16 01:16:54.477677 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:54.477526    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/57b44225-8ae5-410c-8f44-812c00c972b8-data-volume\") pod \"insights-runtime-extractor-bqmz7\" (UID: \"57b44225-8ae5-410c-8f44-812c00c972b8\") " pod="openshift-insights/insights-runtime-extractor-bqmz7"
Sep 16 01:16:54.477879 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:54.477863    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/57b44225-8ae5-410c-8f44-812c00c972b8-data-volume\") pod \"insights-runtime-extractor-bqmz7\" (UID: \"57b44225-8ae5-410c-8f44-812c00c972b8\") " pod="openshift-insights/insights-runtime-extractor-bqmz7"
Sep 16 01:16:54.487149 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:54.487092    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cgb4\" (UniqueName: \"kubernetes.io/projected/57b44225-8ae5-410c-8f44-812c00c972b8-kube-api-access-4cgb4\") pod \"insights-runtime-extractor-bqmz7\" (UID: \"57b44225-8ae5-410c-8f44-812c00c972b8\") " pod="openshift-insights/insights-runtime-extractor-bqmz7"
Sep 16 01:16:54.528587 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:54.528558    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-zkvx6" event={"ID":"4755f5d3-0ca0-4282-b40a-d8fb5ba15798","Type":"ContainerStarted","Data":"ae8d92b7f3fd540a24e9cfed3e95134016da2aa4a469dd9ec78bec4824a8a929"}
Sep 16 01:16:54.530104 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:54.530079    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-f2nnr" event={"ID":"67d9bdd6-a663-4dac-bdde-4211a351379a","Type":"ContainerStarted","Data":"c9d87e7ba69934628b96ecb1901baedef2d5610b1ee4b34c26b7db4cbe469fcb"}
Sep 16 01:16:54.531602 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:54.531583    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dnsvb" event={"ID":"653d2ad6-c615-4dde-a7fb-980f70eb4de7","Type":"ContainerStarted","Data":"aeb4d0ac32d10699e6e9f61fa1ab19f91a0bb5543a10c4c4849f2e3cecdb3d43"}
Sep 16 01:16:54.542193 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:54.542150    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-zkvx6" podStartSLOduration=2.026334398 podStartE2EDuration="5.542134418s" totalImagesPullingTime="3.51580002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:16:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:16:54.542103058 +0000 UTC m=+63.865571635" watchObservedRunningTime="2026-09-16 01:16:54.542134418 +0000 UTC m=+63.865602996"
Sep 16 01:16:54.556180 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:54.556132    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f8b768455-f2nnr" podStartSLOduration=2.015800662 podStartE2EDuration="5.556116153s" totalImagesPullingTime="3.540315491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:16:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:16:54.555188831 +0000 UTC m=+63.878657418" watchObservedRunningTime="2026-09-16 01:16:54.556116153 +0000 UTC m=+63.879584730"
Sep 16 01:16:54.569883 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:54.569847    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dnsvb" podStartSLOduration=1.986296795 podStartE2EDuration="5.569835638s" totalImagesPullingTime="3.583538843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:16:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:16:54.569495027 +0000 UTC m=+63.892963603" watchObservedRunningTime="2026-09-16 01:16:54.569835638 +0000 UTC m=+63.893304212"
Sep 16 01:16:54.983225 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:54.983192    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57b44225-8ae5-410c-8f44-812c00c972b8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bqmz7\" (UID: \"57b44225-8ae5-410c-8f44-812c00c972b8\") " pod="openshift-insights/insights-runtime-extractor-bqmz7"
Sep 16 01:16:54.983405 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:54.983234    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57b44225-8ae5-410c-8f44-812c00c972b8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bqmz7\" (UID: \"57b44225-8ae5-410c-8f44-812c00c972b8\") " pod="openshift-insights/insights-runtime-extractor-bqmz7"
Sep 16 01:16:54.983405 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:54.983319    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 01:16:54.983405 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:54.983359    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 01:16:54.983405 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:54.983393    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/57b44225-8ae5-410c-8f44-812c00c972b8-kube-rbac-proxy-cm podName:57b44225-8ae5-410c-8f44-812c00c972b8 nodeName:}" failed. No retries permitted until 2026-09-16 01:16:55.983375148 +0000 UTC m=+65.306843718 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/57b44225-8ae5-410c-8f44-812c00c972b8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bqmz7" (UID: "57b44225-8ae5-410c-8f44-812c00c972b8") : configmap "kube-rbac-proxy" not found
Sep 16 01:16:54.983566 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:54.983417    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57b44225-8ae5-410c-8f44-812c00c972b8-insights-runtime-extractor-tls podName:57b44225-8ae5-410c-8f44-812c00c972b8 nodeName:}" failed. No retries permitted until 2026-09-16 01:16:55.983400499 +0000 UTC m=+65.306869074 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/57b44225-8ae5-410c-8f44-812c00c972b8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bqmz7" (UID: "57b44225-8ae5-410c-8f44-812c00c972b8") : secret "insights-runtime-extractor-tls" not found
Sep 16 01:16:55.991104 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:55.991068    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57b44225-8ae5-410c-8f44-812c00c972b8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bqmz7\" (UID: \"57b44225-8ae5-410c-8f44-812c00c972b8\") " pod="openshift-insights/insights-runtime-extractor-bqmz7"
Sep 16 01:16:55.991463 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:55.991113    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57b44225-8ae5-410c-8f44-812c00c972b8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bqmz7\" (UID: \"57b44225-8ae5-410c-8f44-812c00c972b8\") " pod="openshift-insights/insights-runtime-extractor-bqmz7"
Sep 16 01:16:55.991463 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:55.991218    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 01:16:55.991463 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:55.991225    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 01:16:55.991463 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:55.991282    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/57b44225-8ae5-410c-8f44-812c00c972b8-kube-rbac-proxy-cm podName:57b44225-8ae5-410c-8f44-812c00c972b8 nodeName:}" failed. No retries permitted until 2026-09-16 01:16:57.991268107 +0000 UTC m=+67.314736674 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/57b44225-8ae5-410c-8f44-812c00c972b8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bqmz7" (UID: "57b44225-8ae5-410c-8f44-812c00c972b8") : configmap "kube-rbac-proxy" not found
Sep 16 01:16:55.991463 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:55.991296    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57b44225-8ae5-410c-8f44-812c00c972b8-insights-runtime-extractor-tls podName:57b44225-8ae5-410c-8f44-812c00c972b8 nodeName:}" failed. No retries permitted until 2026-09-16 01:16:57.991290646 +0000 UTC m=+67.314759200 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/57b44225-8ae5-410c-8f44-812c00c972b8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bqmz7" (UID: "57b44225-8ae5-410c-8f44-812c00c972b8") : secret "insights-runtime-extractor-tls" not found
Sep 16 01:16:56.384037 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:56.383963    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dksqw_cec37c8f-d1ef-47fc-9e34-58c4f9c4e26d/dns-node-resolver/0.log"
Sep 16 01:16:56.897366 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:56.897325    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4112bee2-636b-4e14-a5ba-fd2bb43fffaf-metrics-certs\") pod \"network-metrics-daemon-lxzjg\" (UID: \"4112bee2-636b-4e14-a5ba-fd2bb43fffaf\") " pod="openshift-multus/network-metrics-daemon-lxzjg"
Sep 16 01:16:56.897542 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:56.897396    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7c423cc-710d-49fa-835f-518fc794dfb0-original-pull-secret\") pod \"global-pull-secret-syncer-vzwdx\" (UID: \"f7c423cc-710d-49fa-835f-518fc794dfb0\") " pod="kube-system/global-pull-secret-syncer-vzwdx"
Sep 16 01:16:56.899722 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:56.899705    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 16 01:16:56.899812 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:56.899792    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 16 01:16:56.907838 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:56.907818    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 16 01:16:56.907936 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:56.907874    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4112bee2-636b-4e14-a5ba-fd2bb43fffaf-metrics-certs podName:4112bee2-636b-4e14-a5ba-fd2bb43fffaf nodeName:}" failed. No retries permitted until 2026-09-16 01:18:00.907858019 +0000 UTC m=+130.231326573 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4112bee2-636b-4e14-a5ba-fd2bb43fffaf-metrics-certs") pod "network-metrics-daemon-lxzjg" (UID: "4112bee2-636b-4e14-a5ba-fd2bb43fffaf") : secret "metrics-daemon-secret" not found
Sep 16 01:16:56.909894 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:56.909879    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7c423cc-710d-49fa-835f-518fc794dfb0-original-pull-secret\") pod \"global-pull-secret-syncer-vzwdx\" (UID: \"f7c423cc-710d-49fa-835f-518fc794dfb0\") " pod="kube-system/global-pull-secret-syncer-vzwdx"
Sep 16 01:16:56.998381 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:56.998356    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl2ft\" (UniqueName: \"kubernetes.io/projected/8519201e-63ce-4c38-a45a-b9e0624fd8b5-kube-api-access-sl2ft\") pod \"network-check-target-gvqfk\" (UID: \"8519201e-63ce-4c38-a45a-b9e0624fd8b5\") " pod="openshift-network-diagnostics/network-check-target-gvqfk"
Sep 16 01:16:57.000507 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:57.000489    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sl2ft\" (UniqueName: \"kubernetes.io/projected/8519201e-63ce-4c38-a45a-b9e0624fd8b5-kube-api-access-sl2ft\") pod \"network-check-target-gvqfk\" (UID: \"8519201e-63ce-4c38-a45a-b9e0624fd8b5\") " pod="openshift-network-diagnostics/network-check-target-gvqfk"
Sep 16 01:16:57.183266 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:57.183242    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzwdx"
Sep 16 01:16:57.183639 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:57.183623    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-h9vzm_9b5e1f55-e4cc-46aa-919c-c50324c38ce0/node-ca/0.log"
Sep 16 01:16:57.185264 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:57.185247    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zwsmz\""
Sep 16 01:16:57.193310 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:57.193298    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvqfk"
Sep 16 01:16:57.300848 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:57.300813    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/064dea27-f1a9-4eb9-990b-92d5b4ed0a2c-metrics-tls\") pod \"dns-default-pz7gn\" (UID: \"064dea27-f1a9-4eb9-990b-92d5b4ed0a2c\") " pod="openshift-dns/dns-default-pz7gn"
Sep 16 01:16:57.300981 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:57.300897    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b9dc9cce-c642-4259-83f4-dc9eaac7bbb8-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-dkwxh\" (UID: \"b9dc9cce-c642-4259-83f4-dc9eaac7bbb8\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-dkwxh"
Sep 16 01:16:57.301058 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:57.301042    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 01:16:57.301119 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:57.301109    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/064dea27-f1a9-4eb9-990b-92d5b4ed0a2c-metrics-tls podName:064dea27-f1a9-4eb9-990b-92d5b4ed0a2c nodeName:}" failed. No retries permitted until 2026-09-16 01:17:29.301094294 +0000 UTC m=+98.624562853 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/064dea27-f1a9-4eb9-990b-92d5b4ed0a2c-metrics-tls") pod "dns-default-pz7gn" (UID: "064dea27-f1a9-4eb9-990b-92d5b4ed0a2c") : secret "dns-default-metrics-tls" not found
Sep 16 01:16:57.301184 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:57.301042    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 16 01:16:57.301236 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:57.301187    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9dc9cce-c642-4259-83f4-dc9eaac7bbb8-networking-console-plugin-cert podName:b9dc9cce-c642-4259-83f4-dc9eaac7bbb8 nodeName:}" failed. No retries permitted until 2026-09-16 01:17:05.301174851 +0000 UTC m=+74.624643405 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b9dc9cce-c642-4259-83f4-dc9eaac7bbb8-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-dkwxh" (UID: "b9dc9cce-c642-4259-83f4-dc9eaac7bbb8") : secret "networking-console-plugin-cert" not found
Sep 16 01:16:57.402190 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:57.402159    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62e020bc-deda-4f89-93a8-e737340375d7-service-ca-bundle\") pod \"router-default-ff46cf8-5t75c\" (UID: \"62e020bc-deda-4f89-93a8-e737340375d7\") " pod="openshift-ingress/router-default-ff46cf8-5t75c"
Sep 16 01:16:57.402317 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:57.402299    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/62e020bc-deda-4f89-93a8-e737340375d7-service-ca-bundle podName:62e020bc-deda-4f89-93a8-e737340375d7 nodeName:}" failed. No retries permitted until 2026-09-16 01:17:05.402280825 +0000 UTC m=+74.725749400 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/62e020bc-deda-4f89-93a8-e737340375d7-service-ca-bundle") pod "router-default-ff46cf8-5t75c" (UID: "62e020bc-deda-4f89-93a8-e737340375d7") : configmap references non-existent config key: service-ca.crt
Sep 16 01:16:57.402406 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:57.402392    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62e020bc-deda-4f89-93a8-e737340375d7-metrics-certs\") pod \"router-default-ff46cf8-5t75c\" (UID: \"62e020bc-deda-4f89-93a8-e737340375d7\") " pod="openshift-ingress/router-default-ff46cf8-5t75c"
Sep 16 01:16:57.402520 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:57.402505    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 16 01:16:57.402574 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:57.402563    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62e020bc-deda-4f89-93a8-e737340375d7-metrics-certs podName:62e020bc-deda-4f89-93a8-e737340375d7 nodeName:}" failed. No retries permitted until 2026-09-16 01:17:05.402548288 +0000 UTC m=+74.726016853 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/62e020bc-deda-4f89-93a8-e737340375d7-metrics-certs") pod "router-default-ff46cf8-5t75c" (UID: "62e020bc-deda-4f89-93a8-e737340375d7") : secret "router-metrics-certs-default" not found
Sep 16 01:16:57.486229 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:57.485110    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vzwdx"]
Sep 16 01:16:57.509711 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:57.509688    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gvqfk"]
Sep 16 01:16:57.512472 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:16:57.512444    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8519201e_63ce_4c38_a45a_b9e0624fd8b5.slice/crio-9f738da1387d2fffd6742c2d0318997149ed9de83f2b5c66ecd8f40a356811b9 WatchSource:0}: Error finding container 9f738da1387d2fffd6742c2d0318997149ed9de83f2b5c66ecd8f40a356811b9: Status 404 returned error can't find the container with id 9f738da1387d2fffd6742c2d0318997149ed9de83f2b5c66ecd8f40a356811b9
Sep 16 01:16:57.539740 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:57.539714    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gvqfk" event={"ID":"8519201e-63ce-4c38-a45a-b9e0624fd8b5","Type":"ContainerStarted","Data":"9f738da1387d2fffd6742c2d0318997149ed9de83f2b5c66ecd8f40a356811b9"}
Sep 16 01:16:57.540783 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:57.540765    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vzwdx" event={"ID":"f7c423cc-710d-49fa-835f-518fc794dfb0","Type":"ContainerStarted","Data":"c86a0998c28549aa8aa04f02c119b43ddad25c2b4e23094f724ac047543dbaf9"}
Sep 16 01:16:57.785605 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:57.785532    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tcx6s_1bc088f7-5296-4cd4-b845-f56577d3a938/serve-healthcheck-canary/0.log"
Sep 16 01:16:58.006854 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:58.006818    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57b44225-8ae5-410c-8f44-812c00c972b8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bqmz7\" (UID: \"57b44225-8ae5-410c-8f44-812c00c972b8\") " pod="openshift-insights/insights-runtime-extractor-bqmz7"
Sep 16 01:16:58.007201 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:58.006871    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57b44225-8ae5-410c-8f44-812c00c972b8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bqmz7\" (UID: \"57b44225-8ae5-410c-8f44-812c00c972b8\") " pod="openshift-insights/insights-runtime-extractor-bqmz7"
Sep 16 01:16:58.007201 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:58.006968    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 01:16:58.007201 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:58.006987    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 01:16:58.007201 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:58.007020    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/57b44225-8ae5-410c-8f44-812c00c972b8-kube-rbac-proxy-cm podName:57b44225-8ae5-410c-8f44-812c00c972b8 nodeName:}" failed. No retries permitted until 2026-09-16 01:17:02.00700682 +0000 UTC m=+71.330475374 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/57b44225-8ae5-410c-8f44-812c00c972b8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bqmz7" (UID: "57b44225-8ae5-410c-8f44-812c00c972b8") : configmap "kube-rbac-proxy" not found
Sep 16 01:16:58.007201 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:16:58.007041    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57b44225-8ae5-410c-8f44-812c00c972b8-insights-runtime-extractor-tls podName:57b44225-8ae5-410c-8f44-812c00c972b8 nodeName:}" failed. No retries permitted until 2026-09-16 01:17:02.007028442 +0000 UTC m=+71.330496996 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/57b44225-8ae5-410c-8f44-812c00c972b8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bqmz7" (UID: "57b44225-8ae5-410c-8f44-812c00c972b8") : secret "insights-runtime-extractor-tls" not found
Sep 16 01:16:58.546528 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:58.546490    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gvqfk" event={"ID":"8519201e-63ce-4c38-a45a-b9e0624fd8b5","Type":"ContainerStarted","Data":"baa7415a0c47c7d1ffde6f1697e719d4582e51038a26c6830f8583aefbccd8e6"}
Sep 16 01:16:58.546705 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:58.546617    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gvqfk"
Sep 16 01:16:58.562741 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:16:58.562549    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gvqfk" podStartSLOduration=66.562532 podStartE2EDuration="1m6.562532s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:15:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:16:58.562503335 +0000 UTC m=+67.885971912" watchObservedRunningTime="2026-09-16 01:16:58.562532 +0000 UTC m=+67.886000578"
Sep 16 01:17:01.559204 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:01.559165    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vzwdx" event={"ID":"f7c423cc-710d-49fa-835f-518fc794dfb0","Type":"ContainerStarted","Data":"856d4b4e5e5b89257de90e3db6ec0d586ad5b01c31785c61679271b249d09888"}
Sep 16 01:17:01.579413 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:01.579363    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vzwdx" podStartSLOduration=66.096783569 podStartE2EDuration="1m9.579328272s" totalImagesPullingTime="3.482544703s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 01:15:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:17:01.578362031 +0000 UTC m=+70.901830605" watchObservedRunningTime="2026-09-16 01:17:01.579328272 +0000 UTC m=+70.902796848"
Sep 16 01:17:02.041675 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:02.041641    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57b44225-8ae5-410c-8f44-812c00c972b8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bqmz7\" (UID: \"57b44225-8ae5-410c-8f44-812c00c972b8\") " pod="openshift-insights/insights-runtime-extractor-bqmz7"
Sep 16 01:17:02.041798 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:02.041691    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57b44225-8ae5-410c-8f44-812c00c972b8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bqmz7\" (UID: \"57b44225-8ae5-410c-8f44-812c00c972b8\") " pod="openshift-insights/insights-runtime-extractor-bqmz7"
Sep 16 01:17:02.041798 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:17:02.041759    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 01:17:02.041798 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:17:02.041770    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 01:17:02.041948 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:17:02.041815    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/57b44225-8ae5-410c-8f44-812c00c972b8-kube-rbac-proxy-cm podName:57b44225-8ae5-410c-8f44-812c00c972b8 nodeName:}" failed. No retries permitted until 2026-09-16 01:17:10.04179987 +0000 UTC m=+79.365268426 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/57b44225-8ae5-410c-8f44-812c00c972b8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bqmz7" (UID: "57b44225-8ae5-410c-8f44-812c00c972b8") : configmap "kube-rbac-proxy" not found
Sep 16 01:17:02.041948 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:17:02.041834    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57b44225-8ae5-410c-8f44-812c00c972b8-insights-runtime-extractor-tls podName:57b44225-8ae5-410c-8f44-812c00c972b8 nodeName:}" failed. No retries permitted until 2026-09-16 01:17:10.041825043 +0000 UTC m=+79.365293607 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/57b44225-8ae5-410c-8f44-812c00c972b8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bqmz7" (UID: "57b44225-8ae5-410c-8f44-812c00c972b8") : secret "insights-runtime-extractor-tls" not found
Sep 16 01:17:05.367591 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:05.367556    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b9dc9cce-c642-4259-83f4-dc9eaac7bbb8-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-dkwxh\" (UID: \"b9dc9cce-c642-4259-83f4-dc9eaac7bbb8\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-dkwxh"
Sep 16 01:17:05.367954 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:17:05.367723    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 16 01:17:05.367954 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:17:05.367798    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9dc9cce-c642-4259-83f4-dc9eaac7bbb8-networking-console-plugin-cert podName:b9dc9cce-c642-4259-83f4-dc9eaac7bbb8 nodeName:}" failed. No retries permitted until 2026-09-16 01:17:21.367783067 +0000 UTC m=+90.691251637 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b9dc9cce-c642-4259-83f4-dc9eaac7bbb8-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-dkwxh" (UID: "b9dc9cce-c642-4259-83f4-dc9eaac7bbb8") : secret "networking-console-plugin-cert" not found
Sep 16 01:17:05.468499 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:05.468460    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62e020bc-deda-4f89-93a8-e737340375d7-service-ca-bundle\") pod \"router-default-ff46cf8-5t75c\" (UID: \"62e020bc-deda-4f89-93a8-e737340375d7\") " pod="openshift-ingress/router-default-ff46cf8-5t75c"
Sep 16 01:17:05.468624 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:05.468601    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62e020bc-deda-4f89-93a8-e737340375d7-metrics-certs\") pod \"router-default-ff46cf8-5t75c\" (UID: \"62e020bc-deda-4f89-93a8-e737340375d7\") " pod="openshift-ingress/router-default-ff46cf8-5t75c"
Sep 16 01:17:05.468660 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:17:05.468623    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/62e020bc-deda-4f89-93a8-e737340375d7-service-ca-bundle podName:62e020bc-deda-4f89-93a8-e737340375d7 nodeName:}" failed. No retries permitted until 2026-09-16 01:17:21.468604177 +0000 UTC m=+90.792072757 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/62e020bc-deda-4f89-93a8-e737340375d7-service-ca-bundle") pod "router-default-ff46cf8-5t75c" (UID: "62e020bc-deda-4f89-93a8-e737340375d7") : configmap references non-existent config key: service-ca.crt
Sep 16 01:17:05.468701 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:17:05.468669    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 16 01:17:05.468731 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:17:05.468704    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62e020bc-deda-4f89-93a8-e737340375d7-metrics-certs podName:62e020bc-deda-4f89-93a8-e737340375d7 nodeName:}" failed. No retries permitted until 2026-09-16 01:17:21.468693312 +0000 UTC m=+90.792161879 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/62e020bc-deda-4f89-93a8-e737340375d7-metrics-certs") pod "router-default-ff46cf8-5t75c" (UID: "62e020bc-deda-4f89-93a8-e737340375d7") : secret "router-metrics-certs-default" not found
Sep 16 01:17:10.102554 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:10.102510    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57b44225-8ae5-410c-8f44-812c00c972b8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bqmz7\" (UID: \"57b44225-8ae5-410c-8f44-812c00c972b8\") " pod="openshift-insights/insights-runtime-extractor-bqmz7"
Sep 16 01:17:10.103046 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:10.102564    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57b44225-8ae5-410c-8f44-812c00c972b8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bqmz7\" (UID: \"57b44225-8ae5-410c-8f44-812c00c972b8\") " pod="openshift-insights/insights-runtime-extractor-bqmz7"
Sep 16 01:17:10.103046 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:17:10.102663    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 01:17:10.103046 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:17:10.102736    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57b44225-8ae5-410c-8f44-812c00c972b8-insights-runtime-extractor-tls podName:57b44225-8ae5-410c-8f44-812c00c972b8 nodeName:}" failed. No retries permitted until 2026-09-16 01:17:26.102718726 +0000 UTC m=+95.426187281 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/57b44225-8ae5-410c-8f44-812c00c972b8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bqmz7" (UID: "57b44225-8ae5-410c-8f44-812c00c972b8") : secret "insights-runtime-extractor-tls" not found
Sep 16 01:17:10.103257 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:10.103230    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57b44225-8ae5-410c-8f44-812c00c972b8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bqmz7\" (UID: \"57b44225-8ae5-410c-8f44-812c00c972b8\") " pod="openshift-insights/insights-runtime-extractor-bqmz7"
Sep 16 01:17:18.643425 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:18.643314    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f785b75b7-p9f5n"]
Sep 16 01:17:18.645870 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:18.645854    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f785b75b7-p9f5n"
Sep 16 01:17:18.648995 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:18.648958    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 16 01:17:18.649109 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:18.649015    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 16 01:17:18.650276 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:18.650257    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 16 01:17:18.650369 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:18.650276    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 16 01:17:18.650369 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:18.650257    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 16 01:17:18.650369 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:18.650305    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 16 01:17:18.650369 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:18.650332    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 16 01:17:18.664228 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:18.664204    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f785b75b7-p9f5n"]
Sep 16 01:17:18.770691 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:18.770660    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/29c0baed-cb2e-4421-8bf2-9a415d8f81f7-hub\") pod \"cluster-proxy-proxy-agent-5f785b75b7-p9f5n\" (UID: \"29c0baed-cb2e-4421-8bf2-9a415d8f81f7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f785b75b7-p9f5n"
Sep 16 01:17:18.770691 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:18.770694    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/29c0baed-cb2e-4421-8bf2-9a415d8f81f7-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5f785b75b7-p9f5n\" (UID: \"29c0baed-cb2e-4421-8bf2-9a415d8f81f7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f785b75b7-p9f5n"
Sep 16 01:17:18.770844 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:18.770733    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/29c0baed-cb2e-4421-8bf2-9a415d8f81f7-ca\") pod \"cluster-proxy-proxy-agent-5f785b75b7-p9f5n\" (UID: \"29c0baed-cb2e-4421-8bf2-9a415d8f81f7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f785b75b7-p9f5n"
Sep 16 01:17:18.770880 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:18.770846    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/29c0baed-cb2e-4421-8bf2-9a415d8f81f7-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5f785b75b7-p9f5n\" (UID: \"29c0baed-cb2e-4421-8bf2-9a415d8f81f7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f785b75b7-p9f5n"
Sep 16 01:17:18.770914 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:18.770878    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6c8vq\" (UniqueName: \"kubernetes.io/projected/29c0baed-cb2e-4421-8bf2-9a415d8f81f7-kube-api-access-6c8vq\") pod \"cluster-proxy-proxy-agent-5f785b75b7-p9f5n\" (UID: \"29c0baed-cb2e-4421-8bf2-9a415d8f81f7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f785b75b7-p9f5n"
Sep 16 01:17:18.770950 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:18.770929    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/29c0baed-cb2e-4421-8bf2-9a415d8f81f7-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5f785b75b7-p9f5n\" (UID: \"29c0baed-cb2e-4421-8bf2-9a415d8f81f7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f785b75b7-p9f5n"
Sep 16 01:17:18.872100 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:18.872069    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/29c0baed-cb2e-4421-8bf2-9a415d8f81f7-ca\") pod \"cluster-proxy-proxy-agent-5f785b75b7-p9f5n\" (UID: \"29c0baed-cb2e-4421-8bf2-9a415d8f81f7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f785b75b7-p9f5n"
Sep 16 01:17:18.872241 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:18.872124    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/29c0baed-cb2e-4421-8bf2-9a415d8f81f7-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5f785b75b7-p9f5n\" (UID: \"29c0baed-cb2e-4421-8bf2-9a415d8f81f7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f785b75b7-p9f5n"
Sep 16 01:17:18.872241 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:18.872139    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6c8vq\" (UniqueName: \"kubernetes.io/projected/29c0baed-cb2e-4421-8bf2-9a415d8f81f7-kube-api-access-6c8vq\") pod \"cluster-proxy-proxy-agent-5f785b75b7-p9f5n\" (UID: \"29c0baed-cb2e-4421-8bf2-9a415d8f81f7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f785b75b7-p9f5n"
Sep 16 01:17:18.872241 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:18.872170    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/29c0baed-cb2e-4421-8bf2-9a415d8f81f7-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5f785b75b7-p9f5n\" (UID: \"29c0baed-cb2e-4421-8bf2-9a415d8f81f7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f785b75b7-p9f5n"
Sep 16 01:17:18.872241 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:18.872200    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/29c0baed-cb2e-4421-8bf2-9a415d8f81f7-hub\") pod \"cluster-proxy-proxy-agent-5f785b75b7-p9f5n\" (UID: \"29c0baed-cb2e-4421-8bf2-9a415d8f81f7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f785b75b7-p9f5n"
Sep 16 01:17:18.872241 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:18.872217    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/29c0baed-cb2e-4421-8bf2-9a415d8f81f7-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5f785b75b7-p9f5n\" (UID: \"29c0baed-cb2e-4421-8bf2-9a415d8f81f7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f785b75b7-p9f5n"
Sep 16 01:17:18.873017 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:18.872992    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/29c0baed-cb2e-4421-8bf2-9a415d8f81f7-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5f785b75b7-p9f5n\" (UID: \"29c0baed-cb2e-4421-8bf2-9a415d8f81f7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f785b75b7-p9f5n"
Sep 16 01:17:18.874858 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:18.874831    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/29c0baed-cb2e-4421-8bf2-9a415d8f81f7-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5f785b75b7-p9f5n\" (UID: \"29c0baed-cb2e-4421-8bf2-9a415d8f81f7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f785b75b7-p9f5n"
Sep 16 01:17:18.874972 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:18.874869    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/29c0baed-cb2e-4421-8bf2-9a415d8f81f7-hub\") pod \"cluster-proxy-proxy-agent-5f785b75b7-p9f5n\" (UID: \"29c0baed-cb2e-4421-8bf2-9a415d8f81f7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f785b75b7-p9f5n"
Sep 16 01:17:18.874972 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:18.874959    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/29c0baed-cb2e-4421-8bf2-9a415d8f81f7-ca\") pod \"cluster-proxy-proxy-agent-5f785b75b7-p9f5n\" (UID: \"29c0baed-cb2e-4421-8bf2-9a415d8f81f7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f785b75b7-p9f5n"
Sep 16 01:17:18.875074 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:18.875047    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/29c0baed-cb2e-4421-8bf2-9a415d8f81f7-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5f785b75b7-p9f5n\" (UID: \"29c0baed-cb2e-4421-8bf2-9a415d8f81f7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f785b75b7-p9f5n"
Sep 16 01:17:18.882706 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:18.882682    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6c8vq\" (UniqueName: \"kubernetes.io/projected/29c0baed-cb2e-4421-8bf2-9a415d8f81f7-kube-api-access-6c8vq\") pod \"cluster-proxy-proxy-agent-5f785b75b7-p9f5n\" (UID: \"29c0baed-cb2e-4421-8bf2-9a415d8f81f7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f785b75b7-p9f5n"
Sep 16 01:17:18.962760 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:18.962740    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f785b75b7-p9f5n"
Sep 16 01:17:19.236011 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:19.235956    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f785b75b7-p9f5n"]
Sep 16 01:17:19.238442 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:17:19.238414    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod29c0baed_cb2e_4421_8bf2_9a415d8f81f7.slice/crio-1a59f0f5277e6ae0617c88335b835dae8b1e0f101c8bf1c75ebf5ed4f48a93a8 WatchSource:0}: Error finding container 1a59f0f5277e6ae0617c88335b835dae8b1e0f101c8bf1c75ebf5ed4f48a93a8: Status 404 returned error can't find the container with id 1a59f0f5277e6ae0617c88335b835dae8b1e0f101c8bf1c75ebf5ed4f48a93a8
Sep 16 01:17:19.617262 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:19.617179    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f785b75b7-p9f5n" event={"ID":"29c0baed-cb2e-4421-8bf2-9a415d8f81f7","Type":"ContainerStarted","Data":"1a59f0f5277e6ae0617c88335b835dae8b1e0f101c8bf1c75ebf5ed4f48a93a8"}
Sep 16 01:17:21.394938 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:21.394903    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b9dc9cce-c642-4259-83f4-dc9eaac7bbb8-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-dkwxh\" (UID: \"b9dc9cce-c642-4259-83f4-dc9eaac7bbb8\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-dkwxh"
Sep 16 01:17:21.397188 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:21.397166    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b9dc9cce-c642-4259-83f4-dc9eaac7bbb8-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-dkwxh\" (UID: \"b9dc9cce-c642-4259-83f4-dc9eaac7bbb8\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-dkwxh"
Sep 16 01:17:21.495228 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:21.495193    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62e020bc-deda-4f89-93a8-e737340375d7-service-ca-bundle\") pod \"router-default-ff46cf8-5t75c\" (UID: \"62e020bc-deda-4f89-93a8-e737340375d7\") " pod="openshift-ingress/router-default-ff46cf8-5t75c"
Sep 16 01:17:21.495228 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:21.495229    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62e020bc-deda-4f89-93a8-e737340375d7-metrics-certs\") pod \"router-default-ff46cf8-5t75c\" (UID: \"62e020bc-deda-4f89-93a8-e737340375d7\") " pod="openshift-ingress/router-default-ff46cf8-5t75c"
Sep 16 01:17:21.495892 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:21.495866    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62e020bc-deda-4f89-93a8-e737340375d7-service-ca-bundle\") pod \"router-default-ff46cf8-5t75c\" (UID: \"62e020bc-deda-4f89-93a8-e737340375d7\") " pod="openshift-ingress/router-default-ff46cf8-5t75c"
Sep 16 01:17:21.497595 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:21.497572    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62e020bc-deda-4f89-93a8-e737340375d7-metrics-certs\") pod \"router-default-ff46cf8-5t75c\" (UID: \"62e020bc-deda-4f89-93a8-e737340375d7\") " pod="openshift-ingress/router-default-ff46cf8-5t75c"
Sep 16 01:17:21.650800 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:21.650728    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-4vq2l\""
Sep 16 01:17:21.659097 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:21.659077    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-dkwxh"
Sep 16 01:17:21.781350 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:21.781305    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-wznt8\""
Sep 16 01:17:21.789404 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:21.789378    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-ff46cf8-5t75c"
Sep 16 01:17:21.928863 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:21.928821    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-dkwxh"]
Sep 16 01:17:21.931857 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:17:21.931826    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9dc9cce_c642_4259_83f4_dc9eaac7bbb8.slice/crio-86b84fedd7479ba096e6cc702903411a1eb62acaf16266b3c7c66573a665c0d0 WatchSource:0}: Error finding container 86b84fedd7479ba096e6cc702903411a1eb62acaf16266b3c7c66573a665c0d0: Status 404 returned error can't find the container with id 86b84fedd7479ba096e6cc702903411a1eb62acaf16266b3c7c66573a665c0d0
Sep 16 01:17:22.057972 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:22.057936    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-ff46cf8-5t75c"]
Sep 16 01:17:22.061447 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:17:22.061417    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62e020bc_deda_4f89_93a8_e737340375d7.slice/crio-785ebfdd14188077a71a854affd7ffc7a1eb2277186120b36c325ec9303be67f WatchSource:0}: Error finding container 785ebfdd14188077a71a854affd7ffc7a1eb2277186120b36c325ec9303be67f: Status 404 returned error can't find the container with id 785ebfdd14188077a71a854affd7ffc7a1eb2277186120b36c325ec9303be67f
Sep 16 01:17:22.628678 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:22.628641    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-dkwxh" event={"ID":"b9dc9cce-c642-4259-83f4-dc9eaac7bbb8","Type":"ContainerStarted","Data":"86b84fedd7479ba096e6cc702903411a1eb62acaf16266b3c7c66573a665c0d0"}
Sep 16 01:17:22.630209 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:22.630182    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-ff46cf8-5t75c" event={"ID":"62e020bc-deda-4f89-93a8-e737340375d7","Type":"ContainerStarted","Data":"e577829b6c2dc062cb4350761096bb83c8d80d44d92538b52e22a76fee6773af"}
Sep 16 01:17:22.630296 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:22.630230    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-ff46cf8-5t75c" event={"ID":"62e020bc-deda-4f89-93a8-e737340375d7","Type":"ContainerStarted","Data":"785ebfdd14188077a71a854affd7ffc7a1eb2277186120b36c325ec9303be67f"}
Sep 16 01:17:22.648324 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:22.648282    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-ff46cf8-5t75c" podStartSLOduration=33.648269216 podStartE2EDuration="33.648269216s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:16:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:17:22.646668478 +0000 UTC m=+91.970137055" watchObservedRunningTime="2026-09-16 01:17:22.648269216 +0000 UTC m=+91.971737793"
Sep 16 01:17:22.789659 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:22.789619    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-ff46cf8-5t75c"
Sep 16 01:17:22.791868 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:22.791840    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-ff46cf8-5t75c"
Sep 16 01:17:23.634927 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:23.634848    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-dkwxh" event={"ID":"b9dc9cce-c642-4259-83f4-dc9eaac7bbb8","Type":"ContainerStarted","Data":"4b5736d051d8285c2f386d921d7be27503c67520636c0e4f8e66dfcd2478967f"}
Sep 16 01:17:23.635290 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:23.635270    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-ff46cf8-5t75c"
Sep 16 01:17:23.636524 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:23.636504    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-ff46cf8-5t75c"
Sep 16 01:17:23.649070 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:23.649023    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-dkwxh" podStartSLOduration=33.27414724 podStartE2EDuration="34.649012458s" totalImagesPullingTime="1.374865218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:16:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:17:23.648832443 +0000 UTC m=+92.972301022" watchObservedRunningTime="2026-09-16 01:17:23.649012458 +0000 UTC m=+92.972481035"
Sep 16 01:17:25.643443 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:25.643408    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f785b75b7-p9f5n" event={"ID":"29c0baed-cb2e-4421-8bf2-9a415d8f81f7","Type":"ContainerStarted","Data":"a682bfd789131af2f36d185aaf7e1543f221ca336e9ef9ba63356671fc037e05"}
Sep 16 01:17:25.643443 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:25.643451    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f785b75b7-p9f5n" event={"ID":"29c0baed-cb2e-4421-8bf2-9a415d8f81f7","Type":"ContainerStarted","Data":"c7cd45356360f070036dfb08fb3a27e92d2a062325f700b57c16f5edd18f7908"}
Sep 16 01:17:25.643880 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:25.643466    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f785b75b7-p9f5n" event={"ID":"29c0baed-cb2e-4421-8bf2-9a415d8f81f7","Type":"ContainerStarted","Data":"c342f3a4d75056148acd9666bb3a33cc1b001b4d134e6c54d3d15b56e0df67ec"}
Sep 16 01:17:25.664989 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:25.664946    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f785b75b7-p9f5n" podStartSLOduration=1.909942351 podStartE2EDuration="7.664932804s" totalImagesPullingTime="5.754990453s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:17:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:17:25.66472309 +0000 UTC m=+94.988191669" watchObservedRunningTime="2026-09-16 01:17:25.664932804 +0000 UTC m=+94.988401381"
Sep 16 01:17:26.137848 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:26.137821    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57b44225-8ae5-410c-8f44-812c00c972b8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bqmz7\" (UID: \"57b44225-8ae5-410c-8f44-812c00c972b8\") " pod="openshift-insights/insights-runtime-extractor-bqmz7"
Sep 16 01:17:26.140122 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:26.140092    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57b44225-8ae5-410c-8f44-812c00c972b8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bqmz7\" (UID: \"57b44225-8ae5-410c-8f44-812c00c972b8\") " pod="openshift-insights/insights-runtime-extractor-bqmz7"
Sep 16 01:17:26.347943 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:26.347915    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bqmz7"
Sep 16 01:17:26.645325 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:26.645180    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bqmz7"]
Sep 16 01:17:26.647808 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:17:26.647780    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57b44225_8ae5_410c_8f44_812c00c972b8.slice/crio-5cc952ed474072a61afeb897bc5d36cd86d8629e0e597c1fddb8f94e31c7d19e WatchSource:0}: Error finding container 5cc952ed474072a61afeb897bc5d36cd86d8629e0e597c1fddb8f94e31c7d19e: Status 404 returned error can't find the container with id 5cc952ed474072a61afeb897bc5d36cd86d8629e0e597c1fddb8f94e31c7d19e
Sep 16 01:17:27.651095 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:27.651062    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bqmz7" event={"ID":"57b44225-8ae5-410c-8f44-812c00c972b8","Type":"ContainerStarted","Data":"35a14d802f8296e5433eb868ebc8aa3a4308b078812494ce5d778ca17fdf838b"}
Sep 16 01:17:27.651448 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:27.651114    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bqmz7" event={"ID":"57b44225-8ae5-410c-8f44-812c00c972b8","Type":"ContainerStarted","Data":"5cc952ed474072a61afeb897bc5d36cd86d8629e0e597c1fddb8f94e31c7d19e"}
Sep 16 01:17:28.656804 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:28.656767    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bqmz7" event={"ID":"57b44225-8ae5-410c-8f44-812c00c972b8","Type":"ContainerStarted","Data":"52f77daded2007c2c7c3f05320d37d6a89b47201e2b3dc9ab2a4956a091ab9e6"}
Sep 16 01:17:29.363275 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:29.363217    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/064dea27-f1a9-4eb9-990b-92d5b4ed0a2c-metrics-tls\") pod \"dns-default-pz7gn\" (UID: \"064dea27-f1a9-4eb9-990b-92d5b4ed0a2c\") " pod="openshift-dns/dns-default-pz7gn"
Sep 16 01:17:29.365386 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:29.365366    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/064dea27-f1a9-4eb9-990b-92d5b4ed0a2c-metrics-tls\") pod \"dns-default-pz7gn\" (UID: \"064dea27-f1a9-4eb9-990b-92d5b4ed0a2c\") " pod="openshift-dns/dns-default-pz7gn"
Sep 16 01:17:29.405511 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:29.405491    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sq7hb\""
Sep 16 01:17:29.413545 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:29.413533    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pz7gn"
Sep 16 01:17:29.553084 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:29.553057    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gvqfk"
Sep 16 01:17:29.662100 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:29.662063    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bqmz7" event={"ID":"57b44225-8ae5-410c-8f44-812c00c972b8","Type":"ContainerStarted","Data":"a3ffd73f534f8d6974bdccd143f3f18736198065f0487818d3c2da6c67831d5d"}
Sep 16 01:17:29.680493 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:29.680448    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-bqmz7" podStartSLOduration=33.459626827 podStartE2EDuration="35.680431477s" totalImagesPullingTime="2.22080465s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 01:16:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:17:29.679488404 +0000 UTC m=+99.002956984" watchObservedRunningTime="2026-09-16 01:17:29.680431477 +0000 UTC m=+99.003900053"
Sep 16 01:17:29.683785 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:29.683761    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pz7gn"]
Sep 16 01:17:29.686789 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:17:29.686770    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod064dea27_f1a9_4eb9_990b_92d5b4ed0a2c.slice/crio-45611bc156b759fc5c56271dc14174263bfbaa45fda0054bd9a254118946ef1c WatchSource:0}: Error finding container 45611bc156b759fc5c56271dc14174263bfbaa45fda0054bd9a254118946ef1c: Status 404 returned error can't find the container with id 45611bc156b759fc5c56271dc14174263bfbaa45fda0054bd9a254118946ef1c
Sep 16 01:17:30.666859 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:30.666821    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pz7gn" event={"ID":"064dea27-f1a9-4eb9-990b-92d5b4ed0a2c","Type":"ContainerStarted","Data":"45611bc156b759fc5c56271dc14174263bfbaa45fda0054bd9a254118946ef1c"}
Sep 16 01:17:31.675056 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:31.675022    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pz7gn" event={"ID":"064dea27-f1a9-4eb9-990b-92d5b4ed0a2c","Type":"ContainerStarted","Data":"aed4fe1c351745063696c08ad43f0fa1a16702e5f531863726b1b6e4d1407d12"}
Sep 16 01:17:31.675471 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:31.675110    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pz7gn" event={"ID":"064dea27-f1a9-4eb9-990b-92d5b4ed0a2c","Type":"ContainerStarted","Data":"e4a019cf400d15d5a1b352974f970abe457d7c0a65a4b457a25793b0efb2a972"}
Sep 16 01:17:31.675471 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:31.675177    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pz7gn"
Sep 16 01:17:31.692165 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:31.692119    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-pz7gn" podStartSLOduration=65.077412531 podStartE2EDuration="1m6.692105815s" totalImagesPullingTime="1.614693284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:16:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:17:31.69091704 +0000 UTC m=+101.014385616" watchObservedRunningTime="2026-09-16 01:17:31.692105815 +0000 UTC m=+101.015574392"
Sep 16 01:17:41.681015 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:41.680985    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pz7gn"
Sep 16 01:17:42.051782 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:42.051690    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-x6chc"]
Sep 16 01:17:42.053740 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:42.053723    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x6chc"
Sep 16 01:17:42.056505 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:42.056477    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 16 01:17:42.056929 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:42.056882    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 16 01:17:42.057304 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:42.057284    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 16 01:17:42.057304 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:42.057299    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 16 01:17:42.057624 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:42.057609    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 16 01:17:42.057724 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:42.057643    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bnfrk\""
Sep 16 01:17:42.057807 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:42.057755    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 16 01:17:42.153306 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:42.153279    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c7263ca2-ea08-4e19-986f-23cea0e8d3ab-root\") pod \"node-exporter-x6chc\" (UID: \"c7263ca2-ea08-4e19-986f-23cea0e8d3ab\") " pod="openshift-monitoring/node-exporter-x6chc"
Sep 16 01:17:42.153461 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:42.153311    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c7263ca2-ea08-4e19-986f-23cea0e8d3ab-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x6chc\" (UID: \"c7263ca2-ea08-4e19-986f-23cea0e8d3ab\") " pod="openshift-monitoring/node-exporter-x6chc"
Sep 16 01:17:42.153461 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:42.153330    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c7263ca2-ea08-4e19-986f-23cea0e8d3ab-sys\") pod \"node-exporter-x6chc\" (UID: \"c7263ca2-ea08-4e19-986f-23cea0e8d3ab\") " pod="openshift-monitoring/node-exporter-x6chc"
Sep 16 01:17:42.153461 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:42.153364    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c7263ca2-ea08-4e19-986f-23cea0e8d3ab-node-exporter-wtmp\") pod \"node-exporter-x6chc\" (UID: \"c7263ca2-ea08-4e19-986f-23cea0e8d3ab\") " pod="openshift-monitoring/node-exporter-x6chc"
Sep 16 01:17:42.153461 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:42.153417    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c7263ca2-ea08-4e19-986f-23cea0e8d3ab-node-exporter-accelerators-collector-config\") pod \"node-exporter-x6chc\" (UID: \"c7263ca2-ea08-4e19-986f-23cea0e8d3ab\") " pod="openshift-monitoring/node-exporter-x6chc"
Sep 16 01:17:42.153608 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:42.153499    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c7263ca2-ea08-4e19-986f-23cea0e8d3ab-node-exporter-tls\") pod \"node-exporter-x6chc\" (UID: \"c7263ca2-ea08-4e19-986f-23cea0e8d3ab\") " pod="openshift-monitoring/node-exporter-x6chc"
Sep 16 01:17:42.153608 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:42.153534    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5x8b\" (UniqueName: \"kubernetes.io/projected/c7263ca2-ea08-4e19-986f-23cea0e8d3ab-kube-api-access-p5x8b\") pod \"node-exporter-x6chc\" (UID: \"c7263ca2-ea08-4e19-986f-23cea0e8d3ab\") " pod="openshift-monitoring/node-exporter-x6chc"
Sep 16 01:17:42.153608 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:42.153550    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c7263ca2-ea08-4e19-986f-23cea0e8d3ab-node-exporter-textfile\") pod \"node-exporter-x6chc\" (UID: \"c7263ca2-ea08-4e19-986f-23cea0e8d3ab\") " pod="openshift-monitoring/node-exporter-x6chc"
Sep 16 01:17:42.153706 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:42.153616    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7263ca2-ea08-4e19-986f-23cea0e8d3ab-metrics-client-ca\") pod \"node-exporter-x6chc\" (UID: \"c7263ca2-ea08-4e19-986f-23cea0e8d3ab\") " pod="openshift-monitoring/node-exporter-x6chc"
Sep 16 01:17:42.254107 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:42.254076    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5x8b\" (UniqueName: \"kubernetes.io/projected/c7263ca2-ea08-4e19-986f-23cea0e8d3ab-kube-api-access-p5x8b\") pod \"node-exporter-x6chc\" (UID: \"c7263ca2-ea08-4e19-986f-23cea0e8d3ab\") " pod="openshift-monitoring/node-exporter-x6chc"
Sep 16 01:17:42.254107 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:42.254107    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c7263ca2-ea08-4e19-986f-23cea0e8d3ab-node-exporter-textfile\") pod \"node-exporter-x6chc\" (UID: \"c7263ca2-ea08-4e19-986f-23cea0e8d3ab\") " pod="openshift-monitoring/node-exporter-x6chc"
Sep 16 01:17:42.254279 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:42.254138    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7263ca2-ea08-4e19-986f-23cea0e8d3ab-metrics-client-ca\") pod \"node-exporter-x6chc\" (UID: \"c7263ca2-ea08-4e19-986f-23cea0e8d3ab\") " pod="openshift-monitoring/node-exporter-x6chc"
Sep 16 01:17:42.254279 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:42.254256    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c7263ca2-ea08-4e19-986f-23cea0e8d3ab-root\") pod \"node-exporter-x6chc\" (UID: \"c7263ca2-ea08-4e19-986f-23cea0e8d3ab\") " pod="openshift-monitoring/node-exporter-x6chc"
Sep 16 01:17:42.254380 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:42.254297    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c7263ca2-ea08-4e19-986f-23cea0e8d3ab-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x6chc\" (UID: \"c7263ca2-ea08-4e19-986f-23cea0e8d3ab\") " pod="openshift-monitoring/node-exporter-x6chc"
Sep 16 01:17:42.254380 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:42.254326    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c7263ca2-ea08-4e19-986f-23cea0e8d3ab-sys\") pod \"node-exporter-x6chc\" (UID: \"c7263ca2-ea08-4e19-986f-23cea0e8d3ab\") " pod="openshift-monitoring/node-exporter-x6chc"
Sep 16 01:17:42.254380 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:42.254370    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c7263ca2-ea08-4e19-986f-23cea0e8d3ab-node-exporter-wtmp\") pod \"node-exporter-x6chc\" (UID: \"c7263ca2-ea08-4e19-986f-23cea0e8d3ab\") " pod="openshift-monitoring/node-exporter-x6chc"
Sep 16 01:17:42.254533 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:42.254400    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c7263ca2-ea08-4e19-986f-23cea0e8d3ab-node-exporter-accelerators-collector-config\") pod \"node-exporter-x6chc\" (UID: \"c7263ca2-ea08-4e19-986f-23cea0e8d3ab\") " pod="openshift-monitoring/node-exporter-x6chc"
Sep 16 01:17:42.254533 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:42.254399    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c7263ca2-ea08-4e19-986f-23cea0e8d3ab-root\") pod \"node-exporter-x6chc\" (UID: \"c7263ca2-ea08-4e19-986f-23cea0e8d3ab\") " pod="openshift-monitoring/node-exporter-x6chc"
Sep 16 01:17:42.254533 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:42.254440    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c7263ca2-ea08-4e19-986f-23cea0e8d3ab-sys\") pod \"node-exporter-x6chc\" (UID: \"c7263ca2-ea08-4e19-986f-23cea0e8d3ab\") " pod="openshift-monitoring/node-exporter-x6chc"
Sep 16 01:17:42.254533 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:42.254456    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c7263ca2-ea08-4e19-986f-23cea0e8d3ab-node-exporter-tls\") pod \"node-exporter-x6chc\" (UID: \"c7263ca2-ea08-4e19-986f-23cea0e8d3ab\") " pod="openshift-monitoring/node-exporter-x6chc"
Sep 16 01:17:42.254533 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:42.254524    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c7263ca2-ea08-4e19-986f-23cea0e8d3ab-node-exporter-wtmp\") pod \"node-exporter-x6chc\" (UID: \"c7263ca2-ea08-4e19-986f-23cea0e8d3ab\") " pod="openshift-monitoring/node-exporter-x6chc"
Sep 16 01:17:42.254707 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:42.254568    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c7263ca2-ea08-4e19-986f-23cea0e8d3ab-node-exporter-textfile\") pod \"node-exporter-x6chc\" (UID: \"c7263ca2-ea08-4e19-986f-23cea0e8d3ab\") " pod="openshift-monitoring/node-exporter-x6chc"
Sep 16 01:17:42.254843 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:42.254825    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c7263ca2-ea08-4e19-986f-23cea0e8d3ab-node-exporter-accelerators-collector-config\") pod \"node-exporter-x6chc\" (UID: \"c7263ca2-ea08-4e19-986f-23cea0e8d3ab\") " pod="openshift-monitoring/node-exporter-x6chc"
Sep 16 01:17:42.254901 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:42.254831    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7263ca2-ea08-4e19-986f-23cea0e8d3ab-metrics-client-ca\") pod \"node-exporter-x6chc\" (UID: \"c7263ca2-ea08-4e19-986f-23cea0e8d3ab\") " pod="openshift-monitoring/node-exporter-x6chc"
Sep 16 01:17:42.256778 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:42.256754    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c7263ca2-ea08-4e19-986f-23cea0e8d3ab-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x6chc\" (UID: \"c7263ca2-ea08-4e19-986f-23cea0e8d3ab\") " pod="openshift-monitoring/node-exporter-x6chc"
Sep 16 01:17:42.256847 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:42.256776    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c7263ca2-ea08-4e19-986f-23cea0e8d3ab-node-exporter-tls\") pod \"node-exporter-x6chc\" (UID: \"c7263ca2-ea08-4e19-986f-23cea0e8d3ab\") " pod="openshift-monitoring/node-exporter-x6chc"
Sep 16 01:17:42.264735 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:42.264704    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5x8b\" (UniqueName: \"kubernetes.io/projected/c7263ca2-ea08-4e19-986f-23cea0e8d3ab-kube-api-access-p5x8b\") pod \"node-exporter-x6chc\" (UID: \"c7263ca2-ea08-4e19-986f-23cea0e8d3ab\") " pod="openshift-monitoring/node-exporter-x6chc"
Sep 16 01:17:42.362866 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:42.362777    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x6chc"
Sep 16 01:17:42.371807 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:17:42.371781    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7263ca2_ea08_4e19_986f_23cea0e8d3ab.slice/crio-32c6e7271fd59deda10636861e39d90a1875056d0f728b66e7f2fe310c8561e2 WatchSource:0}: Error finding container 32c6e7271fd59deda10636861e39d90a1875056d0f728b66e7f2fe310c8561e2: Status 404 returned error can't find the container with id 32c6e7271fd59deda10636861e39d90a1875056d0f728b66e7f2fe310c8561e2
Sep 16 01:17:42.712410 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:42.712374    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x6chc" event={"ID":"c7263ca2-ea08-4e19-986f-23cea0e8d3ab","Type":"ContainerStarted","Data":"32c6e7271fd59deda10636861e39d90a1875056d0f728b66e7f2fe310c8561e2"}
Sep 16 01:17:43.717094 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:43.717058    2565 generic.go:356] "Generic (PLEG): container finished" podID="c7263ca2-ea08-4e19-986f-23cea0e8d3ab" containerID="acbab6329f4b1614bc8dadbb293502103dd70140991efd4d50fed74b25dfbadd" exitCode=0
Sep 16 01:17:43.717535 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:43.717146    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x6chc" event={"ID":"c7263ca2-ea08-4e19-986f-23cea0e8d3ab","Type":"ContainerDied","Data":"acbab6329f4b1614bc8dadbb293502103dd70140991efd4d50fed74b25dfbadd"}
Sep 16 01:17:44.722463 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:44.722432    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x6chc" event={"ID":"c7263ca2-ea08-4e19-986f-23cea0e8d3ab","Type":"ContainerStarted","Data":"87f8f83eaa38e008315120083ac56829f399eb6964fc6ea55e301d5f3406eb41"}
Sep 16 01:17:44.722851 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:44.722480    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x6chc" event={"ID":"c7263ca2-ea08-4e19-986f-23cea0e8d3ab","Type":"ContainerStarted","Data":"5d0f064bb92a21c69454f16b4b0cbdce6045f7af0acdcf294921aeb3189d8c80"}
Sep 16 01:17:44.741495 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:44.741448    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-x6chc" podStartSLOduration=1.703777218 podStartE2EDuration="2.741435534s" totalImagesPullingTime="974.73705ms" totalInitContainerRuntime="62.921266ms" isStatefulPod=true podCreationTimestamp="2026-09-16 01:17:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:17:44.74110068 +0000 UTC m=+114.064569250" watchObservedRunningTime="2026-09-16 01:17:44.741435534 +0000 UTC m=+114.064904176"
Sep 16 01:17:46.891244 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:46.891204    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-wtnmz"]
Sep 16 01:17:46.893400 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:46.893380    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-wtnmz"
Sep 16 01:17:46.895842 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:46.895822    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 16 01:17:46.895956 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:46.895933    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-qc2tq\""
Sep 16 01:17:46.904846 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:46.904824    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-wtnmz"]
Sep 16 01:17:46.991305 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:46.991268    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c4fa7f68-6b61-47c6-bb6a-e24e9e240d24-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-wtnmz\" (UID: \"c4fa7f68-6b61-47c6-bb6a-e24e9e240d24\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-wtnmz"
Sep 16 01:17:46.991483 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:46.991333    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9xlb\" (UniqueName: \"kubernetes.io/projected/c4fa7f68-6b61-47c6-bb6a-e24e9e240d24-kube-api-access-b9xlb\") pod \"monitoring-plugin-5d85778b9d-wtnmz\" (UID: \"c4fa7f68-6b61-47c6-bb6a-e24e9e240d24\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-wtnmz"
Sep 16 01:17:47.091928 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:47.091892    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c4fa7f68-6b61-47c6-bb6a-e24e9e240d24-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-wtnmz\" (UID: \"c4fa7f68-6b61-47c6-bb6a-e24e9e240d24\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-wtnmz"
Sep 16 01:17:47.092059 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:47.091957    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9xlb\" (UniqueName: \"kubernetes.io/projected/c4fa7f68-6b61-47c6-bb6a-e24e9e240d24-kube-api-access-b9xlb\") pod \"monitoring-plugin-5d85778b9d-wtnmz\" (UID: \"c4fa7f68-6b61-47c6-bb6a-e24e9e240d24\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-wtnmz"
Sep 16 01:17:47.092059 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:17:47.092038    2565 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Sep 16 01:17:47.092127 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:17:47.092099    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4fa7f68-6b61-47c6-bb6a-e24e9e240d24-monitoring-plugin-cert podName:c4fa7f68-6b61-47c6-bb6a-e24e9e240d24 nodeName:}" failed. No retries permitted until 2026-09-16 01:17:47.592083532 +0000 UTC m=+116.915552092 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/c4fa7f68-6b61-47c6-bb6a-e24e9e240d24-monitoring-plugin-cert") pod "monitoring-plugin-5d85778b9d-wtnmz" (UID: "c4fa7f68-6b61-47c6-bb6a-e24e9e240d24") : secret "monitoring-plugin-cert" not found
Sep 16 01:17:47.101289 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:47.101265    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9xlb\" (UniqueName: \"kubernetes.io/projected/c4fa7f68-6b61-47c6-bb6a-e24e9e240d24-kube-api-access-b9xlb\") pod \"monitoring-plugin-5d85778b9d-wtnmz\" (UID: \"c4fa7f68-6b61-47c6-bb6a-e24e9e240d24\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-wtnmz"
Sep 16 01:17:47.596587 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:47.596548    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c4fa7f68-6b61-47c6-bb6a-e24e9e240d24-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-wtnmz\" (UID: \"c4fa7f68-6b61-47c6-bb6a-e24e9e240d24\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-wtnmz"
Sep 16 01:17:47.598859 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:47.598837    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c4fa7f68-6b61-47c6-bb6a-e24e9e240d24-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-wtnmz\" (UID: \"c4fa7f68-6b61-47c6-bb6a-e24e9e240d24\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-wtnmz"
Sep 16 01:17:47.801963 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:47.801932    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-wtnmz"
Sep 16 01:17:48.066177 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:48.066141    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-wtnmz"]
Sep 16 01:17:48.069057 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:17:48.069028    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4fa7f68_6b61_47c6_bb6a_e24e9e240d24.slice/crio-18f9bfa5be2ef7d2cf577da69bbf13bbfee1604de4178aeb5e9535b49e43e584 WatchSource:0}: Error finding container 18f9bfa5be2ef7d2cf577da69bbf13bbfee1604de4178aeb5e9535b49e43e584: Status 404 returned error can't find the container with id 18f9bfa5be2ef7d2cf577da69bbf13bbfee1604de4178aeb5e9535b49e43e584
Sep 16 01:17:48.737798 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:48.737758    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-wtnmz" event={"ID":"c4fa7f68-6b61-47c6-bb6a-e24e9e240d24","Type":"ContainerStarted","Data":"18f9bfa5be2ef7d2cf577da69bbf13bbfee1604de4178aeb5e9535b49e43e584"}
Sep 16 01:17:49.743320 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:49.743285    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-wtnmz" event={"ID":"c4fa7f68-6b61-47c6-bb6a-e24e9e240d24","Type":"ContainerStarted","Data":"8b05f2ca6722c94101a4d84160fbfb660822594e6d9041e8afebc4c607662788"}
Sep 16 01:17:49.743734 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:49.743465    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-wtnmz"
Sep 16 01:17:49.748233 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:49.748210    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-wtnmz"
Sep 16 01:17:49.757865 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:17:49.757820    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-wtnmz" podStartSLOduration=2.281075606 podStartE2EDuration="3.757805617s" totalImagesPullingTime="1.476730011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:17:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:17:49.756916395 +0000 UTC m=+119.080384971" watchObservedRunningTime="2026-09-16 01:17:49.757805617 +0000 UTC m=+119.081274193"
Sep 16 01:18:00.991211 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:18:00.991158    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4112bee2-636b-4e14-a5ba-fd2bb43fffaf-metrics-certs\") pod \"network-metrics-daemon-lxzjg\" (UID: \"4112bee2-636b-4e14-a5ba-fd2bb43fffaf\") " pod="openshift-multus/network-metrics-daemon-lxzjg"
Sep 16 01:18:00.993512 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:18:00.993489    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4112bee2-636b-4e14-a5ba-fd2bb43fffaf-metrics-certs\") pod \"network-metrics-daemon-lxzjg\" (UID: \"4112bee2-636b-4e14-a5ba-fd2bb43fffaf\") " pod="openshift-multus/network-metrics-daemon-lxzjg"
Sep 16 01:18:01.091357 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:18:01.091300    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-w6h4t\""
Sep 16 01:18:01.099292 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:18:01.099266    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxzjg"
Sep 16 01:18:01.372848 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:18:01.372774    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lxzjg"]
Sep 16 01:18:01.376332 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:18:01.376292    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4112bee2_636b_4e14_a5ba_fd2bb43fffaf.slice/crio-7cba8f95de62a2f3276dc63fbff5634feb38be174d37a374d53baab42d30ed96 WatchSource:0}: Error finding container 7cba8f95de62a2f3276dc63fbff5634feb38be174d37a374d53baab42d30ed96: Status 404 returned error can't find the container with id 7cba8f95de62a2f3276dc63fbff5634feb38be174d37a374d53baab42d30ed96
Sep 16 01:18:01.785315 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:18:01.785274    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lxzjg" event={"ID":"4112bee2-636b-4e14-a5ba-fd2bb43fffaf","Type":"ContainerStarted","Data":"7cba8f95de62a2f3276dc63fbff5634feb38be174d37a374d53baab42d30ed96"}
Sep 16 01:18:02.790523 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:18:02.790446    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lxzjg" event={"ID":"4112bee2-636b-4e14-a5ba-fd2bb43fffaf","Type":"ContainerStarted","Data":"ea38b2c8a710858e73eb35103bdc3888908e256823fdda533c51eadc7fc92073"}
Sep 16 01:18:02.790523 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:18:02.790508    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lxzjg" event={"ID":"4112bee2-636b-4e14-a5ba-fd2bb43fffaf","Type":"ContainerStarted","Data":"66228cf656eed290e91170635fb9bd5ff9d8c5d6f514343f4dee8b9ff5c5bcc4"}
Sep 16 01:18:02.805038 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:18:02.804990    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-lxzjg" podStartSLOduration=129.766691305 podStartE2EDuration="2m10.804974394s" totalImagesPullingTime="1.038283089s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:15:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:18:02.804226743 +0000 UTC m=+132.127695321" watchObservedRunningTime="2026-09-16 01:18:02.804974394 +0000 UTC m=+132.128442964"
Sep 16 01:18:12.880073 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:18:12.880023    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-wtnmz_c4fa7f68-6b61-47c6-bb6a-e24e9e240d24/monitoring-plugin/0.log"
Sep 16 01:18:14.279271 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:18:14.279240    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x6chc_c7263ca2-ea08-4e19-986f-23cea0e8d3ab/init-textfile/0.log"
Sep 16 01:18:14.480181 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:18:14.480147    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x6chc_c7263ca2-ea08-4e19-986f-23cea0e8d3ab/node-exporter/0.log"
Sep 16 01:18:14.678519 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:18:14.678493    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x6chc_c7263ca2-ea08-4e19-986f-23cea0e8d3ab/kube-rbac-proxy/0.log"
Sep 16 01:18:18.679821 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:18:18.679790    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-dkwxh_b9dc9cce-c642-4259-83f4-dc9eaac7bbb8/networking-console-plugin/0.log"
Sep 16 01:18:19.847392 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:18:19.847301    2565 generic.go:356] "Generic (PLEG): container finished" podID="653d2ad6-c615-4dde-a7fb-980f70eb4de7" containerID="aeb4d0ac32d10699e6e9f61fa1ab19f91a0bb5543a10c4c4849f2e3cecdb3d43" exitCode=0
Sep 16 01:18:19.847392 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:18:19.847382    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dnsvb" event={"ID":"653d2ad6-c615-4dde-a7fb-980f70eb4de7","Type":"ContainerDied","Data":"aeb4d0ac32d10699e6e9f61fa1ab19f91a0bb5543a10c4c4849f2e3cecdb3d43"}
Sep 16 01:18:19.847775 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:18:19.847669    2565 scope.go:117] "RemoveContainer" containerID="aeb4d0ac32d10699e6e9f61fa1ab19f91a0bb5543a10c4c4849f2e3cecdb3d43"
Sep 16 01:18:19.884539 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:18:19.880128    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-ff46cf8-5t75c_62e020bc-deda-4f89-93a8-e737340375d7/router/0.log"
Sep 16 01:18:20.078725 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:18:20.078695    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tcx6s_1bc088f7-5296-4cd4-b845-f56577d3a938/serve-healthcheck-canary/0.log"
Sep 16 01:18:20.852576 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:18:20.852542    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dnsvb" event={"ID":"653d2ad6-c615-4dde-a7fb-980f70eb4de7","Type":"ContainerStarted","Data":"2fda44fbf84d885ce5b64c81da28d8391cb8bb7a47b8fc6fa75549940eeba196"}
Sep 16 01:18:29.886735 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:18:29.886699    2565 generic.go:356] "Generic (PLEG): container finished" podID="4755f5d3-0ca0-4282-b40a-d8fb5ba15798" containerID="ae8d92b7f3fd540a24e9cfed3e95134016da2aa4a469dd9ec78bec4824a8a929" exitCode=0
Sep 16 01:18:29.887219 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:18:29.886777    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-zkvx6" event={"ID":"4755f5d3-0ca0-4282-b40a-d8fb5ba15798","Type":"ContainerDied","Data":"ae8d92b7f3fd540a24e9cfed3e95134016da2aa4a469dd9ec78bec4824a8a929"}
Sep 16 01:18:29.887219 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:18:29.887185    2565 scope.go:117] "RemoveContainer" containerID="ae8d92b7f3fd540a24e9cfed3e95134016da2aa4a469dd9ec78bec4824a8a929"
Sep 16 01:18:30.892456 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:18:30.892424    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-zkvx6" event={"ID":"4755f5d3-0ca0-4282-b40a-d8fb5ba15798","Type":"ContainerStarted","Data":"778c37955ba03ace86a4742d3c53715c77cf54ec0f58700303bb4e49a7c7b5c6"}
Sep 16 01:20:51.082761 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:20:51.082724    2565 kubelet.go:1648] "Image garbage collection succeeded"
Sep 16 01:20:52.565179 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:20:52.564594    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-gs7nd"]
Sep 16 01:20:52.568885 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:20:52.568857    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gs7nd"
Sep 16 01:20:52.571393 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:20:52.571371    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 16 01:20:52.572537 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:20:52.572519    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-gfhdh\""
Sep 16 01:20:52.572589 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:20:52.572538    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 16 01:20:52.575179 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:20:52.575119    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-gs7nd"]
Sep 16 01:20:52.610132 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:20:52.610082    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2a7b8c54-f6b4-48c5-8d85-3879fa222c68-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-gs7nd\" (UID: \"2a7b8c54-f6b4-48c5-8d85-3879fa222c68\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gs7nd"
Sep 16 01:20:52.610132 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:20:52.610136    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljl68\" (UniqueName: \"kubernetes.io/projected/2a7b8c54-f6b4-48c5-8d85-3879fa222c68-kube-api-access-ljl68\") pod \"cert-manager-cainjector-559cdd8c87-gs7nd\" (UID: \"2a7b8c54-f6b4-48c5-8d85-3879fa222c68\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gs7nd"
Sep 16 01:20:52.711551 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:20:52.711507    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljl68\" (UniqueName: \"kubernetes.io/projected/2a7b8c54-f6b4-48c5-8d85-3879fa222c68-kube-api-access-ljl68\") pod \"cert-manager-cainjector-559cdd8c87-gs7nd\" (UID: \"2a7b8c54-f6b4-48c5-8d85-3879fa222c68\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gs7nd"
Sep 16 01:20:52.711758 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:20:52.711606    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2a7b8c54-f6b4-48c5-8d85-3879fa222c68-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-gs7nd\" (UID: \"2a7b8c54-f6b4-48c5-8d85-3879fa222c68\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gs7nd"
Sep 16 01:20:52.727762 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:20:52.727729    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2a7b8c54-f6b4-48c5-8d85-3879fa222c68-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-gs7nd\" (UID: \"2a7b8c54-f6b4-48c5-8d85-3879fa222c68\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gs7nd"
Sep 16 01:20:52.727942 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:20:52.727919    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljl68\" (UniqueName: \"kubernetes.io/projected/2a7b8c54-f6b4-48c5-8d85-3879fa222c68-kube-api-access-ljl68\") pod \"cert-manager-cainjector-559cdd8c87-gs7nd\" (UID: \"2a7b8c54-f6b4-48c5-8d85-3879fa222c68\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gs7nd"
Sep 16 01:20:52.878838 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:20:52.878747    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gs7nd"
Sep 16 01:20:53.148568 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:20:53.148416    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-gs7nd"]
Sep 16 01:20:53.151225 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:20:53.151199    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2a7b8c54_f6b4_48c5_8d85_3879fa222c68.slice/crio-e992ef880bed5d40063dc959b8c7ae69fa0402a40cef868e81401f02e3a09540 WatchSource:0}: Error finding container e992ef880bed5d40063dc959b8c7ae69fa0402a40cef868e81401f02e3a09540: Status 404 returned error can't find the container with id e992ef880bed5d40063dc959b8c7ae69fa0402a40cef868e81401f02e3a09540
Sep 16 01:20:53.153249 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:20:53.153227    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 01:20:53.386988 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:20:53.386939    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gs7nd" event={"ID":"2a7b8c54-f6b4-48c5-8d85-3879fa222c68","Type":"ContainerStarted","Data":"e992ef880bed5d40063dc959b8c7ae69fa0402a40cef868e81401f02e3a09540"}
Sep 16 01:20:57.404405 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:20:57.404369    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gs7nd" event={"ID":"2a7b8c54-f6b4-48c5-8d85-3879fa222c68","Type":"ContainerStarted","Data":"c015e3678158e824722778deed512ad8decebab94d8d354ad16db1d9bfc3e45c"}
Sep 16 01:20:57.419605 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:20:57.419562    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gs7nd" podStartSLOduration=2.011575703 podStartE2EDuration="5.419546058s" totalImagesPullingTime="3.407970355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:20:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:20:57.418609295 +0000 UTC m=+306.742077871" watchObservedRunningTime="2026-09-16 01:20:57.419546058 +0000 UTC m=+306.743014633"
Sep 16 01:21:24.760382 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:24.760331    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f84c66984-v2sgb"]
Sep 16 01:21:24.764040 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:24.764021    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f84c66984-v2sgb"
Sep 16 01:21:24.768997 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:24.768978    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 16 01:21:24.769228 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:24.769207    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-8s6lc\""
Sep 16 01:21:24.770717 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:24.770698    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 16 01:21:24.771546 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:24.771529    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 16 01:21:24.772554 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:24.772534    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 16 01:21:24.795230 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:24.795206    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f84c66984-v2sgb"]
Sep 16 01:21:24.840246 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:24.840221    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/553974ef-47d8-4734-9673-2634bcf4839d-tmp\") pod \"opendatahub-operator-controller-manager-5f84c66984-v2sgb\" (UID: \"553974ef-47d8-4734-9673-2634bcf4839d\") " pod="opendatahub/opendatahub-operator-controller-manager-5f84c66984-v2sgb"
Sep 16 01:21:24.840367 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:24.840251    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/553974ef-47d8-4734-9673-2634bcf4839d-manifests\") pod \"opendatahub-operator-controller-manager-5f84c66984-v2sgb\" (UID: \"553974ef-47d8-4734-9673-2634bcf4839d\") " pod="opendatahub/opendatahub-operator-controller-manager-5f84c66984-v2sgb"
Sep 16 01:21:24.840367 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:24.840285    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/553974ef-47d8-4734-9673-2634bcf4839d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f84c66984-v2sgb\" (UID: \"553974ef-47d8-4734-9673-2634bcf4839d\") " pod="opendatahub/opendatahub-operator-controller-manager-5f84c66984-v2sgb"
Sep 16 01:21:24.840367 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:24.840321    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/553974ef-47d8-4734-9673-2634bcf4839d-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f84c66984-v2sgb\" (UID: \"553974ef-47d8-4734-9673-2634bcf4839d\") " pod="opendatahub/opendatahub-operator-controller-manager-5f84c66984-v2sgb"
Sep 16 01:21:24.840488 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:24.840379    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hb66n\" (UniqueName: \"kubernetes.io/projected/553974ef-47d8-4734-9673-2634bcf4839d-kube-api-access-hb66n\") pod \"opendatahub-operator-controller-manager-5f84c66984-v2sgb\" (UID: \"553974ef-47d8-4734-9673-2634bcf4839d\") " pod="opendatahub/opendatahub-operator-controller-manager-5f84c66984-v2sgb"
Sep 16 01:21:24.941000 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:24.940976    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/553974ef-47d8-4734-9673-2634bcf4839d-tmp\") pod \"opendatahub-operator-controller-manager-5f84c66984-v2sgb\" (UID: \"553974ef-47d8-4734-9673-2634bcf4839d\") " pod="opendatahub/opendatahub-operator-controller-manager-5f84c66984-v2sgb"
Sep 16 01:21:24.941112 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:24.941007    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/553974ef-47d8-4734-9673-2634bcf4839d-manifests\") pod \"opendatahub-operator-controller-manager-5f84c66984-v2sgb\" (UID: \"553974ef-47d8-4734-9673-2634bcf4839d\") " pod="opendatahub/opendatahub-operator-controller-manager-5f84c66984-v2sgb"
Sep 16 01:21:24.941112 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:24.941041    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/553974ef-47d8-4734-9673-2634bcf4839d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f84c66984-v2sgb\" (UID: \"553974ef-47d8-4734-9673-2634bcf4839d\") " pod="opendatahub/opendatahub-operator-controller-manager-5f84c66984-v2sgb"
Sep 16 01:21:24.941112 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:24.941077    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/553974ef-47d8-4734-9673-2634bcf4839d-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f84c66984-v2sgb\" (UID: \"553974ef-47d8-4734-9673-2634bcf4839d\") " pod="opendatahub/opendatahub-operator-controller-manager-5f84c66984-v2sgb"
Sep 16 01:21:24.941218 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:24.941112    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hb66n\" (UniqueName: \"kubernetes.io/projected/553974ef-47d8-4734-9673-2634bcf4839d-kube-api-access-hb66n\") pod \"opendatahub-operator-controller-manager-5f84c66984-v2sgb\" (UID: \"553974ef-47d8-4734-9673-2634bcf4839d\") " pod="opendatahub/opendatahub-operator-controller-manager-5f84c66984-v2sgb"
Sep 16 01:21:24.941486 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:24.941466    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/553974ef-47d8-4734-9673-2634bcf4839d-manifests\") pod \"opendatahub-operator-controller-manager-5f84c66984-v2sgb\" (UID: \"553974ef-47d8-4734-9673-2634bcf4839d\") " pod="opendatahub/opendatahub-operator-controller-manager-5f84c66984-v2sgb"
Sep 16 01:21:24.943370 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:24.943330    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/553974ef-47d8-4734-9673-2634bcf4839d-tmp\") pod \"opendatahub-operator-controller-manager-5f84c66984-v2sgb\" (UID: \"553974ef-47d8-4734-9673-2634bcf4839d\") " pod="opendatahub/opendatahub-operator-controller-manager-5f84c66984-v2sgb"
Sep 16 01:21:24.943505 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:24.943485    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/553974ef-47d8-4734-9673-2634bcf4839d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f84c66984-v2sgb\" (UID: \"553974ef-47d8-4734-9673-2634bcf4839d\") " pod="opendatahub/opendatahub-operator-controller-manager-5f84c66984-v2sgb"
Sep 16 01:21:24.943549 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:24.943518    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/553974ef-47d8-4734-9673-2634bcf4839d-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f84c66984-v2sgb\" (UID: \"553974ef-47d8-4734-9673-2634bcf4839d\") " pod="opendatahub/opendatahub-operator-controller-manager-5f84c66984-v2sgb"
Sep 16 01:21:24.955253 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:24.955232    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hb66n\" (UniqueName: \"kubernetes.io/projected/553974ef-47d8-4734-9673-2634bcf4839d-kube-api-access-hb66n\") pod \"opendatahub-operator-controller-manager-5f84c66984-v2sgb\" (UID: \"553974ef-47d8-4734-9673-2634bcf4839d\") " pod="opendatahub/opendatahub-operator-controller-manager-5f84c66984-v2sgb"
Sep 16 01:21:25.073736 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:25.073673    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f84c66984-v2sgb"
Sep 16 01:21:25.353005 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:25.352958    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f84c66984-v2sgb"]
Sep 16 01:21:25.355180 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:21:25.355156    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod553974ef_47d8_4734_9673_2634bcf4839d.slice/crio-1689513a6ca51e8c9a07585a2a842ea93a32188a5a2db9ca47ac77f0dd35e116 WatchSource:0}: Error finding container 1689513a6ca51e8c9a07585a2a842ea93a32188a5a2db9ca47ac77f0dd35e116: Status 404 returned error can't find the container with id 1689513a6ca51e8c9a07585a2a842ea93a32188a5a2db9ca47ac77f0dd35e116
Sep 16 01:21:25.499232 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:25.499191    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f84c66984-v2sgb" event={"ID":"553974ef-47d8-4734-9673-2634bcf4839d","Type":"ContainerStarted","Data":"1689513a6ca51e8c9a07585a2a842ea93a32188a5a2db9ca47ac77f0dd35e116"}
Sep 16 01:21:28.514419 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:28.514390    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f84c66984-v2sgb" event={"ID":"553974ef-47d8-4734-9673-2634bcf4839d","Type":"ContainerStarted","Data":"213375f6b3f6f1d8e5a36fd3d04cd4bbdd5791b679b68ef612e85116b4f575f0"}
Sep 16 01:21:29.519331 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:29.519256    2565 generic.go:356] "Generic (PLEG): container finished" podID="553974ef-47d8-4734-9673-2634bcf4839d" containerID="213375f6b3f6f1d8e5a36fd3d04cd4bbdd5791b679b68ef612e85116b4f575f0" exitCode=0
Sep 16 01:21:29.519696 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:29.519355    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f84c66984-v2sgb" event={"ID":"553974ef-47d8-4734-9673-2634bcf4839d","Type":"ContainerDied","Data":"213375f6b3f6f1d8e5a36fd3d04cd4bbdd5791b679b68ef612e85116b4f575f0"}
Sep 16 01:21:30.524955 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:30.524921    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f84c66984-v2sgb" event={"ID":"553974ef-47d8-4734-9673-2634bcf4839d","Type":"ContainerStarted","Data":"f91f1839313fadb693b3d4132f36a1b532cb59ec8e864d29fd8b5843a836239b"}
Sep 16 01:21:30.525406 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:30.525032    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5f84c66984-v2sgb"
Sep 16 01:21:30.546299 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:30.546244    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5f84c66984-v2sgb" podStartSLOduration=2.213827777 podStartE2EDuration="6.546228197s" totalImagesPullingTime="3.303025388s" totalInitContainerRuntime="1.029375032s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:21:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:21:30.543879764 +0000 UTC m=+339.867348344" watchObservedRunningTime="2026-09-16 01:21:30.546228197 +0000 UTC m=+339.869696774"
Sep 16 01:21:41.530944 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:41.530914    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5f84c66984-v2sgb"
Sep 16 01:21:47.330946 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:47.330907    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-569b779d49-bsbr8"]
Sep 16 01:21:47.334022 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:47.334006    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-569b779d49-bsbr8"
Sep 16 01:21:47.337043 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:47.337022    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 16 01:21:47.337518 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:47.337502    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 16 01:21:47.346158 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:47.346135    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-569b779d49-bsbr8"]
Sep 16 01:21:47.503199 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:47.503162    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/501d163c-b2ec-4565-9318-3446994673e8-tmp\") pod \"kube-auth-proxy-569b779d49-bsbr8\" (UID: \"501d163c-b2ec-4565-9318-3446994673e8\") " pod="openshift-ingress/kube-auth-proxy-569b779d49-bsbr8"
Sep 16 01:21:47.503399 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:47.503247    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/501d163c-b2ec-4565-9318-3446994673e8-tls-certs\") pod \"kube-auth-proxy-569b779d49-bsbr8\" (UID: \"501d163c-b2ec-4565-9318-3446994673e8\") " pod="openshift-ingress/kube-auth-proxy-569b779d49-bsbr8"
Sep 16 01:21:47.503399 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:47.503303    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jrqm\" (UniqueName: \"kubernetes.io/projected/501d163c-b2ec-4565-9318-3446994673e8-kube-api-access-6jrqm\") pod \"kube-auth-proxy-569b779d49-bsbr8\" (UID: \"501d163c-b2ec-4565-9318-3446994673e8\") " pod="openshift-ingress/kube-auth-proxy-569b779d49-bsbr8"
Sep 16 01:21:47.604004 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:47.603934    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jrqm\" (UniqueName: \"kubernetes.io/projected/501d163c-b2ec-4565-9318-3446994673e8-kube-api-access-6jrqm\") pod \"kube-auth-proxy-569b779d49-bsbr8\" (UID: \"501d163c-b2ec-4565-9318-3446994673e8\") " pod="openshift-ingress/kube-auth-proxy-569b779d49-bsbr8"
Sep 16 01:21:47.604004 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:47.603980    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/501d163c-b2ec-4565-9318-3446994673e8-tmp\") pod \"kube-auth-proxy-569b779d49-bsbr8\" (UID: \"501d163c-b2ec-4565-9318-3446994673e8\") " pod="openshift-ingress/kube-auth-proxy-569b779d49-bsbr8"
Sep 16 01:21:47.604159 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:47.604019    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/501d163c-b2ec-4565-9318-3446994673e8-tls-certs\") pod \"kube-auth-proxy-569b779d49-bsbr8\" (UID: \"501d163c-b2ec-4565-9318-3446994673e8\") " pod="openshift-ingress/kube-auth-proxy-569b779d49-bsbr8"
Sep 16 01:21:47.606220 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:47.606199    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/501d163c-b2ec-4565-9318-3446994673e8-tmp\") pod \"kube-auth-proxy-569b779d49-bsbr8\" (UID: \"501d163c-b2ec-4565-9318-3446994673e8\") " pod="openshift-ingress/kube-auth-proxy-569b779d49-bsbr8"
Sep 16 01:21:47.606456 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:47.606438    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/501d163c-b2ec-4565-9318-3446994673e8-tls-certs\") pod \"kube-auth-proxy-569b779d49-bsbr8\" (UID: \"501d163c-b2ec-4565-9318-3446994673e8\") " pod="openshift-ingress/kube-auth-proxy-569b779d49-bsbr8"
Sep 16 01:21:47.611133 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:47.611112    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jrqm\" (UniqueName: \"kubernetes.io/projected/501d163c-b2ec-4565-9318-3446994673e8-kube-api-access-6jrqm\") pod \"kube-auth-proxy-569b779d49-bsbr8\" (UID: \"501d163c-b2ec-4565-9318-3446994673e8\") " pod="openshift-ingress/kube-auth-proxy-569b779d49-bsbr8"
Sep 16 01:21:47.643055 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:47.643032    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-569b779d49-bsbr8"
Sep 16 01:21:47.915424 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:47.915398    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-569b779d49-bsbr8"]
Sep 16 01:21:47.918124 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:21:47.918098    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod501d163c_b2ec_4565_9318_3446994673e8.slice/crio-b35d846954d550e1b78c83a4d982ac38a6d9ecccd9ee724b4e9f1a0bf23ba074 WatchSource:0}: Error finding container b35d846954d550e1b78c83a4d982ac38a6d9ecccd9ee724b4e9f1a0bf23ba074: Status 404 returned error can't find the container with id b35d846954d550e1b78c83a4d982ac38a6d9ecccd9ee724b4e9f1a0bf23ba074
Sep 16 01:21:48.487739 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:48.487706    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w79z4"]
Sep 16 01:21:48.491771 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:48.491754    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w79z4"
Sep 16 01:21:48.494120 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:48.494067    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 16 01:21:48.494235 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:48.494072    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 16 01:21:48.494235 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:48.494158    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-rhpj7\""
Sep 16 01:21:48.494235 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:48.494214    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 16 01:21:48.494440 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:48.494278    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 16 01:21:48.502026 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:48.502002    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w79z4"]
Sep 16 01:21:48.590483 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:48.590450    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-569b779d49-bsbr8" event={"ID":"501d163c-b2ec-4565-9318-3446994673e8","Type":"ContainerStarted","Data":"b35d846954d550e1b78c83a4d982ac38a6d9ecccd9ee724b4e9f1a0bf23ba074"}
Sep 16 01:21:48.613796 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:48.613767    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ce70a06d-62f7-4d5b-9249-595e78515592-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-w79z4\" (UID: \"ce70a06d-62f7-4d5b-9249-595e78515592\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w79z4"
Sep 16 01:21:48.613927 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:48.613822    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce70a06d-62f7-4d5b-9249-595e78515592-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-w79z4\" (UID: \"ce70a06d-62f7-4d5b-9249-595e78515592\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w79z4"
Sep 16 01:21:48.613927 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:48.613841    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce70a06d-62f7-4d5b-9249-595e78515592-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-w79z4\" (UID: \"ce70a06d-62f7-4d5b-9249-595e78515592\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w79z4"
Sep 16 01:21:48.613927 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:48.613860    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkhxt\" (UniqueName: \"kubernetes.io/projected/ce70a06d-62f7-4d5b-9249-595e78515592-kube-api-access-lkhxt\") pod \"istiod-openshift-gateway-7b7995d5cd-w79z4\" (UID: \"ce70a06d-62f7-4d5b-9249-595e78515592\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w79z4"
Sep 16 01:21:48.613927 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:48.613890    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ce70a06d-62f7-4d5b-9249-595e78515592-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-w79z4\" (UID: \"ce70a06d-62f7-4d5b-9249-595e78515592\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w79z4"
Sep 16 01:21:48.614144 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:48.613976    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ce70a06d-62f7-4d5b-9249-595e78515592-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-w79z4\" (UID: \"ce70a06d-62f7-4d5b-9249-595e78515592\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w79z4"
Sep 16 01:21:48.614144 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:48.614003    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ce70a06d-62f7-4d5b-9249-595e78515592-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-w79z4\" (UID: \"ce70a06d-62f7-4d5b-9249-595e78515592\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w79z4"
Sep 16 01:21:48.714933 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:48.714902    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce70a06d-62f7-4d5b-9249-595e78515592-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-w79z4\" (UID: \"ce70a06d-62f7-4d5b-9249-595e78515592\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w79z4"
Sep 16 01:21:48.714933 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:48.714936    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce70a06d-62f7-4d5b-9249-595e78515592-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-w79z4\" (UID: \"ce70a06d-62f7-4d5b-9249-595e78515592\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w79z4"
Sep 16 01:21:48.715145 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:48.714959    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkhxt\" (UniqueName: \"kubernetes.io/projected/ce70a06d-62f7-4d5b-9249-595e78515592-kube-api-access-lkhxt\") pod \"istiod-openshift-gateway-7b7995d5cd-w79z4\" (UID: \"ce70a06d-62f7-4d5b-9249-595e78515592\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w79z4"
Sep 16 01:21:48.715145 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:48.714982    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ce70a06d-62f7-4d5b-9249-595e78515592-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-w79z4\" (UID: \"ce70a06d-62f7-4d5b-9249-595e78515592\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w79z4"
Sep 16 01:21:48.715145 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:48.715021    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ce70a06d-62f7-4d5b-9249-595e78515592-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-w79z4\" (UID: \"ce70a06d-62f7-4d5b-9249-595e78515592\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w79z4"
Sep 16 01:21:48.715145 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:48.715050    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ce70a06d-62f7-4d5b-9249-595e78515592-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-w79z4\" (UID: \"ce70a06d-62f7-4d5b-9249-595e78515592\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w79z4"
Sep 16 01:21:48.715145 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:48.715092    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ce70a06d-62f7-4d5b-9249-595e78515592-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-w79z4\" (UID: \"ce70a06d-62f7-4d5b-9249-595e78515592\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w79z4"
Sep 16 01:21:48.715769 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:48.715721    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ce70a06d-62f7-4d5b-9249-595e78515592-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-w79z4\" (UID: \"ce70a06d-62f7-4d5b-9249-595e78515592\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w79z4"
Sep 16 01:21:48.717261 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:48.717229    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce70a06d-62f7-4d5b-9249-595e78515592-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-w79z4\" (UID: \"ce70a06d-62f7-4d5b-9249-595e78515592\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w79z4"
Sep 16 01:21:48.717548 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:48.717527    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ce70a06d-62f7-4d5b-9249-595e78515592-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-w79z4\" (UID: \"ce70a06d-62f7-4d5b-9249-595e78515592\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w79z4"
Sep 16 01:21:48.717863 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:48.717843    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ce70a06d-62f7-4d5b-9249-595e78515592-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-w79z4\" (UID: \"ce70a06d-62f7-4d5b-9249-595e78515592\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w79z4"
Sep 16 01:21:48.717863 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:48.717856    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ce70a06d-62f7-4d5b-9249-595e78515592-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-w79z4\" (UID: \"ce70a06d-62f7-4d5b-9249-595e78515592\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w79z4"
Sep 16 01:21:48.722207 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:48.722189    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkhxt\" (UniqueName: \"kubernetes.io/projected/ce70a06d-62f7-4d5b-9249-595e78515592-kube-api-access-lkhxt\") pod \"istiod-openshift-gateway-7b7995d5cd-w79z4\" (UID: \"ce70a06d-62f7-4d5b-9249-595e78515592\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w79z4"
Sep 16 01:21:48.722420 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:48.722397    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce70a06d-62f7-4d5b-9249-595e78515592-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-w79z4\" (UID: \"ce70a06d-62f7-4d5b-9249-595e78515592\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w79z4"
Sep 16 01:21:48.801272 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:48.801193    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w79z4"
Sep 16 01:21:49.088002 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:49.087882    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w79z4"]
Sep 16 01:21:49.091822 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:21:49.091790    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce70a06d_62f7_4d5b_9249_595e78515592.slice/crio-525a447e2d9978950af688ce1ecdb08027c702ce15a4e7fc1f57fb83abdf3101 WatchSource:0}: Error finding container 525a447e2d9978950af688ce1ecdb08027c702ce15a4e7fc1f57fb83abdf3101: Status 404 returned error can't find the container with id 525a447e2d9978950af688ce1ecdb08027c702ce15a4e7fc1f57fb83abdf3101
Sep 16 01:21:49.598236 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:49.598195    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w79z4" event={"ID":"ce70a06d-62f7-4d5b-9249-595e78515592","Type":"ContainerStarted","Data":"525a447e2d9978950af688ce1ecdb08027c702ce15a4e7fc1f57fb83abdf3101"}
Sep 16 01:21:51.608825 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:51.608787    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-569b779d49-bsbr8" event={"ID":"501d163c-b2ec-4565-9318-3446994673e8","Type":"ContainerStarted","Data":"d236d687b4770e9478519259153ae50ec188582ccaa5c4df6ad4f1546e8b1aa5"}
Sep 16 01:21:51.625857 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:51.625808    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-569b779d49-bsbr8" podStartSLOduration=1.743704225 podStartE2EDuration="4.625792636s" totalImagesPullingTime="2.882088411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:21:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:21:51.624289759 +0000 UTC m=+360.947758335" watchObservedRunningTime="2026-09-16 01:21:51.625792636 +0000 UTC m=+360.949261212"
Sep 16 01:21:52.905558 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:52.905518    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:21:52.905802 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:52.905591    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:21:53.618612 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:53.618573    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w79z4" event={"ID":"ce70a06d-62f7-4d5b-9249-595e78515592","Type":"ContainerStarted","Data":"7d5b1bc55dfaf0b03ae484c46f720d21f1d9a6fd2029c21f92769a3e9b5d79ac"}
Sep 16 01:21:53.618800 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:53.618739    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w79z4"
Sep 16 01:21:53.620448 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:53.620415    2565 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-w79z4 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 01:21:53.620568 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:53.620487    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w79z4" podUID="ce70a06d-62f7-4d5b-9249-595e78515592" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 01:21:53.638796 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:53.638755    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w79z4" podStartSLOduration=1.8279616459999999 podStartE2EDuration="5.638742125s" totalImagesPullingTime="3.810780479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:21:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:21:53.637802729 +0000 UTC m=+362.961271317" watchObservedRunningTime="2026-09-16 01:21:53.638742125 +0000 UTC m=+362.962210701"
Sep 16 01:21:53.918012 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:53.917979    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6"]
Sep 16 01:21:53.921143 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:53.921126    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6"
Sep 16 01:21:53.926250 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:53.926228    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-nn57q\""
Sep 16 01:21:53.942290 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:53.942265    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6"]
Sep 16 01:21:54.062969 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:54.062932    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53eb79db-7856-4ca3-b8e7-95e015332b55-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6\" (UID: \"53eb79db-7856-4ca3-b8e7-95e015332b55\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6"
Sep 16 01:21:54.062969 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:54.062972    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbx75\" (UniqueName: \"kubernetes.io/projected/53eb79db-7856-4ca3-b8e7-95e015332b55-kube-api-access-lbx75\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6\" (UID: \"53eb79db-7856-4ca3-b8e7-95e015332b55\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6"
Sep 16 01:21:54.063218 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:54.062998    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53eb79db-7856-4ca3-b8e7-95e015332b55-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6\" (UID: \"53eb79db-7856-4ca3-b8e7-95e015332b55\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6"
Sep 16 01:21:54.063218 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:54.063059    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53eb79db-7856-4ca3-b8e7-95e015332b55-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6\" (UID: \"53eb79db-7856-4ca3-b8e7-95e015332b55\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6"
Sep 16 01:21:54.063218 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:54.063098    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53eb79db-7856-4ca3-b8e7-95e015332b55-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6\" (UID: \"53eb79db-7856-4ca3-b8e7-95e015332b55\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6"
Sep 16 01:21:54.063218 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:54.063115    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53eb79db-7856-4ca3-b8e7-95e015332b55-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6\" (UID: \"53eb79db-7856-4ca3-b8e7-95e015332b55\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6"
Sep 16 01:21:54.063218 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:54.063174    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53eb79db-7856-4ca3-b8e7-95e015332b55-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6\" (UID: \"53eb79db-7856-4ca3-b8e7-95e015332b55\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6"
Sep 16 01:21:54.063218 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:54.063206    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53eb79db-7856-4ca3-b8e7-95e015332b55-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6\" (UID: \"53eb79db-7856-4ca3-b8e7-95e015332b55\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6"
Sep 16 01:21:54.063567 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:54.063248    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53eb79db-7856-4ca3-b8e7-95e015332b55-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6\" (UID: \"53eb79db-7856-4ca3-b8e7-95e015332b55\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6"
Sep 16 01:21:54.163658 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:54.163629    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53eb79db-7856-4ca3-b8e7-95e015332b55-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6\" (UID: \"53eb79db-7856-4ca3-b8e7-95e015332b55\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6"
Sep 16 01:21:54.163829 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:54.163670    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53eb79db-7856-4ca3-b8e7-95e015332b55-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6\" (UID: \"53eb79db-7856-4ca3-b8e7-95e015332b55\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6"
Sep 16 01:21:54.163829 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:54.163687    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53eb79db-7856-4ca3-b8e7-95e015332b55-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6\" (UID: \"53eb79db-7856-4ca3-b8e7-95e015332b55\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6"
Sep 16 01:21:54.163829 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:54.163710    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53eb79db-7856-4ca3-b8e7-95e015332b55-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6\" (UID: \"53eb79db-7856-4ca3-b8e7-95e015332b55\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6"
Sep 16 01:21:54.163984 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:54.163915    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53eb79db-7856-4ca3-b8e7-95e015332b55-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6\" (UID: \"53eb79db-7856-4ca3-b8e7-95e015332b55\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6"
Sep 16 01:21:54.163984 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:54.163972    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53eb79db-7856-4ca3-b8e7-95e015332b55-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6\" (UID: \"53eb79db-7856-4ca3-b8e7-95e015332b55\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6"
Sep 16 01:21:54.164082 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:54.164016    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53eb79db-7856-4ca3-b8e7-95e015332b55-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6\" (UID: \"53eb79db-7856-4ca3-b8e7-95e015332b55\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6"
Sep 16 01:21:54.164082 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:54.164051    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbx75\" (UniqueName: \"kubernetes.io/projected/53eb79db-7856-4ca3-b8e7-95e015332b55-kube-api-access-lbx75\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6\" (UID: \"53eb79db-7856-4ca3-b8e7-95e015332b55\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6"
Sep 16 01:21:54.164183 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:54.164085    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53eb79db-7856-4ca3-b8e7-95e015332b55-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6\" (UID: \"53eb79db-7856-4ca3-b8e7-95e015332b55\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6"
Sep 16 01:21:54.164183 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:54.164087    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53eb79db-7856-4ca3-b8e7-95e015332b55-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6\" (UID: \"53eb79db-7856-4ca3-b8e7-95e015332b55\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6"
Sep 16 01:21:54.164183 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:54.164133    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53eb79db-7856-4ca3-b8e7-95e015332b55-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6\" (UID: \"53eb79db-7856-4ca3-b8e7-95e015332b55\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6"
Sep 16 01:21:54.164462 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:54.164440    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53eb79db-7856-4ca3-b8e7-95e015332b55-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6\" (UID: \"53eb79db-7856-4ca3-b8e7-95e015332b55\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6"
Sep 16 01:21:54.164536 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:54.164493    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53eb79db-7856-4ca3-b8e7-95e015332b55-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6\" (UID: \"53eb79db-7856-4ca3-b8e7-95e015332b55\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6"
Sep 16 01:21:54.164536 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:54.164519    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53eb79db-7856-4ca3-b8e7-95e015332b55-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6\" (UID: \"53eb79db-7856-4ca3-b8e7-95e015332b55\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6"
Sep 16 01:21:54.166091 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:54.166060    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53eb79db-7856-4ca3-b8e7-95e015332b55-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6\" (UID: \"53eb79db-7856-4ca3-b8e7-95e015332b55\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6"
Sep 16 01:21:54.166616 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:54.166591    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53eb79db-7856-4ca3-b8e7-95e015332b55-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6\" (UID: \"53eb79db-7856-4ca3-b8e7-95e015332b55\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6"
Sep 16 01:21:54.171751 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:54.171690    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53eb79db-7856-4ca3-b8e7-95e015332b55-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6\" (UID: \"53eb79db-7856-4ca3-b8e7-95e015332b55\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6"
Sep 16 01:21:54.171843 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:54.171784    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbx75\" (UniqueName: \"kubernetes.io/projected/53eb79db-7856-4ca3-b8e7-95e015332b55-kube-api-access-lbx75\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6\" (UID: \"53eb79db-7856-4ca3-b8e7-95e015332b55\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6"
Sep 16 01:21:54.230302 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:54.230275    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6"
Sep 16 01:21:54.501594 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:54.501513    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6"]
Sep 16 01:21:54.505290 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:21:54.505262    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53eb79db_7856_4ca3_b8e7_95e015332b55.slice/crio-21802e5f55a8f7e93e71962a6253ac362c0cc425039fee11f17656754ff83eb0 WatchSource:0}: Error finding container 21802e5f55a8f7e93e71962a6253ac362c0cc425039fee11f17656754ff83eb0: Status 404 returned error can't find the container with id 21802e5f55a8f7e93e71962a6253ac362c0cc425039fee11f17656754ff83eb0
Sep 16 01:21:54.623767 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:54.623723    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6" event={"ID":"53eb79db-7856-4ca3-b8e7-95e015332b55","Type":"ContainerStarted","Data":"21802e5f55a8f7e93e71962a6253ac362c0cc425039fee11f17656754ff83eb0"}
Sep 16 01:21:54.624726 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:54.624697    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w79z4"
Sep 16 01:21:57.212520 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:57.212481    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:21:57.212809 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:57.212549    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:21:57.212809 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:57.212578    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:21:57.638677 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:57.638583    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6" event={"ID":"53eb79db-7856-4ca3-b8e7-95e015332b55","Type":"ContainerStarted","Data":"c0246536e08e4c9a56fd978cbe90a159eae0b953c76ba6de13a6f8797248652f"}
Sep 16 01:21:57.664541 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:57.664490    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6" podStartSLOduration=1.959971452 podStartE2EDuration="4.664473772s" totalImagesPullingTime="2.70450232s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:21:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:21:57.66347069 +0000 UTC m=+366.986939289" watchObservedRunningTime="2026-09-16 01:21:57.664473772 +0000 UTC m=+366.987942346"
Sep 16 01:21:58.231215 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:58.231180    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6"
Sep 16 01:21:58.235856 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:58.235833    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6"
Sep 16 01:21:58.642949 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:58.642846    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6"
Sep 16 01:21:58.643749 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:21:58.643732    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6"
Sep 16 01:22:02.113710 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:02.113679    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4p"]
Sep 16 01:22:02.117614 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:02.117597    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4p"
Sep 16 01:22:02.129099 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:02.129073    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4p"]
Sep 16 01:22:02.131792 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:02.131769    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1e085087-790e-45c7-aa5e-5b97b122e15f-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-fdh4p\" (UID: \"1e085087-790e-45c7-aa5e-5b97b122e15f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4p"
Sep 16 01:22:02.131885 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:02.131815    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e085087-790e-45c7-aa5e-5b97b122e15f-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-fdh4p\" (UID: \"1e085087-790e-45c7-aa5e-5b97b122e15f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4p"
Sep 16 01:22:02.131926 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:02.131908    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1e085087-790e-45c7-aa5e-5b97b122e15f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-fdh4p\" (UID: \"1e085087-790e-45c7-aa5e-5b97b122e15f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4p"
Sep 16 01:22:02.131960 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:02.131938    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1e085087-790e-45c7-aa5e-5b97b122e15f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-fdh4p\" (UID: \"1e085087-790e-45c7-aa5e-5b97b122e15f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4p"
Sep 16 01:22:02.131995 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:02.131969    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e085087-790e-45c7-aa5e-5b97b122e15f-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-fdh4p\" (UID: \"1e085087-790e-45c7-aa5e-5b97b122e15f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4p"
Sep 16 01:22:02.132037 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:02.131997    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1e085087-790e-45c7-aa5e-5b97b122e15f-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-fdh4p\" (UID: \"1e085087-790e-45c7-aa5e-5b97b122e15f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4p"
Sep 16 01:22:02.132037 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:02.132026    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9d85c\" (UniqueName: \"kubernetes.io/projected/1e085087-790e-45c7-aa5e-5b97b122e15f-kube-api-access-9d85c\") pod \"istiod-openshift-gateway-5677ccb49b-fdh4p\" (UID: \"1e085087-790e-45c7-aa5e-5b97b122e15f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4p"
Sep 16 01:22:02.232761 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:02.232727    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1e085087-790e-45c7-aa5e-5b97b122e15f-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-fdh4p\" (UID: \"1e085087-790e-45c7-aa5e-5b97b122e15f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4p"
Sep 16 01:22:02.232761 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:02.232762    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e085087-790e-45c7-aa5e-5b97b122e15f-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-fdh4p\" (UID: \"1e085087-790e-45c7-aa5e-5b97b122e15f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4p"
Sep 16 01:22:02.232992 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:02.232808    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1e085087-790e-45c7-aa5e-5b97b122e15f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-fdh4p\" (UID: \"1e085087-790e-45c7-aa5e-5b97b122e15f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4p"
Sep 16 01:22:02.232992 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:02.232831    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1e085087-790e-45c7-aa5e-5b97b122e15f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-fdh4p\" (UID: \"1e085087-790e-45c7-aa5e-5b97b122e15f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4p"
Sep 16 01:22:02.232992 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:02.232849    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e085087-790e-45c7-aa5e-5b97b122e15f-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-fdh4p\" (UID: \"1e085087-790e-45c7-aa5e-5b97b122e15f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4p"
Sep 16 01:22:02.232992 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:02.232873    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1e085087-790e-45c7-aa5e-5b97b122e15f-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-fdh4p\" (UID: \"1e085087-790e-45c7-aa5e-5b97b122e15f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4p"
Sep 16 01:22:02.232992 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:02.232907    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d85c\" (UniqueName: \"kubernetes.io/projected/1e085087-790e-45c7-aa5e-5b97b122e15f-kube-api-access-9d85c\") pod \"istiod-openshift-gateway-5677ccb49b-fdh4p\" (UID: \"1e085087-790e-45c7-aa5e-5b97b122e15f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4p"
Sep 16 01:22:02.233862 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:02.233827    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1e085087-790e-45c7-aa5e-5b97b122e15f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-fdh4p\" (UID: \"1e085087-790e-45c7-aa5e-5b97b122e15f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4p"
Sep 16 01:22:02.235292 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:02.235268    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1e085087-790e-45c7-aa5e-5b97b122e15f-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-fdh4p\" (UID: \"1e085087-790e-45c7-aa5e-5b97b122e15f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4p"
Sep 16 01:22:02.235471 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:02.235445    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1e085087-790e-45c7-aa5e-5b97b122e15f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-fdh4p\" (UID: \"1e085087-790e-45c7-aa5e-5b97b122e15f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4p"
Sep 16 01:22:02.235645 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:02.235620    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e085087-790e-45c7-aa5e-5b97b122e15f-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-fdh4p\" (UID: \"1e085087-790e-45c7-aa5e-5b97b122e15f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4p"
Sep 16 01:22:02.235685 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:02.235637    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1e085087-790e-45c7-aa5e-5b97b122e15f-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-fdh4p\" (UID: \"1e085087-790e-45c7-aa5e-5b97b122e15f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4p"
Sep 16 01:22:02.242969 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:02.242945    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9d85c\" (UniqueName: \"kubernetes.io/projected/1e085087-790e-45c7-aa5e-5b97b122e15f-kube-api-access-9d85c\") pod \"istiod-openshift-gateway-5677ccb49b-fdh4p\" (UID: \"1e085087-790e-45c7-aa5e-5b97b122e15f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4p"
Sep 16 01:22:02.243141 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:02.243120    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e085087-790e-45c7-aa5e-5b97b122e15f-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-fdh4p\" (UID: \"1e085087-790e-45c7-aa5e-5b97b122e15f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4p"
Sep 16 01:22:02.426154 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:02.426120    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4p"
Sep 16 01:22:02.710785 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:02.710759    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4p"]
Sep 16 01:22:02.712623 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:22:02.712592    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e085087_790e_45c7_aa5e_5b97b122e15f.slice/crio-0d19c730048415d890374800a53834469261c251a9fa703a9a4a88fc2f560ddf WatchSource:0}: Error finding container 0d19c730048415d890374800a53834469261c251a9fa703a9a4a88fc2f560ddf: Status 404 returned error can't find the container with id 0d19c730048415d890374800a53834469261c251a9fa703a9a4a88fc2f560ddf
Sep 16 01:22:02.716037 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:02.715990    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:22:02.716124 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:02.716064    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:22:03.667093 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:03.667055    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4p" event={"ID":"1e085087-790e-45c7-aa5e-5b97b122e15f","Type":"ContainerStarted","Data":"39f5eb32443221e948b80eaa82f7ebdb6866f46b89dcff6c406c951ab67863ef"}
Sep 16 01:22:03.667528 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:03.667107    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4p" event={"ID":"1e085087-790e-45c7-aa5e-5b97b122e15f","Type":"ContainerStarted","Data":"0d19c730048415d890374800a53834469261c251a9fa703a9a4a88fc2f560ddf"}
Sep 16 01:22:03.667528 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:03.667283    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4p"
Sep 16 01:22:03.669049 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:03.669021    2565 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-fdh4p container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 01:22:03.669171 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:03.669073    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4p" podUID="1e085087-790e-45c7-aa5e-5b97b122e15f" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 01:22:03.691367 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:03.691297    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4p" podStartSLOduration=1.6912801069999999 podStartE2EDuration="1.691280107s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:22:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:22:03.689090007 +0000 UTC m=+373.012558583" watchObservedRunningTime="2026-09-16 01:22:03.691280107 +0000 UTC m=+373.014748681"
Sep 16 01:22:04.672932 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:04.672900    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4p"
Sep 16 01:22:04.743858 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:04.743828    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w79z4"]
Sep 16 01:22:04.744032 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:04.744011    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w79z4" podUID="ce70a06d-62f7-4d5b-9249-595e78515592" containerName="discovery" containerID="cri-o://7d5b1bc55dfaf0b03ae484c46f720d21f1d9a6fd2029c21f92769a3e9b5d79ac" gracePeriod=30
Sep 16 01:22:04.994446 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:04.994415    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w79z4"
Sep 16 01:22:05.057208 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:05.057177    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ce70a06d-62f7-4d5b-9249-595e78515592-istio-csr-dns-cert\") pod \"ce70a06d-62f7-4d5b-9249-595e78515592\" (UID: \"ce70a06d-62f7-4d5b-9249-595e78515592\") "
Sep 16 01:22:05.057394 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:05.057221    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce70a06d-62f7-4d5b-9249-595e78515592-local-certs\") pod \"ce70a06d-62f7-4d5b-9249-595e78515592\" (UID: \"ce70a06d-62f7-4d5b-9249-595e78515592\") "
Sep 16 01:22:05.057394 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:05.057254    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ce70a06d-62f7-4d5b-9249-595e78515592-cacerts\") pod \"ce70a06d-62f7-4d5b-9249-595e78515592\" (UID: \"ce70a06d-62f7-4d5b-9249-595e78515592\") "
Sep 16 01:22:05.057394 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:05.057312    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce70a06d-62f7-4d5b-9249-595e78515592-istio-token\") pod \"ce70a06d-62f7-4d5b-9249-595e78515592\" (UID: \"ce70a06d-62f7-4d5b-9249-595e78515592\") "
Sep 16 01:22:05.057394 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:05.057369    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ce70a06d-62f7-4d5b-9249-595e78515592-istio-csr-ca-configmap\") pod \"ce70a06d-62f7-4d5b-9249-595e78515592\" (UID: \"ce70a06d-62f7-4d5b-9249-595e78515592\") "
Sep 16 01:22:05.057588 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:05.057403    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lkhxt\" (UniqueName: \"kubernetes.io/projected/ce70a06d-62f7-4d5b-9249-595e78515592-kube-api-access-lkhxt\") pod \"ce70a06d-62f7-4d5b-9249-595e78515592\" (UID: \"ce70a06d-62f7-4d5b-9249-595e78515592\") "
Sep 16 01:22:05.057588 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:05.057432    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ce70a06d-62f7-4d5b-9249-595e78515592-istio-kubeconfig\") pod \"ce70a06d-62f7-4d5b-9249-595e78515592\" (UID: \"ce70a06d-62f7-4d5b-9249-595e78515592\") "
Sep 16 01:22:05.057955 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:05.057870    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce70a06d-62f7-4d5b-9249-595e78515592-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "ce70a06d-62f7-4d5b-9249-595e78515592" (UID: "ce70a06d-62f7-4d5b-9249-595e78515592"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:22:05.059980 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:05.059866    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce70a06d-62f7-4d5b-9249-595e78515592-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "ce70a06d-62f7-4d5b-9249-595e78515592" (UID: "ce70a06d-62f7-4d5b-9249-595e78515592"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 01:22:05.059980 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:05.059933    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce70a06d-62f7-4d5b-9249-595e78515592-cacerts" (OuterVolumeSpecName: "cacerts") pod "ce70a06d-62f7-4d5b-9249-595e78515592" (UID: "ce70a06d-62f7-4d5b-9249-595e78515592"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 01:22:05.059980 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:05.059945    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce70a06d-62f7-4d5b-9249-595e78515592-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "ce70a06d-62f7-4d5b-9249-595e78515592" (UID: "ce70a06d-62f7-4d5b-9249-595e78515592"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 01:22:05.060191 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:05.060129    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce70a06d-62f7-4d5b-9249-595e78515592-local-certs" (OuterVolumeSpecName: "local-certs") pod "ce70a06d-62f7-4d5b-9249-595e78515592" (UID: "ce70a06d-62f7-4d5b-9249-595e78515592"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:22:05.060279 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:05.060261    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce70a06d-62f7-4d5b-9249-595e78515592-istio-token" (OuterVolumeSpecName: "istio-token") pod "ce70a06d-62f7-4d5b-9249-595e78515592" (UID: "ce70a06d-62f7-4d5b-9249-595e78515592"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:22:05.060392 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:05.060368    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce70a06d-62f7-4d5b-9249-595e78515592-kube-api-access-lkhxt" (OuterVolumeSpecName: "kube-api-access-lkhxt") pod "ce70a06d-62f7-4d5b-9249-595e78515592" (UID: "ce70a06d-62f7-4d5b-9249-595e78515592"). InnerVolumeSpecName "kube-api-access-lkhxt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:22:05.158937 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:05.158905    2565 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ce70a06d-62f7-4d5b-9249-595e78515592-istio-csr-dns-cert\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:22:05.158937 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:05.158932    2565 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce70a06d-62f7-4d5b-9249-595e78515592-local-certs\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:22:05.158937 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:05.158941    2565 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ce70a06d-62f7-4d5b-9249-595e78515592-cacerts\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:22:05.159116 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:05.158950    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce70a06d-62f7-4d5b-9249-595e78515592-istio-token\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:22:05.159116 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:05.158958    2565 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ce70a06d-62f7-4d5b-9249-595e78515592-istio-csr-ca-configmap\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:22:05.159116 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:05.158967    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkhxt\" (UniqueName: \"kubernetes.io/projected/ce70a06d-62f7-4d5b-9249-595e78515592-kube-api-access-lkhxt\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:22:05.159116 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:05.158975    2565 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ce70a06d-62f7-4d5b-9249-595e78515592-istio-kubeconfig\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:22:05.677673 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:05.677640    2565 generic.go:356] "Generic (PLEG): container finished" podID="ce70a06d-62f7-4d5b-9249-595e78515592" containerID="7d5b1bc55dfaf0b03ae484c46f720d21f1d9a6fd2029c21f92769a3e9b5d79ac" exitCode=0
Sep 16 01:22:05.678076 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:05.677684    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w79z4"
Sep 16 01:22:05.678076 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:05.677729    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w79z4" event={"ID":"ce70a06d-62f7-4d5b-9249-595e78515592","Type":"ContainerDied","Data":"7d5b1bc55dfaf0b03ae484c46f720d21f1d9a6fd2029c21f92769a3e9b5d79ac"}
Sep 16 01:22:05.678076 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:05.677775    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w79z4" event={"ID":"ce70a06d-62f7-4d5b-9249-595e78515592","Type":"ContainerDied","Data":"525a447e2d9978950af688ce1ecdb08027c702ce15a4e7fc1f57fb83abdf3101"}
Sep 16 01:22:05.678076 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:05.677794    2565 scope.go:117] "RemoveContainer" containerID="7d5b1bc55dfaf0b03ae484c46f720d21f1d9a6fd2029c21f92769a3e9b5d79ac"
Sep 16 01:22:05.685995 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:05.685970    2565 scope.go:117] "RemoveContainer" containerID="7d5b1bc55dfaf0b03ae484c46f720d21f1d9a6fd2029c21f92769a3e9b5d79ac"
Sep 16 01:22:05.686235 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:22:05.686216    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d5b1bc55dfaf0b03ae484c46f720d21f1d9a6fd2029c21f92769a3e9b5d79ac\": container with ID starting with 7d5b1bc55dfaf0b03ae484c46f720d21f1d9a6fd2029c21f92769a3e9b5d79ac not found: ID does not exist" containerID="7d5b1bc55dfaf0b03ae484c46f720d21f1d9a6fd2029c21f92769a3e9b5d79ac"
Sep 16 01:22:05.686289 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:05.686249    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d5b1bc55dfaf0b03ae484c46f720d21f1d9a6fd2029c21f92769a3e9b5d79ac"} err="failed to get container status \"7d5b1bc55dfaf0b03ae484c46f720d21f1d9a6fd2029c21f92769a3e9b5d79ac\": rpc error: code = NotFound desc = could not find container \"7d5b1bc55dfaf0b03ae484c46f720d21f1d9a6fd2029c21f92769a3e9b5d79ac\": container with ID starting with 7d5b1bc55dfaf0b03ae484c46f720d21f1d9a6fd2029c21f92769a3e9b5d79ac not found: ID does not exist"
Sep 16 01:22:05.694808 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:05.694786    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w79z4"]
Sep 16 01:22:05.698954 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:05.698930    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w79z4"]
Sep 16 01:22:07.171687 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:22:07.171653    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce70a06d-62f7-4d5b-9249-595e78515592" path="/var/lib/kubelet/pods/ce70a06d-62f7-4d5b-9249-595e78515592/volumes"
Sep 16 01:23:11.524962 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:11.524923    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-87b95"]
Sep 16 01:23:11.525407 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:11.525189    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce70a06d-62f7-4d5b-9249-595e78515592" containerName="discovery"
Sep 16 01:23:11.525407 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:11.525200    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce70a06d-62f7-4d5b-9249-595e78515592" containerName="discovery"
Sep 16 01:23:11.525407 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:11.525260    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce70a06d-62f7-4d5b-9249-595e78515592" containerName="discovery"
Sep 16 01:23:11.529191 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:11.529171    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-87b95"
Sep 16 01:23:11.531482 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:11.531462    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 16 01:23:11.531482 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:11.531473    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 16 01:23:11.532383 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:11.532362    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-g7dpm\""
Sep 16 01:23:11.535007 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:11.534986    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-87b95"]
Sep 16 01:23:11.578782 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:11.578749    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxw2k\" (UniqueName: \"kubernetes.io/projected/317b0193-6a9b-49fd-9be5-a68aff3d1f6b-kube-api-access-xxw2k\") pod \"limitador-operator-controller-manager-74495c69f8-87b95\" (UID: \"317b0193-6a9b-49fd-9be5-a68aff3d1f6b\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-87b95"
Sep 16 01:23:11.679827 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:11.679788    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxw2k\" (UniqueName: \"kubernetes.io/projected/317b0193-6a9b-49fd-9be5-a68aff3d1f6b-kube-api-access-xxw2k\") pod \"limitador-operator-controller-manager-74495c69f8-87b95\" (UID: \"317b0193-6a9b-49fd-9be5-a68aff3d1f6b\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-87b95"
Sep 16 01:23:11.702867 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:11.702843    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxw2k\" (UniqueName: \"kubernetes.io/projected/317b0193-6a9b-49fd-9be5-a68aff3d1f6b-kube-api-access-xxw2k\") pod \"limitador-operator-controller-manager-74495c69f8-87b95\" (UID: \"317b0193-6a9b-49fd-9be5-a68aff3d1f6b\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-87b95"
Sep 16 01:23:11.839673 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:11.839571    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-87b95"
Sep 16 01:23:12.138592 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:12.138412    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-87b95"]
Sep 16 01:23:12.142615 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:23:12.142572    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod317b0193_6a9b_49fd_9be5_a68aff3d1f6b.slice/crio-115a79c2998ef0b33bea85bbc51df4b18c1b1816447470d2383888fa10d894fb WatchSource:0}: Error finding container 115a79c2998ef0b33bea85bbc51df4b18c1b1816447470d2383888fa10d894fb: Status 404 returned error can't find the container with id 115a79c2998ef0b33bea85bbc51df4b18c1b1816447470d2383888fa10d894fb
Sep 16 01:23:12.949319 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:12.949274    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-87b95" event={"ID":"317b0193-6a9b-49fd-9be5-a68aff3d1f6b","Type":"ContainerStarted","Data":"115a79c2998ef0b33bea85bbc51df4b18c1b1816447470d2383888fa10d894fb"}
Sep 16 01:23:15.965064 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:15.965029    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-87b95" event={"ID":"317b0193-6a9b-49fd-9be5-a68aff3d1f6b","Type":"ContainerStarted","Data":"a77298a2a34d93e12390996f14c76c802a0b5e1aa1a544ebd8bcd6242bbb55dc"}
Sep 16 01:23:15.965464 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:15.965170    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-87b95"
Sep 16 01:23:15.981523 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:15.981478    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-87b95" podStartSLOduration=2.007410982 podStartE2EDuration="4.981463918s" totalImagesPullingTime="2.974052936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:23:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:23:15.980220252 +0000 UTC m=+445.303688828" watchObservedRunningTime="2026-09-16 01:23:15.981463918 +0000 UTC m=+445.304932492"
Sep 16 01:23:18.107561 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:18.107531    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-pj5rs"]
Sep 16 01:23:18.110812 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:18.110791    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-pj5rs"
Sep 16 01:23:18.113130 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:18.113109    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-pkgqv\""
Sep 16 01:23:18.121079 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:18.121053    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-pj5rs"]
Sep 16 01:23:18.137809 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:18.137783    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v87z6\" (UniqueName: \"kubernetes.io/projected/307c2f46-e70c-4ca5-b46d-2e93e5ce1eca-kube-api-access-v87z6\") pod \"authorino-operator-76b478bd78-pj5rs\" (UID: \"307c2f46-e70c-4ca5-b46d-2e93e5ce1eca\") " pod="kuadrant-system/authorino-operator-76b478bd78-pj5rs"
Sep 16 01:23:18.238823 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:18.238795    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v87z6\" (UniqueName: \"kubernetes.io/projected/307c2f46-e70c-4ca5-b46d-2e93e5ce1eca-kube-api-access-v87z6\") pod \"authorino-operator-76b478bd78-pj5rs\" (UID: \"307c2f46-e70c-4ca5-b46d-2e93e5ce1eca\") " pod="kuadrant-system/authorino-operator-76b478bd78-pj5rs"
Sep 16 01:23:18.246301 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:18.246279    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v87z6\" (UniqueName: \"kubernetes.io/projected/307c2f46-e70c-4ca5-b46d-2e93e5ce1eca-kube-api-access-v87z6\") pod \"authorino-operator-76b478bd78-pj5rs\" (UID: \"307c2f46-e70c-4ca5-b46d-2e93e5ce1eca\") " pod="kuadrant-system/authorino-operator-76b478bd78-pj5rs"
Sep 16 01:23:18.421049 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:18.421021    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-pj5rs"
Sep 16 01:23:18.702556 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:18.702531    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-pj5rs"]
Sep 16 01:23:18.705181 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:23:18.705155    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod307c2f46_e70c_4ca5_b46d_2e93e5ce1eca.slice/crio-8679e733b429c4286875c27b35f6a45ea117a68bcb12d55a58eeb3e5b1eaaace WatchSource:0}: Error finding container 8679e733b429c4286875c27b35f6a45ea117a68bcb12d55a58eeb3e5b1eaaace: Status 404 returned error can't find the container with id 8679e733b429c4286875c27b35f6a45ea117a68bcb12d55a58eeb3e5b1eaaace
Sep 16 01:23:18.978538 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:18.978456    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-pj5rs" event={"ID":"307c2f46-e70c-4ca5-b46d-2e93e5ce1eca","Type":"ContainerStarted","Data":"8679e733b429c4286875c27b35f6a45ea117a68bcb12d55a58eeb3e5b1eaaace"}
Sep 16 01:23:20.989494 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:20.989457    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-pj5rs" event={"ID":"307c2f46-e70c-4ca5-b46d-2e93e5ce1eca","Type":"ContainerStarted","Data":"9f0810c4b5598bb2f35f21506b628d91e604a339a260473c6223d1be8d7451fe"}
Sep 16 01:23:20.989949 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:20.989592    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-pj5rs"
Sep 16 01:23:21.007232 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:21.007173    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-pj5rs" podStartSLOduration=1.655720667 podStartE2EDuration="3.00715786s" totalImagesPullingTime="1.351437193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:23:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:23:21.005640696 +0000 UTC m=+450.329109275" watchObservedRunningTime="2026-09-16 01:23:21.00715786 +0000 UTC m=+450.330626436"
Sep 16 01:23:26.972665 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:26.972632    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-87b95"
Sep 16 01:23:31.997001 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:31.996961    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-pj5rs"
Sep 16 01:23:35.727550 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:35.727510    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-87b95"]
Sep 16 01:23:35.728103 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:35.727782    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-87b95" podUID="317b0193-6a9b-49fd-9be5-a68aff3d1f6b" containerName="manager" containerID="cri-o://a77298a2a34d93e12390996f14c76c802a0b5e1aa1a544ebd8bcd6242bbb55dc" gracePeriod=2
Sep 16 01:23:35.748010 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:35.747942    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-87b95"]
Sep 16 01:23:35.748501 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:23:35.748430    2565 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"317b0193-6a9b-49fd-9be5-a68aff3d1f6b\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-74495c69f8-87b95\": pods \"limitador-operator-controller-manager-74495c69f8-87b95\" not found" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-87b95"
Sep 16 01:23:35.760248 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:35.760220    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-gkn5p"]
Sep 16 01:23:35.760666 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:35.760651    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="317b0193-6a9b-49fd-9be5-a68aff3d1f6b" containerName="manager"
Sep 16 01:23:35.760717 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:35.760670    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="317b0193-6a9b-49fd-9be5-a68aff3d1f6b" containerName="manager"
Sep 16 01:23:35.760774 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:35.760764    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="317b0193-6a9b-49fd-9be5-a68aff3d1f6b" containerName="manager"
Sep 16 01:23:35.763824 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:35.763805    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gkn5p"
Sep 16 01:23:35.765946 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:23:35.765916    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-87b95\" is forbidden: User \"system:node:ip-10-0-135-225.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-225.ec2.internal' and this object" podUID="317b0193-6a9b-49fd-9be5-a68aff3d1f6b" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-87b95"
Sep 16 01:23:35.774427 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:35.774399    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-gkn5p"]
Sep 16 01:23:35.887524 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:35.887470    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25lv4\" (UniqueName: \"kubernetes.io/projected/1fada03f-2b80-4113-90a9-91890464ce69-kube-api-access-25lv4\") pod \"limitador-operator-controller-manager-74495c69f8-gkn5p\" (UID: \"1fada03f-2b80-4113-90a9-91890464ce69\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gkn5p"
Sep 16 01:23:35.959595 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:35.959571    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-87b95"
Sep 16 01:23:35.961519 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:23:35.961493    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-87b95\" is forbidden: User \"system:node:ip-10-0-135-225.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-225.ec2.internal' and this object" podUID="317b0193-6a9b-49fd-9be5-a68aff3d1f6b" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-87b95"
Sep 16 01:23:35.988754 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:35.988681    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25lv4\" (UniqueName: \"kubernetes.io/projected/1fada03f-2b80-4113-90a9-91890464ce69-kube-api-access-25lv4\") pod \"limitador-operator-controller-manager-74495c69f8-gkn5p\" (UID: \"1fada03f-2b80-4113-90a9-91890464ce69\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gkn5p"
Sep 16 01:23:36.004012 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:36.003986    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25lv4\" (UniqueName: \"kubernetes.io/projected/1fada03f-2b80-4113-90a9-91890464ce69-kube-api-access-25lv4\") pod \"limitador-operator-controller-manager-74495c69f8-gkn5p\" (UID: \"1fada03f-2b80-4113-90a9-91890464ce69\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gkn5p"
Sep 16 01:23:36.055731 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:36.055693    2565 generic.go:356] "Generic (PLEG): container finished" podID="317b0193-6a9b-49fd-9be5-a68aff3d1f6b" containerID="a77298a2a34d93e12390996f14c76c802a0b5e1aa1a544ebd8bcd6242bbb55dc" exitCode=0
Sep 16 01:23:36.055900 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:36.055747    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-87b95"
Sep 16 01:23:36.055900 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:36.055751    2565 scope.go:117] "RemoveContainer" containerID="a77298a2a34d93e12390996f14c76c802a0b5e1aa1a544ebd8bcd6242bbb55dc"
Sep 16 01:23:36.061156 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:23:36.061123    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-87b95\" is forbidden: User \"system:node:ip-10-0-135-225.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-225.ec2.internal' and this object" podUID="317b0193-6a9b-49fd-9be5-a68aff3d1f6b" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-87b95"
Sep 16 01:23:36.063744 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:36.063725    2565 scope.go:117] "RemoveContainer" containerID="a77298a2a34d93e12390996f14c76c802a0b5e1aa1a544ebd8bcd6242bbb55dc"
Sep 16 01:23:36.064003 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:23:36.063986    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a77298a2a34d93e12390996f14c76c802a0b5e1aa1a544ebd8bcd6242bbb55dc\": container with ID starting with a77298a2a34d93e12390996f14c76c802a0b5e1aa1a544ebd8bcd6242bbb55dc not found: ID does not exist" containerID="a77298a2a34d93e12390996f14c76c802a0b5e1aa1a544ebd8bcd6242bbb55dc"
Sep 16 01:23:36.064046 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:36.064014    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a77298a2a34d93e12390996f14c76c802a0b5e1aa1a544ebd8bcd6242bbb55dc"} err="failed to get container status \"a77298a2a34d93e12390996f14c76c802a0b5e1aa1a544ebd8bcd6242bbb55dc\": rpc error: code = NotFound desc = could not find container \"a77298a2a34d93e12390996f14c76c802a0b5e1aa1a544ebd8bcd6242bbb55dc\": container with ID starting with a77298a2a34d93e12390996f14c76c802a0b5e1aa1a544ebd8bcd6242bbb55dc not found: ID does not exist"
Sep 16 01:23:36.089355 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:36.089297    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxw2k\" (UniqueName: \"kubernetes.io/projected/317b0193-6a9b-49fd-9be5-a68aff3d1f6b-kube-api-access-xxw2k\") pod \"317b0193-6a9b-49fd-9be5-a68aff3d1f6b\" (UID: \"317b0193-6a9b-49fd-9be5-a68aff3d1f6b\") "
Sep 16 01:23:36.091658 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:36.091631    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/317b0193-6a9b-49fd-9be5-a68aff3d1f6b-kube-api-access-xxw2k" (OuterVolumeSpecName: "kube-api-access-xxw2k") pod "317b0193-6a9b-49fd-9be5-a68aff3d1f6b" (UID: "317b0193-6a9b-49fd-9be5-a68aff3d1f6b"). InnerVolumeSpecName "kube-api-access-xxw2k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:23:36.103835 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:36.103808    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gkn5p"
Sep 16 01:23:36.190884 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:36.190841    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxw2k\" (UniqueName: \"kubernetes.io/projected/317b0193-6a9b-49fd-9be5-a68aff3d1f6b-kube-api-access-xxw2k\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:23:36.367962 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:23:36.367906    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-87b95\" is forbidden: User \"system:node:ip-10-0-135-225.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-225.ec2.internal' and this object" podUID="317b0193-6a9b-49fd-9be5-a68aff3d1f6b" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-87b95"
Sep 16 01:23:36.378431 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:36.378383    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-gkn5p"]
Sep 16 01:23:36.381812 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:23:36.381784    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fada03f_2b80_4113_90a9_91890464ce69.slice/crio-d072020a71b1c672e0a8279f732d62fdf8e47c163513a9d32690184e516918cf WatchSource:0}: Error finding container d072020a71b1c672e0a8279f732d62fdf8e47c163513a9d32690184e516918cf: Status 404 returned error can't find the container with id d072020a71b1c672e0a8279f732d62fdf8e47c163513a9d32690184e516918cf
Sep 16 01:23:37.061949 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:37.061906    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gkn5p" event={"ID":"1fada03f-2b80-4113-90a9-91890464ce69","Type":"ContainerStarted","Data":"02acfa154ab3e8fac0ed17611cae00dc8bf6a95c9ca580c5d66089bdd2a7881e"}
Sep 16 01:23:37.062427 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:37.061975    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gkn5p" event={"ID":"1fada03f-2b80-4113-90a9-91890464ce69","Type":"ContainerStarted","Data":"d072020a71b1c672e0a8279f732d62fdf8e47c163513a9d32690184e516918cf"}
Sep 16 01:23:37.062427 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:37.062002    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gkn5p"
Sep 16 01:23:37.064245 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:23:37.064210    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-87b95\" is forbidden: User \"system:node:ip-10-0-135-225.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-225.ec2.internal' and this object" podUID="317b0193-6a9b-49fd-9be5-a68aff3d1f6b" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-87b95"
Sep 16 01:23:37.081038 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:37.080979    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gkn5p" podStartSLOduration=2.080960031 podStartE2EDuration="2.080960031s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:23:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:23:37.079772447 +0000 UTC m=+466.403241026" watchObservedRunningTime="2026-09-16 01:23:37.080960031 +0000 UTC m=+466.404428609"
Sep 16 01:23:37.169622 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:37.169584    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="317b0193-6a9b-49fd-9be5-a68aff3d1f6b" path="/var/lib/kubelet/pods/317b0193-6a9b-49fd-9be5-a68aff3d1f6b/volumes"
Sep 16 01:23:48.070207 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:23:48.070172    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gkn5p"
Sep 16 01:24:27.501017 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:27.500975    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-5nlbq"]
Sep 16 01:24:27.503638 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:27.503605    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-5nlbq"
Sep 16 01:24:27.505904 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:27.505879    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-g98ls\""
Sep 16 01:24:27.511097 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:27.511065    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-5nlbq"]
Sep 16 01:24:27.610604 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:27.610559    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdlq4\" (UniqueName: \"kubernetes.io/projected/08b77233-dc6d-468c-b9d5-a8ae8950130f-kube-api-access-qdlq4\") pod \"authorino-59c974bd48-5nlbq\" (UID: \"08b77233-dc6d-468c-b9d5-a8ae8950130f\") " pod="kuadrant-system/authorino-59c974bd48-5nlbq"
Sep 16 01:24:27.711606 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:27.711559    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdlq4\" (UniqueName: \"kubernetes.io/projected/08b77233-dc6d-468c-b9d5-a8ae8950130f-kube-api-access-qdlq4\") pod \"authorino-59c974bd48-5nlbq\" (UID: \"08b77233-dc6d-468c-b9d5-a8ae8950130f\") " pod="kuadrant-system/authorino-59c974bd48-5nlbq"
Sep 16 01:24:27.719516 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:27.719485    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdlq4\" (UniqueName: \"kubernetes.io/projected/08b77233-dc6d-468c-b9d5-a8ae8950130f-kube-api-access-qdlq4\") pod \"authorino-59c974bd48-5nlbq\" (UID: \"08b77233-dc6d-468c-b9d5-a8ae8950130f\") " pod="kuadrant-system/authorino-59c974bd48-5nlbq"
Sep 16 01:24:27.814559 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:27.814448    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-5nlbq"
Sep 16 01:24:28.084432 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:28.084404    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-5nlbq"]
Sep 16 01:24:28.087105 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:24:28.087075    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod08b77233_dc6d_468c_b9d5_a8ae8950130f.slice/crio-a02fae04a50d966dcd3cb71a1a4e226eef3c366974d147ce70ffe8a36ded884e WatchSource:0}: Error finding container a02fae04a50d966dcd3cb71a1a4e226eef3c366974d147ce70ffe8a36ded884e: Status 404 returned error can't find the container with id a02fae04a50d966dcd3cb71a1a4e226eef3c366974d147ce70ffe8a36ded884e
Sep 16 01:24:28.290427 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:28.290391    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-5nlbq" event={"ID":"08b77233-dc6d-468c-b9d5-a8ae8950130f","Type":"ContainerStarted","Data":"a02fae04a50d966dcd3cb71a1a4e226eef3c366974d147ce70ffe8a36ded884e"}
Sep 16 01:24:30.300676 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:30.300637    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-5nlbq" event={"ID":"08b77233-dc6d-468c-b9d5-a8ae8950130f","Type":"ContainerStarted","Data":"f5f45daf6f665aa870fba3c7eb1414069620cad101b444571a71b7a0d87624fd"}
Sep 16 01:24:30.314730 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:30.314678    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-5nlbq" podStartSLOduration=1.523498217 podStartE2EDuration="3.314657702s" totalImagesPullingTime="1.791159485s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:24:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:24:30.313863535 +0000 UTC m=+519.637332112" watchObservedRunningTime="2026-09-16 01:24:30.314657702 +0000 UTC m=+519.638126279"
Sep 16 01:24:53.171247 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:53.171215    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-78q2r"]
Sep 16 01:24:53.173745 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:53.173728    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-78q2r"
Sep 16 01:24:53.175990 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:53.175970    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 16 01:24:53.181232 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:53.181210    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-78q2r"]
Sep 16 01:24:53.218027 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:53.217991    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-78q2r"]
Sep 16 01:24:53.218247 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:24:53.218228    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-pfbqz tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-pfbqz tls-cert]: context canceled" pod="kuadrant-system/authorino-6d4dfc649f-78q2r" podUID="3c075795-991f-439c-b578-3882575b5782"
Sep 16 01:24:53.243392 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:53.243359    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8585f876ff-j9kpp"]
Sep 16 01:24:53.245865 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:53.245844    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8585f876ff-j9kpp"
Sep 16 01:24:53.256041 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:53.256020    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8585f876ff-j9kpp"]
Sep 16 01:24:53.328829 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:53.328795    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/566b76ac-7c64-4735-84cb-745f1a0a33e2-tls-cert\") pod \"authorino-8585f876ff-j9kpp\" (UID: \"566b76ac-7c64-4735-84cb-745f1a0a33e2\") " pod="kuadrant-system/authorino-8585f876ff-j9kpp"
Sep 16 01:24:53.329000 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:53.328837    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfbqz\" (UniqueName: \"kubernetes.io/projected/3c075795-991f-439c-b578-3882575b5782-kube-api-access-pfbqz\") pod \"authorino-6d4dfc649f-78q2r\" (UID: \"3c075795-991f-439c-b578-3882575b5782\") " pod="kuadrant-system/authorino-6d4dfc649f-78q2r"
Sep 16 01:24:53.329000 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:53.328858    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3c075795-991f-439c-b578-3882575b5782-tls-cert\") pod \"authorino-6d4dfc649f-78q2r\" (UID: \"3c075795-991f-439c-b578-3882575b5782\") " pod="kuadrant-system/authorino-6d4dfc649f-78q2r"
Sep 16 01:24:53.329000 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:53.328952    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd9lv\" (UniqueName: \"kubernetes.io/projected/566b76ac-7c64-4735-84cb-745f1a0a33e2-kube-api-access-zd9lv\") pod \"authorino-8585f876ff-j9kpp\" (UID: \"566b76ac-7c64-4735-84cb-745f1a0a33e2\") " pod="kuadrant-system/authorino-8585f876ff-j9kpp"
Sep 16 01:24:53.398704 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:53.398670    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-78q2r"
Sep 16 01:24:53.404540 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:53.404517    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-78q2r"
Sep 16 01:24:53.429774 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:53.429668    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zd9lv\" (UniqueName: \"kubernetes.io/projected/566b76ac-7c64-4735-84cb-745f1a0a33e2-kube-api-access-zd9lv\") pod \"authorino-8585f876ff-j9kpp\" (UID: \"566b76ac-7c64-4735-84cb-745f1a0a33e2\") " pod="kuadrant-system/authorino-8585f876ff-j9kpp"
Sep 16 01:24:53.429774 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:53.429751    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/566b76ac-7c64-4735-84cb-745f1a0a33e2-tls-cert\") pod \"authorino-8585f876ff-j9kpp\" (UID: \"566b76ac-7c64-4735-84cb-745f1a0a33e2\") " pod="kuadrant-system/authorino-8585f876ff-j9kpp"
Sep 16 01:24:53.430026 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:53.429797    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfbqz\" (UniqueName: \"kubernetes.io/projected/3c075795-991f-439c-b578-3882575b5782-kube-api-access-pfbqz\") pod \"authorino-6d4dfc649f-78q2r\" (UID: \"3c075795-991f-439c-b578-3882575b5782\") " pod="kuadrant-system/authorino-6d4dfc649f-78q2r"
Sep 16 01:24:53.430026 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:53.429825    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3c075795-991f-439c-b578-3882575b5782-tls-cert\") pod \"authorino-6d4dfc649f-78q2r\" (UID: \"3c075795-991f-439c-b578-3882575b5782\") " pod="kuadrant-system/authorino-6d4dfc649f-78q2r"
Sep 16 01:24:53.432441 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:53.432415    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3c075795-991f-439c-b578-3882575b5782-tls-cert\") pod \"authorino-6d4dfc649f-78q2r\" (UID: \"3c075795-991f-439c-b578-3882575b5782\") " pod="kuadrant-system/authorino-6d4dfc649f-78q2r"
Sep 16 01:24:53.432595 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:53.432525    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/566b76ac-7c64-4735-84cb-745f1a0a33e2-tls-cert\") pod \"authorino-8585f876ff-j9kpp\" (UID: \"566b76ac-7c64-4735-84cb-745f1a0a33e2\") " pod="kuadrant-system/authorino-8585f876ff-j9kpp"
Sep 16 01:24:53.436960 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:53.436926    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd9lv\" (UniqueName: \"kubernetes.io/projected/566b76ac-7c64-4735-84cb-745f1a0a33e2-kube-api-access-zd9lv\") pod \"authorino-8585f876ff-j9kpp\" (UID: \"566b76ac-7c64-4735-84cb-745f1a0a33e2\") " pod="kuadrant-system/authorino-8585f876ff-j9kpp"
Sep 16 01:24:53.437090 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:53.437046    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfbqz\" (UniqueName: \"kubernetes.io/projected/3c075795-991f-439c-b578-3882575b5782-kube-api-access-pfbqz\") pod \"authorino-6d4dfc649f-78q2r\" (UID: \"3c075795-991f-439c-b578-3882575b5782\") " pod="kuadrant-system/authorino-6d4dfc649f-78q2r"
Sep 16 01:24:53.530169 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:53.530130    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3c075795-991f-439c-b578-3882575b5782-tls-cert\") pod \"3c075795-991f-439c-b578-3882575b5782\" (UID: \"3c075795-991f-439c-b578-3882575b5782\") "
Sep 16 01:24:53.530404 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:53.530191    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pfbqz\" (UniqueName: \"kubernetes.io/projected/3c075795-991f-439c-b578-3882575b5782-kube-api-access-pfbqz\") pod \"3c075795-991f-439c-b578-3882575b5782\" (UID: \"3c075795-991f-439c-b578-3882575b5782\") "
Sep 16 01:24:53.532510 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:53.532473    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c075795-991f-439c-b578-3882575b5782-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "3c075795-991f-439c-b578-3882575b5782" (UID: "3c075795-991f-439c-b578-3882575b5782"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 01:24:53.532612 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:53.532505    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c075795-991f-439c-b578-3882575b5782-kube-api-access-pfbqz" (OuterVolumeSpecName: "kube-api-access-pfbqz") pod "3c075795-991f-439c-b578-3882575b5782" (UID: "3c075795-991f-439c-b578-3882575b5782"). InnerVolumeSpecName "kube-api-access-pfbqz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:24:53.554819 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:53.554788    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8585f876ff-j9kpp"
Sep 16 01:24:53.630972 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:53.630939    2565 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3c075795-991f-439c-b578-3882575b5782-tls-cert\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:24:53.631106 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:53.630977    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pfbqz\" (UniqueName: \"kubernetes.io/projected/3c075795-991f-439c-b578-3882575b5782-kube-api-access-pfbqz\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:24:53.823146 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:53.823054    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8585f876ff-j9kpp"]
Sep 16 01:24:53.827053 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:24:53.827026    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod566b76ac_7c64_4735_84cb_745f1a0a33e2.slice/crio-3f519e49e33ed25d665eacc7d983a8f6c5933767a97bc1b07fee2517a92d12e0 WatchSource:0}: Error finding container 3f519e49e33ed25d665eacc7d983a8f6c5933767a97bc1b07fee2517a92d12e0: Status 404 returned error can't find the container with id 3f519e49e33ed25d665eacc7d983a8f6c5933767a97bc1b07fee2517a92d12e0
Sep 16 01:24:54.404510 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:54.404462    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8585f876ff-j9kpp" event={"ID":"566b76ac-7c64-4735-84cb-745f1a0a33e2","Type":"ContainerStarted","Data":"3f519e49e33ed25d665eacc7d983a8f6c5933767a97bc1b07fee2517a92d12e0"}
Sep 16 01:24:54.404510 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:54.404480    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-78q2r"
Sep 16 01:24:54.435604 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:54.435569    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-78q2r"]
Sep 16 01:24:54.445452 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:54.445417    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-78q2r"]
Sep 16 01:24:55.169714 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:55.169680    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c075795-991f-439c-b578-3882575b5782" path="/var/lib/kubelet/pods/3c075795-991f-439c-b578-3882575b5782/volumes"
Sep 16 01:24:55.409976 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:55.409939    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8585f876ff-j9kpp" event={"ID":"566b76ac-7c64-4735-84cb-745f1a0a33e2","Type":"ContainerStarted","Data":"ee0072109e7f13dea256a02d6cc014d4a496db26033dfb4012670130accc1977"}
Sep 16 01:24:55.424081 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:55.423985    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-8585f876ff-j9kpp" podStartSLOduration=1.5946611019999999 podStartE2EDuration="2.423967843s" totalImagesPullingTime="829.306741ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:24:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:24:55.423801529 +0000 UTC m=+544.747270102" watchObservedRunningTime="2026-09-16 01:24:55.423967843 +0000 UTC m=+544.747436457"
Sep 16 01:24:55.445490 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:55.445450    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-5nlbq"]
Sep 16 01:24:55.445715 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:55.445692    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-5nlbq" podUID="08b77233-dc6d-468c-b9d5-a8ae8950130f" containerName="authorino" containerID="cri-o://f5f45daf6f665aa870fba3c7eb1414069620cad101b444571a71b7a0d87624fd" gracePeriod=30
Sep 16 01:24:55.694686 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:55.694658    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-5nlbq"
Sep 16 01:24:55.849544 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:55.849507    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qdlq4\" (UniqueName: \"kubernetes.io/projected/08b77233-dc6d-468c-b9d5-a8ae8950130f-kube-api-access-qdlq4\") pod \"08b77233-dc6d-468c-b9d5-a8ae8950130f\" (UID: \"08b77233-dc6d-468c-b9d5-a8ae8950130f\") "
Sep 16 01:24:55.851628 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:55.851596    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08b77233-dc6d-468c-b9d5-a8ae8950130f-kube-api-access-qdlq4" (OuterVolumeSpecName: "kube-api-access-qdlq4") pod "08b77233-dc6d-468c-b9d5-a8ae8950130f" (UID: "08b77233-dc6d-468c-b9d5-a8ae8950130f"). InnerVolumeSpecName "kube-api-access-qdlq4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:24:55.950723 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:55.950636    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdlq4\" (UniqueName: \"kubernetes.io/projected/08b77233-dc6d-468c-b9d5-a8ae8950130f-kube-api-access-qdlq4\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:24:56.416791 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:56.416755    2565 generic.go:356] "Generic (PLEG): container finished" podID="08b77233-dc6d-468c-b9d5-a8ae8950130f" containerID="f5f45daf6f665aa870fba3c7eb1414069620cad101b444571a71b7a0d87624fd" exitCode=0
Sep 16 01:24:56.417278 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:56.416811    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-5nlbq"
Sep 16 01:24:56.417278 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:56.416846    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-5nlbq" event={"ID":"08b77233-dc6d-468c-b9d5-a8ae8950130f","Type":"ContainerDied","Data":"f5f45daf6f665aa870fba3c7eb1414069620cad101b444571a71b7a0d87624fd"}
Sep 16 01:24:56.417278 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:56.416903    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-5nlbq" event={"ID":"08b77233-dc6d-468c-b9d5-a8ae8950130f","Type":"ContainerDied","Data":"a02fae04a50d966dcd3cb71a1a4e226eef3c366974d147ce70ffe8a36ded884e"}
Sep 16 01:24:56.417278 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:56.416931    2565 scope.go:117] "RemoveContainer" containerID="f5f45daf6f665aa870fba3c7eb1414069620cad101b444571a71b7a0d87624fd"
Sep 16 01:24:56.425556 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:56.425537    2565 scope.go:117] "RemoveContainer" containerID="f5f45daf6f665aa870fba3c7eb1414069620cad101b444571a71b7a0d87624fd"
Sep 16 01:24:56.425819 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:24:56.425802    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5f45daf6f665aa870fba3c7eb1414069620cad101b444571a71b7a0d87624fd\": container with ID starting with f5f45daf6f665aa870fba3c7eb1414069620cad101b444571a71b7a0d87624fd not found: ID does not exist" containerID="f5f45daf6f665aa870fba3c7eb1414069620cad101b444571a71b7a0d87624fd"
Sep 16 01:24:56.425873 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:56.425828    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5f45daf6f665aa870fba3c7eb1414069620cad101b444571a71b7a0d87624fd"} err="failed to get container status \"f5f45daf6f665aa870fba3c7eb1414069620cad101b444571a71b7a0d87624fd\": rpc error: code = NotFound desc = could not find container \"f5f45daf6f665aa870fba3c7eb1414069620cad101b444571a71b7a0d87624fd\": container with ID starting with f5f45daf6f665aa870fba3c7eb1414069620cad101b444571a71b7a0d87624fd not found: ID does not exist"
Sep 16 01:24:56.436512 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:56.436480    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-5nlbq"]
Sep 16 01:24:56.439796 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:56.439773    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-5nlbq"]
Sep 16 01:24:57.170535 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:24:57.170502    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08b77233-dc6d-468c-b9d5-a8ae8950130f" path="/var/lib/kubelet/pods/08b77233-dc6d-468c-b9d5-a8ae8950130f/volumes"
Sep 16 01:25:37.966463 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:25:37.966418    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-ltz8r"]
Sep 16 01:25:37.966929 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:25:37.966741    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08b77233-dc6d-468c-b9d5-a8ae8950130f" containerName="authorino"
Sep 16 01:25:37.966929 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:25:37.966753    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="08b77233-dc6d-468c-b9d5-a8ae8950130f" containerName="authorino"
Sep 16 01:25:37.966929 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:25:37.966821    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="08b77233-dc6d-468c-b9d5-a8ae8950130f" containerName="authorino"
Sep 16 01:25:37.969863 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:25:37.969844    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-ltz8r"
Sep 16 01:25:37.972687 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:25:37.972659    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-kkbcm\""
Sep 16 01:25:37.972843 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:25:37.972660    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 16 01:25:37.987284 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:25:37.987255    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-ltz8r"]
Sep 16 01:25:38.094984 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:25:38.094944    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a0fb7db3-b20f-4b1d-ac20-fc1886e58087-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-ltz8r\" (UID: \"a0fb7db3-b20f-4b1d-ac20-fc1886e58087\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-ltz8r"
Sep 16 01:25:38.094984 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:25:38.094992    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nrgk\" (UniqueName: \"kubernetes.io/projected/a0fb7db3-b20f-4b1d-ac20-fc1886e58087-kube-api-access-7nrgk\") pod \"payload-pre-processing-59fbc47bf8-ltz8r\" (UID: \"a0fb7db3-b20f-4b1d-ac20-fc1886e58087\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-ltz8r"
Sep 16 01:25:38.196072 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:25:38.196029    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a0fb7db3-b20f-4b1d-ac20-fc1886e58087-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-ltz8r\" (UID: \"a0fb7db3-b20f-4b1d-ac20-fc1886e58087\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-ltz8r"
Sep 16 01:25:38.196072 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:25:38.196075    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nrgk\" (UniqueName: \"kubernetes.io/projected/a0fb7db3-b20f-4b1d-ac20-fc1886e58087-kube-api-access-7nrgk\") pod \"payload-pre-processing-59fbc47bf8-ltz8r\" (UID: \"a0fb7db3-b20f-4b1d-ac20-fc1886e58087\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-ltz8r"
Sep 16 01:25:38.197070 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:25:38.197043    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a0fb7db3-b20f-4b1d-ac20-fc1886e58087-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-ltz8r\" (UID: \"a0fb7db3-b20f-4b1d-ac20-fc1886e58087\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-ltz8r"
Sep 16 01:25:38.204073 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:25:38.204039    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nrgk\" (UniqueName: \"kubernetes.io/projected/a0fb7db3-b20f-4b1d-ac20-fc1886e58087-kube-api-access-7nrgk\") pod \"payload-pre-processing-59fbc47bf8-ltz8r\" (UID: \"a0fb7db3-b20f-4b1d-ac20-fc1886e58087\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-ltz8r"
Sep 16 01:25:38.280165 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:25:38.280074    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-ltz8r"
Sep 16 01:25:38.561046 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:25:38.560956    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-ltz8r"]
Sep 16 01:25:38.563928 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:25:38.563899    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0fb7db3_b20f_4b1d_ac20_fc1886e58087.slice/crio-e62588b79a7cb0be1d5f1ac50a87bafcd6ffa23a61e9e4748525ec719993a48a WatchSource:0}: Error finding container e62588b79a7cb0be1d5f1ac50a87bafcd6ffa23a61e9e4748525ec719993a48a: Status 404 returned error can't find the container with id e62588b79a7cb0be1d5f1ac50a87bafcd6ffa23a61e9e4748525ec719993a48a
Sep 16 01:25:38.599434 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:25:38.599396    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-ltz8r" event={"ID":"a0fb7db3-b20f-4b1d-ac20-fc1886e58087","Type":"ContainerStarted","Data":"e62588b79a7cb0be1d5f1ac50a87bafcd6ffa23a61e9e4748525ec719993a48a"}
Sep 16 01:25:40.609971 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:25:40.609930    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-ltz8r" event={"ID":"a0fb7db3-b20f-4b1d-ac20-fc1886e58087","Type":"ContainerStarted","Data":"3b85af4e72d026f81b879b7f3a35b16f0c87c655dbe57e58ad9016691452346d"}
Sep 16 01:25:40.610477 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:25:40.610057    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-ltz8r"
Sep 16 01:25:40.625181 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:25:40.625127    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-ltz8r" podStartSLOduration=2.410236937 podStartE2EDuration="3.625111291s" totalImagesPullingTime="1.214874354s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:25:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:25:40.623961208 +0000 UTC m=+589.947429787" watchObservedRunningTime="2026-09-16 01:25:40.625111291 +0000 UTC m=+589.948579867"
Sep 16 01:25:51.616999 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:25:51.616954    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-ltz8r"
Sep 16 01:26:01.313708 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:01.313676    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q92rw"]
Sep 16 01:26:01.316808 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:01.316792    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q92rw"
Sep 16 01:26:01.319134 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:01.319115    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 16 01:26:01.320063 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:01.320039    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 16 01:26:01.320177 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:01.320140    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 16 01:26:01.320229 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:01.320179    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-lbkhj\""
Sep 16 01:26:01.326537 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:01.326516    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q92rw"]
Sep 16 01:26:01.496722 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:01.496678    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vd5ck\" (UniqueName: \"kubernetes.io/projected/83dd2343-6d08-4ccc-b4bf-1d8e1cf8ea42-kube-api-access-vd5ck\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q92rw\" (UID: \"83dd2343-6d08-4ccc-b4bf-1d8e1cf8ea42\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q92rw"
Sep 16 01:26:01.496918 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:01.496796    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83dd2343-6d08-4ccc-b4bf-1d8e1cf8ea42-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q92rw\" (UID: \"83dd2343-6d08-4ccc-b4bf-1d8e1cf8ea42\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q92rw"
Sep 16 01:26:01.496918 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:01.496850    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83dd2343-6d08-4ccc-b4bf-1d8e1cf8ea42-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q92rw\" (UID: \"83dd2343-6d08-4ccc-b4bf-1d8e1cf8ea42\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q92rw"
Sep 16 01:26:01.496918 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:01.496914    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83dd2343-6d08-4ccc-b4bf-1d8e1cf8ea42-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q92rw\" (UID: \"83dd2343-6d08-4ccc-b4bf-1d8e1cf8ea42\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q92rw"
Sep 16 01:26:01.497089 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:01.496944    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83dd2343-6d08-4ccc-b4bf-1d8e1cf8ea42-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q92rw\" (UID: \"83dd2343-6d08-4ccc-b4bf-1d8e1cf8ea42\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q92rw"
Sep 16 01:26:01.497089 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:01.496992    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83dd2343-6d08-4ccc-b4bf-1d8e1cf8ea42-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q92rw\" (UID: \"83dd2343-6d08-4ccc-b4bf-1d8e1cf8ea42\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q92rw"
Sep 16 01:26:01.597633 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:01.597536    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83dd2343-6d08-4ccc-b4bf-1d8e1cf8ea42-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q92rw\" (UID: \"83dd2343-6d08-4ccc-b4bf-1d8e1cf8ea42\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q92rw"
Sep 16 01:26:01.597633 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:01.597581    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83dd2343-6d08-4ccc-b4bf-1d8e1cf8ea42-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q92rw\" (UID: \"83dd2343-6d08-4ccc-b4bf-1d8e1cf8ea42\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q92rw"
Sep 16 01:26:01.597633 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:01.597605    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83dd2343-6d08-4ccc-b4bf-1d8e1cf8ea42-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q92rw\" (UID: \"83dd2343-6d08-4ccc-b4bf-1d8e1cf8ea42\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q92rw"
Sep 16 01:26:01.597914 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:01.597644    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vd5ck\" (UniqueName: \"kubernetes.io/projected/83dd2343-6d08-4ccc-b4bf-1d8e1cf8ea42-kube-api-access-vd5ck\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q92rw\" (UID: \"83dd2343-6d08-4ccc-b4bf-1d8e1cf8ea42\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q92rw"
Sep 16 01:26:01.597914 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:01.597685    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83dd2343-6d08-4ccc-b4bf-1d8e1cf8ea42-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q92rw\" (UID: \"83dd2343-6d08-4ccc-b4bf-1d8e1cf8ea42\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q92rw"
Sep 16 01:26:01.597914 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:01.597712    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83dd2343-6d08-4ccc-b4bf-1d8e1cf8ea42-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q92rw\" (UID: \"83dd2343-6d08-4ccc-b4bf-1d8e1cf8ea42\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q92rw"
Sep 16 01:26:01.598077 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:01.598009    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83dd2343-6d08-4ccc-b4bf-1d8e1cf8ea42-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q92rw\" (UID: \"83dd2343-6d08-4ccc-b4bf-1d8e1cf8ea42\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q92rw"
Sep 16 01:26:01.598131 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:01.598078    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83dd2343-6d08-4ccc-b4bf-1d8e1cf8ea42-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q92rw\" (UID: \"83dd2343-6d08-4ccc-b4bf-1d8e1cf8ea42\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q92rw"
Sep 16 01:26:01.598168 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:01.598137    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83dd2343-6d08-4ccc-b4bf-1d8e1cf8ea42-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q92rw\" (UID: \"83dd2343-6d08-4ccc-b4bf-1d8e1cf8ea42\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q92rw"
Sep 16 01:26:01.599890 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:01.599867    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83dd2343-6d08-4ccc-b4bf-1d8e1cf8ea42-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q92rw\" (UID: \"83dd2343-6d08-4ccc-b4bf-1d8e1cf8ea42\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q92rw"
Sep 16 01:26:01.600367 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:01.600325    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83dd2343-6d08-4ccc-b4bf-1d8e1cf8ea42-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q92rw\" (UID: \"83dd2343-6d08-4ccc-b4bf-1d8e1cf8ea42\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q92rw"
Sep 16 01:26:01.604958 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:01.604941    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vd5ck\" (UniqueName: \"kubernetes.io/projected/83dd2343-6d08-4ccc-b4bf-1d8e1cf8ea42-kube-api-access-vd5ck\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q92rw\" (UID: \"83dd2343-6d08-4ccc-b4bf-1d8e1cf8ea42\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q92rw"
Sep 16 01:26:01.627290 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:01.627251    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q92rw"
Sep 16 01:26:01.901762 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:01.901595    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q92rw"]
Sep 16 01:26:01.905144 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:26:01.905106    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83dd2343_6d08_4ccc_b4bf_1d8e1cf8ea42.slice/crio-f9960b8af4db3cd08d0e84ca34e21b4192f5b576e892145e4f45adb2a17473c1 WatchSource:0}: Error finding container f9960b8af4db3cd08d0e84ca34e21b4192f5b576e892145e4f45adb2a17473c1: Status 404 returned error can't find the container with id f9960b8af4db3cd08d0e84ca34e21b4192f5b576e892145e4f45adb2a17473c1
Sep 16 01:26:01.906445 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:01.906426    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 01:26:02.708411 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:02.708370    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q92rw" event={"ID":"83dd2343-6d08-4ccc-b4bf-1d8e1cf8ea42","Type":"ContainerStarted","Data":"f9960b8af4db3cd08d0e84ca34e21b4192f5b576e892145e4f45adb2a17473c1"}
Sep 16 01:26:03.715385 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:03.715322    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q92rw" event={"ID":"83dd2343-6d08-4ccc-b4bf-1d8e1cf8ea42","Type":"ContainerStarted","Data":"94afd749b7fb4d0f40d945440c4e206527c8da03443f786e82ed8327e8796f06"}
Sep 16 01:26:03.732204 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:03.732151    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q92rw" podStartSLOduration=1.5555296790000002 podStartE2EDuration="2.732133929s" totalImagesPullingTime="1.17660425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:26:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:26:03.730122882 +0000 UTC m=+613.053591458" watchObservedRunningTime="2026-09-16 01:26:03.732133929 +0000 UTC m=+613.055602507"
Sep 16 01:26:11.627590 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:11.627551    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q92rw"
Sep 16 01:26:11.627988 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:11.627623    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q92rw"
Sep 16 01:26:11.640102 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:11.640074    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q92rw"
Sep 16 01:26:11.760226 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:11.760198    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q92rw"
Sep 16 01:26:22.412826 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:22.412722    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-67scb"]
Sep 16 01:26:22.416668 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:22.416646    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-67scb"
Sep 16 01:26:22.420281 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:22.420258    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 16 01:26:22.426092 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:22.425990    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-67scb"]
Sep 16 01:26:22.457708 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:22.457673    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5390d1bd-9e63-4ba6-a6c1-da21fe2e3f69-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-67scb\" (UID: \"5390d1bd-9e63-4ba6-a6c1-da21fe2e3f69\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-67scb"
Sep 16 01:26:22.457899 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:22.457714    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5390d1bd-9e63-4ba6-a6c1-da21fe2e3f69-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-67scb\" (UID: \"5390d1bd-9e63-4ba6-a6c1-da21fe2e3f69\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-67scb"
Sep 16 01:26:22.457899 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:22.457743    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5390d1bd-9e63-4ba6-a6c1-da21fe2e3f69-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-67scb\" (UID: \"5390d1bd-9e63-4ba6-a6c1-da21fe2e3f69\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-67scb"
Sep 16 01:26:22.457899 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:22.457770    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5390d1bd-9e63-4ba6-a6c1-da21fe2e3f69-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-67scb\" (UID: \"5390d1bd-9e63-4ba6-a6c1-da21fe2e3f69\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-67scb"
Sep 16 01:26:22.457899 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:22.457845    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5h9p\" (UniqueName: \"kubernetes.io/projected/5390d1bd-9e63-4ba6-a6c1-da21fe2e3f69-kube-api-access-s5h9p\") pod \"e2e-distinct-simulated-kserve-59975d69f9-67scb\" (UID: \"5390d1bd-9e63-4ba6-a6c1-da21fe2e3f69\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-67scb"
Sep 16 01:26:22.458063 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:22.457936    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5390d1bd-9e63-4ba6-a6c1-da21fe2e3f69-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-67scb\" (UID: \"5390d1bd-9e63-4ba6-a6c1-da21fe2e3f69\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-67scb"
Sep 16 01:26:22.559363 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:22.559298    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5390d1bd-9e63-4ba6-a6c1-da21fe2e3f69-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-67scb\" (UID: \"5390d1bd-9e63-4ba6-a6c1-da21fe2e3f69\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-67scb"
Sep 16 01:26:22.559363 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:22.559362    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5390d1bd-9e63-4ba6-a6c1-da21fe2e3f69-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-67scb\" (UID: \"5390d1bd-9e63-4ba6-a6c1-da21fe2e3f69\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-67scb"
Sep 16 01:26:22.559606 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:22.559392    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5390d1bd-9e63-4ba6-a6c1-da21fe2e3f69-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-67scb\" (UID: \"5390d1bd-9e63-4ba6-a6c1-da21fe2e3f69\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-67scb"
Sep 16 01:26:22.559606 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:22.559421    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5390d1bd-9e63-4ba6-a6c1-da21fe2e3f69-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-67scb\" (UID: \"5390d1bd-9e63-4ba6-a6c1-da21fe2e3f69\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-67scb"
Sep 16 01:26:22.559606 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:22.559454    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5h9p\" (UniqueName: \"kubernetes.io/projected/5390d1bd-9e63-4ba6-a6c1-da21fe2e3f69-kube-api-access-s5h9p\") pod \"e2e-distinct-simulated-kserve-59975d69f9-67scb\" (UID: \"5390d1bd-9e63-4ba6-a6c1-da21fe2e3f69\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-67scb"
Sep 16 01:26:22.559606 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:22.559548    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5390d1bd-9e63-4ba6-a6c1-da21fe2e3f69-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-67scb\" (UID: \"5390d1bd-9e63-4ba6-a6c1-da21fe2e3f69\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-67scb"
Sep 16 01:26:22.559804 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:22.559763    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5390d1bd-9e63-4ba6-a6c1-da21fe2e3f69-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-67scb\" (UID: \"5390d1bd-9e63-4ba6-a6c1-da21fe2e3f69\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-67scb"
Sep 16 01:26:22.559865 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:22.559814    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5390d1bd-9e63-4ba6-a6c1-da21fe2e3f69-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-67scb\" (UID: \"5390d1bd-9e63-4ba6-a6c1-da21fe2e3f69\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-67scb"
Sep 16 01:26:22.559921 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:22.559862    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5390d1bd-9e63-4ba6-a6c1-da21fe2e3f69-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-67scb\" (UID: \"5390d1bd-9e63-4ba6-a6c1-da21fe2e3f69\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-67scb"
Sep 16 01:26:22.561607 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:22.561589    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5390d1bd-9e63-4ba6-a6c1-da21fe2e3f69-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-67scb\" (UID: \"5390d1bd-9e63-4ba6-a6c1-da21fe2e3f69\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-67scb"
Sep 16 01:26:22.561981 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:22.561963    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5390d1bd-9e63-4ba6-a6c1-da21fe2e3f69-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-67scb\" (UID: \"5390d1bd-9e63-4ba6-a6c1-da21fe2e3f69\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-67scb"
Sep 16 01:26:22.566914 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:22.566897    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5h9p\" (UniqueName: \"kubernetes.io/projected/5390d1bd-9e63-4ba6-a6c1-da21fe2e3f69-kube-api-access-s5h9p\") pod \"e2e-distinct-simulated-kserve-59975d69f9-67scb\" (UID: \"5390d1bd-9e63-4ba6-a6c1-da21fe2e3f69\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-67scb"
Sep 16 01:26:22.730539 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:22.730462    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-67scb"
Sep 16 01:26:22.998725 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:22.998697    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-67scb"]
Sep 16 01:26:23.001188 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:26:23.001155    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5390d1bd_9e63_4ba6_a6c1_da21fe2e3f69.slice/crio-7e83c72509cb286796a95e436c58c5025001e1c18c7bf1ddf1dd9122927dc34c WatchSource:0}: Error finding container 7e83c72509cb286796a95e436c58c5025001e1c18c7bf1ddf1dd9122927dc34c: Status 404 returned error can't find the container with id 7e83c72509cb286796a95e436c58c5025001e1c18c7bf1ddf1dd9122927dc34c
Sep 16 01:26:23.805033 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:23.804994    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-67scb" event={"ID":"5390d1bd-9e63-4ba6-a6c1-da21fe2e3f69","Type":"ContainerStarted","Data":"0349305b7922f75ebe95c32b25b2366217e5a9b10fd4201478a1b987008fbd6e"}
Sep 16 01:26:23.805459 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:23.805052    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-67scb" event={"ID":"5390d1bd-9e63-4ba6-a6c1-da21fe2e3f69","Type":"ContainerStarted","Data":"7e83c72509cb286796a95e436c58c5025001e1c18c7bf1ddf1dd9122927dc34c"}
Sep 16 01:26:23.822833 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:23.822773    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-67scb" podStartSLOduration=1.556816789 podStartE2EDuration="1.822751424s" totalImagesPullingTime="265.934635ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:26:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:26:23.820612332 +0000 UTC m=+633.144080932" watchObservedRunningTime="2026-09-16 01:26:23.822751424 +0000 UTC m=+633.146220005"
Sep 16 01:26:32.730633 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:32.730595    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-67scb"
Sep 16 01:26:32.731133 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:32.730659    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-67scb"
Sep 16 01:26:32.743357 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:32.743321    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-67scb"
Sep 16 01:26:32.854877 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:26:32.854839    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-67scb"
Sep 16 01:27:00.597402 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:27:00.597361    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-92bvz"]
Sep 16 01:27:00.601185 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:27:00.601161    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-92bvz"
Sep 16 01:27:00.603449 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:27:00.603428    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 16 01:27:00.611388 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:27:00.611354    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-92bvz"]
Sep 16 01:27:00.694187 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:27:00.694154    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2473b96-fcd3-43d0-a66b-84673656e1fd-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-92bvz\" (UID: \"d2473b96-fcd3-43d0-a66b-84673656e1fd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-92bvz"
Sep 16 01:27:00.694187 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:27:00.694192    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fm9pc\" (UniqueName: \"kubernetes.io/projected/d2473b96-fcd3-43d0-a66b-84673656e1fd-kube-api-access-fm9pc\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-92bvz\" (UID: \"d2473b96-fcd3-43d0-a66b-84673656e1fd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-92bvz"
Sep 16 01:27:00.694421 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:27:00.694227    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2473b96-fcd3-43d0-a66b-84673656e1fd-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-92bvz\" (UID: \"d2473b96-fcd3-43d0-a66b-84673656e1fd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-92bvz"
Sep 16 01:27:00.694421 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:27:00.694254    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2473b96-fcd3-43d0-a66b-84673656e1fd-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-92bvz\" (UID: \"d2473b96-fcd3-43d0-a66b-84673656e1fd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-92bvz"
Sep 16 01:27:00.694421 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:27:00.694275    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2473b96-fcd3-43d0-a66b-84673656e1fd-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-92bvz\" (UID: \"d2473b96-fcd3-43d0-a66b-84673656e1fd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-92bvz"
Sep 16 01:27:00.694421 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:27:00.694357    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2473b96-fcd3-43d0-a66b-84673656e1fd-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-92bvz\" (UID: \"d2473b96-fcd3-43d0-a66b-84673656e1fd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-92bvz"
Sep 16 01:27:00.795488 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:27:00.795449    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2473b96-fcd3-43d0-a66b-84673656e1fd-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-92bvz\" (UID: \"d2473b96-fcd3-43d0-a66b-84673656e1fd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-92bvz"
Sep 16 01:27:00.795672 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:27:00.795506    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2473b96-fcd3-43d0-a66b-84673656e1fd-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-92bvz\" (UID: \"d2473b96-fcd3-43d0-a66b-84673656e1fd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-92bvz"
Sep 16 01:27:00.795672 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:27:00.795525    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm9pc\" (UniqueName: \"kubernetes.io/projected/d2473b96-fcd3-43d0-a66b-84673656e1fd-kube-api-access-fm9pc\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-92bvz\" (UID: \"d2473b96-fcd3-43d0-a66b-84673656e1fd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-92bvz"
Sep 16 01:27:00.795672 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:27:00.795566    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2473b96-fcd3-43d0-a66b-84673656e1fd-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-92bvz\" (UID: \"d2473b96-fcd3-43d0-a66b-84673656e1fd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-92bvz"
Sep 16 01:27:00.795672 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:27:00.795595    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2473b96-fcd3-43d0-a66b-84673656e1fd-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-92bvz\" (UID: \"d2473b96-fcd3-43d0-a66b-84673656e1fd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-92bvz"
Sep 16 01:27:00.795672 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:27:00.795624    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2473b96-fcd3-43d0-a66b-84673656e1fd-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-92bvz\" (UID: \"d2473b96-fcd3-43d0-a66b-84673656e1fd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-92bvz"
Sep 16 01:27:00.795981 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:27:00.795956    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2473b96-fcd3-43d0-a66b-84673656e1fd-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-92bvz\" (UID: \"d2473b96-fcd3-43d0-a66b-84673656e1fd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-92bvz"
Sep 16 01:27:00.796050 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:27:00.796029    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2473b96-fcd3-43d0-a66b-84673656e1fd-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-92bvz\" (UID: \"d2473b96-fcd3-43d0-a66b-84673656e1fd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-92bvz"
Sep 16 01:27:00.796104 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:27:00.796076    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2473b96-fcd3-43d0-a66b-84673656e1fd-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-92bvz\" (UID: \"d2473b96-fcd3-43d0-a66b-84673656e1fd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-92bvz"
Sep 16 01:27:00.797895 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:27:00.797875    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2473b96-fcd3-43d0-a66b-84673656e1fd-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-92bvz\" (UID: \"d2473b96-fcd3-43d0-a66b-84673656e1fd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-92bvz"
Sep 16 01:27:00.798174 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:27:00.798156    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2473b96-fcd3-43d0-a66b-84673656e1fd-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-92bvz\" (UID: \"d2473b96-fcd3-43d0-a66b-84673656e1fd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-92bvz"
Sep 16 01:27:00.802730 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:27:00.802707    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fm9pc\" (UniqueName: \"kubernetes.io/projected/d2473b96-fcd3-43d0-a66b-84673656e1fd-kube-api-access-fm9pc\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-92bvz\" (UID: \"d2473b96-fcd3-43d0-a66b-84673656e1fd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-92bvz"
Sep 16 01:27:00.914397 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:27:00.914356    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-92bvz"
Sep 16 01:27:01.186737 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:27:01.186571    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-92bvz"]
Sep 16 01:27:01.189731 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:27:01.189699    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2473b96_fcd3_43d0_a66b_84673656e1fd.slice/crio-ff87b4e7cf6005c9a643a8261cfb307b508a464140d85dd8fd004f535d34401f WatchSource:0}: Error finding container ff87b4e7cf6005c9a643a8261cfb307b508a464140d85dd8fd004f535d34401f: Status 404 returned error can't find the container with id ff87b4e7cf6005c9a643a8261cfb307b508a464140d85dd8fd004f535d34401f
Sep 16 01:27:01.975912 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:27:01.975862    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-92bvz" event={"ID":"d2473b96-fcd3-43d0-a66b-84673656e1fd","Type":"ContainerStarted","Data":"a0277f5c0edf5bb18026f77f2c8b9d8127c916e5237a731e4817d2a6a2fbb252"}
Sep 16 01:27:01.976296 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:27:01.975937    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-92bvz" event={"ID":"d2473b96-fcd3-43d0-a66b-84673656e1fd","Type":"ContainerStarted","Data":"ff87b4e7cf6005c9a643a8261cfb307b508a464140d85dd8fd004f535d34401f"}
Sep 16 01:27:01.991183 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:27:01.991128    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-92bvz" podStartSLOduration=1.765505 podStartE2EDuration="1.991108129s" totalImagesPullingTime="225.603129ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:27:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:27:01.990636005 +0000 UTC m=+671.314104576" watchObservedRunningTime="2026-09-16 01:27:01.991108129 +0000 UTC m=+671.314576707"
Sep 16 01:27:10.914606 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:27:10.914565    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-92bvz"
Sep 16 01:27:10.915017 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:27:10.914633    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-92bvz"
Sep 16 01:27:10.927467 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:27:10.927429    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-92bvz"
Sep 16 01:27:11.028043 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:27:11.028005    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-92bvz"
Sep 16 01:28:10.399803 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:10.399758    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8585f876ff-j9kpp"]
Sep 16 01:28:10.400433 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:10.399950    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-8585f876ff-j9kpp" podUID="566b76ac-7c64-4735-84cb-745f1a0a33e2" containerName="authorino" containerID="cri-o://ee0072109e7f13dea256a02d6cc014d4a496db26033dfb4012670130accc1977" gracePeriod=30
Sep 16 01:28:10.655007 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:10.654982    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8585f876ff-j9kpp"
Sep 16 01:28:10.708067 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:10.708024    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/566b76ac-7c64-4735-84cb-745f1a0a33e2-tls-cert\") pod \"566b76ac-7c64-4735-84cb-745f1a0a33e2\" (UID: \"566b76ac-7c64-4735-84cb-745f1a0a33e2\") "
Sep 16 01:28:10.708239 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:10.708137    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zd9lv\" (UniqueName: \"kubernetes.io/projected/566b76ac-7c64-4735-84cb-745f1a0a33e2-kube-api-access-zd9lv\") pod \"566b76ac-7c64-4735-84cb-745f1a0a33e2\" (UID: \"566b76ac-7c64-4735-84cb-745f1a0a33e2\") "
Sep 16 01:28:10.710245 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:10.710216    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/566b76ac-7c64-4735-84cb-745f1a0a33e2-kube-api-access-zd9lv" (OuterVolumeSpecName: "kube-api-access-zd9lv") pod "566b76ac-7c64-4735-84cb-745f1a0a33e2" (UID: "566b76ac-7c64-4735-84cb-745f1a0a33e2"). InnerVolumeSpecName "kube-api-access-zd9lv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:28:10.717964 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:10.717934    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/566b76ac-7c64-4735-84cb-745f1a0a33e2-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "566b76ac-7c64-4735-84cb-745f1a0a33e2" (UID: "566b76ac-7c64-4735-84cb-745f1a0a33e2"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 01:28:10.809492 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:10.809446    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zd9lv\" (UniqueName: \"kubernetes.io/projected/566b76ac-7c64-4735-84cb-745f1a0a33e2-kube-api-access-zd9lv\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:28:10.809492 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:10.809482    2565 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/566b76ac-7c64-4735-84cb-745f1a0a33e2-tls-cert\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:28:11.295192 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:11.295156    2565 generic.go:356] "Generic (PLEG): container finished" podID="566b76ac-7c64-4735-84cb-745f1a0a33e2" containerID="ee0072109e7f13dea256a02d6cc014d4a496db26033dfb4012670130accc1977" exitCode=0
Sep 16 01:28:11.295412 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:11.295196    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8585f876ff-j9kpp"
Sep 16 01:28:11.295412 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:11.295242    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8585f876ff-j9kpp" event={"ID":"566b76ac-7c64-4735-84cb-745f1a0a33e2","Type":"ContainerDied","Data":"ee0072109e7f13dea256a02d6cc014d4a496db26033dfb4012670130accc1977"}
Sep 16 01:28:11.295412 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:11.295279    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8585f876ff-j9kpp" event={"ID":"566b76ac-7c64-4735-84cb-745f1a0a33e2","Type":"ContainerDied","Data":"3f519e49e33ed25d665eacc7d983a8f6c5933767a97bc1b07fee2517a92d12e0"}
Sep 16 01:28:11.295412 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:11.295300    2565 scope.go:117] "RemoveContainer" containerID="ee0072109e7f13dea256a02d6cc014d4a496db26033dfb4012670130accc1977"
Sep 16 01:28:11.305420 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:11.305401    2565 scope.go:117] "RemoveContainer" containerID="ee0072109e7f13dea256a02d6cc014d4a496db26033dfb4012670130accc1977"
Sep 16 01:28:11.305713 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:28:11.305685    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee0072109e7f13dea256a02d6cc014d4a496db26033dfb4012670130accc1977\": container with ID starting with ee0072109e7f13dea256a02d6cc014d4a496db26033dfb4012670130accc1977 not found: ID does not exist" containerID="ee0072109e7f13dea256a02d6cc014d4a496db26033dfb4012670130accc1977"
Sep 16 01:28:11.305774 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:11.305724    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee0072109e7f13dea256a02d6cc014d4a496db26033dfb4012670130accc1977"} err="failed to get container status \"ee0072109e7f13dea256a02d6cc014d4a496db26033dfb4012670130accc1977\": rpc error: code = NotFound desc = could not find container \"ee0072109e7f13dea256a02d6cc014d4a496db26033dfb4012670130accc1977\": container with ID starting with ee0072109e7f13dea256a02d6cc014d4a496db26033dfb4012670130accc1977 not found: ID does not exist"
Sep 16 01:28:11.310822 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:11.310795    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8585f876ff-j9kpp"]
Sep 16 01:28:11.313427 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:11.313403    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8585f876ff-j9kpp"]
Sep 16 01:28:11.356072 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:11.356038    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-ltz8r"]
Sep 16 01:28:11.356581 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:11.356550    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-ltz8r" podUID="a0fb7db3-b20f-4b1d-ac20-fc1886e58087" containerName="payload-pre-processing" containerID="cri-o://3b85af4e72d026f81b879b7f3a35b16f0c87c655dbe57e58ad9016691452346d" gracePeriod=30
Sep 16 01:28:11.613263 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:11.613237    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-ltz8r"
Sep 16 01:28:11.719571 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:11.719536    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a0fb7db3-b20f-4b1d-ac20-fc1886e58087-plugins-config-volume\") pod \"a0fb7db3-b20f-4b1d-ac20-fc1886e58087\" (UID: \"a0fb7db3-b20f-4b1d-ac20-fc1886e58087\") "
Sep 16 01:28:11.719780 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:11.719620    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7nrgk\" (UniqueName: \"kubernetes.io/projected/a0fb7db3-b20f-4b1d-ac20-fc1886e58087-kube-api-access-7nrgk\") pod \"a0fb7db3-b20f-4b1d-ac20-fc1886e58087\" (UID: \"a0fb7db3-b20f-4b1d-ac20-fc1886e58087\") "
Sep 16 01:28:11.719969 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:11.719936    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0fb7db3-b20f-4b1d-ac20-fc1886e58087-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a0fb7db3-b20f-4b1d-ac20-fc1886e58087" (UID: "a0fb7db3-b20f-4b1d-ac20-fc1886e58087"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:28:11.721780 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:11.721747    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0fb7db3-b20f-4b1d-ac20-fc1886e58087-kube-api-access-7nrgk" (OuterVolumeSpecName: "kube-api-access-7nrgk") pod "a0fb7db3-b20f-4b1d-ac20-fc1886e58087" (UID: "a0fb7db3-b20f-4b1d-ac20-fc1886e58087"). InnerVolumeSpecName "kube-api-access-7nrgk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:28:11.820488 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:11.820449    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7nrgk\" (UniqueName: \"kubernetes.io/projected/a0fb7db3-b20f-4b1d-ac20-fc1886e58087-kube-api-access-7nrgk\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:28:11.820488 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:11.820478    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a0fb7db3-b20f-4b1d-ac20-fc1886e58087-plugins-config-volume\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:28:12.301271 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:12.301231    2565 generic.go:356] "Generic (PLEG): container finished" podID="a0fb7db3-b20f-4b1d-ac20-fc1886e58087" containerID="3b85af4e72d026f81b879b7f3a35b16f0c87c655dbe57e58ad9016691452346d" exitCode=0
Sep 16 01:28:12.301271 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:12.301273    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-ltz8r"
Sep 16 01:28:12.301549 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:12.301320    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-ltz8r" event={"ID":"a0fb7db3-b20f-4b1d-ac20-fc1886e58087","Type":"ContainerDied","Data":"3b85af4e72d026f81b879b7f3a35b16f0c87c655dbe57e58ad9016691452346d"}
Sep 16 01:28:12.301549 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:12.301399    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-ltz8r" event={"ID":"a0fb7db3-b20f-4b1d-ac20-fc1886e58087","Type":"ContainerDied","Data":"e62588b79a7cb0be1d5f1ac50a87bafcd6ffa23a61e9e4748525ec719993a48a"}
Sep 16 01:28:12.301549 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:12.301439    2565 scope.go:117] "RemoveContainer" containerID="3b85af4e72d026f81b879b7f3a35b16f0c87c655dbe57e58ad9016691452346d"
Sep 16 01:28:12.310007 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:12.309990    2565 scope.go:117] "RemoveContainer" containerID="3b85af4e72d026f81b879b7f3a35b16f0c87c655dbe57e58ad9016691452346d"
Sep 16 01:28:12.310327 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:28:12.310302    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b85af4e72d026f81b879b7f3a35b16f0c87c655dbe57e58ad9016691452346d\": container with ID starting with 3b85af4e72d026f81b879b7f3a35b16f0c87c655dbe57e58ad9016691452346d not found: ID does not exist" containerID="3b85af4e72d026f81b879b7f3a35b16f0c87c655dbe57e58ad9016691452346d"
Sep 16 01:28:12.310498 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:12.310348    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b85af4e72d026f81b879b7f3a35b16f0c87c655dbe57e58ad9016691452346d"} err="failed to get container status \"3b85af4e72d026f81b879b7f3a35b16f0c87c655dbe57e58ad9016691452346d\": rpc error: code = NotFound desc = could not find container \"3b85af4e72d026f81b879b7f3a35b16f0c87c655dbe57e58ad9016691452346d\": container with ID starting with 3b85af4e72d026f81b879b7f3a35b16f0c87c655dbe57e58ad9016691452346d not found: ID does not exist"
Sep 16 01:28:12.322508 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:12.322483    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-ltz8r"]
Sep 16 01:28:12.329070 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:12.329046    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-ltz8r"]
Sep 16 01:28:13.168758 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:13.168723    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="566b76ac-7c64-4735-84cb-745f1a0a33e2" path="/var/lib/kubelet/pods/566b76ac-7c64-4735-84cb-745f1a0a33e2/volumes"
Sep 16 01:28:13.169132 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:13.169114    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0fb7db3-b20f-4b1d-ac20-fc1886e58087" path="/var/lib/kubelet/pods/a0fb7db3-b20f-4b1d-ac20-fc1886e58087/volumes"
Sep 16 01:28:24.680878 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:24.680827    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-6d77c65979-4ltlw"]
Sep 16 01:28:24.681277 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:24.681189    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="566b76ac-7c64-4735-84cb-745f1a0a33e2" containerName="authorino"
Sep 16 01:28:24.681277 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:24.681204    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="566b76ac-7c64-4735-84cb-745f1a0a33e2" containerName="authorino"
Sep 16 01:28:24.681277 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:24.681221    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0fb7db3-b20f-4b1d-ac20-fc1886e58087" containerName="payload-pre-processing"
Sep 16 01:28:24.681277 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:24.681227    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0fb7db3-b20f-4b1d-ac20-fc1886e58087" containerName="payload-pre-processing"
Sep 16 01:28:24.681277 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:24.681279    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0fb7db3-b20f-4b1d-ac20-fc1886e58087" containerName="payload-pre-processing"
Sep 16 01:28:24.681462 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:24.681288    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="566b76ac-7c64-4735-84cb-745f1a0a33e2" containerName="authorino"
Sep 16 01:28:24.684591 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:24.684567    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-6d77c65979-4ltlw"
Sep 16 01:28:24.686955 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:24.686932    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"ai-gateway-controller-parameters\""
Sep 16 01:28:24.687065 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:24.686932    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-dockercfg-tj8wb\""
Sep 16 01:28:24.692876 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:24.692848    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-6d77c65979-4ltlw"]
Sep 16 01:28:24.826201 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:24.826156    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d28s\" (UniqueName: \"kubernetes.io/projected/125dc212-9f37-48cc-8034-4b566e1462c2-kube-api-access-4d28s\") pod \"ai-gateway-controller-6d77c65979-4ltlw\" (UID: \"125dc212-9f37-48cc-8034-4b566e1462c2\") " pod="opendatahub/ai-gateway-controller-6d77c65979-4ltlw"
Sep 16 01:28:24.927052 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:24.927009    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d28s\" (UniqueName: \"kubernetes.io/projected/125dc212-9f37-48cc-8034-4b566e1462c2-kube-api-access-4d28s\") pod \"ai-gateway-controller-6d77c65979-4ltlw\" (UID: \"125dc212-9f37-48cc-8034-4b566e1462c2\") " pod="opendatahub/ai-gateway-controller-6d77c65979-4ltlw"
Sep 16 01:28:24.934812 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:24.934748    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d28s\" (UniqueName: \"kubernetes.io/projected/125dc212-9f37-48cc-8034-4b566e1462c2-kube-api-access-4d28s\") pod \"ai-gateway-controller-6d77c65979-4ltlw\" (UID: \"125dc212-9f37-48cc-8034-4b566e1462c2\") " pod="opendatahub/ai-gateway-controller-6d77c65979-4ltlw"
Sep 16 01:28:24.996512 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:24.996472    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-6d77c65979-4ltlw"
Sep 16 01:28:25.265958 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:25.265932    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-6d77c65979-4ltlw"]
Sep 16 01:28:25.268448 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:28:25.268421    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod125dc212_9f37_48cc_8034_4b566e1462c2.slice/crio-6c9f8dc1d7803521fa9f2ed6cd778aaa5a191730a0fab3f165d4e1ec12341096 WatchSource:0}: Error finding container 6c9f8dc1d7803521fa9f2ed6cd778aaa5a191730a0fab3f165d4e1ec12341096: Status 404 returned error can't find the container with id 6c9f8dc1d7803521fa9f2ed6cd778aaa5a191730a0fab3f165d4e1ec12341096
Sep 16 01:28:25.362001 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:25.361960    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-6d77c65979-4ltlw" event={"ID":"125dc212-9f37-48cc-8034-4b566e1462c2","Type":"ContainerStarted","Data":"6c9f8dc1d7803521fa9f2ed6cd778aaa5a191730a0fab3f165d4e1ec12341096"}
Sep 16 01:28:27.875209 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:27.875122    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5d7dbbd56b-4455c"]
Sep 16 01:28:27.878480 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:27.878459    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5d7dbbd56b-4455c"
Sep 16 01:28:27.880738 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:27.880719    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 16 01:28:27.880874 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:27.880852    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-kkbcm\""
Sep 16 01:28:27.886369 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:27.886330    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5d7dbbd56b-4455c"]
Sep 16 01:28:27.899440 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:27.899415    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-6cd864bc95-st4pq"]
Sep 16 01:28:27.902691 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:27.902669    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-6cd864bc95-st4pq"
Sep 16 01:28:27.913462 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:27.913438    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-6cd864bc95-st4pq"]
Sep 16 01:28:27.956303 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:27.956278    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c67aa80-4f89-4425-8726-a2a63b6a3121-plugins-config-volume\") pod \"payload-processing-5d7dbbd56b-4455c\" (UID: \"6c67aa80-4f89-4425-8726-a2a63b6a3121\") " pod="openshift-ingress/payload-processing-5d7dbbd56b-4455c"
Sep 16 01:28:27.956416 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:27.956315    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkclv\" (UniqueName: \"kubernetes.io/projected/6c67aa80-4f89-4425-8726-a2a63b6a3121-kube-api-access-wkclv\") pod \"payload-processing-5d7dbbd56b-4455c\" (UID: \"6c67aa80-4f89-4425-8726-a2a63b6a3121\") " pod="openshift-ingress/payload-processing-5d7dbbd56b-4455c"
Sep 16 01:28:28.057716 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:28.057686    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14a698e1-acae-4027-bca5-6cf067112033-plugins-config-volume\") pod \"payload-pre-processing-6cd864bc95-st4pq\" (UID: \"14a698e1-acae-4027-bca5-6cf067112033\") " pod="openshift-ingress/payload-pre-processing-6cd864bc95-st4pq"
Sep 16 01:28:28.057851 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:28.057730    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c67aa80-4f89-4425-8726-a2a63b6a3121-plugins-config-volume\") pod \"payload-processing-5d7dbbd56b-4455c\" (UID: \"6c67aa80-4f89-4425-8726-a2a63b6a3121\") " pod="openshift-ingress/payload-processing-5d7dbbd56b-4455c"
Sep 16 01:28:28.057851 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:28.057757    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkclv\" (UniqueName: \"kubernetes.io/projected/6c67aa80-4f89-4425-8726-a2a63b6a3121-kube-api-access-wkclv\") pod \"payload-processing-5d7dbbd56b-4455c\" (UID: \"6c67aa80-4f89-4425-8726-a2a63b6a3121\") " pod="openshift-ingress/payload-processing-5d7dbbd56b-4455c"
Sep 16 01:28:28.057851 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:28.057794    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fqjl\" (UniqueName: \"kubernetes.io/projected/14a698e1-acae-4027-bca5-6cf067112033-kube-api-access-7fqjl\") pod \"payload-pre-processing-6cd864bc95-st4pq\" (UID: \"14a698e1-acae-4027-bca5-6cf067112033\") " pod="openshift-ingress/payload-pre-processing-6cd864bc95-st4pq"
Sep 16 01:28:28.058695 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:28.058676    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c67aa80-4f89-4425-8726-a2a63b6a3121-plugins-config-volume\") pod \"payload-processing-5d7dbbd56b-4455c\" (UID: \"6c67aa80-4f89-4425-8726-a2a63b6a3121\") " pod="openshift-ingress/payload-processing-5d7dbbd56b-4455c"
Sep 16 01:28:28.066797 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:28.066770    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkclv\" (UniqueName: \"kubernetes.io/projected/6c67aa80-4f89-4425-8726-a2a63b6a3121-kube-api-access-wkclv\") pod \"payload-processing-5d7dbbd56b-4455c\" (UID: \"6c67aa80-4f89-4425-8726-a2a63b6a3121\") " pod="openshift-ingress/payload-processing-5d7dbbd56b-4455c"
Sep 16 01:28:28.158710 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:28.158687    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14a698e1-acae-4027-bca5-6cf067112033-plugins-config-volume\") pod \"payload-pre-processing-6cd864bc95-st4pq\" (UID: \"14a698e1-acae-4027-bca5-6cf067112033\") " pod="openshift-ingress/payload-pre-processing-6cd864bc95-st4pq"
Sep 16 01:28:28.158807 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:28.158746    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fqjl\" (UniqueName: \"kubernetes.io/projected/14a698e1-acae-4027-bca5-6cf067112033-kube-api-access-7fqjl\") pod \"payload-pre-processing-6cd864bc95-st4pq\" (UID: \"14a698e1-acae-4027-bca5-6cf067112033\") " pod="openshift-ingress/payload-pre-processing-6cd864bc95-st4pq"
Sep 16 01:28:28.159465 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:28.159447    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14a698e1-acae-4027-bca5-6cf067112033-plugins-config-volume\") pod \"payload-pre-processing-6cd864bc95-st4pq\" (UID: \"14a698e1-acae-4027-bca5-6cf067112033\") " pod="openshift-ingress/payload-pre-processing-6cd864bc95-st4pq"
Sep 16 01:28:28.167868 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:28.167850    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fqjl\" (UniqueName: \"kubernetes.io/projected/14a698e1-acae-4027-bca5-6cf067112033-kube-api-access-7fqjl\") pod \"payload-pre-processing-6cd864bc95-st4pq\" (UID: \"14a698e1-acae-4027-bca5-6cf067112033\") " pod="openshift-ingress/payload-pre-processing-6cd864bc95-st4pq"
Sep 16 01:28:28.189722 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:28.189702    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5d7dbbd56b-4455c"
Sep 16 01:28:28.213759 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:28.213736    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-6cd864bc95-st4pq"
Sep 16 01:28:28.379708 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:28.379669    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-6d77c65979-4ltlw" event={"ID":"125dc212-9f37-48cc-8034-4b566e1462c2","Type":"ContainerStarted","Data":"8955da1f7ac4301677f443dc1f260df5479da9b16a32752768ccde9c03f1c1ab"}
Sep 16 01:28:28.379846 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:28.379829    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-6d77c65979-4ltlw"
Sep 16 01:28:28.395291 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:28.395246    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-6d77c65979-4ltlw" podStartSLOduration=2.18756419 podStartE2EDuration="4.395210707s" totalImagesPullingTime="2.207646517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:28:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:28:28.393755059 +0000 UTC m=+757.717223639" watchObservedRunningTime="2026-09-16 01:28:28.395210707 +0000 UTC m=+757.718679320"
Sep 16 01:28:28.456322 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:28.456299    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5d7dbbd56b-4455c"]
Sep 16 01:28:28.458047 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:28:28.458026    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c67aa80_4f89_4425_8726_a2a63b6a3121.slice/crio-da8eec1630720bce3bc96c9987a33f5567b5d9a0e501184ddb9467139f114ce2 WatchSource:0}: Error finding container da8eec1630720bce3bc96c9987a33f5567b5d9a0e501184ddb9467139f114ce2: Status 404 returned error can't find the container with id da8eec1630720bce3bc96c9987a33f5567b5d9a0e501184ddb9467139f114ce2
Sep 16 01:28:28.486286 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:28.486266    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-6cd864bc95-st4pq"]
Sep 16 01:28:28.487490 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:28:28.487466    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14a698e1_acae_4027_bca5_6cf067112033.slice/crio-17cf2c9cccc62ed31c637c0dbd1d187618feb77b779093b12d45f1cf1802455b WatchSource:0}: Error finding container 17cf2c9cccc62ed31c637c0dbd1d187618feb77b779093b12d45f1cf1802455b: Status 404 returned error can't find the container with id 17cf2c9cccc62ed31c637c0dbd1d187618feb77b779093b12d45f1cf1802455b
Sep 16 01:28:29.386395 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:29.386358    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-6cd864bc95-st4pq" event={"ID":"14a698e1-acae-4027-bca5-6cf067112033","Type":"ContainerStarted","Data":"17cf2c9cccc62ed31c637c0dbd1d187618feb77b779093b12d45f1cf1802455b"}
Sep 16 01:28:29.387799 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:29.387770    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5d7dbbd56b-4455c" event={"ID":"6c67aa80-4f89-4425-8726-a2a63b6a3121","Type":"ContainerStarted","Data":"da8eec1630720bce3bc96c9987a33f5567b5d9a0e501184ddb9467139f114ce2"}
Sep 16 01:28:30.394937 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:30.394882    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5d7dbbd56b-4455c" event={"ID":"6c67aa80-4f89-4425-8726-a2a63b6a3121","Type":"ContainerStarted","Data":"c45fd8d4962f2365b2c5253da05118f8ca726e755ed66aea5ec44644b554a3c9"}
Sep 16 01:28:30.395403 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:30.394961    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5d7dbbd56b-4455c"
Sep 16 01:28:30.396676 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:30.396643    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-6cd864bc95-st4pq" event={"ID":"14a698e1-acae-4027-bca5-6cf067112033","Type":"ContainerStarted","Data":"6d02e1eec506e450f6ed90d77cfabddacc20ed9a7659da06bbdf1b9a6c8609be"}
Sep 16 01:28:30.396822 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:30.396695    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-6cd864bc95-st4pq"
Sep 16 01:28:30.410552 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:30.410501    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5d7dbbd56b-4455c" podStartSLOduration=2.371645147 podStartE2EDuration="3.410486533s" totalImagesPullingTime="1.038841386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:28:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:28:30.409258352 +0000 UTC m=+759.732726930" watchObservedRunningTime="2026-09-16 01:28:30.410486533 +0000 UTC m=+759.733955109"
Sep 16 01:28:30.426055 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:30.425970    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-6cd864bc95-st4pq" podStartSLOduration=2.41472423 podStartE2EDuration="3.425949433s" totalImagesPullingTime="1.011225203s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:28:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:28:30.425195144 +0000 UTC m=+759.748663722" watchObservedRunningTime="2026-09-16 01:28:30.425949433 +0000 UTC m=+759.749418011"
Sep 16 01:28:39.389912 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:39.389881    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-6d77c65979-4ltlw"
Sep 16 01:28:39.612411 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:39.612377    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-5d945fb875-d7cbl"]
Sep 16 01:28:39.615945 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:39.615924    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-5d945fb875-d7cbl"
Sep 16 01:28:39.622797 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:39.622772    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-5d945fb875-d7cbl"]
Sep 16 01:28:39.753736 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:39.753704    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldzl8\" (UniqueName: \"kubernetes.io/projected/e6bb7a83-bb5d-4334-9307-ea7e85e5200e-kube-api-access-ldzl8\") pod \"ai-gateway-controller-5d945fb875-d7cbl\" (UID: \"e6bb7a83-bb5d-4334-9307-ea7e85e5200e\") " pod="opendatahub/ai-gateway-controller-5d945fb875-d7cbl"
Sep 16 01:28:39.854710 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:39.854652    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldzl8\" (UniqueName: \"kubernetes.io/projected/e6bb7a83-bb5d-4334-9307-ea7e85e5200e-kube-api-access-ldzl8\") pod \"ai-gateway-controller-5d945fb875-d7cbl\" (UID: \"e6bb7a83-bb5d-4334-9307-ea7e85e5200e\") " pod="opendatahub/ai-gateway-controller-5d945fb875-d7cbl"
Sep 16 01:28:39.862110 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:39.862078    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldzl8\" (UniqueName: \"kubernetes.io/projected/e6bb7a83-bb5d-4334-9307-ea7e85e5200e-kube-api-access-ldzl8\") pod \"ai-gateway-controller-5d945fb875-d7cbl\" (UID: \"e6bb7a83-bb5d-4334-9307-ea7e85e5200e\") " pod="opendatahub/ai-gateway-controller-5d945fb875-d7cbl"
Sep 16 01:28:39.927054 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:39.927027    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-5d945fb875-d7cbl"
Sep 16 01:28:40.194429 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:40.194389    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-5d945fb875-d7cbl"]
Sep 16 01:28:40.197444 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:28:40.197419    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6bb7a83_bb5d_4334_9307_ea7e85e5200e.slice/crio-817efece1c6a7a9816e4461bc9fc100ae3346290c76223260b0d7154be6b073c WatchSource:0}: Error finding container 817efece1c6a7a9816e4461bc9fc100ae3346290c76223260b0d7154be6b073c: Status 404 returned error can't find the container with id 817efece1c6a7a9816e4461bc9fc100ae3346290c76223260b0d7154be6b073c
Sep 16 01:28:40.440231 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:40.440195    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-5d945fb875-d7cbl" event={"ID":"e6bb7a83-bb5d-4334-9307-ea7e85e5200e","Type":"ContainerStarted","Data":"817efece1c6a7a9816e4461bc9fc100ae3346290c76223260b0d7154be6b073c"}
Sep 16 01:28:41.403449 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:41.403413    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5d7dbbd56b-4455c"
Sep 16 01:28:41.403620 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:41.403485    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-6cd864bc95-st4pq"
Sep 16 01:28:41.403962 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:41.403938    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-6cd864bc95-st4pq" secret="" err="secret \"payload-processing-dockercfg-kkbcm\" not found"
Sep 16 01:28:41.404016 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:41.404003    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-processing-5d7dbbd56b-4455c" secret="" err="secret \"payload-processing-dockercfg-kkbcm\" not found"
Sep 16 01:28:41.446892 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:41.446858    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-5d945fb875-d7cbl" event={"ID":"e6bb7a83-bb5d-4334-9307-ea7e85e5200e","Type":"ContainerStarted","Data":"5c26aa5c2a89946875db792cb77b44ce703cf3ee8a5f327ad27c4088a42aba64"}
Sep 16 01:28:41.447368 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:41.447054    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-5d945fb875-d7cbl"
Sep 16 01:28:41.460841 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:41.460772    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-5d945fb875-d7cbl" podStartSLOduration=2.131965992 podStartE2EDuration="2.460754501s" totalImagesPullingTime="328.788509ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:28:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:28:41.460116104 +0000 UTC m=+770.783584681" watchObservedRunningTime="2026-09-16 01:28:41.460754501 +0000 UTC m=+770.784223118"
Sep 16 01:28:52.453815 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:52.453771    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-5d945fb875-d7cbl"
Sep 16 01:28:52.485404 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:52.485365    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-6d77c65979-4ltlw"]
Sep 16 01:28:52.485664 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:52.485612    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/ai-gateway-controller-6d77c65979-4ltlw" podUID="125dc212-9f37-48cc-8034-4b566e1462c2" containerName="manager" containerID="cri-o://8955da1f7ac4301677f443dc1f260df5479da9b16a32752768ccde9c03f1c1ab" gracePeriod=30
Sep 16 01:28:52.732651 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:52.732617    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-6d77c65979-4ltlw"
Sep 16 01:28:52.869815 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:52.869773    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4d28s\" (UniqueName: \"kubernetes.io/projected/125dc212-9f37-48cc-8034-4b566e1462c2-kube-api-access-4d28s\") pod \"125dc212-9f37-48cc-8034-4b566e1462c2\" (UID: \"125dc212-9f37-48cc-8034-4b566e1462c2\") "
Sep 16 01:28:52.872062 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:52.872036    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/125dc212-9f37-48cc-8034-4b566e1462c2-kube-api-access-4d28s" (OuterVolumeSpecName: "kube-api-access-4d28s") pod "125dc212-9f37-48cc-8034-4b566e1462c2" (UID: "125dc212-9f37-48cc-8034-4b566e1462c2"). InnerVolumeSpecName "kube-api-access-4d28s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:28:52.970884 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:52.970787    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4d28s\" (UniqueName: \"kubernetes.io/projected/125dc212-9f37-48cc-8034-4b566e1462c2-kube-api-access-4d28s\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:28:53.499950 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:53.499912    2565 generic.go:356] "Generic (PLEG): container finished" podID="125dc212-9f37-48cc-8034-4b566e1462c2" containerID="8955da1f7ac4301677f443dc1f260df5479da9b16a32752768ccde9c03f1c1ab" exitCode=0
Sep 16 01:28:53.499950 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:53.499954    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-6d77c65979-4ltlw"
Sep 16 01:28:53.500478 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:53.499987    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-6d77c65979-4ltlw" event={"ID":"125dc212-9f37-48cc-8034-4b566e1462c2","Type":"ContainerDied","Data":"8955da1f7ac4301677f443dc1f260df5479da9b16a32752768ccde9c03f1c1ab"}
Sep 16 01:28:53.500478 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:53.500034    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-6d77c65979-4ltlw" event={"ID":"125dc212-9f37-48cc-8034-4b566e1462c2","Type":"ContainerDied","Data":"6c9f8dc1d7803521fa9f2ed6cd778aaa5a191730a0fab3f165d4e1ec12341096"}
Sep 16 01:28:53.500478 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:53.500058    2565 scope.go:117] "RemoveContainer" containerID="8955da1f7ac4301677f443dc1f260df5479da9b16a32752768ccde9c03f1c1ab"
Sep 16 01:28:53.508402 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:53.508380    2565 scope.go:117] "RemoveContainer" containerID="8955da1f7ac4301677f443dc1f260df5479da9b16a32752768ccde9c03f1c1ab"
Sep 16 01:28:53.508693 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:28:53.508674    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8955da1f7ac4301677f443dc1f260df5479da9b16a32752768ccde9c03f1c1ab\": container with ID starting with 8955da1f7ac4301677f443dc1f260df5479da9b16a32752768ccde9c03f1c1ab not found: ID does not exist" containerID="8955da1f7ac4301677f443dc1f260df5479da9b16a32752768ccde9c03f1c1ab"
Sep 16 01:28:53.508748 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:53.508703    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8955da1f7ac4301677f443dc1f260df5479da9b16a32752768ccde9c03f1c1ab"} err="failed to get container status \"8955da1f7ac4301677f443dc1f260df5479da9b16a32752768ccde9c03f1c1ab\": rpc error: code = NotFound desc = could not find container \"8955da1f7ac4301677f443dc1f260df5479da9b16a32752768ccde9c03f1c1ab\": container with ID starting with 8955da1f7ac4301677f443dc1f260df5479da9b16a32752768ccde9c03f1c1ab not found: ID does not exist"
Sep 16 01:28:53.513939 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:53.513908    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-6d77c65979-4ltlw"]
Sep 16 01:28:53.518200 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:53.518174    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/ai-gateway-controller-6d77c65979-4ltlw"]
Sep 16 01:28:55.170501 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:28:55.170467    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="125dc212-9f37-48cc-8034-4b566e1462c2" path="/var/lib/kubelet/pods/125dc212-9f37-48cc-8034-4b566e1462c2/volumes"
Sep 16 01:29:16.150746 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.150665    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597"]
Sep 16 01:29:16.151195 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.151012    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="125dc212-9f37-48cc-8034-4b566e1462c2" containerName="manager"
Sep 16 01:29:16.151195 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.151024    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="125dc212-9f37-48cc-8034-4b566e1462c2" containerName="manager"
Sep 16 01:29:16.151195 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.151093    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="125dc212-9f37-48cc-8034-4b566e1462c2" containerName="manager"
Sep 16 01:29:16.157957 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.157931    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597"
Sep 16 01:29:16.160436 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.160402    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-033feb-openshift-default-dockercfg-wm9hn\""
Sep 16 01:29:16.165725 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.165698    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597"]
Sep 16 01:29:16.251456 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.251415    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b98f945-35b3-40f5-97d2-0b8d33e5bf48-workload-socket\") pod \"e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597\" (UID: \"5b98f945-35b3-40f5-97d2-0b8d33e5bf48\") " pod="openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597"
Sep 16 01:29:16.251644 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.251471    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b98f945-35b3-40f5-97d2-0b8d33e5bf48-istio-podinfo\") pod \"e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597\" (UID: \"5b98f945-35b3-40f5-97d2-0b8d33e5bf48\") " pod="openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597"
Sep 16 01:29:16.251644 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.251498    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxnqq\" (UniqueName: \"kubernetes.io/projected/5b98f945-35b3-40f5-97d2-0b8d33e5bf48-kube-api-access-sxnqq\") pod \"e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597\" (UID: \"5b98f945-35b3-40f5-97d2-0b8d33e5bf48\") " pod="openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597"
Sep 16 01:29:16.251644 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.251546    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b98f945-35b3-40f5-97d2-0b8d33e5bf48-credential-socket\") pod \"e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597\" (UID: \"5b98f945-35b3-40f5-97d2-0b8d33e5bf48\") " pod="openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597"
Sep 16 01:29:16.251644 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.251613    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b98f945-35b3-40f5-97d2-0b8d33e5bf48-istio-envoy\") pod \"e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597\" (UID: \"5b98f945-35b3-40f5-97d2-0b8d33e5bf48\") " pod="openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597"
Sep 16 01:29:16.251857 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.251649    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b98f945-35b3-40f5-97d2-0b8d33e5bf48-istio-data\") pod \"e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597\" (UID: \"5b98f945-35b3-40f5-97d2-0b8d33e5bf48\") " pod="openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597"
Sep 16 01:29:16.251857 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.251700    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b98f945-35b3-40f5-97d2-0b8d33e5bf48-istiod-ca-cert\") pod \"e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597\" (UID: \"5b98f945-35b3-40f5-97d2-0b8d33e5bf48\") " pod="openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597"
Sep 16 01:29:16.251857 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.251806    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b98f945-35b3-40f5-97d2-0b8d33e5bf48-workload-certs\") pod \"e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597\" (UID: \"5b98f945-35b3-40f5-97d2-0b8d33e5bf48\") " pod="openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597"
Sep 16 01:29:16.251857 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.251845    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b98f945-35b3-40f5-97d2-0b8d33e5bf48-istio-token\") pod \"e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597\" (UID: \"5b98f945-35b3-40f5-97d2-0b8d33e5bf48\") " pod="openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597"
Sep 16 01:29:16.270148 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.270116    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb"]
Sep 16 01:29:16.273785 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.273756    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb"
Sep 16 01:29:16.276365 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.276327    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-d0c9f2-openshift-default-dockercfg-5gw48\""
Sep 16 01:29:16.290181 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.290145    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb"]
Sep 16 01:29:16.352665 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.352613    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48e1a301-c2e1-4ae8-ab6d-36e149b88454-credential-socket\") pod \"e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb\" (UID: \"48e1a301-c2e1-4ae8-ab6d-36e149b88454\") " pod="openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb"
Sep 16 01:29:16.352665 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.352668    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b98f945-35b3-40f5-97d2-0b8d33e5bf48-workload-certs\") pod \"e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597\" (UID: \"5b98f945-35b3-40f5-97d2-0b8d33e5bf48\") " pod="openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597"
Sep 16 01:29:16.352902 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.352695    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48e1a301-c2e1-4ae8-ab6d-36e149b88454-istio-data\") pod \"e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb\" (UID: \"48e1a301-c2e1-4ae8-ab6d-36e149b88454\") " pod="openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb"
Sep 16 01:29:16.352902 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.352754    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b98f945-35b3-40f5-97d2-0b8d33e5bf48-istio-token\") pod \"e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597\" (UID: \"5b98f945-35b3-40f5-97d2-0b8d33e5bf48\") " pod="openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597"
Sep 16 01:29:16.352902 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.352790    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48e1a301-c2e1-4ae8-ab6d-36e149b88454-istio-envoy\") pod \"e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb\" (UID: \"48e1a301-c2e1-4ae8-ab6d-36e149b88454\") " pod="openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb"
Sep 16 01:29:16.352902 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.352814    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b98f945-35b3-40f5-97d2-0b8d33e5bf48-workload-socket\") pod \"e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597\" (UID: \"5b98f945-35b3-40f5-97d2-0b8d33e5bf48\") " pod="openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597"
Sep 16 01:29:16.352902 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.352840    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48e1a301-c2e1-4ae8-ab6d-36e149b88454-istio-token\") pod \"e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb\" (UID: \"48e1a301-c2e1-4ae8-ab6d-36e149b88454\") " pod="openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb"
Sep 16 01:29:16.352902 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.352863    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b98f945-35b3-40f5-97d2-0b8d33e5bf48-istio-podinfo\") pod \"e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597\" (UID: \"5b98f945-35b3-40f5-97d2-0b8d33e5bf48\") " pod="openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597"
Sep 16 01:29:16.352902 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.352884    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxnqq\" (UniqueName: \"kubernetes.io/projected/5b98f945-35b3-40f5-97d2-0b8d33e5bf48-kube-api-access-sxnqq\") pod \"e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597\" (UID: \"5b98f945-35b3-40f5-97d2-0b8d33e5bf48\") " pod="openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597"
Sep 16 01:29:16.353181 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.352908    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48e1a301-c2e1-4ae8-ab6d-36e149b88454-workload-certs\") pod \"e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb\" (UID: \"48e1a301-c2e1-4ae8-ab6d-36e149b88454\") " pod="openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb"
Sep 16 01:29:16.353181 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.352954    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b98f945-35b3-40f5-97d2-0b8d33e5bf48-credential-socket\") pod \"e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597\" (UID: \"5b98f945-35b3-40f5-97d2-0b8d33e5bf48\") " pod="openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597"
Sep 16 01:29:16.353181 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.353166    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b98f945-35b3-40f5-97d2-0b8d33e5bf48-workload-certs\") pod \"e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597\" (UID: \"5b98f945-35b3-40f5-97d2-0b8d33e5bf48\") " pod="openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597"
Sep 16 01:29:16.353278 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.353183    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b98f945-35b3-40f5-97d2-0b8d33e5bf48-workload-socket\") pod \"e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597\" (UID: \"5b98f945-35b3-40f5-97d2-0b8d33e5bf48\") " pod="openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597"
Sep 16 01:29:16.353313 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.353289    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b98f945-35b3-40f5-97d2-0b8d33e5bf48-credential-socket\") pod \"e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597\" (UID: \"5b98f945-35b3-40f5-97d2-0b8d33e5bf48\") " pod="openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597"
Sep 16 01:29:16.353399 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.353380    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48e1a301-c2e1-4ae8-ab6d-36e149b88454-istiod-ca-cert\") pod \"e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb\" (UID: \"48e1a301-c2e1-4ae8-ab6d-36e149b88454\") " pod="openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb"
Sep 16 01:29:16.353441 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.353421    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gr9j\" (UniqueName: \"kubernetes.io/projected/48e1a301-c2e1-4ae8-ab6d-36e149b88454-kube-api-access-2gr9j\") pod \"e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb\" (UID: \"48e1a301-c2e1-4ae8-ab6d-36e149b88454\") " pod="openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb"
Sep 16 01:29:16.353476 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.353445    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b98f945-35b3-40f5-97d2-0b8d33e5bf48-istio-envoy\") pod \"e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597\" (UID: \"5b98f945-35b3-40f5-97d2-0b8d33e5bf48\") " pod="openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597"
Sep 16 01:29:16.353509 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.353473    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b98f945-35b3-40f5-97d2-0b8d33e5bf48-istio-data\") pod \"e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597\" (UID: \"5b98f945-35b3-40f5-97d2-0b8d33e5bf48\") " pod="openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597"
Sep 16 01:29:16.353557 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.353543    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48e1a301-c2e1-4ae8-ab6d-36e149b88454-workload-socket\") pod \"e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb\" (UID: \"48e1a301-c2e1-4ae8-ab6d-36e149b88454\") " pod="openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb"
Sep 16 01:29:16.353590 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.353580    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b98f945-35b3-40f5-97d2-0b8d33e5bf48-istiod-ca-cert\") pod \"e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597\" (UID: \"5b98f945-35b3-40f5-97d2-0b8d33e5bf48\") " pod="openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597"
Sep 16 01:29:16.353645 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.353599    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48e1a301-c2e1-4ae8-ab6d-36e149b88454-istio-podinfo\") pod \"e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb\" (UID: \"48e1a301-c2e1-4ae8-ab6d-36e149b88454\") " pod="openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb"
Sep 16 01:29:16.353827 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.353801    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b98f945-35b3-40f5-97d2-0b8d33e5bf48-istio-data\") pod \"e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597\" (UID: \"5b98f945-35b3-40f5-97d2-0b8d33e5bf48\") " pod="openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597"
Sep 16 01:29:16.354217 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.354192    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b98f945-35b3-40f5-97d2-0b8d33e5bf48-istiod-ca-cert\") pod \"e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597\" (UID: \"5b98f945-35b3-40f5-97d2-0b8d33e5bf48\") " pod="openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597"
Sep 16 01:29:16.355686 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.355662    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b98f945-35b3-40f5-97d2-0b8d33e5bf48-istio-envoy\") pod \"e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597\" (UID: \"5b98f945-35b3-40f5-97d2-0b8d33e5bf48\") " pod="openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597"
Sep 16 01:29:16.355686 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.355672    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b98f945-35b3-40f5-97d2-0b8d33e5bf48-istio-podinfo\") pod \"e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597\" (UID: \"5b98f945-35b3-40f5-97d2-0b8d33e5bf48\") " pod="openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597"
Sep 16 01:29:16.366994 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.366963    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxnqq\" (UniqueName: \"kubernetes.io/projected/5b98f945-35b3-40f5-97d2-0b8d33e5bf48-kube-api-access-sxnqq\") pod \"e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597\" (UID: \"5b98f945-35b3-40f5-97d2-0b8d33e5bf48\") " pod="openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597"
Sep 16 01:29:16.373275 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.373243    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b98f945-35b3-40f5-97d2-0b8d33e5bf48-istio-token\") pod \"e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597\" (UID: \"5b98f945-35b3-40f5-97d2-0b8d33e5bf48\") " pod="openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597"
Sep 16 01:29:16.454546 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.454502    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48e1a301-c2e1-4ae8-ab6d-36e149b88454-workload-socket\") pod \"e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb\" (UID: \"48e1a301-c2e1-4ae8-ab6d-36e149b88454\") " pod="openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb"
Sep 16 01:29:16.454546 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.454554    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48e1a301-c2e1-4ae8-ab6d-36e149b88454-istio-podinfo\") pod \"e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb\" (UID: \"48e1a301-c2e1-4ae8-ab6d-36e149b88454\") " pod="openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb"
Sep 16 01:29:16.454826 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.454594    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48e1a301-c2e1-4ae8-ab6d-36e149b88454-credential-socket\") pod \"e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb\" (UID: \"48e1a301-c2e1-4ae8-ab6d-36e149b88454\") " pod="openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb"
Sep 16 01:29:16.454826 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.454611    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48e1a301-c2e1-4ae8-ab6d-36e149b88454-istio-data\") pod \"e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb\" (UID: \"48e1a301-c2e1-4ae8-ab6d-36e149b88454\") " pod="openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb"
Sep 16 01:29:16.454826 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.454630    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48e1a301-c2e1-4ae8-ab6d-36e149b88454-istio-envoy\") pod \"e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb\" (UID: \"48e1a301-c2e1-4ae8-ab6d-36e149b88454\") " pod="openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb"
Sep 16 01:29:16.454826 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.454657    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48e1a301-c2e1-4ae8-ab6d-36e149b88454-istio-token\") pod \"e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb\" (UID: \"48e1a301-c2e1-4ae8-ab6d-36e149b88454\") " pod="openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb"
Sep 16 01:29:16.454826 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.454675    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48e1a301-c2e1-4ae8-ab6d-36e149b88454-workload-certs\") pod \"e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb\" (UID: \"48e1a301-c2e1-4ae8-ab6d-36e149b88454\") " pod="openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb"
Sep 16 01:29:16.454826 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.454706    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48e1a301-c2e1-4ae8-ab6d-36e149b88454-istiod-ca-cert\") pod \"e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb\" (UID: \"48e1a301-c2e1-4ae8-ab6d-36e149b88454\") " pod="openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb"
Sep 16 01:29:16.454826 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.454737    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gr9j\" (UniqueName: \"kubernetes.io/projected/48e1a301-c2e1-4ae8-ab6d-36e149b88454-kube-api-access-2gr9j\") pod \"e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb\" (UID: \"48e1a301-c2e1-4ae8-ab6d-36e149b88454\") " pod="openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb"
Sep 16 01:29:16.455239 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.454993    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48e1a301-c2e1-4ae8-ab6d-36e149b88454-workload-socket\") pod \"e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb\" (UID: \"48e1a301-c2e1-4ae8-ab6d-36e149b88454\") " pod="openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb"
Sep 16 01:29:16.455239 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.455027    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48e1a301-c2e1-4ae8-ab6d-36e149b88454-credential-socket\") pod \"e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb\" (UID: \"48e1a301-c2e1-4ae8-ab6d-36e149b88454\") " pod="openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb"
Sep 16 01:29:16.455239 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.455157    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48e1a301-c2e1-4ae8-ab6d-36e149b88454-istio-data\") pod \"e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb\" (UID: \"48e1a301-c2e1-4ae8-ab6d-36e149b88454\") " pod="openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb"
Sep 16 01:29:16.455361 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.455240    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48e1a301-c2e1-4ae8-ab6d-36e149b88454-workload-certs\") pod \"e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb\" (UID: \"48e1a301-c2e1-4ae8-ab6d-36e149b88454\") " pod="openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb"
Sep 16 01:29:16.456018 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.455999    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48e1a301-c2e1-4ae8-ab6d-36e149b88454-istiod-ca-cert\") pod \"e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb\" (UID: \"48e1a301-c2e1-4ae8-ab6d-36e149b88454\") " pod="openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb"
Sep 16 01:29:16.457102 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.457078    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48e1a301-c2e1-4ae8-ab6d-36e149b88454-istio-envoy\") pod \"e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb\" (UID: \"48e1a301-c2e1-4ae8-ab6d-36e149b88454\") " pod="openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb"
Sep 16 01:29:16.457196 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.457179    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48e1a301-c2e1-4ae8-ab6d-36e149b88454-istio-podinfo\") pod \"e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb\" (UID: \"48e1a301-c2e1-4ae8-ab6d-36e149b88454\") " pod="openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb"
Sep 16 01:29:16.463381 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.463356    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48e1a301-c2e1-4ae8-ab6d-36e149b88454-istio-token\") pod \"e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb\" (UID: \"48e1a301-c2e1-4ae8-ab6d-36e149b88454\") " pod="openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb"
Sep 16 01:29:16.463818 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.463795    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gr9j\" (UniqueName: \"kubernetes.io/projected/48e1a301-c2e1-4ae8-ab6d-36e149b88454-kube-api-access-2gr9j\") pod \"e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb\" (UID: \"48e1a301-c2e1-4ae8-ab6d-36e149b88454\") " pod="openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb"
Sep 16 01:29:16.470492 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.470467    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597"
Sep 16 01:29:16.589572 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.589534    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb"
Sep 16 01:29:16.747593 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.747569    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597"]
Sep 16 01:29:16.749316 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:29:16.749293    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b98f945_35b3_40f5_97d2_0b8d33e5bf48.slice/crio-eec5a563b6ea68d3afc4c0d3c1ff8d1cc1d12c2d1b8f87c346a4f596b10b9903 WatchSource:0}: Error finding container eec5a563b6ea68d3afc4c0d3c1ff8d1cc1d12c2d1b8f87c346a4f596b10b9903: Status 404 returned error can't find the container with id eec5a563b6ea68d3afc4c0d3c1ff8d1cc1d12c2d1b8f87c346a4f596b10b9903
Sep 16 01:29:16.751500 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.751464    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:29:16.751607 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.751551    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:29:16.751669 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.751605    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:29:16.864501 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.864477    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb"]
Sep 16 01:29:16.866593 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:29:16.866562    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48e1a301_c2e1_4ae8_ab6d_36e149b88454.slice/crio-1fbc538e2d229fd1452b6a4702e6e9f59ab5928d8b6fc84907c3a65e4fd17efe WatchSource:0}: Error finding container 1fbc538e2d229fd1452b6a4702e6e9f59ab5928d8b6fc84907c3a65e4fd17efe: Status 404 returned error can't find the container with id 1fbc538e2d229fd1452b6a4702e6e9f59ab5928d8b6fc84907c3a65e4fd17efe
Sep 16 01:29:16.869098 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.869061    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:29:16.869175 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.869148    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:29:16.869222 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:16.869203    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:29:17.618764 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:17.618720    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597" event={"ID":"5b98f945-35b3-40f5-97d2-0b8d33e5bf48","Type":"ContainerStarted","Data":"c345657fa52c7bb6686acc0a10432ff66409f70d02354dfdf5990a3e4e1b6ed5"}
Sep 16 01:29:17.619254 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:17.618790    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597" event={"ID":"5b98f945-35b3-40f5-97d2-0b8d33e5bf48","Type":"ContainerStarted","Data":"eec5a563b6ea68d3afc4c0d3c1ff8d1cc1d12c2d1b8f87c346a4f596b10b9903"}
Sep 16 01:29:17.620434 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:17.620396    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb" event={"ID":"48e1a301-c2e1-4ae8-ab6d-36e149b88454","Type":"ContainerStarted","Data":"852d3afc8c224f16a4179e3ebd6ee6869b2552e6240ef86a6469c2eb4c476a75"}
Sep 16 01:29:17.620557 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:17.620456    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb" event={"ID":"48e1a301-c2e1-4ae8-ab6d-36e149b88454","Type":"ContainerStarted","Data":"1fbc538e2d229fd1452b6a4702e6e9f59ab5928d8b6fc84907c3a65e4fd17efe"}
Sep 16 01:29:17.638540 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:17.638478    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597" podStartSLOduration=1.638452225 podStartE2EDuration="1.638452225s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:29:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:29:17.637071855 +0000 UTC m=+806.960540433" watchObservedRunningTime="2026-09-16 01:29:17.638452225 +0000 UTC m=+806.961920809"
Sep 16 01:29:17.657008 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:17.656949    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb" podStartSLOduration=1.6569329019999999 podStartE2EDuration="1.656932902s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:29:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:29:17.655738663 +0000 UTC m=+806.979207242" watchObservedRunningTime="2026-09-16 01:29:17.656932902 +0000 UTC m=+806.980401472"
Sep 16 01:29:18.471455 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:18.471415    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597"
Sep 16 01:29:18.476644 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:18.476610    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597"
Sep 16 01:29:18.590274 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:18.590234    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb"
Sep 16 01:29:18.596610 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:18.596581    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb"
Sep 16 01:29:18.626252 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:18.626214    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb"
Sep 16 01:29:18.626724 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:18.626275    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597"
Sep 16 01:29:18.627116 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:18.627092    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597"
Sep 16 01:29:18.627203 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:18.627155    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb"
Sep 16 01:29:21.606646 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:21.606605    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-482177-5469cc445d-d7r55"]
Sep 16 01:29:21.610248 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:21.610229    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-482177-5469cc445d-d7r55"
Sep 16 01:29:21.612880 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:21.612852    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-482177\""
Sep 16 01:29:21.613017 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:21.612906    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-482177-dockercfg-9r96h\""
Sep 16 01:29:21.619725 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:21.619699    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-482177-5469cc445d-d7r55"]
Sep 16 01:29:21.647269 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:21.647238    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-482177-75756ff869-sjdhh"]
Sep 16 01:29:21.650565 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:21.650546    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-482177-75756ff869-sjdhh"
Sep 16 01:29:21.658387 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:21.658355    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-482177-75756ff869-sjdhh"]
Sep 16 01:29:21.706589 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:21.706548    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcq28\" (UniqueName: \"kubernetes.io/projected/abb32465-86ce-48c3-a7a3-43744b06d950-kube-api-access-xcq28\") pod \"payload-processing-e2e-worker-w0-482177-75756ff869-sjdhh\" (UID: \"abb32465-86ce-48c3-a7a3-43744b06d950\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-482177-75756ff869-sjdhh"
Sep 16 01:29:21.706906 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:21.706885    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ec1ab84-143f-4022-b78d-feaa05abad21-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-482177-5469cc445d-d7r55\" (UID: \"0ec1ab84-143f-4022-b78d-feaa05abad21\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-482177-5469cc445d-d7r55"
Sep 16 01:29:21.707091 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:21.707076    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9nm5\" (UniqueName: \"kubernetes.io/projected/0ec1ab84-143f-4022-b78d-feaa05abad21-kube-api-access-f9nm5\") pod \"payload-pre-processing-e2e-worker-w0-482177-5469cc445d-d7r55\" (UID: \"0ec1ab84-143f-4022-b78d-feaa05abad21\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-482177-5469cc445d-d7r55"
Sep 16 01:29:21.707241 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:21.707226    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/abb32465-86ce-48c3-a7a3-43744b06d950-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-482177-75756ff869-sjdhh\" (UID: \"abb32465-86ce-48c3-a7a3-43744b06d950\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-482177-75756ff869-sjdhh"
Sep 16 01:29:21.808307 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:21.808264    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcq28\" (UniqueName: \"kubernetes.io/projected/abb32465-86ce-48c3-a7a3-43744b06d950-kube-api-access-xcq28\") pod \"payload-processing-e2e-worker-w0-482177-75756ff869-sjdhh\" (UID: \"abb32465-86ce-48c3-a7a3-43744b06d950\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-482177-75756ff869-sjdhh"
Sep 16 01:29:21.808512 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:21.808318    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ec1ab84-143f-4022-b78d-feaa05abad21-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-482177-5469cc445d-d7r55\" (UID: \"0ec1ab84-143f-4022-b78d-feaa05abad21\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-482177-5469cc445d-d7r55"
Sep 16 01:29:21.808512 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:21.808381    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9nm5\" (UniqueName: \"kubernetes.io/projected/0ec1ab84-143f-4022-b78d-feaa05abad21-kube-api-access-f9nm5\") pod \"payload-pre-processing-e2e-worker-w0-482177-5469cc445d-d7r55\" (UID: \"0ec1ab84-143f-4022-b78d-feaa05abad21\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-482177-5469cc445d-d7r55"
Sep 16 01:29:21.808512 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:21.808404    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/abb32465-86ce-48c3-a7a3-43744b06d950-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-482177-75756ff869-sjdhh\" (UID: \"abb32465-86ce-48c3-a7a3-43744b06d950\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-482177-75756ff869-sjdhh"
Sep 16 01:29:21.809177 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:21.809157    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/abb32465-86ce-48c3-a7a3-43744b06d950-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-482177-75756ff869-sjdhh\" (UID: \"abb32465-86ce-48c3-a7a3-43744b06d950\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-482177-75756ff869-sjdhh"
Sep 16 01:29:21.809297 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:21.809278    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ec1ab84-143f-4022-b78d-feaa05abad21-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-482177-5469cc445d-d7r55\" (UID: \"0ec1ab84-143f-4022-b78d-feaa05abad21\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-482177-5469cc445d-d7r55"
Sep 16 01:29:21.815847 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:21.815814    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9nm5\" (UniqueName: \"kubernetes.io/projected/0ec1ab84-143f-4022-b78d-feaa05abad21-kube-api-access-f9nm5\") pod \"payload-pre-processing-e2e-worker-w0-482177-5469cc445d-d7r55\" (UID: \"0ec1ab84-143f-4022-b78d-feaa05abad21\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-482177-5469cc445d-d7r55"
Sep 16 01:29:21.815958 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:21.815886    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcq28\" (UniqueName: \"kubernetes.io/projected/abb32465-86ce-48c3-a7a3-43744b06d950-kube-api-access-xcq28\") pod \"payload-processing-e2e-worker-w0-482177-75756ff869-sjdhh\" (UID: \"abb32465-86ce-48c3-a7a3-43744b06d950\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-482177-75756ff869-sjdhh"
Sep 16 01:29:21.922727 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:21.922686    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-482177-5469cc445d-d7r55"
Sep 16 01:29:21.963152 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:21.963098    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-482177-75756ff869-sjdhh"
Sep 16 01:29:22.197868 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:22.197768    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-482177-5469cc445d-d7r55"]
Sep 16 01:29:22.201770 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:29:22.201739    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ec1ab84_143f_4022_b78d_feaa05abad21.slice/crio-bf262103dedcdc3f09782a81140e0a3e1d647c64cb58fa1448e6b39ff1438af3 WatchSource:0}: Error finding container bf262103dedcdc3f09782a81140e0a3e1d647c64cb58fa1448e6b39ff1438af3: Status 404 returned error can't find the container with id bf262103dedcdc3f09782a81140e0a3e1d647c64cb58fa1448e6b39ff1438af3
Sep 16 01:29:22.246450 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:22.246426    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-482177-75756ff869-sjdhh"]
Sep 16 01:29:22.248261 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:29:22.248232    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabb32465_86ce_48c3_a7a3_43744b06d950.slice/crio-8cc654faa6a177eb9746e08a118ba8b0860168dfd4226d1a727ee613d53b46d2 WatchSource:0}: Error finding container 8cc654faa6a177eb9746e08a118ba8b0860168dfd4226d1a727ee613d53b46d2: Status 404 returned error can't find the container with id 8cc654faa6a177eb9746e08a118ba8b0860168dfd4226d1a727ee613d53b46d2
Sep 16 01:29:22.649413 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:22.649035    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-482177-5469cc445d-d7r55" event={"ID":"0ec1ab84-143f-4022-b78d-feaa05abad21","Type":"ContainerStarted","Data":"12bb7761aaea0008c7953d0edbf01845c55aa9f58785adf10f7ff98a942aacae"}
Sep 16 01:29:22.649413 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:22.649152    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-482177-5469cc445d-d7r55" event={"ID":"0ec1ab84-143f-4022-b78d-feaa05abad21","Type":"ContainerStarted","Data":"bf262103dedcdc3f09782a81140e0a3e1d647c64cb58fa1448e6b39ff1438af3"}
Sep 16 01:29:22.649413 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:22.649215    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-482177-5469cc445d-d7r55"
Sep 16 01:29:22.651542 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:22.651322    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-482177-75756ff869-sjdhh" event={"ID":"abb32465-86ce-48c3-a7a3-43744b06d950","Type":"ContainerStarted","Data":"bb5e2c0468780dbe194874a8f58ae428800c4d5e56d8b1b337ebdf765f380800"}
Sep 16 01:29:22.651542 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:22.651398    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-482177-75756ff869-sjdhh" event={"ID":"abb32465-86ce-48c3-a7a3-43744b06d950","Type":"ContainerStarted","Data":"8cc654faa6a177eb9746e08a118ba8b0860168dfd4226d1a727ee613d53b46d2"}
Sep 16 01:29:22.651542 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:22.651470    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-482177-75756ff869-sjdhh"
Sep 16 01:29:22.668907 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:22.668856    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-482177-5469cc445d-d7r55" podStartSLOduration=1.6688405610000001 podStartE2EDuration="1.668840561s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:29:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:29:22.667792025 +0000 UTC m=+811.991260603" watchObservedRunningTime="2026-09-16 01:29:22.668840561 +0000 UTC m=+811.992309137"
Sep 16 01:29:22.683806 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:22.683758    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w0-482177-75756ff869-sjdhh" podStartSLOduration=1.6837430389999999 podStartE2EDuration="1.683743039s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:29:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:29:22.682467377 +0000 UTC m=+812.005935954" watchObservedRunningTime="2026-09-16 01:29:22.683743039 +0000 UTC m=+812.007211616"
Sep 16 01:29:22.750679 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:22.750645    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-d0c9f2-7699d77785-z7vsl"]
Sep 16 01:29:22.754833 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:22.754807    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-d0c9f2-7699d77785-z7vsl"
Sep 16 01:29:22.757621 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:22.757591    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w3-d0c9f2\""
Sep 16 01:29:22.757747 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:22.757702    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w3-d0c9f2-dockercfg-mgzhg\""
Sep 16 01:29:22.763066 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:22.763040    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-d0c9f2-7699d77785-z7vsl"]
Sep 16 01:29:22.825772 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:22.825737    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b535c84b-48d5-4b66-a1f8-39df2c359ace-plugins-config-volume\") pod \"payload-processing-e2e-worker-w3-d0c9f2-7699d77785-z7vsl\" (UID: \"b535c84b-48d5-4b66-a1f8-39df2c359ace\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-d0c9f2-7699d77785-z7vsl"
Sep 16 01:29:22.825947 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:22.825850    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqm72\" (UniqueName: \"kubernetes.io/projected/b535c84b-48d5-4b66-a1f8-39df2c359ace-kube-api-access-wqm72\") pod \"payload-processing-e2e-worker-w3-d0c9f2-7699d77785-z7vsl\" (UID: \"b535c84b-48d5-4b66-a1f8-39df2c359ace\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-d0c9f2-7699d77785-z7vsl"
Sep 16 01:29:22.927199 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:22.927146    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b535c84b-48d5-4b66-a1f8-39df2c359ace-plugins-config-volume\") pod \"payload-processing-e2e-worker-w3-d0c9f2-7699d77785-z7vsl\" (UID: \"b535c84b-48d5-4b66-a1f8-39df2c359ace\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-d0c9f2-7699d77785-z7vsl"
Sep 16 01:29:22.927443 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:22.927262    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqm72\" (UniqueName: \"kubernetes.io/projected/b535c84b-48d5-4b66-a1f8-39df2c359ace-kube-api-access-wqm72\") pod \"payload-processing-e2e-worker-w3-d0c9f2-7699d77785-z7vsl\" (UID: \"b535c84b-48d5-4b66-a1f8-39df2c359ace\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-d0c9f2-7699d77785-z7vsl"
Sep 16 01:29:22.928172 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:22.928143    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b535c84b-48d5-4b66-a1f8-39df2c359ace-plugins-config-volume\") pod \"payload-processing-e2e-worker-w3-d0c9f2-7699d77785-z7vsl\" (UID: \"b535c84b-48d5-4b66-a1f8-39df2c359ace\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-d0c9f2-7699d77785-z7vsl"
Sep 16 01:29:22.935207 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:22.935171    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqm72\" (UniqueName: \"kubernetes.io/projected/b535c84b-48d5-4b66-a1f8-39df2c359ace-kube-api-access-wqm72\") pod \"payload-processing-e2e-worker-w3-d0c9f2-7699d77785-z7vsl\" (UID: \"b535c84b-48d5-4b66-a1f8-39df2c359ace\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-d0c9f2-7699d77785-z7vsl"
Sep 16 01:29:23.068393 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:23.068350    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-d0c9f2-7699d77785-z7vsl"
Sep 16 01:29:23.351896 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:23.351870    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-d0c9f2-7699d77785-z7vsl"]
Sep 16 01:29:23.354236 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:29:23.354196    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb535c84b_48d5_4b66_a1f8_39df2c359ace.slice/crio-b7cb83fa9b478c141d4d48f7de69e3fb269b967ec46b72381ce22b50539a93d4 WatchSource:0}: Error finding container b7cb83fa9b478c141d4d48f7de69e3fb269b967ec46b72381ce22b50539a93d4: Status 404 returned error can't find the container with id b7cb83fa9b478c141d4d48f7de69e3fb269b967ec46b72381ce22b50539a93d4
Sep 16 01:29:23.590676 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:23.590631    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-033feb-6b45d795bc-n4t4k"]
Sep 16 01:29:23.594171 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:23.594146    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-033feb-6b45d795bc-n4t4k"
Sep 16 01:29:23.596523 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:23.596497    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-033feb\""
Sep 16 01:29:23.596642 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:23.596551    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-033feb-dockercfg-hgrl9\""
Sep 16 01:29:23.604275 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:23.604242    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-033feb-6b45d795bc-n4t4k"]
Sep 16 01:29:23.634233 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:23.634198    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvzmx\" (UniqueName: \"kubernetes.io/projected/b007ebbc-3582-4fa8-98f4-863a632f5777-kube-api-access-jvzmx\") pod \"payload-processing-e2e-inf-a-033feb-6b45d795bc-n4t4k\" (UID: \"b007ebbc-3582-4fa8-98f4-863a632f5777\") " pod="openshift-ingress/payload-processing-e2e-inf-a-033feb-6b45d795bc-n4t4k"
Sep 16 01:29:23.634452 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:23.634316    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b007ebbc-3582-4fa8-98f4-863a632f5777-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-033feb-6b45d795bc-n4t4k\" (UID: \"b007ebbc-3582-4fa8-98f4-863a632f5777\") " pod="openshift-ingress/payload-processing-e2e-inf-a-033feb-6b45d795bc-n4t4k"
Sep 16 01:29:23.659381 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:23.659316    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-d0c9f2-7699d77785-z7vsl" event={"ID":"b535c84b-48d5-4b66-a1f8-39df2c359ace","Type":"ContainerStarted","Data":"3ce216abbbeea353338c22e8b7e8e2ab6e048dddd633393145d9aa125d13cec3"}
Sep 16 01:29:23.659955 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:23.659901    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-d0c9f2-7699d77785-z7vsl" event={"ID":"b535c84b-48d5-4b66-a1f8-39df2c359ace","Type":"ContainerStarted","Data":"b7cb83fa9b478c141d4d48f7de69e3fb269b967ec46b72381ce22b50539a93d4"}
Sep 16 01:29:23.661148 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:23.659973    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w3-d0c9f2-7699d77785-z7vsl"
Sep 16 01:29:23.675400 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:23.675325    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w3-d0c9f2-7699d77785-z7vsl" podStartSLOduration=1.675305445 podStartE2EDuration="1.675305445s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:29:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:29:23.673676587 +0000 UTC m=+812.997145180" watchObservedRunningTime="2026-09-16 01:29:23.675305445 +0000 UTC m=+812.998774023"
Sep 16 01:29:23.735189 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:23.735084    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvzmx\" (UniqueName: \"kubernetes.io/projected/b007ebbc-3582-4fa8-98f4-863a632f5777-kube-api-access-jvzmx\") pod \"payload-processing-e2e-inf-a-033feb-6b45d795bc-n4t4k\" (UID: \"b007ebbc-3582-4fa8-98f4-863a632f5777\") " pod="openshift-ingress/payload-processing-e2e-inf-a-033feb-6b45d795bc-n4t4k"
Sep 16 01:29:23.735463 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:23.735440    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b007ebbc-3582-4fa8-98f4-863a632f5777-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-033feb-6b45d795bc-n4t4k\" (UID: \"b007ebbc-3582-4fa8-98f4-863a632f5777\") " pod="openshift-ingress/payload-processing-e2e-inf-a-033feb-6b45d795bc-n4t4k"
Sep 16 01:29:23.736109 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:23.736084    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b007ebbc-3582-4fa8-98f4-863a632f5777-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-033feb-6b45d795bc-n4t4k\" (UID: \"b007ebbc-3582-4fa8-98f4-863a632f5777\") " pod="openshift-ingress/payload-processing-e2e-inf-a-033feb-6b45d795bc-n4t4k"
Sep 16 01:29:23.754812 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:23.754776    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvzmx\" (UniqueName: \"kubernetes.io/projected/b007ebbc-3582-4fa8-98f4-863a632f5777-kube-api-access-jvzmx\") pod \"payload-processing-e2e-inf-a-033feb-6b45d795bc-n4t4k\" (UID: \"b007ebbc-3582-4fa8-98f4-863a632f5777\") " pod="openshift-ingress/payload-processing-e2e-inf-a-033feb-6b45d795bc-n4t4k"
Sep 16 01:29:23.906810 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:23.906765    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-033feb-6b45d795bc-n4t4k"
Sep 16 01:29:24.179405 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:24.179372    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-033feb-6b45d795bc-n4t4k"]
Sep 16 01:29:24.181421 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:29:24.181382    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb007ebbc_3582_4fa8_98f4_863a632f5777.slice/crio-0c213b54ef98b6a1665a59847aa88094a4b535e60e4489717db9d4f91a019530 WatchSource:0}: Error finding container 0c213b54ef98b6a1665a59847aa88094a4b535e60e4489717db9d4f91a019530: Status 404 returned error can't find the container with id 0c213b54ef98b6a1665a59847aa88094a4b535e60e4489717db9d4f91a019530
Sep 16 01:29:24.665953 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:24.665910    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-033feb-6b45d795bc-n4t4k" event={"ID":"b007ebbc-3582-4fa8-98f4-863a632f5777","Type":"ContainerStarted","Data":"2861652b0f5177cf717d8baee2c38271b62b8c4f641b5c4d25a2cde8f7419d17"}
Sep 16 01:29:24.666397 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:24.665982    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-033feb-6b45d795bc-n4t4k" event={"ID":"b007ebbc-3582-4fa8-98f4-863a632f5777","Type":"ContainerStarted","Data":"0c213b54ef98b6a1665a59847aa88094a4b535e60e4489717db9d4f91a019530"}
Sep 16 01:29:24.666397 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:24.666126    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-033feb-6b45d795bc-n4t4k"
Sep 16 01:29:24.680313 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:24.680253    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-033feb-6b45d795bc-n4t4k" podStartSLOduration=1.680235753 podStartE2EDuration="1.680235753s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:29:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:29:24.67955161 +0000 UTC m=+814.003020178" watchObservedRunningTime="2026-09-16 01:29:24.680235753 +0000 UTC m=+814.003704330"
Sep 16 01:29:33.662219 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:33.662161    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-482177-75756ff869-sjdhh"
Sep 16 01:29:33.662717 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:33.662292    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-482177-5469cc445d-d7r55"
Sep 16 01:29:34.667548 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:34.667499    2565 patch_prober.go:28] interesting pod/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 16 01:29:34.667934 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:34.667548    2565 patch_prober.go:28] interesting pod/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 16 01:29:34.667934 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:34.667580    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597" podUID="5b98f945-35b3-40f5-97d2-0b8d33e5bf48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 16 01:29:34.667934 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:34.667587    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb" podUID="48e1a301-c2e1-4ae8-ab6d-36e149b88454" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 16 01:29:34.668983 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:34.668963    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w3-d0c9f2-7699d77785-z7vsl"
Sep 16 01:29:35.674757 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:35.674723    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-033feb-6b45d795bc-n4t4k"
Sep 16 01:29:36.737943 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:36.737908    2565 generic.go:356] "Generic (PLEG): container finished" podID="5b98f945-35b3-40f5-97d2-0b8d33e5bf48" containerID="c345657fa52c7bb6686acc0a10432ff66409f70d02354dfdf5990a3e4e1b6ed5" exitCode=0
Sep 16 01:29:36.738408 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:36.737982    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597" event={"ID":"5b98f945-35b3-40f5-97d2-0b8d33e5bf48","Type":"ContainerDied","Data":"c345657fa52c7bb6686acc0a10432ff66409f70d02354dfdf5990a3e4e1b6ed5"}
Sep 16 01:29:36.738408 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:36.738399    2565 scope.go:117] "RemoveContainer" containerID="c345657fa52c7bb6686acc0a10432ff66409f70d02354dfdf5990a3e4e1b6ed5"
Sep 16 01:29:36.739583 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:36.739552    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:29:36.739655 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:36.739642    2565 generic.go:356] "Generic (PLEG): container finished" podID="48e1a301-c2e1-4ae8-ab6d-36e149b88454" containerID="852d3afc8c224f16a4179e3ebd6ee6869b2552e6240ef86a6469c2eb4c476a75" exitCode=0
Sep 16 01:29:36.739692 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:36.739649    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:29:36.739692 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:36.739681    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb" event={"ID":"48e1a301-c2e1-4ae8-ab6d-36e149b88454","Type":"ContainerDied","Data":"852d3afc8c224f16a4179e3ebd6ee6869b2552e6240ef86a6469c2eb4c476a75"}
Sep 16 01:29:36.739760 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:36.739699    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:29:36.740055 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:36.740041    2565 scope.go:117] "RemoveContainer" containerID="852d3afc8c224f16a4179e3ebd6ee6869b2552e6240ef86a6469c2eb4c476a75"
Sep 16 01:29:36.741072 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:36.740956    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:29:36.741072 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:36.741022    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:29:36.741072 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:36.741055    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:29:37.748360 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:37.748297    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597" event={"ID":"5b98f945-35b3-40f5-97d2-0b8d33e5bf48","Type":"ContainerStarted","Data":"a7ae9c62eed9990a4204711519b3a95eceeeed0079d83665dbf6370321bac9da"}
Sep 16 01:29:37.751946 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:37.751907    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb" event={"ID":"48e1a301-c2e1-4ae8-ab6d-36e149b88454","Type":"ContainerStarted","Data":"5e0496f4069e7b8ffe815aaacd517d38817583768413cc6a617e851bed4631e8"}
Sep 16 01:29:38.470892 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:38.470838    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597"
Sep 16 01:29:38.471098 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:38.470945    2565 patch_prober.go:28] interesting pod/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Sep 16 01:29:38.471098 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:38.471000    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597" podUID="5b98f945-35b3-40f5-97d2-0b8d33e5bf48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Sep 16 01:29:38.590185 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:38.590147    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb"
Sep 16 01:29:38.590390 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:38.590264    2565 patch_prober.go:28] interesting pod/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Sep 16 01:29:38.590390 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:38.590318    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb" podUID="48e1a301-c2e1-4ae8-ab6d-36e149b88454" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Sep 16 01:29:39.471313 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:39.471268    2565 patch_prober.go:28] interesting pod/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Sep 16 01:29:39.471809 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:39.471357    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597" podUID="5b98f945-35b3-40f5-97d2-0b8d33e5bf48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Sep 16 01:29:39.591045 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:39.591008    2565 patch_prober.go:28] interesting pod/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Sep 16 01:29:39.591352 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:39.591308    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb" podUID="48e1a301-c2e1-4ae8-ab6d-36e149b88454" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Sep 16 01:29:40.470892 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:40.470853    2565 patch_prober.go:28] interesting pod/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Sep 16 01:29:40.471171 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:40.471142    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597" podUID="5b98f945-35b3-40f5-97d2-0b8d33e5bf48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Sep 16 01:29:40.590640 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:40.590602    2565 patch_prober.go:28] interesting pod/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Sep 16 01:29:40.591218 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:40.591177    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb" podUID="48e1a301-c2e1-4ae8-ab6d-36e149b88454" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Sep 16 01:29:41.471372 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:41.471315    2565 patch_prober.go:28] interesting pod/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Sep 16 01:29:41.471658 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:41.471628    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597" podUID="5b98f945-35b3-40f5-97d2-0b8d33e5bf48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Sep 16 01:29:41.591504 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:41.591035    2565 patch_prober.go:28] interesting pod/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Sep 16 01:29:41.591504 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:41.591100    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb" podUID="48e1a301-c2e1-4ae8-ab6d-36e149b88454" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Sep 16 01:29:42.471934 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:42.471893    2565 patch_prober.go:28] interesting pod/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Sep 16 01:29:42.472227 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:42.472193    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597" podUID="5b98f945-35b3-40f5-97d2-0b8d33e5bf48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Sep 16 01:29:42.590763 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:42.590723    2565 patch_prober.go:28] interesting pod/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Sep 16 01:29:42.591073 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:42.591041    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb" podUID="48e1a301-c2e1-4ae8-ab6d-36e149b88454" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Sep 16 01:29:43.474980 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:43.474950    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597"
Sep 16 01:29:43.475374 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:43.475245    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597"
Sep 16 01:29:43.475940 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:43.475917    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597"
Sep 16 01:29:43.594217 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:43.594184    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb"
Sep 16 01:29:43.594610 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:43.594591    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb"
Sep 16 01:29:43.595328 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:43.595305    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb"
Sep 16 01:29:51.166752 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:29:51.166040    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-processing-5d7dbbd56b-4455c" secret="" err="secret \"payload-processing-dockercfg-kkbcm\" not found"
Sep 16 01:30:00.138160 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:30:00.138123    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-d0c9f2-29825370-ckkdv"]
Sep 16 01:30:00.142557 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:30:00.142530    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-482177-29825370-759fx"]
Sep 16 01:30:00.142715 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:30:00.142653    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-d0c9f2-29825370-ckkdv"
Sep 16 01:30:00.145023 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:30:00.144999    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4ljjd\""
Sep 16 01:30:00.146097 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:30:00.146077    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29825370-fsjgs"]
Sep 16 01:30:00.146247 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:30:00.146143    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-482177-29825370-759fx"
Sep 16 01:30:00.148952 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:30:00.148930    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29825370-fsjgs"
Sep 16 01:30:00.153481 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:30:00.153404    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-d0c9f2-29825370-ckkdv"]
Sep 16 01:30:00.155840 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:30:00.155821    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-482177-29825370-759fx"]
Sep 16 01:30:00.157076 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:30:00.157059    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-d0c9f2-29825370-ckkdv"
Sep 16 01:30:00.158248 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:30:00.158227    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29825370-fsjgs"]
Sep 16 01:30:00.176906 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:30:00.176404    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-482177-29825370-759fx"
Sep 16 01:30:00.203513 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:30:00.203488    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29825370-fsjgs"
Sep 16 01:30:00.443325 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:30:00.443294    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-d0c9f2-29825370-ckkdv"]
Sep 16 01:30:00.445957 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:30:00.445929    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80ab198d_a996_496c_813f_477f399db72e.slice/crio-046c1fab1910cc8df2978178f215eb03f9124bcccd4774f7896ddbab44adaeb6 WatchSource:0}: Error finding container 046c1fab1910cc8df2978178f215eb03f9124bcccd4774f7896ddbab44adaeb6: Status 404 returned error can't find the container with id 046c1fab1910cc8df2978178f215eb03f9124bcccd4774f7896ddbab44adaeb6
Sep 16 01:30:00.452520 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:30:00.452467    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-482177-29825370-759fx"]
Sep 16 01:30:00.454425 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:30:00.454400    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd544c0ff_3b52_4886_bffa_ed27f739369d.slice/crio-6dc15db011426299c23899cbd1bfa5cfe16a97ae64f47d20ab0f6bea0b8b5929 WatchSource:0}: Error finding container 6dc15db011426299c23899cbd1bfa5cfe16a97ae64f47d20ab0f6bea0b8b5929: Status 404 returned error can't find the container with id 6dc15db011426299c23899cbd1bfa5cfe16a97ae64f47d20ab0f6bea0b8b5929
Sep 16 01:30:00.485046 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:30:00.485025    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29825370-fsjgs"]
Sep 16 01:30:00.486038 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:30:00.486015    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb418b39_ef70_4508_806f_a6fea866c32e.slice/crio-740441994a7d740dae3b1f037faa1070a0999c322677b2638ddd8e74e79d8e1d WatchSource:0}: Error finding container 740441994a7d740dae3b1f037faa1070a0999c322677b2638ddd8e74e79d8e1d: Status 404 returned error can't find the container with id 740441994a7d740dae3b1f037faa1070a0999c322677b2638ddd8e74e79d8e1d
Sep 16 01:30:00.875118 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:30:00.875026    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-d0c9f2-29825370-ckkdv" event={"ID":"80ab198d-a996-496c-813f-477f399db72e","Type":"ContainerStarted","Data":"046c1fab1910cc8df2978178f215eb03f9124bcccd4774f7896ddbab44adaeb6"}
Sep 16 01:30:00.876170 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:30:00.876141    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-482177-29825370-759fx" event={"ID":"d544c0ff-3b52-4886-bffa-ed27f739369d","Type":"ContainerStarted","Data":"6dc15db011426299c23899cbd1bfa5cfe16a97ae64f47d20ab0f6bea0b8b5929"}
Sep 16 01:30:00.877217 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:30:00.877199    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29825370-fsjgs" event={"ID":"eb418b39-ef70-4508-806f-a6fea866c32e","Type":"ContainerStarted","Data":"740441994a7d740dae3b1f037faa1070a0999c322677b2638ddd8e74e79d8e1d"}
Sep 16 01:30:03.897263 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:30:03.897161    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29825370-fsjgs" event={"ID":"eb418b39-ef70-4508-806f-a6fea866c32e","Type":"ContainerStarted","Data":"ff9494efd029de49723cfe5f90061d9f3236c8c802844bf085cd112a6bb9c769"}
Sep 16 01:30:03.898824 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:30:03.898791    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-d0c9f2-29825370-ckkdv" event={"ID":"80ab198d-a996-496c-813f-477f399db72e","Type":"ContainerStarted","Data":"264c2cba3a2407ddf07070dbbdb49f32165bd170cf86d17d17c935cb23744769"}
Sep 16 01:30:03.900265 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:30:03.900222    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-482177-29825370-759fx" event={"ID":"d544c0ff-3b52-4886-bffa-ed27f739369d","Type":"ContainerStarted","Data":"53f06110cf995527eef7dc4fe917fbe2a1de895da77abe18b9368fea3a6210db"}
Sep 16 01:30:03.911705 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:30:03.911658    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29825370-fsjgs" podStartSLOduration=1.085917518 podStartE2EDuration="3.911642884s" totalImagesPullingTime="2.825725366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:30:03.911386918 +0000 UTC m=+853.234855496" watchObservedRunningTime="2026-09-16 01:30:03.911642884 +0000 UTC m=+853.235111461"
Sep 16 01:30:03.932502 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:30:03.932457    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-d0c9f2-29825370-ckkdv" podStartSLOduration=1.07235104 podStartE2EDuration="3.932443494s" totalImagesPullingTime="2.860092454s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:30:03.930562092 +0000 UTC m=+853.254030668" watchObservedRunningTime="2026-09-16 01:30:03.932443494 +0000 UTC m=+853.255912071"
Sep 16 01:30:03.949139 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:30:03.949088    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-482177-29825370-759fx" podStartSLOduration=1.0971491 podStartE2EDuration="3.949069529s" totalImagesPullingTime="2.851920429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:30:03.946814493 +0000 UTC m=+853.270283071" watchObservedRunningTime="2026-09-16 01:30:03.949069529 +0000 UTC m=+853.272538106"
Sep 16 01:30:04.907027 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:30:04.906994    2565 generic.go:356] "Generic (PLEG): container finished" podID="d544c0ff-3b52-4886-bffa-ed27f739369d" containerID="53f06110cf995527eef7dc4fe917fbe2a1de895da77abe18b9368fea3a6210db" exitCode=0
Sep 16 01:30:04.907452 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:30:04.907074    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-482177-29825370-759fx" event={"ID":"d544c0ff-3b52-4886-bffa-ed27f739369d","Type":"ContainerDied","Data":"53f06110cf995527eef7dc4fe917fbe2a1de895da77abe18b9368fea3a6210db"}
Sep 16 01:30:04.908664 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:30:04.908641    2565 generic.go:356] "Generic (PLEG): container finished" podID="eb418b39-ef70-4508-806f-a6fea866c32e" containerID="ff9494efd029de49723cfe5f90061d9f3236c8c802844bf085cd112a6bb9c769" exitCode=0
Sep 16 01:30:04.908732 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:30:04.908713    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29825370-fsjgs" event={"ID":"eb418b39-ef70-4508-806f-a6fea866c32e","Type":"ContainerDied","Data":"ff9494efd029de49723cfe5f90061d9f3236c8c802844bf085cd112a6bb9c769"}
Sep 16 01:30:04.910200 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:30:04.910178    2565 generic.go:356] "Generic (PLEG): container finished" podID="80ab198d-a996-496c-813f-477f399db72e" containerID="264c2cba3a2407ddf07070dbbdb49f32165bd170cf86d17d17c935cb23744769" exitCode=0
Sep 16 01:30:04.910295 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:30:04.910241    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-d0c9f2-29825370-ckkdv" event={"ID":"80ab198d-a996-496c-813f-477f399db72e","Type":"ContainerDied","Data":"264c2cba3a2407ddf07070dbbdb49f32165bd170cf86d17d17c935cb23744769"}
Sep 16 01:30:06.112848 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:30:06.112821    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-d0c9f2-29825370-ckkdv"
Sep 16 01:30:06.114788 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:30:06.114772    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29825370-fsjgs"
Sep 16 01:30:06.116763 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:30:06.116747    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-482177-29825370-759fx"
Sep 16 01:30:06.921095 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:30:06.921066    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-482177-29825370-759fx"
Sep 16 01:30:06.921095 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:30:06.921078    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-482177-29825370-759fx" event={"ID":"d544c0ff-3b52-4886-bffa-ed27f739369d","Type":"ContainerDied","Data":"6dc15db011426299c23899cbd1bfa5cfe16a97ae64f47d20ab0f6bea0b8b5929"}
Sep 16 01:30:06.921305 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:30:06.921128    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6dc15db011426299c23899cbd1bfa5cfe16a97ae64f47d20ab0f6bea0b8b5929"
Sep 16 01:30:06.922380 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:30:06.922361    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29825370-fsjgs"
Sep 16 01:30:06.922519 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:30:06.922400    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29825370-fsjgs" event={"ID":"eb418b39-ef70-4508-806f-a6fea866c32e","Type":"ContainerDied","Data":"740441994a7d740dae3b1f037faa1070a0999c322677b2638ddd8e74e79d8e1d"}
Sep 16 01:30:06.922519 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:30:06.922445    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="740441994a7d740dae3b1f037faa1070a0999c322677b2638ddd8e74e79d8e1d"
Sep 16 01:30:06.923746 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:30:06.923722    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-d0c9f2-29825370-ckkdv" event={"ID":"80ab198d-a996-496c-813f-477f399db72e","Type":"ContainerDied","Data":"046c1fab1910cc8df2978178f215eb03f9124bcccd4774f7896ddbab44adaeb6"}
Sep 16 01:30:06.923841 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:30:06.923754    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-d0c9f2-29825370-ckkdv"
Sep 16 01:30:06.923841 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:30:06.923759    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="046c1fab1910cc8df2978178f215eb03f9124bcccd4774f7896ddbab44adaeb6"
Sep 16 01:30:08.163510 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:30:08.163478    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-6cd864bc95-st4pq" secret="" err="secret \"payload-processing-dockercfg-kkbcm\" not found"
Sep 16 01:31:10.163557 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:31:10.163516    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-processing-5d7dbbd56b-4455c" secret="" err="secret \"payload-processing-dockercfg-kkbcm\" not found"
Sep 16 01:31:36.164248 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:31:36.164206    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-6cd864bc95-st4pq" secret="" err="secret \"payload-processing-dockercfg-kkbcm\" not found"
Sep 16 01:32:22.617145 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:22.617049    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-9147-aac433"]
Sep 16 01:32:22.617770 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:22.617655    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d544c0ff-3b52-4886-bffa-ed27f739369d" containerName="cleanup"
Sep 16 01:32:22.617770 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:22.617677    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d544c0ff-3b52-4886-bffa-ed27f739369d" containerName="cleanup"
Sep 16 01:32:22.617770 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:22.617704    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb418b39-ef70-4508-806f-a6fea866c32e" containerName="cleanup"
Sep 16 01:32:22.617770 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:22.617715    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb418b39-ef70-4508-806f-a6fea866c32e" containerName="cleanup"
Sep 16 01:32:22.617770 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:22.617725    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80ab198d-a996-496c-813f-477f399db72e" containerName="cleanup"
Sep 16 01:32:22.617770 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:22.617734    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="80ab198d-a996-496c-813f-477f399db72e" containerName="cleanup"
Sep 16 01:32:22.618073 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:22.617836    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="80ab198d-a996-496c-813f-477f399db72e" containerName="cleanup"
Sep 16 01:32:22.618073 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:22.617848    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb418b39-ef70-4508-806f-a6fea866c32e" containerName="cleanup"
Sep 16 01:32:22.618073 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:22.617862    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d544c0ff-3b52-4886-bffa-ed27f739369d" containerName="cleanup"
Sep 16 01:32:22.620905 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:22.620880    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9147-aac433"
Sep 16 01:32:22.623309 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:22.623274    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-6n2fb\""
Sep 16 01:32:22.627295 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:22.627270    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-9147-aac433"]
Sep 16 01:32:22.676369 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:22.676307    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkc6z\" (UniqueName: \"kubernetes.io/projected/93fd712e-7282-4a65-8bcd-f62742e14a82-kube-api-access-pkc6z\") pod \"test-curl-9147-aac433\" (UID: \"93fd712e-7282-4a65-8bcd-f62742e14a82\") " pod="opendatahub/test-curl-9147-aac433"
Sep 16 01:32:22.777493 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:22.777454    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkc6z\" (UniqueName: \"kubernetes.io/projected/93fd712e-7282-4a65-8bcd-f62742e14a82-kube-api-access-pkc6z\") pod \"test-curl-9147-aac433\" (UID: \"93fd712e-7282-4a65-8bcd-f62742e14a82\") " pod="opendatahub/test-curl-9147-aac433"
Sep 16 01:32:22.786077 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:22.786049    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkc6z\" (UniqueName: \"kubernetes.io/projected/93fd712e-7282-4a65-8bcd-f62742e14a82-kube-api-access-pkc6z\") pod \"test-curl-9147-aac433\" (UID: \"93fd712e-7282-4a65-8bcd-f62742e14a82\") " pod="opendatahub/test-curl-9147-aac433"
Sep 16 01:32:22.933232 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:22.933196    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9147-aac433"
Sep 16 01:32:23.202010 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:23.201979    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-9147-aac433"]
Sep 16 01:32:23.204188 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:32:23.204156    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod93fd712e_7282_4a65_8bcd_f62742e14a82.slice/crio-40099fa12188a4579c88a469046ca95e3857364e576ba5cabc37ea9d157a9c58 WatchSource:0}: Error finding container 40099fa12188a4579c88a469046ca95e3857364e576ba5cabc37ea9d157a9c58: Status 404 returned error can't find the container with id 40099fa12188a4579c88a469046ca95e3857364e576ba5cabc37ea9d157a9c58
Sep 16 01:32:23.206085 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:23.206064    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 01:32:23.624756 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:23.624658    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-9147-aac433" event={"ID":"93fd712e-7282-4a65-8bcd-f62742e14a82","Type":"ContainerStarted","Data":"40099fa12188a4579c88a469046ca95e3857364e576ba5cabc37ea9d157a9c58"}
Sep 16 01:32:25.637996 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:25.637950    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-9147-aac433" event={"ID":"93fd712e-7282-4a65-8bcd-f62742e14a82","Type":"ContainerStarted","Data":"22b72138c43ff0fdef96e45f923bc592f8d33ecc14a117a20b0c6340138d7977"}
Sep 16 01:32:25.653672 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:25.653621    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-9147-aac433" podStartSLOduration=1.447852991 podStartE2EDuration="3.653603076s" totalImagesPullingTime="2.205750085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:32:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:32:25.652552928 +0000 UTC m=+994.976021507" watchObservedRunningTime="2026-09-16 01:32:25.653603076 +0000 UTC m=+994.977071652"
Sep 16 01:32:26.263101 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:26.263062    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-9147-aac433"]
Sep 16 01:32:26.265543 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:26.265515    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-9147-aac433"]
Sep 16 01:32:26.390249 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:26.390213    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-9147-a41239"]
Sep 16 01:32:26.390631 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:26.390617    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93fd712e-7282-4a65-8bcd-f62742e14a82" containerName="test-curl-9147-aac433"
Sep 16 01:32:26.390631 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:26.390632    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="93fd712e-7282-4a65-8bcd-f62742e14a82" containerName="test-curl-9147-aac433"
Sep 16 01:32:26.390780 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:26.390695    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="93fd712e-7282-4a65-8bcd-f62742e14a82" containerName="test-curl-9147-aac433"
Sep 16 01:32:26.393794 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:26.393773    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9147-a41239"
Sep 16 01:32:26.398787 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:26.398754    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-9147-a41239"]
Sep 16 01:32:26.410607 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:26.410576    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtbck\" (UniqueName: \"kubernetes.io/projected/1df405b2-0f99-42e1-9f1d-3aa70620546b-kube-api-access-jtbck\") pod \"test-curl-9147-a41239\" (UID: \"1df405b2-0f99-42e1-9f1d-3aa70620546b\") " pod="opendatahub/test-curl-9147-a41239"
Sep 16 01:32:26.511511 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:26.511479    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtbck\" (UniqueName: \"kubernetes.io/projected/1df405b2-0f99-42e1-9f1d-3aa70620546b-kube-api-access-jtbck\") pod \"test-curl-9147-a41239\" (UID: \"1df405b2-0f99-42e1-9f1d-3aa70620546b\") " pod="opendatahub/test-curl-9147-a41239"
Sep 16 01:32:26.519297 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:26.519235    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtbck\" (UniqueName: \"kubernetes.io/projected/1df405b2-0f99-42e1-9f1d-3aa70620546b-kube-api-access-jtbck\") pod \"test-curl-9147-a41239\" (UID: \"1df405b2-0f99-42e1-9f1d-3aa70620546b\") " pod="opendatahub/test-curl-9147-a41239"
Sep 16 01:32:26.643449 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:32:26.643416    2565 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-9147-aac433" container="test-curl-9147-aac433"
Sep 16 01:32:26.704488 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:26.704449    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9147-a41239"
Sep 16 01:32:26.972650 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:26.972620    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-9147-a41239"]
Sep 16 01:32:26.974370 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:32:26.974330    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1df405b2_0f99_42e1_9f1d_3aa70620546b.slice/crio-9489b1e234b5b1af19e5dcb6087f67de353c4007b310d87d944cd775f6c55bbb WatchSource:0}: Error finding container 9489b1e234b5b1af19e5dcb6087f67de353c4007b310d87d944cd775f6c55bbb: Status 404 returned error can't find the container with id 9489b1e234b5b1af19e5dcb6087f67de353c4007b310d87d944cd775f6c55bbb
Sep 16 01:32:27.649704 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:27.649662    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-9147-a41239" event={"ID":"1df405b2-0f99-42e1-9f1d-3aa70620546b","Type":"ContainerStarted","Data":"039c76e1b0a7166329ef9d3c8c166c207364a708ee1d628dcc3a7ba717d663ec"}
Sep 16 01:32:27.650121 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:27.649715    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-9147-a41239" event={"ID":"1df405b2-0f99-42e1-9f1d-3aa70620546b","Type":"ContainerStarted","Data":"9489b1e234b5b1af19e5dcb6087f67de353c4007b310d87d944cd775f6c55bbb"}
Sep 16 01:32:27.650121 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:27.649762    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-9147-aac433" podUID="93fd712e-7282-4a65-8bcd-f62742e14a82" containerName="test-curl-9147-aac433" containerID="cri-o://22b72138c43ff0fdef96e45f923bc592f8d33ecc14a117a20b0c6340138d7977" gracePeriod=2
Sep 16 01:32:27.665946 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:27.665882    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-9147-a41239" podStartSLOduration=1.665866726 podStartE2EDuration="1.665866726s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:32:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:32:27.664251492 +0000 UTC m=+996.987720068" watchObservedRunningTime="2026-09-16 01:32:27.665866726 +0000 UTC m=+996.989335372"
Sep 16 01:32:28.246947 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:28.246909    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-9147-a41239"]
Sep 16 01:32:28.253116 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:28.253084    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-9147-a41239"]
Sep 16 01:32:28.654516 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:32:28.654485    2565 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-9147-a41239" container="test-curl-9147-a41239"
Sep 16 01:32:29.660120 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:29.660085    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-9147-a41239" podUID="1df405b2-0f99-42e1-9f1d-3aa70620546b" containerName="test-curl-9147-a41239" containerID="cri-o://039c76e1b0a7166329ef9d3c8c166c207364a708ee1d628dcc3a7ba717d663ec" gracePeriod=2
Sep 16 01:32:29.826376 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:29.826348    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9147-aac433"
Sep 16 01:32:29.945037 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:29.945001    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkc6z\" (UniqueName: \"kubernetes.io/projected/93fd712e-7282-4a65-8bcd-f62742e14a82-kube-api-access-pkc6z\") pod \"93fd712e-7282-4a65-8bcd-f62742e14a82\" (UID: \"93fd712e-7282-4a65-8bcd-f62742e14a82\") "
Sep 16 01:32:29.947083 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:29.947053    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93fd712e-7282-4a65-8bcd-f62742e14a82-kube-api-access-pkc6z" (OuterVolumeSpecName: "kube-api-access-pkc6z") pod "93fd712e-7282-4a65-8bcd-f62742e14a82" (UID: "93fd712e-7282-4a65-8bcd-f62742e14a82"). InnerVolumeSpecName "kube-api-access-pkc6z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:32:30.045948 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:30.045910    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkc6z\" (UniqueName: \"kubernetes.io/projected/93fd712e-7282-4a65-8bcd-f62742e14a82-kube-api-access-pkc6z\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:32:30.666289 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:30.666246    2565 generic.go:356] "Generic (PLEG): container finished" podID="93fd712e-7282-4a65-8bcd-f62742e14a82" containerID="22b72138c43ff0fdef96e45f923bc592f8d33ecc14a117a20b0c6340138d7977" exitCode=137
Sep 16 01:32:30.666733 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:30.666297    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9147-aac433"
Sep 16 01:32:30.666733 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:30.666366    2565 scope.go:117] "RemoveContainer" containerID="22b72138c43ff0fdef96e45f923bc592f8d33ecc14a117a20b0c6340138d7977"
Sep 16 01:32:30.675173 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:30.675155    2565 scope.go:117] "RemoveContainer" containerID="22b72138c43ff0fdef96e45f923bc592f8d33ecc14a117a20b0c6340138d7977"
Sep 16 01:32:30.675492 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:32:30.675472    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22b72138c43ff0fdef96e45f923bc592f8d33ecc14a117a20b0c6340138d7977\": container with ID starting with 22b72138c43ff0fdef96e45f923bc592f8d33ecc14a117a20b0c6340138d7977 not found: ID does not exist" containerID="22b72138c43ff0fdef96e45f923bc592f8d33ecc14a117a20b0c6340138d7977"
Sep 16 01:32:30.675542 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:30.675505    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22b72138c43ff0fdef96e45f923bc592f8d33ecc14a117a20b0c6340138d7977"} err="failed to get container status \"22b72138c43ff0fdef96e45f923bc592f8d33ecc14a117a20b0c6340138d7977\": rpc error: code = NotFound desc = could not find container \"22b72138c43ff0fdef96e45f923bc592f8d33ecc14a117a20b0c6340138d7977\": container with ID starting with 22b72138c43ff0fdef96e45f923bc592f8d33ecc14a117a20b0c6340138d7977 not found: ID does not exist"
Sep 16 01:32:30.676621 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:32:30.676587    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-9147-aac433\" is forbidden: User \"system:node:ip-10-0-135-225.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-225.ec2.internal' and this object" podUID="93fd712e-7282-4a65-8bcd-f62742e14a82" pod="opendatahub/test-curl-9147-aac433"
Sep 16 01:32:31.168281 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:32:31.168236    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-9147-aac433\" is forbidden: User \"system:node:ip-10-0-135-225.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-225.ec2.internal' and this object" podUID="93fd712e-7282-4a65-8bcd-f62742e14a82" pod="opendatahub/test-curl-9147-aac433"
Sep 16 01:32:31.170206 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:31.170178    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93fd712e-7282-4a65-8bcd-f62742e14a82" path="/var/lib/kubelet/pods/93fd712e-7282-4a65-8bcd-f62742e14a82/volumes"
Sep 16 01:32:31.835542 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:31.835513    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9147-a41239"
Sep 16 01:32:31.966490 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:31.966379    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtbck\" (UniqueName: \"kubernetes.io/projected/1df405b2-0f99-42e1-9f1d-3aa70620546b-kube-api-access-jtbck\") pod \"1df405b2-0f99-42e1-9f1d-3aa70620546b\" (UID: \"1df405b2-0f99-42e1-9f1d-3aa70620546b\") "
Sep 16 01:32:31.968480 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:31.968448    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1df405b2-0f99-42e1-9f1d-3aa70620546b-kube-api-access-jtbck" (OuterVolumeSpecName: "kube-api-access-jtbck") pod "1df405b2-0f99-42e1-9f1d-3aa70620546b" (UID: "1df405b2-0f99-42e1-9f1d-3aa70620546b"). InnerVolumeSpecName "kube-api-access-jtbck". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:32:32.067403 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:32.067364    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtbck\" (UniqueName: \"kubernetes.io/projected/1df405b2-0f99-42e1-9f1d-3aa70620546b-kube-api-access-jtbck\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:32:32.679690 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:32.679651    2565 generic.go:356] "Generic (PLEG): container finished" podID="1df405b2-0f99-42e1-9f1d-3aa70620546b" containerID="039c76e1b0a7166329ef9d3c8c166c207364a708ee1d628dcc3a7ba717d663ec" exitCode=137
Sep 16 01:32:32.679690 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:32.679692    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9147-a41239"
Sep 16 01:32:32.679953 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:32.679742    2565 scope.go:117] "RemoveContainer" containerID="039c76e1b0a7166329ef9d3c8c166c207364a708ee1d628dcc3a7ba717d663ec"
Sep 16 01:32:32.689430 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:32.689325    2565 scope.go:117] "RemoveContainer" containerID="039c76e1b0a7166329ef9d3c8c166c207364a708ee1d628dcc3a7ba717d663ec"
Sep 16 01:32:32.689665 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:32:32.689645    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"039c76e1b0a7166329ef9d3c8c166c207364a708ee1d628dcc3a7ba717d663ec\": container with ID starting with 039c76e1b0a7166329ef9d3c8c166c207364a708ee1d628dcc3a7ba717d663ec not found: ID does not exist" containerID="039c76e1b0a7166329ef9d3c8c166c207364a708ee1d628dcc3a7ba717d663ec"
Sep 16 01:32:32.689711 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:32.689674    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"039c76e1b0a7166329ef9d3c8c166c207364a708ee1d628dcc3a7ba717d663ec"} err="failed to get container status \"039c76e1b0a7166329ef9d3c8c166c207364a708ee1d628dcc3a7ba717d663ec\": rpc error: code = NotFound desc = could not find container \"039c76e1b0a7166329ef9d3c8c166c207364a708ee1d628dcc3a7ba717d663ec\": container with ID starting with 039c76e1b0a7166329ef9d3c8c166c207364a708ee1d628dcc3a7ba717d663ec not found: ID does not exist"
Sep 16 01:32:32.690483 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:32:32.690463    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-9147-a41239\" is forbidden: User \"system:node:ip-10-0-135-225.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-225.ec2.internal' and this object" podUID="1df405b2-0f99-42e1-9f1d-3aa70620546b" pod="opendatahub/test-curl-9147-a41239"
Sep 16 01:32:33.169439 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:33.169407    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1df405b2-0f99-42e1-9f1d-3aa70620546b" path="/var/lib/kubelet/pods/1df405b2-0f99-42e1-9f1d-3aa70620546b/volumes"
Sep 16 01:32:36.164188 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:36.164155    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-processing-5d7dbbd56b-4455c" secret="" err="secret \"payload-processing-dockercfg-kkbcm\" not found"
Sep 16 01:32:50.723229 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:50.723193    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-d0c9f2/distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk"]
Sep 16 01:32:50.723835 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:50.723817    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1df405b2-0f99-42e1-9f1d-3aa70620546b" containerName="test-curl-9147-a41239"
Sep 16 01:32:50.723892 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:50.723839    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1df405b2-0f99-42e1-9f1d-3aa70620546b" containerName="test-curl-9147-a41239"
Sep 16 01:32:50.723940 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:50.723928    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1df405b2-0f99-42e1-9f1d-3aa70620546b" containerName="test-curl-9147-a41239"
Sep 16 01:32:50.727205 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:50.727188    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-d0c9f2/distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk"
Sep 16 01:32:50.729716 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:50.729689    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-d0c9f2\"/\"openshift-service-ca.crt\""
Sep 16 01:32:50.732724 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:50.731457    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-d0c9f2\"/\"default-dockercfg-8n69k\""
Sep 16 01:32:50.732724 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:50.731722    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-d0c9f2\"/\"kube-root-ca.crt\""
Sep 16 01:32:50.732724 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:50.732068    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-d0c9f2\"/\"distinct-w3-d0c9f2-kserve-self-signed-certs\""
Sep 16 01:32:50.734800 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:50.734746    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-d0c9f2/distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk"]
Sep 16 01:32:50.845952 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:50.845896    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c626f1e-51c2-4e1f-9005-8d545708aa58-model-cache\") pod \"distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk\" (UID: \"6c626f1e-51c2-4e1f-9005-8d545708aa58\") " pod="e2e-models-e2e-worker-w3-d0c9f2/distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk"
Sep 16 01:32:50.846158 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:50.845970    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9lgt\" (UniqueName: \"kubernetes.io/projected/6c626f1e-51c2-4e1f-9005-8d545708aa58-kube-api-access-q9lgt\") pod \"distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk\" (UID: \"6c626f1e-51c2-4e1f-9005-8d545708aa58\") " pod="e2e-models-e2e-worker-w3-d0c9f2/distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk"
Sep 16 01:32:50.846158 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:50.846019    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c626f1e-51c2-4e1f-9005-8d545708aa58-home\") pod \"distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk\" (UID: \"6c626f1e-51c2-4e1f-9005-8d545708aa58\") " pod="e2e-models-e2e-worker-w3-d0c9f2/distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk"
Sep 16 01:32:50.846158 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:50.846049    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c626f1e-51c2-4e1f-9005-8d545708aa58-dshm\") pod \"distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk\" (UID: \"6c626f1e-51c2-4e1f-9005-8d545708aa58\") " pod="e2e-models-e2e-worker-w3-d0c9f2/distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk"
Sep 16 01:32:50.846158 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:50.846091    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c626f1e-51c2-4e1f-9005-8d545708aa58-tls-certs\") pod \"distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk\" (UID: \"6c626f1e-51c2-4e1f-9005-8d545708aa58\") " pod="e2e-models-e2e-worker-w3-d0c9f2/distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk"
Sep 16 01:32:50.846393 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:50.846170    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c626f1e-51c2-4e1f-9005-8d545708aa58-tmp-dir\") pod \"distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk\" (UID: \"6c626f1e-51c2-4e1f-9005-8d545708aa58\") " pod="e2e-models-e2e-worker-w3-d0c9f2/distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk"
Sep 16 01:32:50.946750 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:50.946706    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c626f1e-51c2-4e1f-9005-8d545708aa58-model-cache\") pod \"distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk\" (UID: \"6c626f1e-51c2-4e1f-9005-8d545708aa58\") " pod="e2e-models-e2e-worker-w3-d0c9f2/distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk"
Sep 16 01:32:50.946750 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:50.946753    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9lgt\" (UniqueName: \"kubernetes.io/projected/6c626f1e-51c2-4e1f-9005-8d545708aa58-kube-api-access-q9lgt\") pod \"distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk\" (UID: \"6c626f1e-51c2-4e1f-9005-8d545708aa58\") " pod="e2e-models-e2e-worker-w3-d0c9f2/distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk"
Sep 16 01:32:50.947005 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:50.946786    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c626f1e-51c2-4e1f-9005-8d545708aa58-home\") pod \"distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk\" (UID: \"6c626f1e-51c2-4e1f-9005-8d545708aa58\") " pod="e2e-models-e2e-worker-w3-d0c9f2/distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk"
Sep 16 01:32:50.947005 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:50.946803    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c626f1e-51c2-4e1f-9005-8d545708aa58-dshm\") pod \"distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk\" (UID: \"6c626f1e-51c2-4e1f-9005-8d545708aa58\") " pod="e2e-models-e2e-worker-w3-d0c9f2/distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk"
Sep 16 01:32:50.947005 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:50.946833    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c626f1e-51c2-4e1f-9005-8d545708aa58-tls-certs\") pod \"distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk\" (UID: \"6c626f1e-51c2-4e1f-9005-8d545708aa58\") " pod="e2e-models-e2e-worker-w3-d0c9f2/distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk"
Sep 16 01:32:50.947005 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:50.946883    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c626f1e-51c2-4e1f-9005-8d545708aa58-tmp-dir\") pod \"distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk\" (UID: \"6c626f1e-51c2-4e1f-9005-8d545708aa58\") " pod="e2e-models-e2e-worker-w3-d0c9f2/distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk"
Sep 16 01:32:50.947258 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:50.947229    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c626f1e-51c2-4e1f-9005-8d545708aa58-home\") pod \"distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk\" (UID: \"6c626f1e-51c2-4e1f-9005-8d545708aa58\") " pod="e2e-models-e2e-worker-w3-d0c9f2/distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk"
Sep 16 01:32:50.947314 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:50.947229    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c626f1e-51c2-4e1f-9005-8d545708aa58-model-cache\") pod \"distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk\" (UID: \"6c626f1e-51c2-4e1f-9005-8d545708aa58\") " pod="e2e-models-e2e-worker-w3-d0c9f2/distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk"
Sep 16 01:32:50.947314 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:50.947281    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c626f1e-51c2-4e1f-9005-8d545708aa58-tmp-dir\") pod \"distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk\" (UID: \"6c626f1e-51c2-4e1f-9005-8d545708aa58\") " pod="e2e-models-e2e-worker-w3-d0c9f2/distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk"
Sep 16 01:32:50.949209 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:50.949186    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c626f1e-51c2-4e1f-9005-8d545708aa58-dshm\") pod \"distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk\" (UID: \"6c626f1e-51c2-4e1f-9005-8d545708aa58\") " pod="e2e-models-e2e-worker-w3-d0c9f2/distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk"
Sep 16 01:32:50.949406 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:50.949386    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c626f1e-51c2-4e1f-9005-8d545708aa58-tls-certs\") pod \"distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk\" (UID: \"6c626f1e-51c2-4e1f-9005-8d545708aa58\") " pod="e2e-models-e2e-worker-w3-d0c9f2/distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk"
Sep 16 01:32:50.954707 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:50.954683    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9lgt\" (UniqueName: \"kubernetes.io/projected/6c626f1e-51c2-4e1f-9005-8d545708aa58-kube-api-access-q9lgt\") pod \"distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk\" (UID: \"6c626f1e-51c2-4e1f-9005-8d545708aa58\") " pod="e2e-models-e2e-worker-w3-d0c9f2/distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk"
Sep 16 01:32:51.039312 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:51.039221    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-d0c9f2/distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk"
Sep 16 01:32:51.310406 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:51.310382    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-d0c9f2/distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk"]
Sep 16 01:32:51.312171 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:32:51.312142    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6c626f1e_51c2_4e1f_9005_8d545708aa58.slice/crio-002bcebbc2d5ed58d4b5f85f6849641bb6737a6c146eb4a01e4905bfc33a71cf WatchSource:0}: Error finding container 002bcebbc2d5ed58d4b5f85f6849641bb6737a6c146eb4a01e4905bfc33a71cf: Status 404 returned error can't find the container with id 002bcebbc2d5ed58d4b5f85f6849641bb6737a6c146eb4a01e4905bfc33a71cf
Sep 16 01:32:51.777440 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:51.777400    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-d0c9f2/distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk" event={"ID":"6c626f1e-51c2-4e1f-9005-8d545708aa58","Type":"ContainerStarted","Data":"4a74e13ecde61cb3409d232d1d4cbad20bc3d72afb810f4c3e2b3bdb4de8a078"}
Sep 16 01:32:51.777816 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:51.777450    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-d0c9f2/distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk" event={"ID":"6c626f1e-51c2-4e1f-9005-8d545708aa58","Type":"ContainerStarted","Data":"002bcebbc2d5ed58d4b5f85f6849641bb6737a6c146eb4a01e4905bfc33a71cf"}
Sep 16 01:32:51.795080 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:32:51.795025    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-d0c9f2/distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk" podStartSLOduration=1.7950092180000001 podStartE2EDuration="1.795009218s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:32:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:32:51.793025732 +0000 UTC m=+1021.116494309" watchObservedRunningTime="2026-09-16 01:32:51.795009218 +0000 UTC m=+1021.118477795"
Sep 16 01:33:01.039659 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:01.039619    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-d0c9f2/distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk"
Sep 16 01:33:01.040282 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:01.039678    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-d0c9f2/distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk"
Sep 16 01:33:01.052328 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:01.052296    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-d0c9f2/distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk"
Sep 16 01:33:01.846423 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:01.846393    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-d0c9f2/distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk"
Sep 16 01:33:06.164370 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:06.164301    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-6cd864bc95-st4pq" secret="" err="secret \"payload-processing-dockercfg-kkbcm\" not found"
Sep 16 01:33:23.381018 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:23.380984    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp"]
Sep 16 01:33:23.385100 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:23.385076    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp"
Sep 16 01:33:23.387565 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:23.387536    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-ba321c07-openshift-default-dockercfg-r796n\""
Sep 16 01:33:23.395780 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:23.395757    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp"]
Sep 16 01:33:23.458007 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:23.457972    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eca80ebc-f4cd-4ab0-8348-e3d54005d655-istio-token\") pod \"e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp\" (UID: \"eca80ebc-f4cd-4ab0-8348-e3d54005d655\") " pod="openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp"
Sep 16 01:33:23.458199 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:23.458017    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eca80ebc-f4cd-4ab0-8348-e3d54005d655-istio-podinfo\") pod \"e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp\" (UID: \"eca80ebc-f4cd-4ab0-8348-e3d54005d655\") " pod="openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp"
Sep 16 01:33:23.458199 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:23.458149    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eca80ebc-f4cd-4ab0-8348-e3d54005d655-workload-certs\") pod \"e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp\" (UID: \"eca80ebc-f4cd-4ab0-8348-e3d54005d655\") " pod="openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp"
Sep 16 01:33:23.458292 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:23.458241    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eca80ebc-f4cd-4ab0-8348-e3d54005d655-workload-socket\") pod \"e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp\" (UID: \"eca80ebc-f4cd-4ab0-8348-e3d54005d655\") " pod="openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp"
Sep 16 01:33:23.458332 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:23.458302    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eca80ebc-f4cd-4ab0-8348-e3d54005d655-istio-envoy\") pod \"e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp\" (UID: \"eca80ebc-f4cd-4ab0-8348-e3d54005d655\") " pod="openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp"
Sep 16 01:33:23.458397 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:23.458362    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eca80ebc-f4cd-4ab0-8348-e3d54005d655-credential-socket\") pod \"e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp\" (UID: \"eca80ebc-f4cd-4ab0-8348-e3d54005d655\") " pod="openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp"
Sep 16 01:33:23.458440 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:23.458396    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eca80ebc-f4cd-4ab0-8348-e3d54005d655-istio-data\") pod \"e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp\" (UID: \"eca80ebc-f4cd-4ab0-8348-e3d54005d655\") " pod="openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp"
Sep 16 01:33:23.458440 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:23.458424    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq85c\" (UniqueName: \"kubernetes.io/projected/eca80ebc-f4cd-4ab0-8348-e3d54005d655-kube-api-access-tq85c\") pod \"e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp\" (UID: \"eca80ebc-f4cd-4ab0-8348-e3d54005d655\") " pod="openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp"
Sep 16 01:33:23.458564 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:23.458539    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eca80ebc-f4cd-4ab0-8348-e3d54005d655-istiod-ca-cert\") pod \"e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp\" (UID: \"eca80ebc-f4cd-4ab0-8348-e3d54005d655\") " pod="openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp"
Sep 16 01:33:23.559311 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:23.559273    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eca80ebc-f4cd-4ab0-8348-e3d54005d655-workload-certs\") pod \"e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp\" (UID: \"eca80ebc-f4cd-4ab0-8348-e3d54005d655\") " pod="openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp"
Sep 16 01:33:23.559533 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:23.559326    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eca80ebc-f4cd-4ab0-8348-e3d54005d655-workload-socket\") pod \"e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp\" (UID: \"eca80ebc-f4cd-4ab0-8348-e3d54005d655\") " pod="openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp"
Sep 16 01:33:23.559533 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:23.559383    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eca80ebc-f4cd-4ab0-8348-e3d54005d655-istio-envoy\") pod \"e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp\" (UID: \"eca80ebc-f4cd-4ab0-8348-e3d54005d655\") " pod="openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp"
Sep 16 01:33:23.559533 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:23.559407    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eca80ebc-f4cd-4ab0-8348-e3d54005d655-credential-socket\") pod \"e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp\" (UID: \"eca80ebc-f4cd-4ab0-8348-e3d54005d655\") " pod="openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp"
Sep 16 01:33:23.559533 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:23.559428    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eca80ebc-f4cd-4ab0-8348-e3d54005d655-istio-data\") pod \"e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp\" (UID: \"eca80ebc-f4cd-4ab0-8348-e3d54005d655\") " pod="openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp"
Sep 16 01:33:23.559533 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:23.559450    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tq85c\" (UniqueName: \"kubernetes.io/projected/eca80ebc-f4cd-4ab0-8348-e3d54005d655-kube-api-access-tq85c\") pod \"e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp\" (UID: \"eca80ebc-f4cd-4ab0-8348-e3d54005d655\") " pod="openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp"
Sep 16 01:33:23.559533 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:23.559510    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eca80ebc-f4cd-4ab0-8348-e3d54005d655-istiod-ca-cert\") pod \"e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp\" (UID: \"eca80ebc-f4cd-4ab0-8348-e3d54005d655\") " pod="openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp"
Sep 16 01:33:23.559872 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:23.559563    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eca80ebc-f4cd-4ab0-8348-e3d54005d655-istio-token\") pod \"e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp\" (UID: \"eca80ebc-f4cd-4ab0-8348-e3d54005d655\") " pod="openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp"
Sep 16 01:33:23.559872 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:23.559746    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eca80ebc-f4cd-4ab0-8348-e3d54005d655-istio-podinfo\") pod \"e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp\" (UID: \"eca80ebc-f4cd-4ab0-8348-e3d54005d655\") " pod="openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp"
Sep 16 01:33:23.559872 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:23.559818    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eca80ebc-f4cd-4ab0-8348-e3d54005d655-istio-data\") pod \"e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp\" (UID: \"eca80ebc-f4cd-4ab0-8348-e3d54005d655\") " pod="openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp"
Sep 16 01:33:23.559872 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:23.559748    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eca80ebc-f4cd-4ab0-8348-e3d54005d655-workload-certs\") pod \"e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp\" (UID: \"eca80ebc-f4cd-4ab0-8348-e3d54005d655\") " pod="openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp"
Sep 16 01:33:23.560085 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:23.559936    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eca80ebc-f4cd-4ab0-8348-e3d54005d655-credential-socket\") pod \"e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp\" (UID: \"eca80ebc-f4cd-4ab0-8348-e3d54005d655\") " pod="openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp"
Sep 16 01:33:23.560085 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:23.559993    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eca80ebc-f4cd-4ab0-8348-e3d54005d655-workload-socket\") pod \"e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp\" (UID: \"eca80ebc-f4cd-4ab0-8348-e3d54005d655\") " pod="openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp"
Sep 16 01:33:23.560237 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:23.560216    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eca80ebc-f4cd-4ab0-8348-e3d54005d655-istiod-ca-cert\") pod \"e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp\" (UID: \"eca80ebc-f4cd-4ab0-8348-e3d54005d655\") " pod="openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp"
Sep 16 01:33:23.562024 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:23.561999    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eca80ebc-f4cd-4ab0-8348-e3d54005d655-istio-envoy\") pod \"e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp\" (UID: \"eca80ebc-f4cd-4ab0-8348-e3d54005d655\") " pod="openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp"
Sep 16 01:33:23.562233 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:23.562216    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eca80ebc-f4cd-4ab0-8348-e3d54005d655-istio-podinfo\") pod \"e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp\" (UID: \"eca80ebc-f4cd-4ab0-8348-e3d54005d655\") " pod="openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp"
Sep 16 01:33:23.567123 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:23.567090    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq85c\" (UniqueName: \"kubernetes.io/projected/eca80ebc-f4cd-4ab0-8348-e3d54005d655-kube-api-access-tq85c\") pod \"e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp\" (UID: \"eca80ebc-f4cd-4ab0-8348-e3d54005d655\") " pod="openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp"
Sep 16 01:33:23.567439 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:23.567417    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eca80ebc-f4cd-4ab0-8348-e3d54005d655-istio-token\") pod \"e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp\" (UID: \"eca80ebc-f4cd-4ab0-8348-e3d54005d655\") " pod="openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp"
Sep 16 01:33:23.697657 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:23.697622    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp"
Sep 16 01:33:23.977194 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:23.977166    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp"]
Sep 16 01:33:23.980143 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:33:23.980109    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeca80ebc_f4cd_4ab0_8348_e3d54005d655.slice/crio-d9641855088f7a59ae8c7e418b695c296415367d0cd8c4b444c6313636491755 WatchSource:0}: Error finding container d9641855088f7a59ae8c7e418b695c296415367d0cd8c4b444c6313636491755: Status 404 returned error can't find the container with id d9641855088f7a59ae8c7e418b695c296415367d0cd8c4b444c6313636491755
Sep 16 01:33:23.982473 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:23.982440    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:33:23.982546 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:23.982508    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:33:23.982546 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:23.982538    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:33:24.953182 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:24.953132    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp" event={"ID":"eca80ebc-f4cd-4ab0-8348-e3d54005d655","Type":"ContainerStarted","Data":"26251c3076b72cafeab34ac51bb215a208cca0e87ad2ac2d38f1a2a7f1758daa"}
Sep 16 01:33:24.953614 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:24.953235    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp" event={"ID":"eca80ebc-f4cd-4ab0-8348-e3d54005d655","Type":"ContainerStarted","Data":"d9641855088f7a59ae8c7e418b695c296415367d0cd8c4b444c6313636491755"}
Sep 16 01:33:24.971843 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:24.971793    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp" podStartSLOduration=1.971778097 podStartE2EDuration="1.971778097s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:33:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:33:24.970910473 +0000 UTC m=+1054.294379050" watchObservedRunningTime="2026-09-16 01:33:24.971778097 +0000 UTC m=+1054.295246674"
Sep 16 01:33:25.698422 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:25.698380    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp"
Sep 16 01:33:25.703612 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:25.703583    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp"
Sep 16 01:33:25.959025 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:25.958926    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp"
Sep 16 01:33:25.959919 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:25.959901    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp"
Sep 16 01:33:29.798769 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:29.798735    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ba321c07-7fdbbd7cd6-v58tt"]
Sep 16 01:33:29.802600 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:29.802581    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ba321c07-7fdbbd7cd6-v58tt"
Sep 16 01:33:29.805154 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:29.805129    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-ba321c07-dockercfg-z4twl\""
Sep 16 01:33:29.805282 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:29.805180    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-ba321c07\""
Sep 16 01:33:29.811691 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:29.811663    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ba321c07-7fdbbd7cd6-v58tt"]
Sep 16 01:33:29.920873 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:29.920824    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78tvb\" (UniqueName: \"kubernetes.io/projected/17f377cf-7484-4c6b-9202-4f6404d414a4-kube-api-access-78tvb\") pod \"payload-pre-processing-e2e-ait-ba321c07-7fdbbd7cd6-v58tt\" (UID: \"17f377cf-7484-4c6b-9202-4f6404d414a4\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ba321c07-7fdbbd7cd6-v58tt"
Sep 16 01:33:29.921095 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:29.920996    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17f377cf-7484-4c6b-9202-4f6404d414a4-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-ba321c07-7fdbbd7cd6-v58tt\" (UID: \"17f377cf-7484-4c6b-9202-4f6404d414a4\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ba321c07-7fdbbd7cd6-v58tt"
Sep 16 01:33:30.022106 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:30.022056    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17f377cf-7484-4c6b-9202-4f6404d414a4-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-ba321c07-7fdbbd7cd6-v58tt\" (UID: \"17f377cf-7484-4c6b-9202-4f6404d414a4\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ba321c07-7fdbbd7cd6-v58tt"
Sep 16 01:33:30.022284 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:30.022151    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78tvb\" (UniqueName: \"kubernetes.io/projected/17f377cf-7484-4c6b-9202-4f6404d414a4-kube-api-access-78tvb\") pod \"payload-pre-processing-e2e-ait-ba321c07-7fdbbd7cd6-v58tt\" (UID: \"17f377cf-7484-4c6b-9202-4f6404d414a4\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ba321c07-7fdbbd7cd6-v58tt"
Sep 16 01:33:30.022822 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:30.022800    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17f377cf-7484-4c6b-9202-4f6404d414a4-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-ba321c07-7fdbbd7cd6-v58tt\" (UID: \"17f377cf-7484-4c6b-9202-4f6404d414a4\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ba321c07-7fdbbd7cd6-v58tt"
Sep 16 01:33:30.029810 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:30.029785    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78tvb\" (UniqueName: \"kubernetes.io/projected/17f377cf-7484-4c6b-9202-4f6404d414a4-kube-api-access-78tvb\") pod \"payload-pre-processing-e2e-ait-ba321c07-7fdbbd7cd6-v58tt\" (UID: \"17f377cf-7484-4c6b-9202-4f6404d414a4\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ba321c07-7fdbbd7cd6-v58tt"
Sep 16 01:33:30.114554 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:30.114462    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ba321c07-7fdbbd7cd6-v58tt"
Sep 16 01:33:30.385957 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:30.385931    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ba321c07-7fdbbd7cd6-v58tt"]
Sep 16 01:33:30.388034 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:33:30.388006    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17f377cf_7484_4c6b_9202_4f6404d414a4.slice/crio-b9a7c094817be884766622534f94f973b5e2e6464e6391112ca8493962e87b28 WatchSource:0}: Error finding container b9a7c094817be884766622534f94f973b5e2e6464e6391112ca8493962e87b28: Status 404 returned error can't find the container with id b9a7c094817be884766622534f94f973b5e2e6464e6391112ca8493962e87b28
Sep 16 01:33:30.985886 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:30.985839    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ba321c07-7fdbbd7cd6-v58tt" event={"ID":"17f377cf-7484-4c6b-9202-4f6404d414a4","Type":"ContainerStarted","Data":"edab076641db5b004fa74c5e0681b772d43aca1360577bc319f23acf8d5a7a47"}
Sep 16 01:33:30.986280 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:30.985904    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ba321c07-7fdbbd7cd6-v58tt" event={"ID":"17f377cf-7484-4c6b-9202-4f6404d414a4","Type":"ContainerStarted","Data":"b9a7c094817be884766622534f94f973b5e2e6464e6391112ca8493962e87b28"}
Sep 16 01:33:30.986280 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:30.985939    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-ba321c07-7fdbbd7cd6-v58tt"
Sep 16 01:33:31.000948 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:31.000893    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-ba321c07-7fdbbd7cd6-v58tt" podStartSLOduration=2.000875394 podStartE2EDuration="2.000875394s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:33:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:33:30.998668149 +0000 UTC m=+1060.322136728" watchObservedRunningTime="2026-09-16 01:33:31.000875394 +0000 UTC m=+1060.324343973"
Sep 16 01:33:41.994678 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:41.994645    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-ba321c07-7fdbbd7cd6-v58tt"
Sep 16 01:33:47.084436 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:47.084398    2565 generic.go:356] "Generic (PLEG): container finished" podID="eca80ebc-f4cd-4ab0-8348-e3d54005d655" containerID="26251c3076b72cafeab34ac51bb215a208cca0e87ad2ac2d38f1a2a7f1758daa" exitCode=0
Sep 16 01:33:47.084883 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:47.084471    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp" event={"ID":"eca80ebc-f4cd-4ab0-8348-e3d54005d655","Type":"ContainerDied","Data":"26251c3076b72cafeab34ac51bb215a208cca0e87ad2ac2d38f1a2a7f1758daa"}
Sep 16 01:33:47.084937 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:47.084890    2565 scope.go:117] "RemoveContainer" containerID="26251c3076b72cafeab34ac51bb215a208cca0e87ad2ac2d38f1a2a7f1758daa"
Sep 16 01:33:47.086102 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:47.086067    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:33:47.086184 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:47.086148    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:33:47.086184 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:47.086180    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:33:48.093163 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:48.093128    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp" event={"ID":"eca80ebc-f4cd-4ab0-8348-e3d54005d655","Type":"ContainerStarted","Data":"d94e99cd7a58873fabb51b19c0fc2ac13fb1123c1049d036e72c468f3e1ae126"}
Sep 16 01:33:48.698624 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:48.698584    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp"
Sep 16 01:33:48.698912 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:48.698887    2565 patch_prober.go:28] interesting pod/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 16 01:33:48.699014 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:48.698944    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp" podUID="eca80ebc-f4cd-4ab0-8348-e3d54005d655" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 16 01:33:49.698166 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:49.698132    2565 patch_prober.go:28] interesting pod/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 16 01:33:49.698543 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:49.698190    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp" podUID="eca80ebc-f4cd-4ab0-8348-e3d54005d655" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 16 01:33:50.699036 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:50.698990    2565 patch_prober.go:28] interesting pod/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 16 01:33:50.699540 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:50.699060    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp" podUID="eca80ebc-f4cd-4ab0-8348-e3d54005d655" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 16 01:33:51.698098 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:51.698059    2565 patch_prober.go:28] interesting pod/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 16 01:33:51.698288 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:51.698119    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp" podUID="eca80ebc-f4cd-4ab0-8348-e3d54005d655" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 16 01:33:52.698800 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:52.698763    2565 patch_prober.go:28] interesting pod/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 16 01:33:52.699228 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:52.698838    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp" podUID="eca80ebc-f4cd-4ab0-8348-e3d54005d655" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 16 01:33:53.702896 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:53.702863    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp"
Sep 16 01:33:53.703331 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:53.703268    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp"
Sep 16 01:33:53.704099 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:53.704079    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp"
Sep 16 01:33:53.783396 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:53.783356    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-033feb-gsrnn"]
Sep 16 01:33:53.787755 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:53.787731    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-033feb-gsrnn"
Sep 16 01:33:53.791125 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:53.791073    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 01:33:53.791450 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:53.791243    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4ljjd\""
Sep 16 01:33:53.792361 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:53.792320    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-033feb-gsrnn"]
Sep 16 01:33:53.861388 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:53.861329    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e3babe3-bdbe-49ae-912d-a690d269cbc4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-033feb-gsrnn\" (UID: \"5e3babe3-bdbe-49ae-912d-a690d269cbc4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-033feb-gsrnn"
Sep 16 01:33:53.962331 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:53.962229    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e3babe3-bdbe-49ae-912d-a690d269cbc4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-033feb-gsrnn\" (UID: \"5e3babe3-bdbe-49ae-912d-a690d269cbc4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-033feb-gsrnn"
Sep 16 01:33:53.962878 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:53.962855    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e3babe3-bdbe-49ae-912d-a690d269cbc4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-033feb-gsrnn\" (UID: \"5e3babe3-bdbe-49ae-912d-a690d269cbc4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-033feb-gsrnn"
Sep 16 01:33:54.104125 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:54.104080    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-033feb-gsrnn"
Sep 16 01:33:54.163850 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:54.163810    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-processing-5d7dbbd56b-4455c" secret="" err="secret \"payload-processing-dockercfg-kkbcm\" not found"
Sep 16 01:33:54.397134 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:54.397102    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-033feb-gsrnn"]
Sep 16 01:33:54.400082 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:33:54.400053    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e3babe3_bdbe_49ae_912d_a690d269cbc4.slice/crio-bb4f41a1452f535052e82c634f76391eb4bb85bbfd705a55dd0dcf04fae02cea WatchSource:0}: Error finding container bb4f41a1452f535052e82c634f76391eb4bb85bbfd705a55dd0dcf04fae02cea: Status 404 returned error can't find the container with id bb4f41a1452f535052e82c634f76391eb4bb85bbfd705a55dd0dcf04fae02cea
Sep 16 01:33:55.137826 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:55.137793    2565 generic.go:356] "Generic (PLEG): container finished" podID="5e3babe3-bdbe-49ae-912d-a690d269cbc4" containerID="89c2c37c01ae17e34cdfbd30be4c4480cc00c8496ba1badf4ed8180e5187f922" exitCode=0
Sep 16 01:33:55.138213 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:55.137880    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-033feb-gsrnn" event={"ID":"5e3babe3-bdbe-49ae-912d-a690d269cbc4","Type":"ContainerDied","Data":"89c2c37c01ae17e34cdfbd30be4c4480cc00c8496ba1badf4ed8180e5187f922"}
Sep 16 01:33:55.138213 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:55.137937    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-033feb-gsrnn" event={"ID":"5e3babe3-bdbe-49ae-912d-a690d269cbc4","Type":"ContainerStarted","Data":"bb4f41a1452f535052e82c634f76391eb4bb85bbfd705a55dd0dcf04fae02cea"}
Sep 16 01:33:56.282371 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:56.282325    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-033feb-gsrnn"
Sep 16 01:33:56.385759 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:56.385726    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e3babe3-bdbe-49ae-912d-a690d269cbc4-maas-api-service-ca\") pod \"5e3babe3-bdbe-49ae-912d-a690d269cbc4\" (UID: \"5e3babe3-bdbe-49ae-912d-a690d269cbc4\") "
Sep 16 01:33:56.386060 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:56.386036    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e3babe3-bdbe-49ae-912d-a690d269cbc4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5e3babe3-bdbe-49ae-912d-a690d269cbc4" (UID: "5e3babe3-bdbe-49ae-912d-a690d269cbc4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:33:56.486872 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:56.486841    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e3babe3-bdbe-49ae-912d-a690d269cbc4-maas-api-service-ca\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:33:57.059627 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:57.059584    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ba321c07-svpb9"]
Sep 16 01:33:57.060058 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:57.060042    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e3babe3-bdbe-49ae-912d-a690d269cbc4" containerName="revoke-keys"
Sep 16 01:33:57.060109 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:57.060061    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e3babe3-bdbe-49ae-912d-a690d269cbc4" containerName="revoke-keys"
Sep 16 01:33:57.060196 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:57.060128    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e3babe3-bdbe-49ae-912d-a690d269cbc4" containerName="revoke-keys"
Sep 16 01:33:57.063218 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:57.063201    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ba321c07-svpb9"
Sep 16 01:33:57.070361 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:57.070311    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ba321c07-svpb9"]
Sep 16 01:33:57.150050 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:57.150011    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-033feb-gsrnn" event={"ID":"5e3babe3-bdbe-49ae-912d-a690d269cbc4","Type":"ContainerDied","Data":"bb4f41a1452f535052e82c634f76391eb4bb85bbfd705a55dd0dcf04fae02cea"}
Sep 16 01:33:57.150050 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:57.150048    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-033feb-gsrnn"
Sep 16 01:33:57.150248 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:57.150068    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bb4f41a1452f535052e82c634f76391eb4bb85bbfd705a55dd0dcf04fae02cea"
Sep 16 01:33:57.194126 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:57.194091    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c77d79d2-e152-4f78-8588-ea0d80323eb9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ba321c07-svpb9\" (UID: \"c77d79d2-e152-4f78-8588-ea0d80323eb9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ba321c07-svpb9"
Sep 16 01:33:57.295206 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:57.295166    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c77d79d2-e152-4f78-8588-ea0d80323eb9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ba321c07-svpb9\" (UID: \"c77d79d2-e152-4f78-8588-ea0d80323eb9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ba321c07-svpb9"
Sep 16 01:33:57.295819 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:57.295799    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c77d79d2-e152-4f78-8588-ea0d80323eb9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ba321c07-svpb9\" (UID: \"c77d79d2-e152-4f78-8588-ea0d80323eb9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ba321c07-svpb9"
Sep 16 01:33:57.374993 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:57.374893    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ba321c07-svpb9"
Sep 16 01:33:57.650884 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:57.650851    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ba321c07-svpb9"]
Sep 16 01:33:58.156408 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:58.156370    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ba321c07-svpb9" event={"ID":"c77d79d2-e152-4f78-8588-ea0d80323eb9","Type":"ContainerStarted","Data":"6547491b2f082f6f86d7db70559a1e69815bb3f8de933b54979299ef4995e155"}
Sep 16 01:33:58.156578 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:58.156428    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ba321c07-svpb9" event={"ID":"c77d79d2-e152-4f78-8588-ea0d80323eb9","Type":"ContainerStarted","Data":"fb5d0e3b0aa8253c8f1af6151b175d74237053f201340ea96bdd2b6caee0d857"}
Sep 16 01:33:58.170976 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:58.170921    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ba321c07-svpb9" podStartSLOduration=1.1709048 podStartE2EDuration="1.1709048s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:33:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:33:58.169452418 +0000 UTC m=+1087.492920994" watchObservedRunningTime="2026-09-16 01:33:58.1709048 +0000 UTC m=+1087.494373424"
Sep 16 01:33:59.164183 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:59.164146    2565 generic.go:356] "Generic (PLEG): container finished" podID="c77d79d2-e152-4f78-8588-ea0d80323eb9" containerID="6547491b2f082f6f86d7db70559a1e69815bb3f8de933b54979299ef4995e155" exitCode=0
Sep 16 01:33:59.169361 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:33:59.169310    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ba321c07-svpb9" event={"ID":"c77d79d2-e152-4f78-8588-ea0d80323eb9","Type":"ContainerDied","Data":"6547491b2f082f6f86d7db70559a1e69815bb3f8de933b54979299ef4995e155"}
Sep 16 01:34:00.310446 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:00.310414    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ba321c07-svpb9"
Sep 16 01:34:00.426549 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:00.426454    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c77d79d2-e152-4f78-8588-ea0d80323eb9-maas-api-service-ca\") pod \"c77d79d2-e152-4f78-8588-ea0d80323eb9\" (UID: \"c77d79d2-e152-4f78-8588-ea0d80323eb9\") "
Sep 16 01:34:00.426817 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:00.426794    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c77d79d2-e152-4f78-8588-ea0d80323eb9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c77d79d2-e152-4f78-8588-ea0d80323eb9" (UID: "c77d79d2-e152-4f78-8588-ea0d80323eb9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:34:00.527231 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:00.527196    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c77d79d2-e152-4f78-8588-ea0d80323eb9-maas-api-service-ca\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:34:01.175143 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:01.175111    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ba321c07-svpb9"
Sep 16 01:34:01.175319 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:01.175115    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ba321c07-svpb9" event={"ID":"c77d79d2-e152-4f78-8588-ea0d80323eb9","Type":"ContainerDied","Data":"fb5d0e3b0aa8253c8f1af6151b175d74237053f201340ea96bdd2b6caee0d857"}
Sep 16 01:34:01.175319 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:01.175255    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fb5d0e3b0aa8253c8f1af6151b175d74237053f201340ea96bdd2b6caee0d857"
Sep 16 01:34:04.510295 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:04.510258    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-033feb-6b45d795bc-n4t4k"]
Sep 16 01:34:04.510752 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:04.510512    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-033feb-6b45d795bc-n4t4k" podUID="b007ebbc-3582-4fa8-98f4-863a632f5777" containerName="payload-processing" containerID="cri-o://2861652b0f5177cf717d8baee2c38271b62b8c4f641b5c4d25a2cde8f7419d17" gracePeriod=30
Sep 16 01:34:04.663880 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:04.663836    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-033feb-gsrnn"]
Sep 16 01:34:04.669570 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:04.669536    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-033feb-gsrnn"]
Sep 16 01:34:04.775695 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:04.775624    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-033feb-6b45d795bc-n4t4k"
Sep 16 01:34:04.873225 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:04.873188    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvzmx\" (UniqueName: \"kubernetes.io/projected/b007ebbc-3582-4fa8-98f4-863a632f5777-kube-api-access-jvzmx\") pod \"b007ebbc-3582-4fa8-98f4-863a632f5777\" (UID: \"b007ebbc-3582-4fa8-98f4-863a632f5777\") "
Sep 16 01:34:04.873425 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:04.873238    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b007ebbc-3582-4fa8-98f4-863a632f5777-plugins-config-volume\") pod \"b007ebbc-3582-4fa8-98f4-863a632f5777\" (UID: \"b007ebbc-3582-4fa8-98f4-863a632f5777\") "
Sep 16 01:34:04.873842 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:04.873807    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b007ebbc-3582-4fa8-98f4-863a632f5777-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b007ebbc-3582-4fa8-98f4-863a632f5777" (UID: "b007ebbc-3582-4fa8-98f4-863a632f5777"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:34:04.875725 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:04.875691    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b007ebbc-3582-4fa8-98f4-863a632f5777-kube-api-access-jvzmx" (OuterVolumeSpecName: "kube-api-access-jvzmx") pod "b007ebbc-3582-4fa8-98f4-863a632f5777" (UID: "b007ebbc-3582-4fa8-98f4-863a632f5777"). InnerVolumeSpecName "kube-api-access-jvzmx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:34:04.974901 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:04.974854    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvzmx\" (UniqueName: \"kubernetes.io/projected/b007ebbc-3582-4fa8-98f4-863a632f5777-kube-api-access-jvzmx\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:34:04.974901 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:04.974889    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b007ebbc-3582-4fa8-98f4-863a632f5777-plugins-config-volume\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:34:05.172064 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:05.172024    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e3babe3-bdbe-49ae-912d-a690d269cbc4" path="/var/lib/kubelet/pods/5e3babe3-bdbe-49ae-912d-a690d269cbc4/volumes"
Sep 16 01:34:05.207638 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:05.207606    2565 generic.go:356] "Generic (PLEG): container finished" podID="b007ebbc-3582-4fa8-98f4-863a632f5777" containerID="2861652b0f5177cf717d8baee2c38271b62b8c4f641b5c4d25a2cde8f7419d17" exitCode=0
Sep 16 01:34:05.207817 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:05.207658    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-033feb-6b45d795bc-n4t4k"
Sep 16 01:34:05.207817 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:05.207678    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-033feb-6b45d795bc-n4t4k" event={"ID":"b007ebbc-3582-4fa8-98f4-863a632f5777","Type":"ContainerDied","Data":"2861652b0f5177cf717d8baee2c38271b62b8c4f641b5c4d25a2cde8f7419d17"}
Sep 16 01:34:05.207817 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:05.207724    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-033feb-6b45d795bc-n4t4k" event={"ID":"b007ebbc-3582-4fa8-98f4-863a632f5777","Type":"ContainerDied","Data":"0c213b54ef98b6a1665a59847aa88094a4b535e60e4489717db9d4f91a019530"}
Sep 16 01:34:05.207817 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:05.207750    2565 scope.go:117] "RemoveContainer" containerID="2861652b0f5177cf717d8baee2c38271b62b8c4f641b5c4d25a2cde8f7419d17"
Sep 16 01:34:05.217435 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:05.217411    2565 scope.go:117] "RemoveContainer" containerID="2861652b0f5177cf717d8baee2c38271b62b8c4f641b5c4d25a2cde8f7419d17"
Sep 16 01:34:05.217832 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:34:05.217806    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2861652b0f5177cf717d8baee2c38271b62b8c4f641b5c4d25a2cde8f7419d17\": container with ID starting with 2861652b0f5177cf717d8baee2c38271b62b8c4f641b5c4d25a2cde8f7419d17 not found: ID does not exist" containerID="2861652b0f5177cf717d8baee2c38271b62b8c4f641b5c4d25a2cde8f7419d17"
Sep 16 01:34:05.217927 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:05.217843    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2861652b0f5177cf717d8baee2c38271b62b8c4f641b5c4d25a2cde8f7419d17"} err="failed to get container status \"2861652b0f5177cf717d8baee2c38271b62b8c4f641b5c4d25a2cde8f7419d17\": rpc error: code = NotFound desc = could not find container \"2861652b0f5177cf717d8baee2c38271b62b8c4f641b5c4d25a2cde8f7419d17\": container with ID starting with 2861652b0f5177cf717d8baee2c38271b62b8c4f641b5c4d25a2cde8f7419d17 not found: ID does not exist"
Sep 16 01:34:05.227613 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:05.227559    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-033feb-6b45d795bc-n4t4k"]
Sep 16 01:34:05.227613 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:05.227623    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-033feb-6b45d795bc-n4t4k"]
Sep 16 01:34:07.170564 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:07.170527    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b007ebbc-3582-4fa8-98f4-863a632f5777" path="/var/lib/kubelet/pods/b007ebbc-3582-4fa8-98f4-863a632f5777/volumes"
Sep 16 01:34:07.975959 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:07.975909    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ba321c07-7fdbbd7cd6-v58tt"]
Sep 16 01:34:07.976214 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:07.976190    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-ba321c07-7fdbbd7cd6-v58tt" podUID="17f377cf-7484-4c6b-9202-4f6404d414a4" containerName="payload-pre-processing" containerID="cri-o://edab076641db5b004fa74c5e0681b772d43aca1360577bc319f23acf8d5a7a47" gracePeriod=30
Sep 16 01:34:08.113239 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:08.113203    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ba321c07-svpb9"]
Sep 16 01:34:08.116596 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:08.116560    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ba321c07-svpb9"]
Sep 16 01:34:08.238257 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:08.237949    2565 generic.go:356] "Generic (PLEG): container finished" podID="17f377cf-7484-4c6b-9202-4f6404d414a4" containerID="edab076641db5b004fa74c5e0681b772d43aca1360577bc319f23acf8d5a7a47" exitCode=0
Sep 16 01:34:08.238257 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:08.238106    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ba321c07-7fdbbd7cd6-v58tt" event={"ID":"17f377cf-7484-4c6b-9202-4f6404d414a4","Type":"ContainerDied","Data":"edab076641db5b004fa74c5e0681b772d43aca1360577bc319f23acf8d5a7a47"}
Sep 16 01:34:08.246965 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:08.246723    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp"]
Sep 16 01:34:08.247360 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:08.247187    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp" podUID="eca80ebc-f4cd-4ab0-8348-e3d54005d655" containerName="istio-proxy" containerID="cri-o://d94e99cd7a58873fabb51b19c0fc2ac13fb1123c1049d036e72c468f3e1ae126" gracePeriod=30
Sep 16 01:34:08.266907 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:08.266874    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ba321c07-7fdbbd7cd6-v58tt"
Sep 16 01:34:08.409307 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:08.409268    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-78tvb\" (UniqueName: \"kubernetes.io/projected/17f377cf-7484-4c6b-9202-4f6404d414a4-kube-api-access-78tvb\") pod \"17f377cf-7484-4c6b-9202-4f6404d414a4\" (UID: \"17f377cf-7484-4c6b-9202-4f6404d414a4\") "
Sep 16 01:34:08.409520 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:08.409387    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17f377cf-7484-4c6b-9202-4f6404d414a4-plugins-config-volume\") pod \"17f377cf-7484-4c6b-9202-4f6404d414a4\" (UID: \"17f377cf-7484-4c6b-9202-4f6404d414a4\") "
Sep 16 01:34:08.409768 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:08.409740    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17f377cf-7484-4c6b-9202-4f6404d414a4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "17f377cf-7484-4c6b-9202-4f6404d414a4" (UID: "17f377cf-7484-4c6b-9202-4f6404d414a4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:34:08.411527 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:08.411503    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17f377cf-7484-4c6b-9202-4f6404d414a4-kube-api-access-78tvb" (OuterVolumeSpecName: "kube-api-access-78tvb") pod "17f377cf-7484-4c6b-9202-4f6404d414a4" (UID: "17f377cf-7484-4c6b-9202-4f6404d414a4"). InnerVolumeSpecName "kube-api-access-78tvb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:34:08.510589 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:08.510490    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-78tvb\" (UniqueName: \"kubernetes.io/projected/17f377cf-7484-4c6b-9202-4f6404d414a4-kube-api-access-78tvb\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:34:08.510589 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:08.510517    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17f377cf-7484-4c6b-9202-4f6404d414a4-plugins-config-volume\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:34:08.706587 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:08.706548    2565 patch_prober.go:28] interesting pod/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 01:34:08.706756 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:08.706613    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp" podUID="eca80ebc-f4cd-4ab0-8348-e3d54005d655" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 01:34:09.172857 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:09.172817    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c77d79d2-e152-4f78-8588-ea0d80323eb9" path="/var/lib/kubelet/pods/c77d79d2-e152-4f78-8588-ea0d80323eb9/volumes"
Sep 16 01:34:09.235609 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:09.235570    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7"]
Sep 16 01:34:09.235998 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:09.235979    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c77d79d2-e152-4f78-8588-ea0d80323eb9" containerName="revoke-keys"
Sep 16 01:34:09.235998 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:09.235997    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c77d79d2-e152-4f78-8588-ea0d80323eb9" containerName="revoke-keys"
Sep 16 01:34:09.236142 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:09.236011    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b007ebbc-3582-4fa8-98f4-863a632f5777" containerName="payload-processing"
Sep 16 01:34:09.236142 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:09.236016    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b007ebbc-3582-4fa8-98f4-863a632f5777" containerName="payload-processing"
Sep 16 01:34:09.236142 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:09.236036    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17f377cf-7484-4c6b-9202-4f6404d414a4" containerName="payload-pre-processing"
Sep 16 01:34:09.236142 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:09.236042    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="17f377cf-7484-4c6b-9202-4f6404d414a4" containerName="payload-pre-processing"
Sep 16 01:34:09.236142 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:09.236123    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b007ebbc-3582-4fa8-98f4-863a632f5777" containerName="payload-processing"
Sep 16 01:34:09.236142 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:09.236136    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c77d79d2-e152-4f78-8588-ea0d80323eb9" containerName="revoke-keys"
Sep 16 01:34:09.236441 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:09.236150    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="17f377cf-7484-4c6b-9202-4f6404d414a4" containerName="payload-pre-processing"
Sep 16 01:34:09.239954 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:09.239931    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7"
Sep 16 01:34:09.242362 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:09.242303    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-3f6bf6aa-gw-openshift-default-dockercfg-854qh\""
Sep 16 01:34:09.245022 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:09.245004    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ba321c07-7fdbbd7cd6-v58tt"
Sep 16 01:34:09.245134 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:09.245041    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ba321c07-7fdbbd7cd6-v58tt" event={"ID":"17f377cf-7484-4c6b-9202-4f6404d414a4","Type":"ContainerDied","Data":"b9a7c094817be884766622534f94f973b5e2e6464e6391112ca8493962e87b28"}
Sep 16 01:34:09.245134 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:09.245100    2565 scope.go:117] "RemoveContainer" containerID="edab076641db5b004fa74c5e0681b772d43aca1360577bc319f23acf8d5a7a47"
Sep 16 01:34:09.250017 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:09.249992    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7"]
Sep 16 01:34:09.276490 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:09.276453    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ba321c07-7fdbbd7cd6-v58tt"]
Sep 16 01:34:09.280212 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:09.280184    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ba321c07-7fdbbd7cd6-v58tt"]
Sep 16 01:34:09.417957 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:09.417912    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f-workload-certs\") pod \"e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7\" (UID: \"1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f\") " pod="openshift-ingress/e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7"
Sep 16 01:34:09.418150 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:09.417992    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f-istio-envoy\") pod \"e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7\" (UID: \"1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f\") " pod="openshift-ingress/e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7"
Sep 16 01:34:09.418150 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:09.418014    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f-istiod-ca-cert\") pod \"e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7\" (UID: \"1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f\") " pod="openshift-ingress/e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7"
Sep 16 01:34:09.418150 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:09.418103    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f-istio-data\") pod \"e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7\" (UID: \"1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f\") " pod="openshift-ingress/e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7"
Sep 16 01:34:09.418261 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:09.418148    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f-workload-socket\") pod \"e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7\" (UID: \"1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f\") " pod="openshift-ingress/e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7"
Sep 16 01:34:09.418261 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:09.418176    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f-istio-token\") pod \"e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7\" (UID: \"1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f\") " pod="openshift-ingress/e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7"
Sep 16 01:34:09.418261 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:09.418210    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f-istio-podinfo\") pod \"e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7\" (UID: \"1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f\") " pod="openshift-ingress/e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7"
Sep 16 01:34:09.418261 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:09.418246    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f-credential-socket\") pod \"e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7\" (UID: \"1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f\") " pod="openshift-ingress/e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7"
Sep 16 01:34:09.418456 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:09.418275    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqqrk\" (UniqueName: \"kubernetes.io/projected/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f-kube-api-access-jqqrk\") pod \"e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7\" (UID: \"1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f\") " pod="openshift-ingress/e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7"
Sep 16 01:34:09.518981 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:09.518873    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f-istio-token\") pod \"e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7\" (UID: \"1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f\") " pod="openshift-ingress/e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7"
Sep 16 01:34:09.518981 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:09.518934    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f-istio-podinfo\") pod \"e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7\" (UID: \"1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f\") " pod="openshift-ingress/e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7"
Sep 16 01:34:09.518981 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:09.518957    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f-credential-socket\") pod \"e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7\" (UID: \"1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f\") " pod="openshift-ingress/e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7"
Sep 16 01:34:09.518981 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:09.518978    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqqrk\" (UniqueName: \"kubernetes.io/projected/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f-kube-api-access-jqqrk\") pod \"e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7\" (UID: \"1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f\") " pod="openshift-ingress/e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7"
Sep 16 01:34:09.519368 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:09.519157    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f-workload-certs\") pod \"e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7\" (UID: \"1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f\") " pod="openshift-ingress/e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7"
Sep 16 01:34:09.519368 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:09.519274    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f-istio-envoy\") pod \"e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7\" (UID: \"1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f\") " pod="openshift-ingress/e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7"
Sep 16 01:34:09.519368 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:09.519316    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f-istiod-ca-cert\") pod \"e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7\" (UID: \"1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f\") " pod="openshift-ingress/e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7"
Sep 16 01:34:09.519532 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:09.519454    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f-istio-data\") pod \"e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7\" (UID: \"1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f\") " pod="openshift-ingress/e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7"
Sep 16 01:34:09.519532 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:09.519488    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f-workload-socket\") pod \"e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7\" (UID: \"1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f\") " pod="openshift-ingress/e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7"
Sep 16 01:34:09.519532 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:09.519500    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f-credential-socket\") pod \"e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7\" (UID: \"1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f\") " pod="openshift-ingress/e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7"
Sep 16 01:34:09.519678 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:09.519547    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f-workload-certs\") pod \"e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7\" (UID: \"1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f\") " pod="openshift-ingress/e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7"
Sep 16 01:34:09.519869 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:09.519846    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f-istio-data\") pod \"e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7\" (UID: \"1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f\") " pod="openshift-ingress/e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7"
Sep 16 01:34:09.519945 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:09.519875    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f-workload-socket\") pod \"e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7\" (UID: \"1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f\") " pod="openshift-ingress/e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7"
Sep 16 01:34:09.520118 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:09.520098    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f-istiod-ca-cert\") pod \"e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7\" (UID: \"1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f\") " pod="openshift-ingress/e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7"
Sep 16 01:34:09.521567 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:09.521541    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f-istio-envoy\") pod \"e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7\" (UID: \"1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f\") " pod="openshift-ingress/e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7"
Sep 16 01:34:09.521848 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:09.521830    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f-istio-podinfo\") pod \"e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7\" (UID: \"1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f\") " pod="openshift-ingress/e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7"
Sep 16 01:34:09.527827 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:09.527788    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f-istio-token\") pod \"e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7\" (UID: \"1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f\") " pod="openshift-ingress/e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7"
Sep 16 01:34:09.527961 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:09.527939    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqqrk\" (UniqueName: \"kubernetes.io/projected/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f-kube-api-access-jqqrk\") pod \"e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7\" (UID: \"1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f\") " pod="openshift-ingress/e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7"
Sep 16 01:34:09.555582 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:09.555537    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7"
Sep 16 01:34:09.841600 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:09.841558    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7"]
Sep 16 01:34:09.843209 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:34:09.843177    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1746f0c3_ae1e_4f5e_bbfc_8e5ed286369f.slice/crio-bb6006a0fdeed37cf8cbc2af3586ebd44ecb48058348e642d8f0619cae4f9515 WatchSource:0}: Error finding container bb6006a0fdeed37cf8cbc2af3586ebd44ecb48058348e642d8f0619cae4f9515: Status 404 returned error can't find the container with id bb6006a0fdeed37cf8cbc2af3586ebd44ecb48058348e642d8f0619cae4f9515
Sep 16 01:34:09.845576 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:09.845534    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:34:09.845661 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:09.845609    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:34:09.845661 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:09.845638    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:34:10.254368 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:10.254315    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7" event={"ID":"1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f","Type":"ContainerStarted","Data":"8d5036ac6999212790a9a0adb09c98933da18a394c930628cd895389e8f8f95e"}
Sep 16 01:34:10.254803 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:10.254399    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7" event={"ID":"1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f","Type":"ContainerStarted","Data":"bb6006a0fdeed37cf8cbc2af3586ebd44ecb48058348e642d8f0619cae4f9515"}
Sep 16 01:34:10.274207 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:10.274147    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7" podStartSLOduration=1.274127746 podStartE2EDuration="1.274127746s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:34:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:34:10.272325515 +0000 UTC m=+1099.595794092" watchObservedRunningTime="2026-09-16 01:34:10.274127746 +0000 UTC m=+1099.597596377"
Sep 16 01:34:10.556596 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:10.556492    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7"
Sep 16 01:34:10.562610 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:10.562579    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7"
Sep 16 01:34:11.165891 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:11.165847    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-6cd864bc95-st4pq" secret="" err="secret \"payload-processing-dockercfg-kkbcm\" not found"
Sep 16 01:34:11.169704 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:11.169673    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17f377cf-7484-4c6b-9202-4f6404d414a4" path="/var/lib/kubelet/pods/17f377cf-7484-4c6b-9202-4f6404d414a4/volumes"
Sep 16 01:34:11.261768 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:11.261721    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7"
Sep 16 01:34:11.263271 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:11.263244    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7"
Sep 16 01:34:11.265478 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:11.265450    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597"]
Sep 16 01:34:11.265647 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:11.265626    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597" podUID="5b98f945-35b3-40f5-97d2-0b8d33e5bf48" containerName="istio-proxy" containerID="cri-o://a7ae9c62eed9990a4204711519b3a95eceeeed0079d83665dbf6370321bac9da" gracePeriod=30
Sep 16 01:34:11.635727 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:11.635640    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a58460-6k4dc"]
Sep 16 01:34:11.640386 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:11.640348    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a58460-6k4dc"
Sep 16 01:34:11.642949 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:11.642919    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4ljjd\""
Sep 16 01:34:11.643113 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:11.643088    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 01:34:11.645769 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:11.645740    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a58460-6k4dc"]
Sep 16 01:34:11.740726 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:11.740681    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fa36668-eb3d-412b-93a1-de5f4ac6697d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-a58460-6k4dc\" (UID: \"5fa36668-eb3d-412b-93a1-de5f4ac6697d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a58460-6k4dc"
Sep 16 01:34:11.841795 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:11.841754    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fa36668-eb3d-412b-93a1-de5f4ac6697d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-a58460-6k4dc\" (UID: \"5fa36668-eb3d-412b-93a1-de5f4ac6697d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a58460-6k4dc"
Sep 16 01:34:11.842438 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:11.842416    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fa36668-eb3d-412b-93a1-de5f4ac6697d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-a58460-6k4dc\" (UID: \"5fa36668-eb3d-412b-93a1-de5f4ac6697d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a58460-6k4dc"
Sep 16 01:34:11.953932 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:11.953894    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a58460-6k4dc"
Sep 16 01:34:12.232619 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:12.232575    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a58460-6k4dc"]
Sep 16 01:34:12.234392 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:34:12.234313    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fa36668_eb3d_412b_93a1_de5f4ac6697d.slice/crio-8b8f6f9ad95f136b9d64926bbb34c2112620f9b11b3c7c48eb2acc14dd1086b9 WatchSource:0}: Error finding container 8b8f6f9ad95f136b9d64926bbb34c2112620f9b11b3c7c48eb2acc14dd1086b9: Status 404 returned error can't find the container with id 8b8f6f9ad95f136b9d64926bbb34c2112620f9b11b3c7c48eb2acc14dd1086b9
Sep 16 01:34:12.267729 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:12.267694    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a58460-6k4dc" event={"ID":"5fa36668-eb3d-412b-93a1-de5f4ac6697d","Type":"ContainerStarted","Data":"8b8f6f9ad95f136b9d64926bbb34c2112620f9b11b3c7c48eb2acc14dd1086b9"}
Sep 16 01:34:13.276512 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:13.276478    2565 generic.go:356] "Generic (PLEG): container finished" podID="5fa36668-eb3d-412b-93a1-de5f4ac6697d" containerID="57059548cc01cebea823b3f6beca4f33f8ee5c47f370419fdb4330382bd14f6f" exitCode=0
Sep 16 01:34:13.276970 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:13.276565    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a58460-6k4dc" event={"ID":"5fa36668-eb3d-412b-93a1-de5f4ac6697d","Type":"ContainerDied","Data":"57059548cc01cebea823b3f6beca4f33f8ee5c47f370419fdb4330382bd14f6f"}
Sep 16 01:34:13.477864 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:13.477824    2565 patch_prober.go:28] interesting pod/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 01:34:13.478043 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:13.477894    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597" podUID="5b98f945-35b3-40f5-97d2-0b8d33e5bf48" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 01:34:13.517949 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:13.517870    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp"
Sep 16 01:34:13.559536 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:13.559500    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eca80ebc-f4cd-4ab0-8348-e3d54005d655-istio-data\") pod \"eca80ebc-f4cd-4ab0-8348-e3d54005d655\" (UID: \"eca80ebc-f4cd-4ab0-8348-e3d54005d655\") "
Sep 16 01:34:13.559759 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:13.559580    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eca80ebc-f4cd-4ab0-8348-e3d54005d655-istio-envoy\") pod \"eca80ebc-f4cd-4ab0-8348-e3d54005d655\" (UID: \"eca80ebc-f4cd-4ab0-8348-e3d54005d655\") "
Sep 16 01:34:13.559759 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:13.559656    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eca80ebc-f4cd-4ab0-8348-e3d54005d655-istiod-ca-cert\") pod \"eca80ebc-f4cd-4ab0-8348-e3d54005d655\" (UID: \"eca80ebc-f4cd-4ab0-8348-e3d54005d655\") "
Sep 16 01:34:13.559759 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:13.559685    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eca80ebc-f4cd-4ab0-8348-e3d54005d655-credential-socket\") pod \"eca80ebc-f4cd-4ab0-8348-e3d54005d655\" (UID: \"eca80ebc-f4cd-4ab0-8348-e3d54005d655\") "
Sep 16 01:34:13.559759 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:13.559722    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eca80ebc-f4cd-4ab0-8348-e3d54005d655-workload-socket\") pod \"eca80ebc-f4cd-4ab0-8348-e3d54005d655\" (UID: \"eca80ebc-f4cd-4ab0-8348-e3d54005d655\") "
Sep 16 01:34:13.559981 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:13.559785    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eca80ebc-f4cd-4ab0-8348-e3d54005d655-istio-data" (OuterVolumeSpecName: "istio-data") pod "eca80ebc-f4cd-4ab0-8348-e3d54005d655" (UID: "eca80ebc-f4cd-4ab0-8348-e3d54005d655"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:34:13.559981 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:13.559844    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eca80ebc-f4cd-4ab0-8348-e3d54005d655-istio-token\") pod \"eca80ebc-f4cd-4ab0-8348-e3d54005d655\" (UID: \"eca80ebc-f4cd-4ab0-8348-e3d54005d655\") "
Sep 16 01:34:13.559981 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:13.559869    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eca80ebc-f4cd-4ab0-8348-e3d54005d655-istio-podinfo\") pod \"eca80ebc-f4cd-4ab0-8348-e3d54005d655\" (UID: \"eca80ebc-f4cd-4ab0-8348-e3d54005d655\") "
Sep 16 01:34:13.559981 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:13.559900    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eca80ebc-f4cd-4ab0-8348-e3d54005d655-workload-certs\") pod \"eca80ebc-f4cd-4ab0-8348-e3d54005d655\" (UID: \"eca80ebc-f4cd-4ab0-8348-e3d54005d655\") "
Sep 16 01:34:13.559981 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:13.559958    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tq85c\" (UniqueName: \"kubernetes.io/projected/eca80ebc-f4cd-4ab0-8348-e3d54005d655-kube-api-access-tq85c\") pod \"eca80ebc-f4cd-4ab0-8348-e3d54005d655\" (UID: \"eca80ebc-f4cd-4ab0-8348-e3d54005d655\") "
Sep 16 01:34:13.560240 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:13.559998    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eca80ebc-f4cd-4ab0-8348-e3d54005d655-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "eca80ebc-f4cd-4ab0-8348-e3d54005d655" (UID: "eca80ebc-f4cd-4ab0-8348-e3d54005d655"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:34:13.560240 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:13.560012    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eca80ebc-f4cd-4ab0-8348-e3d54005d655-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "eca80ebc-f4cd-4ab0-8348-e3d54005d655" (UID: "eca80ebc-f4cd-4ab0-8348-e3d54005d655"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:34:13.560240 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:13.560095    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eca80ebc-f4cd-4ab0-8348-e3d54005d655-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "eca80ebc-f4cd-4ab0-8348-e3d54005d655" (UID: "eca80ebc-f4cd-4ab0-8348-e3d54005d655"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:34:13.560240 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:13.560203    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eca80ebc-f4cd-4ab0-8348-e3d54005d655-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "eca80ebc-f4cd-4ab0-8348-e3d54005d655" (UID: "eca80ebc-f4cd-4ab0-8348-e3d54005d655"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:34:13.560495 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:13.560385    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eca80ebc-f4cd-4ab0-8348-e3d54005d655-istiod-ca-cert\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:34:13.560495 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:13.560403    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eca80ebc-f4cd-4ab0-8348-e3d54005d655-credential-socket\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:34:13.560495 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:13.560417    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eca80ebc-f4cd-4ab0-8348-e3d54005d655-workload-socket\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:34:13.560495 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:13.560431    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eca80ebc-f4cd-4ab0-8348-e3d54005d655-workload-certs\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:34:13.560495 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:13.560444    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eca80ebc-f4cd-4ab0-8348-e3d54005d655-istio-data\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:34:13.562246 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:13.562213    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/eca80ebc-f4cd-4ab0-8348-e3d54005d655-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "eca80ebc-f4cd-4ab0-8348-e3d54005d655" (UID: "eca80ebc-f4cd-4ab0-8348-e3d54005d655"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 01:34:13.562477 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:13.562298    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eca80ebc-f4cd-4ab0-8348-e3d54005d655-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "eca80ebc-f4cd-4ab0-8348-e3d54005d655" (UID: "eca80ebc-f4cd-4ab0-8348-e3d54005d655"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:34:13.562543 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:13.562473    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eca80ebc-f4cd-4ab0-8348-e3d54005d655-istio-token" (OuterVolumeSpecName: "istio-token") pod "eca80ebc-f4cd-4ab0-8348-e3d54005d655" (UID: "eca80ebc-f4cd-4ab0-8348-e3d54005d655"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:34:13.562712 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:13.562696    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eca80ebc-f4cd-4ab0-8348-e3d54005d655-kube-api-access-tq85c" (OuterVolumeSpecName: "kube-api-access-tq85c") pod "eca80ebc-f4cd-4ab0-8348-e3d54005d655" (UID: "eca80ebc-f4cd-4ab0-8348-e3d54005d655"). InnerVolumeSpecName "kube-api-access-tq85c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:34:13.660926 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:13.660882    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eca80ebc-f4cd-4ab0-8348-e3d54005d655-istio-envoy\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:34:13.660926 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:13.660910    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eca80ebc-f4cd-4ab0-8348-e3d54005d655-istio-token\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:34:13.660926 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:13.660930    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eca80ebc-f4cd-4ab0-8348-e3d54005d655-istio-podinfo\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:34:13.660926 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:13.660940    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tq85c\" (UniqueName: \"kubernetes.io/projected/eca80ebc-f4cd-4ab0-8348-e3d54005d655-kube-api-access-tq85c\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:34:14.051266 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:14.051227    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-3f6bf6aa-77dd7f9bb-krzlw"]
Sep 16 01:34:14.051692 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:14.051676    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eca80ebc-f4cd-4ab0-8348-e3d54005d655" containerName="istio-proxy"
Sep 16 01:34:14.051740 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:14.051694    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="eca80ebc-f4cd-4ab0-8348-e3d54005d655" containerName="istio-proxy"
Sep 16 01:34:14.051740 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:14.051703    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eca80ebc-f4cd-4ab0-8348-e3d54005d655" containerName="istio-proxy"
Sep 16 01:34:14.051740 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:14.051708    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="eca80ebc-f4cd-4ab0-8348-e3d54005d655" containerName="istio-proxy"
Sep 16 01:34:14.051840 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:14.051781    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="eca80ebc-f4cd-4ab0-8348-e3d54005d655" containerName="istio-proxy"
Sep 16 01:34:14.051840 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:14.051790    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="eca80ebc-f4cd-4ab0-8348-e3d54005d655" containerName="istio-proxy"
Sep 16 01:34:14.055295 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:14.055268    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3f6bf6aa-77dd7f9bb-krzlw"
Sep 16 01:34:14.057967 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:14.057936    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-3f6bf6aa\""
Sep 16 01:34:14.058093 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:14.058014    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-3f6bf6aa-dockercfg-j89t8\""
Sep 16 01:34:14.069122 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:14.065458    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-3f6bf6aa-77dd7f9bb-krzlw"]
Sep 16 01:34:14.069122 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:14.065463    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7fa474b6-92b8-4fb8-917d-619a5cf878d1-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-3f6bf6aa-77dd7f9bb-krzlw\" (UID: \"7fa474b6-92b8-4fb8-917d-619a5cf878d1\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-3f6bf6aa-77dd7f9bb-krzlw"
Sep 16 01:34:14.069122 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:14.065635    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l28hm\" (UniqueName: \"kubernetes.io/projected/7fa474b6-92b8-4fb8-917d-619a5cf878d1-kube-api-access-l28hm\") pod \"payload-pre-processing-e2e-migrate-3f6bf6aa-77dd7f9bb-krzlw\" (UID: \"7fa474b6-92b8-4fb8-917d-619a5cf878d1\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-3f6bf6aa-77dd7f9bb-krzlw"
Sep 16 01:34:14.094809 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:14.094757    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-3f6bf6aa-7bf779f9cd-m5scq"]
Sep 16 01:34:14.098452 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:14.098414    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-3f6bf6aa-7bf779f9cd-m5scq"
Sep 16 01:34:14.106681 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:14.106637    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-3f6bf6aa-7bf779f9cd-m5scq"]
Sep 16 01:34:14.167861 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:14.166607    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqw26\" (UniqueName: \"kubernetes.io/projected/6b28d11d-1df3-4483-84f7-e9d596437583-kube-api-access-tqw26\") pod \"payload-processing-e2e-migrate-3f6bf6aa-7bf779f9cd-m5scq\" (UID: \"6b28d11d-1df3-4483-84f7-e9d596437583\") " pod="openshift-ingress/payload-processing-e2e-migrate-3f6bf6aa-7bf779f9cd-m5scq"
Sep 16 01:34:14.167861 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:14.166720    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7fa474b6-92b8-4fb8-917d-619a5cf878d1-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-3f6bf6aa-77dd7f9bb-krzlw\" (UID: \"7fa474b6-92b8-4fb8-917d-619a5cf878d1\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-3f6bf6aa-77dd7f9bb-krzlw"
Sep 16 01:34:14.167861 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:14.166767    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l28hm\" (UniqueName: \"kubernetes.io/projected/7fa474b6-92b8-4fb8-917d-619a5cf878d1-kube-api-access-l28hm\") pod \"payload-pre-processing-e2e-migrate-3f6bf6aa-77dd7f9bb-krzlw\" (UID: \"7fa474b6-92b8-4fb8-917d-619a5cf878d1\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-3f6bf6aa-77dd7f9bb-krzlw"
Sep 16 01:34:14.167861 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:14.166812    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b28d11d-1df3-4483-84f7-e9d596437583-plugins-config-volume\") pod \"payload-processing-e2e-migrate-3f6bf6aa-7bf779f9cd-m5scq\" (UID: \"6b28d11d-1df3-4483-84f7-e9d596437583\") " pod="openshift-ingress/payload-processing-e2e-migrate-3f6bf6aa-7bf779f9cd-m5scq"
Sep 16 01:34:14.168274 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:14.167899    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7fa474b6-92b8-4fb8-917d-619a5cf878d1-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-3f6bf6aa-77dd7f9bb-krzlw\" (UID: \"7fa474b6-92b8-4fb8-917d-619a5cf878d1\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-3f6bf6aa-77dd7f9bb-krzlw"
Sep 16 01:34:14.176353 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:14.176306    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l28hm\" (UniqueName: \"kubernetes.io/projected/7fa474b6-92b8-4fb8-917d-619a5cf878d1-kube-api-access-l28hm\") pod \"payload-pre-processing-e2e-migrate-3f6bf6aa-77dd7f9bb-krzlw\" (UID: \"7fa474b6-92b8-4fb8-917d-619a5cf878d1\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-3f6bf6aa-77dd7f9bb-krzlw"
Sep 16 01:34:14.267303 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:14.267265    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqw26\" (UniqueName: \"kubernetes.io/projected/6b28d11d-1df3-4483-84f7-e9d596437583-kube-api-access-tqw26\") pod \"payload-processing-e2e-migrate-3f6bf6aa-7bf779f9cd-m5scq\" (UID: \"6b28d11d-1df3-4483-84f7-e9d596437583\") " pod="openshift-ingress/payload-processing-e2e-migrate-3f6bf6aa-7bf779f9cd-m5scq"
Sep 16 01:34:14.267544 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:14.267383    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b28d11d-1df3-4483-84f7-e9d596437583-plugins-config-volume\") pod \"payload-processing-e2e-migrate-3f6bf6aa-7bf779f9cd-m5scq\" (UID: \"6b28d11d-1df3-4483-84f7-e9d596437583\") " pod="openshift-ingress/payload-processing-e2e-migrate-3f6bf6aa-7bf779f9cd-m5scq"
Sep 16 01:34:14.268119 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:14.268099    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b28d11d-1df3-4483-84f7-e9d596437583-plugins-config-volume\") pod \"payload-processing-e2e-migrate-3f6bf6aa-7bf779f9cd-m5scq\" (UID: \"6b28d11d-1df3-4483-84f7-e9d596437583\") " pod="openshift-ingress/payload-processing-e2e-migrate-3f6bf6aa-7bf779f9cd-m5scq"
Sep 16 01:34:14.275234 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:14.275201    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqw26\" (UniqueName: \"kubernetes.io/projected/6b28d11d-1df3-4483-84f7-e9d596437583-kube-api-access-tqw26\") pod \"payload-processing-e2e-migrate-3f6bf6aa-7bf779f9cd-m5scq\" (UID: \"6b28d11d-1df3-4483-84f7-e9d596437583\") " pod="openshift-ingress/payload-processing-e2e-migrate-3f6bf6aa-7bf779f9cd-m5scq"
Sep 16 01:34:14.285929 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:14.285895    2565 generic.go:356] "Generic (PLEG): container finished" podID="eca80ebc-f4cd-4ab0-8348-e3d54005d655" containerID="d94e99cd7a58873fabb51b19c0fc2ac13fb1123c1049d036e72c468f3e1ae126" exitCode=0
Sep 16 01:34:14.286449 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:14.285956    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp"
Sep 16 01:34:14.286449 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:14.285971    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp" event={"ID":"eca80ebc-f4cd-4ab0-8348-e3d54005d655","Type":"ContainerDied","Data":"d94e99cd7a58873fabb51b19c0fc2ac13fb1123c1049d036e72c468f3e1ae126"}
Sep 16 01:34:14.286449 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:14.286046    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp" event={"ID":"eca80ebc-f4cd-4ab0-8348-e3d54005d655","Type":"ContainerDied","Data":"d9641855088f7a59ae8c7e418b695c296415367d0cd8c4b444c6313636491755"}
Sep 16 01:34:14.286449 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:14.286081    2565 scope.go:117] "RemoveContainer" containerID="d94e99cd7a58873fabb51b19c0fc2ac13fb1123c1049d036e72c468f3e1ae126"
Sep 16 01:34:14.299371 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:14.299312    2565 scope.go:117] "RemoveContainer" containerID="26251c3076b72cafeab34ac51bb215a208cca0e87ad2ac2d38f1a2a7f1758daa"
Sep 16 01:34:14.311194 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:14.311164    2565 scope.go:117] "RemoveContainer" containerID="d94e99cd7a58873fabb51b19c0fc2ac13fb1123c1049d036e72c468f3e1ae126"
Sep 16 01:34:14.311590 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:14.311546    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp"]
Sep 16 01:34:14.312374 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:34:14.312322    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d94e99cd7a58873fabb51b19c0fc2ac13fb1123c1049d036e72c468f3e1ae126\": container with ID starting with d94e99cd7a58873fabb51b19c0fc2ac13fb1123c1049d036e72c468f3e1ae126 not found: ID does not exist" containerID="d94e99cd7a58873fabb51b19c0fc2ac13fb1123c1049d036e72c468f3e1ae126"
Sep 16 01:34:14.312483 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:14.312379    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d94e99cd7a58873fabb51b19c0fc2ac13fb1123c1049d036e72c468f3e1ae126"} err="failed to get container status \"d94e99cd7a58873fabb51b19c0fc2ac13fb1123c1049d036e72c468f3e1ae126\": rpc error: code = NotFound desc = could not find container \"d94e99cd7a58873fabb51b19c0fc2ac13fb1123c1049d036e72c468f3e1ae126\": container with ID starting with d94e99cd7a58873fabb51b19c0fc2ac13fb1123c1049d036e72c468f3e1ae126 not found: ID does not exist"
Sep 16 01:34:14.312483 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:14.312408    2565 scope.go:117] "RemoveContainer" containerID="26251c3076b72cafeab34ac51bb215a208cca0e87ad2ac2d38f1a2a7f1758daa"
Sep 16 01:34:14.312778 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:34:14.312753    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26251c3076b72cafeab34ac51bb215a208cca0e87ad2ac2d38f1a2a7f1758daa\": container with ID starting with 26251c3076b72cafeab34ac51bb215a208cca0e87ad2ac2d38f1a2a7f1758daa not found: ID does not exist" containerID="26251c3076b72cafeab34ac51bb215a208cca0e87ad2ac2d38f1a2a7f1758daa"
Sep 16 01:34:14.312856 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:14.312787    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26251c3076b72cafeab34ac51bb215a208cca0e87ad2ac2d38f1a2a7f1758daa"} err="failed to get container status \"26251c3076b72cafeab34ac51bb215a208cca0e87ad2ac2d38f1a2a7f1758daa\": rpc error: code = NotFound desc = could not find container \"26251c3076b72cafeab34ac51bb215a208cca0e87ad2ac2d38f1a2a7f1758daa\": container with ID starting with 26251c3076b72cafeab34ac51bb215a208cca0e87ad2ac2d38f1a2a7f1758daa not found: ID does not exist"
Sep 16 01:34:14.315422 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:14.315392    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp"]
Sep 16 01:34:14.321101 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:34:14.321058    2565 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeca80ebc_f4cd_4ab0_8348_e3d54005d655.slice\": RecentStats: unable to find data in memory cache]"
Sep 16 01:34:14.372972 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:14.372929    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3f6bf6aa-77dd7f9bb-krzlw"
Sep 16 01:34:14.412378 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:14.412306    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-3f6bf6aa-7bf779f9cd-m5scq"
Sep 16 01:34:14.430027 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:14.429981    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a58460-6k4dc"
Sep 16 01:34:14.469149 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:14.469106    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fa36668-eb3d-412b-93a1-de5f4ac6697d-maas-api-service-ca\") pod \"5fa36668-eb3d-412b-93a1-de5f4ac6697d\" (UID: \"5fa36668-eb3d-412b-93a1-de5f4ac6697d\") "
Sep 16 01:34:14.469652 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:14.469617    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fa36668-eb3d-412b-93a1-de5f4ac6697d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5fa36668-eb3d-412b-93a1-de5f4ac6697d" (UID: "5fa36668-eb3d-412b-93a1-de5f4ac6697d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:34:14.469818 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:14.469795    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fa36668-eb3d-412b-93a1-de5f4ac6697d-maas-api-service-ca\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:34:14.658894 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:14.658865    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-3f6bf6aa-77dd7f9bb-krzlw"]
Sep 16 01:34:14.660970 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:34:14.660931    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fa474b6_92b8_4fb8_917d_619a5cf878d1.slice/crio-e0a371f019d24b575b9d8b72a820c710584af7127c908240b89f79b77152251f WatchSource:0}: Error finding container e0a371f019d24b575b9d8b72a820c710584af7127c908240b89f79b77152251f: Status 404 returned error can't find the container with id e0a371f019d24b575b9d8b72a820c710584af7127c908240b89f79b77152251f
Sep 16 01:34:14.705075 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:14.705045    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-3f6bf6aa-7bf779f9cd-m5scq"]
Sep 16 01:34:14.723391 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:34:14.723363    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b28d11d_1df3_4483_84f7_e9d596437583.slice/crio-b01be0091393657bfa386c0769971e87d4e2df37dba91798385437b5079eeaf4 WatchSource:0}: Error finding container b01be0091393657bfa386c0769971e87d4e2df37dba91798385437b5079eeaf4: Status 404 returned error can't find the container with id b01be0091393657bfa386c0769971e87d4e2df37dba91798385437b5079eeaf4
Sep 16 01:34:15.170877 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:15.170841    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eca80ebc-f4cd-4ab0-8348-e3d54005d655" path="/var/lib/kubelet/pods/eca80ebc-f4cd-4ab0-8348-e3d54005d655/volumes"
Sep 16 01:34:15.295102 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:15.295063    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a58460-6k4dc"
Sep 16 01:34:15.295590 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:15.295101    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a58460-6k4dc" event={"ID":"5fa36668-eb3d-412b-93a1-de5f4ac6697d","Type":"ContainerDied","Data":"8b8f6f9ad95f136b9d64926bbb34c2112620f9b11b3c7c48eb2acc14dd1086b9"}
Sep 16 01:34:15.295590 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:15.295166    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8b8f6f9ad95f136b9d64926bbb34c2112620f9b11b3c7c48eb2acc14dd1086b9"
Sep 16 01:34:15.298465 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:15.298433    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-3f6bf6aa-7bf779f9cd-m5scq" event={"ID":"6b28d11d-1df3-4483-84f7-e9d596437583","Type":"ContainerStarted","Data":"e029dbbb04987af68bd4c3d871fe2f3c71ea9b8c8b66f8a6673a53f51e72c511"}
Sep 16 01:34:15.298637 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:15.298485    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-3f6bf6aa-7bf779f9cd-m5scq" event={"ID":"6b28d11d-1df3-4483-84f7-e9d596437583","Type":"ContainerStarted","Data":"b01be0091393657bfa386c0769971e87d4e2df37dba91798385437b5079eeaf4"}
Sep 16 01:34:15.298637 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:15.298517    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-3f6bf6aa-7bf779f9cd-m5scq"
Sep 16 01:34:15.299986 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:15.299958    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3f6bf6aa-77dd7f9bb-krzlw" event={"ID":"7fa474b6-92b8-4fb8-917d-619a5cf878d1","Type":"ContainerStarted","Data":"cf1ff703ec7373231d399404c376daf8c011fc9bd7adad809ec25f637497bfce"}
Sep 16 01:34:15.300104 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:15.299997    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3f6bf6aa-77dd7f9bb-krzlw" event={"ID":"7fa474b6-92b8-4fb8-917d-619a5cf878d1","Type":"ContainerStarted","Data":"e0a371f019d24b575b9d8b72a820c710584af7127c908240b89f79b77152251f"}
Sep 16 01:34:15.300104 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:15.300026    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3f6bf6aa-77dd7f9bb-krzlw"
Sep 16 01:34:15.316145 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:15.316025    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-3f6bf6aa-7bf779f9cd-m5scq" podStartSLOduration=1.316004731 podStartE2EDuration="1.316004731s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:34:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:34:15.314717293 +0000 UTC m=+1104.638185895" watchObservedRunningTime="2026-09-16 01:34:15.316004731 +0000 UTC m=+1104.639473308"
Sep 16 01:34:15.330428 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:15.330362    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3f6bf6aa-77dd7f9bb-krzlw" podStartSLOduration=1.33033003 podStartE2EDuration="1.33033003s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:34:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:34:15.328183727 +0000 UTC m=+1104.651652305" watchObservedRunningTime="2026-09-16 01:34:15.33033003 +0000 UTC m=+1104.653798606"
Sep 16 01:34:16.526230 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:16.526196    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597"
Sep 16 01:34:16.593522 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:16.593421    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b98f945-35b3-40f5-97d2-0b8d33e5bf48-workload-socket\") pod \"5b98f945-35b3-40f5-97d2-0b8d33e5bf48\" (UID: \"5b98f945-35b3-40f5-97d2-0b8d33e5bf48\") "
Sep 16 01:34:16.593522 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:16.593474    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b98f945-35b3-40f5-97d2-0b8d33e5bf48-workload-certs\") pod \"5b98f945-35b3-40f5-97d2-0b8d33e5bf48\" (UID: \"5b98f945-35b3-40f5-97d2-0b8d33e5bf48\") "
Sep 16 01:34:16.593732 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:16.593574    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b98f945-35b3-40f5-97d2-0b8d33e5bf48-istio-data\") pod \"5b98f945-35b3-40f5-97d2-0b8d33e5bf48\" (UID: \"5b98f945-35b3-40f5-97d2-0b8d33e5bf48\") "
Sep 16 01:34:16.593732 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:16.593600    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b98f945-35b3-40f5-97d2-0b8d33e5bf48-istio-envoy\") pod \"5b98f945-35b3-40f5-97d2-0b8d33e5bf48\" (UID: \"5b98f945-35b3-40f5-97d2-0b8d33e5bf48\") "
Sep 16 01:34:16.593732 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:16.593664    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxnqq\" (UniqueName: \"kubernetes.io/projected/5b98f945-35b3-40f5-97d2-0b8d33e5bf48-kube-api-access-sxnqq\") pod \"5b98f945-35b3-40f5-97d2-0b8d33e5bf48\" (UID: \"5b98f945-35b3-40f5-97d2-0b8d33e5bf48\") "
Sep 16 01:34:16.593895 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:16.593774    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b98f945-35b3-40f5-97d2-0b8d33e5bf48-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5b98f945-35b3-40f5-97d2-0b8d33e5bf48" (UID: "5b98f945-35b3-40f5-97d2-0b8d33e5bf48"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:34:16.593895 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:16.593779    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b98f945-35b3-40f5-97d2-0b8d33e5bf48-credential-socket\") pod \"5b98f945-35b3-40f5-97d2-0b8d33e5bf48\" (UID: \"5b98f945-35b3-40f5-97d2-0b8d33e5bf48\") "
Sep 16 01:34:16.593895 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:16.593813    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b98f945-35b3-40f5-97d2-0b8d33e5bf48-istio-token\") pod \"5b98f945-35b3-40f5-97d2-0b8d33e5bf48\" (UID: \"5b98f945-35b3-40f5-97d2-0b8d33e5bf48\") "
Sep 16 01:34:16.593895 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:16.593829    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b98f945-35b3-40f5-97d2-0b8d33e5bf48-istio-data" (OuterVolumeSpecName: "istio-data") pod "5b98f945-35b3-40f5-97d2-0b8d33e5bf48" (UID: "5b98f945-35b3-40f5-97d2-0b8d33e5bf48"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:34:16.593895 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:16.593852    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b98f945-35b3-40f5-97d2-0b8d33e5bf48-istiod-ca-cert\") pod \"5b98f945-35b3-40f5-97d2-0b8d33e5bf48\" (UID: \"5b98f945-35b3-40f5-97d2-0b8d33e5bf48\") "
Sep 16 01:34:16.593895 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:16.593884    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b98f945-35b3-40f5-97d2-0b8d33e5bf48-istio-podinfo\") pod \"5b98f945-35b3-40f5-97d2-0b8d33e5bf48\" (UID: \"5b98f945-35b3-40f5-97d2-0b8d33e5bf48\") "
Sep 16 01:34:16.594186 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:16.593908    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b98f945-35b3-40f5-97d2-0b8d33e5bf48-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5b98f945-35b3-40f5-97d2-0b8d33e5bf48" (UID: "5b98f945-35b3-40f5-97d2-0b8d33e5bf48"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:34:16.594186 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:16.594012    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b98f945-35b3-40f5-97d2-0b8d33e5bf48-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5b98f945-35b3-40f5-97d2-0b8d33e5bf48" (UID: "5b98f945-35b3-40f5-97d2-0b8d33e5bf48"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:34:16.594283 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:16.594233    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b98f945-35b3-40f5-97d2-0b8d33e5bf48-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5b98f945-35b3-40f5-97d2-0b8d33e5bf48" (UID: "5b98f945-35b3-40f5-97d2-0b8d33e5bf48"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:34:16.594283 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:16.594262    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b98f945-35b3-40f5-97d2-0b8d33e5bf48-workload-certs\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:34:16.594283 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:16.594283    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b98f945-35b3-40f5-97d2-0b8d33e5bf48-istio-data\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:34:16.594481 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:16.594296    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b98f945-35b3-40f5-97d2-0b8d33e5bf48-credential-socket\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:34:16.594481 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:16.594310    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b98f945-35b3-40f5-97d2-0b8d33e5bf48-workload-socket\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:34:16.596111 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:16.596086    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b98f945-35b3-40f5-97d2-0b8d33e5bf48-kube-api-access-sxnqq" (OuterVolumeSpecName: "kube-api-access-sxnqq") pod "5b98f945-35b3-40f5-97d2-0b8d33e5bf48" (UID: "5b98f945-35b3-40f5-97d2-0b8d33e5bf48"). InnerVolumeSpecName "kube-api-access-sxnqq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:34:16.596245 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:16.596129    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b98f945-35b3-40f5-97d2-0b8d33e5bf48-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5b98f945-35b3-40f5-97d2-0b8d33e5bf48" (UID: "5b98f945-35b3-40f5-97d2-0b8d33e5bf48"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:34:16.596245 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:16.596155    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b98f945-35b3-40f5-97d2-0b8d33e5bf48-istio-token" (OuterVolumeSpecName: "istio-token") pod "5b98f945-35b3-40f5-97d2-0b8d33e5bf48" (UID: "5b98f945-35b3-40f5-97d2-0b8d33e5bf48"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:34:16.596245 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:16.596174    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5b98f945-35b3-40f5-97d2-0b8d33e5bf48-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5b98f945-35b3-40f5-97d2-0b8d33e5bf48" (UID: "5b98f945-35b3-40f5-97d2-0b8d33e5bf48"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 01:34:16.695425 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:16.695379    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b98f945-35b3-40f5-97d2-0b8d33e5bf48-istio-envoy\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:34:16.695425 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:16.695412    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxnqq\" (UniqueName: \"kubernetes.io/projected/5b98f945-35b3-40f5-97d2-0b8d33e5bf48-kube-api-access-sxnqq\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:34:16.695425 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:16.695423    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b98f945-35b3-40f5-97d2-0b8d33e5bf48-istio-token\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:34:16.695425 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:16.695431    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b98f945-35b3-40f5-97d2-0b8d33e5bf48-istiod-ca-cert\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:34:16.695425 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:16.695439    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b98f945-35b3-40f5-97d2-0b8d33e5bf48-istio-podinfo\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:34:17.312944 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:17.312902    2565 generic.go:356] "Generic (PLEG): container finished" podID="5b98f945-35b3-40f5-97d2-0b8d33e5bf48" containerID="a7ae9c62eed9990a4204711519b3a95eceeeed0079d83665dbf6370321bac9da" exitCode=0
Sep 16 01:34:17.313122 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:17.312961    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597"
Sep 16 01:34:17.313122 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:17.312982    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597" event={"ID":"5b98f945-35b3-40f5-97d2-0b8d33e5bf48","Type":"ContainerDied","Data":"a7ae9c62eed9990a4204711519b3a95eceeeed0079d83665dbf6370321bac9da"}
Sep 16 01:34:17.313122 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:17.313044    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597" event={"ID":"5b98f945-35b3-40f5-97d2-0b8d33e5bf48","Type":"ContainerDied","Data":"eec5a563b6ea68d3afc4c0d3c1ff8d1cc1d12c2d1b8f87c346a4f596b10b9903"}
Sep 16 01:34:17.313122 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:17.313069    2565 scope.go:117] "RemoveContainer" containerID="a7ae9c62eed9990a4204711519b3a95eceeeed0079d83665dbf6370321bac9da"
Sep 16 01:34:17.322720 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:17.322702    2565 scope.go:117] "RemoveContainer" containerID="c345657fa52c7bb6686acc0a10432ff66409f70d02354dfdf5990a3e4e1b6ed5"
Sep 16 01:34:17.330187 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:17.330156    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597"]
Sep 16 01:34:17.331833 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:17.331809    2565 scope.go:117] "RemoveContainer" containerID="a7ae9c62eed9990a4204711519b3a95eceeeed0079d83665dbf6370321bac9da"
Sep 16 01:34:17.332199 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:34:17.332177    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7ae9c62eed9990a4204711519b3a95eceeeed0079d83665dbf6370321bac9da\": container with ID starting with a7ae9c62eed9990a4204711519b3a95eceeeed0079d83665dbf6370321bac9da not found: ID does not exist" containerID="a7ae9c62eed9990a4204711519b3a95eceeeed0079d83665dbf6370321bac9da"
Sep 16 01:34:17.332289 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:17.332214    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7ae9c62eed9990a4204711519b3a95eceeeed0079d83665dbf6370321bac9da"} err="failed to get container status \"a7ae9c62eed9990a4204711519b3a95eceeeed0079d83665dbf6370321bac9da\": rpc error: code = NotFound desc = could not find container \"a7ae9c62eed9990a4204711519b3a95eceeeed0079d83665dbf6370321bac9da\": container with ID starting with a7ae9c62eed9990a4204711519b3a95eceeeed0079d83665dbf6370321bac9da not found: ID does not exist"
Sep 16 01:34:17.332289 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:17.332241    2565 scope.go:117] "RemoveContainer" containerID="c345657fa52c7bb6686acc0a10432ff66409f70d02354dfdf5990a3e4e1b6ed5"
Sep 16 01:34:17.332558 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:34:17.332540    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c345657fa52c7bb6686acc0a10432ff66409f70d02354dfdf5990a3e4e1b6ed5\": container with ID starting with c345657fa52c7bb6686acc0a10432ff66409f70d02354dfdf5990a3e4e1b6ed5 not found: ID does not exist" containerID="c345657fa52c7bb6686acc0a10432ff66409f70d02354dfdf5990a3e4e1b6ed5"
Sep 16 01:34:17.332597 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:17.332564    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c345657fa52c7bb6686acc0a10432ff66409f70d02354dfdf5990a3e4e1b6ed5"} err="failed to get container status \"c345657fa52c7bb6686acc0a10432ff66409f70d02354dfdf5990a3e4e1b6ed5\": rpc error: code = NotFound desc = could not find container \"c345657fa52c7bb6686acc0a10432ff66409f70d02354dfdf5990a3e4e1b6ed5\": container with ID starting with c345657fa52c7bb6686acc0a10432ff66409f70d02354dfdf5990a3e4e1b6ed5 not found: ID does not exist"
Sep 16 01:34:17.334019 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:17.333985    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597"]
Sep 16 01:34:19.170152 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:19.170114    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b98f945-35b3-40f5-97d2-0b8d33e5bf48" path="/var/lib/kubelet/pods/5b98f945-35b3-40f5-97d2-0b8d33e5bf48/volumes"
Sep 16 01:34:22.454548 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:22.454503    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a58460-6k4dc"]
Sep 16 01:34:22.456543 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:22.456514    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a58460-6k4dc"]
Sep 16 01:34:23.169417 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:23.169383    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fa36668-eb3d-412b-93a1-de5f4ac6697d" path="/var/lib/kubelet/pods/5fa36668-eb3d-412b-93a1-de5f4ac6697d/volumes"
Sep 16 01:34:26.308421 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:26.308382    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3f6bf6aa-77dd7f9bb-krzlw"
Sep 16 01:34:26.308832 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:26.308537    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-3f6bf6aa-7bf779f9cd-m5scq"
Sep 16 01:34:37.563486 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:37.563453    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-3f6bf6aa-7bf779f9cd-m5scq"]
Sep 16 01:34:37.564005 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:37.563671    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-3f6bf6aa-7bf779f9cd-m5scq" podUID="6b28d11d-1df3-4483-84f7-e9d596437583" containerName="payload-processing" containerID="cri-o://e029dbbb04987af68bd4c3d871fe2f3c71ea9b8c8b66f8a6673a53f51e72c511" gracePeriod=30
Sep 16 01:34:37.577508 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:37.576972    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-3f6bf6aa-77dd7f9bb-krzlw"]
Sep 16 01:34:37.579824 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:37.578052    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3f6bf6aa-77dd7f9bb-krzlw" podUID="7fa474b6-92b8-4fb8-917d-619a5cf878d1" containerName="payload-pre-processing" containerID="cri-o://cf1ff703ec7373231d399404c376daf8c011fc9bd7adad809ec25f637497bfce" gracePeriod=30
Sep 16 01:34:37.858300 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:37.858264    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7"]
Sep 16 01:34:37.858553 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:37.858520    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7" podUID="1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f" containerName="istio-proxy" containerID="cri-o://8d5036ac6999212790a9a0adb09c98933da18a394c930628cd895389e8f8f95e" gracePeriod=30
Sep 16 01:34:37.879178 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:37.879149    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-3f6bf6aa-7bf779f9cd-m5scq"
Sep 16 01:34:37.881981 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:37.881958    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3f6bf6aa-77dd7f9bb-krzlw"
Sep 16 01:34:38.004291 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.004259    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7fa474b6-92b8-4fb8-917d-619a5cf878d1-plugins-config-volume\") pod \"7fa474b6-92b8-4fb8-917d-619a5cf878d1\" (UID: \"7fa474b6-92b8-4fb8-917d-619a5cf878d1\") "
Sep 16 01:34:38.004506 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.004309    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l28hm\" (UniqueName: \"kubernetes.io/projected/7fa474b6-92b8-4fb8-917d-619a5cf878d1-kube-api-access-l28hm\") pod \"7fa474b6-92b8-4fb8-917d-619a5cf878d1\" (UID: \"7fa474b6-92b8-4fb8-917d-619a5cf878d1\") "
Sep 16 01:34:38.004506 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.004329    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqw26\" (UniqueName: \"kubernetes.io/projected/6b28d11d-1df3-4483-84f7-e9d596437583-kube-api-access-tqw26\") pod \"6b28d11d-1df3-4483-84f7-e9d596437583\" (UID: \"6b28d11d-1df3-4483-84f7-e9d596437583\") "
Sep 16 01:34:38.004506 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.004381    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b28d11d-1df3-4483-84f7-e9d596437583-plugins-config-volume\") pod \"6b28d11d-1df3-4483-84f7-e9d596437583\" (UID: \"6b28d11d-1df3-4483-84f7-e9d596437583\") "
Sep 16 01:34:38.004798 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.004764    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7fa474b6-92b8-4fb8-917d-619a5cf878d1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7fa474b6-92b8-4fb8-917d-619a5cf878d1" (UID: "7fa474b6-92b8-4fb8-917d-619a5cf878d1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:34:38.004944 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.004811    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b28d11d-1df3-4483-84f7-e9d596437583-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6b28d11d-1df3-4483-84f7-e9d596437583" (UID: "6b28d11d-1df3-4483-84f7-e9d596437583"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:34:38.006627 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.006598    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fa474b6-92b8-4fb8-917d-619a5cf878d1-kube-api-access-l28hm" (OuterVolumeSpecName: "kube-api-access-l28hm") pod "7fa474b6-92b8-4fb8-917d-619a5cf878d1" (UID: "7fa474b6-92b8-4fb8-917d-619a5cf878d1"). InnerVolumeSpecName "kube-api-access-l28hm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:34:38.006697 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.006602    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b28d11d-1df3-4483-84f7-e9d596437583-kube-api-access-tqw26" (OuterVolumeSpecName: "kube-api-access-tqw26") pod "6b28d11d-1df3-4483-84f7-e9d596437583" (UID: "6b28d11d-1df3-4483-84f7-e9d596437583"). InnerVolumeSpecName "kube-api-access-tqw26". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:34:38.105774 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.105696    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b28d11d-1df3-4483-84f7-e9d596437583-plugins-config-volume\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:34:38.105774 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.105725    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7fa474b6-92b8-4fb8-917d-619a5cf878d1-plugins-config-volume\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:34:38.105774 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.105734    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l28hm\" (UniqueName: \"kubernetes.io/projected/7fa474b6-92b8-4fb8-917d-619a5cf878d1-kube-api-access-l28hm\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:34:38.105774 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.105742    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqw26\" (UniqueName: \"kubernetes.io/projected/6b28d11d-1df3-4483-84f7-e9d596437583-kube-api-access-tqw26\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:34:38.434877 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.434840    2565 generic.go:356] "Generic (PLEG): container finished" podID="6b28d11d-1df3-4483-84f7-e9d596437583" containerID="e029dbbb04987af68bd4c3d871fe2f3c71ea9b8c8b66f8a6673a53f51e72c511" exitCode=0
Sep 16 01:34:38.436001 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.434903    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-3f6bf6aa-7bf779f9cd-m5scq"
Sep 16 01:34:38.436001 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.434927    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-3f6bf6aa-7bf779f9cd-m5scq" event={"ID":"6b28d11d-1df3-4483-84f7-e9d596437583","Type":"ContainerDied","Data":"e029dbbb04987af68bd4c3d871fe2f3c71ea9b8c8b66f8a6673a53f51e72c511"}
Sep 16 01:34:38.436001 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.434981    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-3f6bf6aa-7bf779f9cd-m5scq" event={"ID":"6b28d11d-1df3-4483-84f7-e9d596437583","Type":"ContainerDied","Data":"b01be0091393657bfa386c0769971e87d4e2df37dba91798385437b5079eeaf4"}
Sep 16 01:34:38.436001 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.435009    2565 scope.go:117] "RemoveContainer" containerID="e029dbbb04987af68bd4c3d871fe2f3c71ea9b8c8b66f8a6673a53f51e72c511"
Sep 16 01:34:38.436721 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.436696    2565 generic.go:356] "Generic (PLEG): container finished" podID="7fa474b6-92b8-4fb8-917d-619a5cf878d1" containerID="cf1ff703ec7373231d399404c376daf8c011fc9bd7adad809ec25f637497bfce" exitCode=0
Sep 16 01:34:38.436847 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.436725    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3f6bf6aa-77dd7f9bb-krzlw" event={"ID":"7fa474b6-92b8-4fb8-917d-619a5cf878d1","Type":"ContainerDied","Data":"cf1ff703ec7373231d399404c376daf8c011fc9bd7adad809ec25f637497bfce"}
Sep 16 01:34:38.436847 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.436742    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3f6bf6aa-77dd7f9bb-krzlw"
Sep 16 01:34:38.436847 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.436779    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3f6bf6aa-77dd7f9bb-krzlw" event={"ID":"7fa474b6-92b8-4fb8-917d-619a5cf878d1","Type":"ContainerDied","Data":"e0a371f019d24b575b9d8b72a820c710584af7127c908240b89f79b77152251f"}
Sep 16 01:34:38.444799 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.444781    2565 scope.go:117] "RemoveContainer" containerID="e029dbbb04987af68bd4c3d871fe2f3c71ea9b8c8b66f8a6673a53f51e72c511"
Sep 16 01:34:38.445233 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:34:38.445060    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e029dbbb04987af68bd4c3d871fe2f3c71ea9b8c8b66f8a6673a53f51e72c511\": container with ID starting with e029dbbb04987af68bd4c3d871fe2f3c71ea9b8c8b66f8a6673a53f51e72c511 not found: ID does not exist" containerID="e029dbbb04987af68bd4c3d871fe2f3c71ea9b8c8b66f8a6673a53f51e72c511"
Sep 16 01:34:38.445233 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.445087    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e029dbbb04987af68bd4c3d871fe2f3c71ea9b8c8b66f8a6673a53f51e72c511"} err="failed to get container status \"e029dbbb04987af68bd4c3d871fe2f3c71ea9b8c8b66f8a6673a53f51e72c511\": rpc error: code = NotFound desc = could not find container \"e029dbbb04987af68bd4c3d871fe2f3c71ea9b8c8b66f8a6673a53f51e72c511\": container with ID starting with e029dbbb04987af68bd4c3d871fe2f3c71ea9b8c8b66f8a6673a53f51e72c511 not found: ID does not exist"
Sep 16 01:34:38.445233 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.445106    2565 scope.go:117] "RemoveContainer" containerID="cf1ff703ec7373231d399404c376daf8c011fc9bd7adad809ec25f637497bfce"
Sep 16 01:34:38.453173 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.453155    2565 scope.go:117] "RemoveContainer" containerID="cf1ff703ec7373231d399404c376daf8c011fc9bd7adad809ec25f637497bfce"
Sep 16 01:34:38.453451 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:34:38.453433    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf1ff703ec7373231d399404c376daf8c011fc9bd7adad809ec25f637497bfce\": container with ID starting with cf1ff703ec7373231d399404c376daf8c011fc9bd7adad809ec25f637497bfce not found: ID does not exist" containerID="cf1ff703ec7373231d399404c376daf8c011fc9bd7adad809ec25f637497bfce"
Sep 16 01:34:38.453525 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.453459    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf1ff703ec7373231d399404c376daf8c011fc9bd7adad809ec25f637497bfce"} err="failed to get container status \"cf1ff703ec7373231d399404c376daf8c011fc9bd7adad809ec25f637497bfce\": rpc error: code = NotFound desc = could not find container \"cf1ff703ec7373231d399404c376daf8c011fc9bd7adad809ec25f637497bfce\": container with ID starting with cf1ff703ec7373231d399404c376daf8c011fc9bd7adad809ec25f637497bfce not found: ID does not exist"
Sep 16 01:34:38.461527 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.461503    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-3f6bf6aa-7bf779f9cd-m5scq"]
Sep 16 01:34:38.465073 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.465051    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-3f6bf6aa-7bf779f9cd-m5scq"]
Sep 16 01:34:38.474305 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.474278    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-3f6bf6aa-77dd7f9bb-krzlw"]
Sep 16 01:34:38.478249 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.478227    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-3f6bf6aa-77dd7f9bb-krzlw"]
Sep 16 01:34:38.626299 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.626245    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-60623346-openshift-default-74b46659c6-ttl2k"]
Sep 16 01:34:38.627597 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.627572    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b28d11d-1df3-4483-84f7-e9d596437583" containerName="payload-processing"
Sep 16 01:34:38.627729 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.627611    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b28d11d-1df3-4483-84f7-e9d596437583" containerName="payload-processing"
Sep 16 01:34:38.627729 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.627634    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fa36668-eb3d-412b-93a1-de5f4ac6697d" containerName="revoke-keys"
Sep 16 01:34:38.627729 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.627643    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fa36668-eb3d-412b-93a1-de5f4ac6697d" containerName="revoke-keys"
Sep 16 01:34:38.627729 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.627681    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b98f945-35b3-40f5-97d2-0b8d33e5bf48" containerName="istio-proxy"
Sep 16 01:34:38.627729 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.627691    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b98f945-35b3-40f5-97d2-0b8d33e5bf48" containerName="istio-proxy"
Sep 16 01:34:38.627729 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.627709    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fa474b6-92b8-4fb8-917d-619a5cf878d1" containerName="payload-pre-processing"
Sep 16 01:34:38.627729 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.627718    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fa474b6-92b8-4fb8-917d-619a5cf878d1" containerName="payload-pre-processing"
Sep 16 01:34:38.628090 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.627756    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b98f945-35b3-40f5-97d2-0b8d33e5bf48" containerName="istio-proxy"
Sep 16 01:34:38.628090 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.627769    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b98f945-35b3-40f5-97d2-0b8d33e5bf48" containerName="istio-proxy"
Sep 16 01:34:38.628090 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.627917    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b98f945-35b3-40f5-97d2-0b8d33e5bf48" containerName="istio-proxy"
Sep 16 01:34:38.628090 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.627931    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b98f945-35b3-40f5-97d2-0b8d33e5bf48" containerName="istio-proxy"
Sep 16 01:34:38.628090 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.627943    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b28d11d-1df3-4483-84f7-e9d596437583" containerName="payload-processing"
Sep 16 01:34:38.628090 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.627958    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fa36668-eb3d-412b-93a1-de5f4ac6697d" containerName="revoke-keys"
Sep 16 01:34:38.628090 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.627967    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fa474b6-92b8-4fb8-917d-619a5cf878d1" containerName="payload-pre-processing"
Sep 16 01:34:38.630896 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.630867    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-60623346-openshift-default-74b46659c6-ttl2k"
Sep 16 01:34:38.633358 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.633255    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-60623346-openshift-default-dockercfg-8lxv4\""
Sep 16 01:34:38.643100 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.643038    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-60623346-openshift-default-74b46659c6-ttl2k"]
Sep 16 01:34:38.712297 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.712207    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01b59193-8317-485d-adb3-f222099d7ae8-workload-certs\") pod \"e2e-ait-60623346-openshift-default-74b46659c6-ttl2k\" (UID: \"01b59193-8317-485d-adb3-f222099d7ae8\") " pod="openshift-ingress/e2e-ait-60623346-openshift-default-74b46659c6-ttl2k"
Sep 16 01:34:38.712297 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.712255    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01b59193-8317-485d-adb3-f222099d7ae8-istio-envoy\") pod \"e2e-ait-60623346-openshift-default-74b46659c6-ttl2k\" (UID: \"01b59193-8317-485d-adb3-f222099d7ae8\") " pod="openshift-ingress/e2e-ait-60623346-openshift-default-74b46659c6-ttl2k"
Sep 16 01:34:38.712542 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.712301    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01b59193-8317-485d-adb3-f222099d7ae8-istio-podinfo\") pod \"e2e-ait-60623346-openshift-default-74b46659c6-ttl2k\" (UID: \"01b59193-8317-485d-adb3-f222099d7ae8\") " pod="openshift-ingress/e2e-ait-60623346-openshift-default-74b46659c6-ttl2k"
Sep 16 01:34:38.712542 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.712366    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01b59193-8317-485d-adb3-f222099d7ae8-workload-socket\") pod \"e2e-ait-60623346-openshift-default-74b46659c6-ttl2k\" (UID: \"01b59193-8317-485d-adb3-f222099d7ae8\") " pod="openshift-ingress/e2e-ait-60623346-openshift-default-74b46659c6-ttl2k"
Sep 16 01:34:38.712542 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.712397    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01b59193-8317-485d-adb3-f222099d7ae8-istiod-ca-cert\") pod \"e2e-ait-60623346-openshift-default-74b46659c6-ttl2k\" (UID: \"01b59193-8317-485d-adb3-f222099d7ae8\") " pod="openshift-ingress/e2e-ait-60623346-openshift-default-74b46659c6-ttl2k"
Sep 16 01:34:38.712542 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.712417    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqf67\" (UniqueName: \"kubernetes.io/projected/01b59193-8317-485d-adb3-f222099d7ae8-kube-api-access-cqf67\") pod \"e2e-ait-60623346-openshift-default-74b46659c6-ttl2k\" (UID: \"01b59193-8317-485d-adb3-f222099d7ae8\") " pod="openshift-ingress/e2e-ait-60623346-openshift-default-74b46659c6-ttl2k"
Sep 16 01:34:38.712542 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.712463    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01b59193-8317-485d-adb3-f222099d7ae8-credential-socket\") pod \"e2e-ait-60623346-openshift-default-74b46659c6-ttl2k\" (UID: \"01b59193-8317-485d-adb3-f222099d7ae8\") " pod="openshift-ingress/e2e-ait-60623346-openshift-default-74b46659c6-ttl2k"
Sep 16 01:34:38.712542 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.712499    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01b59193-8317-485d-adb3-f222099d7ae8-istio-data\") pod \"e2e-ait-60623346-openshift-default-74b46659c6-ttl2k\" (UID: \"01b59193-8317-485d-adb3-f222099d7ae8\") " pod="openshift-ingress/e2e-ait-60623346-openshift-default-74b46659c6-ttl2k"
Sep 16 01:34:38.712542 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.712521    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01b59193-8317-485d-adb3-f222099d7ae8-istio-token\") pod \"e2e-ait-60623346-openshift-default-74b46659c6-ttl2k\" (UID: \"01b59193-8317-485d-adb3-f222099d7ae8\") " pod="openshift-ingress/e2e-ait-60623346-openshift-default-74b46659c6-ttl2k"
Sep 16 01:34:38.737101 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.737078    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7"
Sep 16 01:34:38.813495 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.813457    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f-istiod-ca-cert\") pod \"1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f\" (UID: \"1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f\") "
Sep 16 01:34:38.813685 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.813526    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f-workload-socket\") pod \"1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f\" (UID: \"1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f\") "
Sep 16 01:34:38.813685 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.813565    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqqrk\" (UniqueName: \"kubernetes.io/projected/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f-kube-api-access-jqqrk\") pod \"1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f\" (UID: \"1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f\") "
Sep 16 01:34:38.813685 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.813611    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f-istio-token\") pod \"1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f\" (UID: \"1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f\") "
Sep 16 01:34:38.813685 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.813639    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f-workload-certs\") pod \"1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f\" (UID: \"1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f\") "
Sep 16 01:34:38.813685 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.813676    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f-istio-data\") pod \"1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f\" (UID: \"1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f\") "
Sep 16 01:34:38.813950 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.813711    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f-istio-podinfo\") pod \"1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f\" (UID: \"1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f\") "
Sep 16 01:34:38.813950 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.813763    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f-istio-envoy\") pod \"1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f\" (UID: \"1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f\") "
Sep 16 01:34:38.813950 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.813791    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f-credential-socket\") pod \"1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f\" (UID: \"1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f\") "
Sep 16 01:34:38.813950 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.813867    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f" (UID: "1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:34:38.813950 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.813915    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f" (UID: "1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:34:38.813950 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.813941    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01b59193-8317-485d-adb3-f222099d7ae8-istio-data\") pod \"e2e-ait-60623346-openshift-default-74b46659c6-ttl2k\" (UID: \"01b59193-8317-485d-adb3-f222099d7ae8\") " pod="openshift-ingress/e2e-ait-60623346-openshift-default-74b46659c6-ttl2k"
Sep 16 01:34:38.814241 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.813973    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01b59193-8317-485d-adb3-f222099d7ae8-istio-token\") pod \"e2e-ait-60623346-openshift-default-74b46659c6-ttl2k\" (UID: \"01b59193-8317-485d-adb3-f222099d7ae8\") " pod="openshift-ingress/e2e-ait-60623346-openshift-default-74b46659c6-ttl2k"
Sep 16 01:34:38.814241 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.814049    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01b59193-8317-485d-adb3-f222099d7ae8-workload-certs\") pod \"e2e-ait-60623346-openshift-default-74b46659c6-ttl2k\" (UID: \"01b59193-8317-485d-adb3-f222099d7ae8\") " pod="openshift-ingress/e2e-ait-60623346-openshift-default-74b46659c6-ttl2k"
Sep 16 01:34:38.814241 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.814081    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01b59193-8317-485d-adb3-f222099d7ae8-istio-envoy\") pod \"e2e-ait-60623346-openshift-default-74b46659c6-ttl2k\" (UID: \"01b59193-8317-485d-adb3-f222099d7ae8\") " pod="openshift-ingress/e2e-ait-60623346-openshift-default-74b46659c6-ttl2k"
Sep 16 01:34:38.814241 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.814084    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f" (UID: "1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:34:38.814241 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.814172    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01b59193-8317-485d-adb3-f222099d7ae8-istio-podinfo\") pod \"e2e-ait-60623346-openshift-default-74b46659c6-ttl2k\" (UID: \"01b59193-8317-485d-adb3-f222099d7ae8\") " pod="openshift-ingress/e2e-ait-60623346-openshift-default-74b46659c6-ttl2k"
Sep 16 01:34:38.814241 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.814223    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01b59193-8317-485d-adb3-f222099d7ae8-workload-socket\") pod \"e2e-ait-60623346-openshift-default-74b46659c6-ttl2k\" (UID: \"01b59193-8317-485d-adb3-f222099d7ae8\") " pod="openshift-ingress/e2e-ait-60623346-openshift-default-74b46659c6-ttl2k"
Sep 16 01:34:38.816357 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.814268    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01b59193-8317-485d-adb3-f222099d7ae8-istiod-ca-cert\") pod \"e2e-ait-60623346-openshift-default-74b46659c6-ttl2k\" (UID: \"01b59193-8317-485d-adb3-f222099d7ae8\") " pod="openshift-ingress/e2e-ait-60623346-openshift-default-74b46659c6-ttl2k"
Sep 16 01:34:38.816357 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.814293    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqf67\" (UniqueName: \"kubernetes.io/projected/01b59193-8317-485d-adb3-f222099d7ae8-kube-api-access-cqf67\") pod \"e2e-ait-60623346-openshift-default-74b46659c6-ttl2k\" (UID: \"01b59193-8317-485d-adb3-f222099d7ae8\") " pod="openshift-ingress/e2e-ait-60623346-openshift-default-74b46659c6-ttl2k"
Sep 16 01:34:38.816357 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.814440    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01b59193-8317-485d-adb3-f222099d7ae8-credential-socket\") pod \"e2e-ait-60623346-openshift-default-74b46659c6-ttl2k\" (UID: \"01b59193-8317-485d-adb3-f222099d7ae8\") " pod="openshift-ingress/e2e-ait-60623346-openshift-default-74b46659c6-ttl2k"
Sep 16 01:34:38.816357 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.814527    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f-istiod-ca-cert\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:34:38.816357 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.814553    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f-workload-socket\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:34:38.816357 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.814570    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f-workload-certs\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:34:38.816357 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.814954    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01b59193-8317-485d-adb3-f222099d7ae8-credential-socket\") pod \"e2e-ait-60623346-openshift-default-74b46659c6-ttl2k\" (UID: \"01b59193-8317-485d-adb3-f222099d7ae8\") " pod="openshift-ingress/e2e-ait-60623346-openshift-default-74b46659c6-ttl2k"
Sep 16 01:34:38.816357 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.815181    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01b59193-8317-485d-adb3-f222099d7ae8-workload-socket\") pod \"e2e-ait-60623346-openshift-default-74b46659c6-ttl2k\" (UID: \"01b59193-8317-485d-adb3-f222099d7ae8\") " pod="openshift-ingress/e2e-ait-60623346-openshift-default-74b46659c6-ttl2k"
Sep 16 01:34:38.816357 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.815673    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f-istio-data" (OuterVolumeSpecName: "istio-data") pod "1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f" (UID: "1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:34:38.816357 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.815827    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01b59193-8317-485d-adb3-f222099d7ae8-istiod-ca-cert\") pod \"e2e-ait-60623346-openshift-default-74b46659c6-ttl2k\" (UID: \"01b59193-8317-485d-adb3-f222099d7ae8\") " pod="openshift-ingress/e2e-ait-60623346-openshift-default-74b46659c6-ttl2k"
Sep 16 01:34:38.816357 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.816058    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01b59193-8317-485d-adb3-f222099d7ae8-istio-data\") pod \"e2e-ait-60623346-openshift-default-74b46659c6-ttl2k\" (UID: \"01b59193-8317-485d-adb3-f222099d7ae8\") " pod="openshift-ingress/e2e-ait-60623346-openshift-default-74b46659c6-ttl2k"
Sep 16 01:34:38.816962 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.816360    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f" (UID: "1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:34:38.816962 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.816864    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01b59193-8317-485d-adb3-f222099d7ae8-workload-certs\") pod \"e2e-ait-60623346-openshift-default-74b46659c6-ttl2k\" (UID: \"01b59193-8317-485d-adb3-f222099d7ae8\") " pod="openshift-ingress/e2e-ait-60623346-openshift-default-74b46659c6-ttl2k"
Sep 16 01:34:38.817507 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.817479    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01b59193-8317-485d-adb3-f222099d7ae8-istio-envoy\") pod \"e2e-ait-60623346-openshift-default-74b46659c6-ttl2k\" (UID: \"01b59193-8317-485d-adb3-f222099d7ae8\") " pod="openshift-ingress/e2e-ait-60623346-openshift-default-74b46659c6-ttl2k"
Sep 16 01:34:38.817992 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.817970    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f-kube-api-access-jqqrk" (OuterVolumeSpecName: "kube-api-access-jqqrk") pod "1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f" (UID: "1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f"). InnerVolumeSpecName "kube-api-access-jqqrk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:34:38.818744 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.818707    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f" (UID: "1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:34:38.818855 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.818741    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f" (UID: "1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 01:34:38.819012 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.818987    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f-istio-token" (OuterVolumeSpecName: "istio-token") pod "1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f" (UID: "1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:34:38.820472 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.820449    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01b59193-8317-485d-adb3-f222099d7ae8-istio-podinfo\") pod \"e2e-ait-60623346-openshift-default-74b46659c6-ttl2k\" (UID: \"01b59193-8317-485d-adb3-f222099d7ae8\") " pod="openshift-ingress/e2e-ait-60623346-openshift-default-74b46659c6-ttl2k"
Sep 16 01:34:38.823328 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.823300    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqf67\" (UniqueName: \"kubernetes.io/projected/01b59193-8317-485d-adb3-f222099d7ae8-kube-api-access-cqf67\") pod \"e2e-ait-60623346-openshift-default-74b46659c6-ttl2k\" (UID: \"01b59193-8317-485d-adb3-f222099d7ae8\") " pod="openshift-ingress/e2e-ait-60623346-openshift-default-74b46659c6-ttl2k"
Sep 16 01:34:38.823667 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.823649    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01b59193-8317-485d-adb3-f222099d7ae8-istio-token\") pod \"e2e-ait-60623346-openshift-default-74b46659c6-ttl2k\" (UID: \"01b59193-8317-485d-adb3-f222099d7ae8\") " pod="openshift-ingress/e2e-ait-60623346-openshift-default-74b46659c6-ttl2k"
Sep 16 01:34:38.915220 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.915180    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f-istio-envoy\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:34:38.915220 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.915215    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f-credential-socket\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:34:38.915220 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.915223    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqqrk\" (UniqueName: \"kubernetes.io/projected/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f-kube-api-access-jqqrk\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:34:38.915220 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.915232    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f-istio-token\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:34:38.915551 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.915242    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f-istio-data\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:34:38.915551 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.915252    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f-istio-podinfo\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:34:38.946176 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:38.946143    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-60623346-openshift-default-74b46659c6-ttl2k"
Sep 16 01:34:39.169685 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:39.169657    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b28d11d-1df3-4483-84f7-e9d596437583" path="/var/lib/kubelet/pods/6b28d11d-1df3-4483-84f7-e9d596437583/volumes"
Sep 16 01:34:39.169998 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:39.169986    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7fa474b6-92b8-4fb8-917d-619a5cf878d1" path="/var/lib/kubelet/pods/7fa474b6-92b8-4fb8-917d-619a5cf878d1/volumes"
Sep 16 01:34:39.221902 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:39.221879    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-60623346-openshift-default-74b46659c6-ttl2k"]
Sep 16 01:34:39.223743 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:34:39.223717    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01b59193_8317_485d_adb3_f222099d7ae8.slice/crio-2d4c58c22bdb773a72d503e8f4940b40d0357844f446d17e22c38eab7734e189 WatchSource:0}: Error finding container 2d4c58c22bdb773a72d503e8f4940b40d0357844f446d17e22c38eab7734e189: Status 404 returned error can't find the container with id 2d4c58c22bdb773a72d503e8f4940b40d0357844f446d17e22c38eab7734e189
Sep 16 01:34:39.225792 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:39.225761    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:34:39.225874 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:39.225832    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:34:39.225930 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:39.225875    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:34:39.447802 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:39.447765    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-60623346-openshift-default-74b46659c6-ttl2k" event={"ID":"01b59193-8317-485d-adb3-f222099d7ae8","Type":"ContainerStarted","Data":"20cf8fdd76204c044f458010785c67d30e211c6aa69e7baa6839fc9d829b6d00"}
Sep 16 01:34:39.447991 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:39.447825    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-60623346-openshift-default-74b46659c6-ttl2k" event={"ID":"01b59193-8317-485d-adb3-f222099d7ae8","Type":"ContainerStarted","Data":"2d4c58c22bdb773a72d503e8f4940b40d0357844f446d17e22c38eab7734e189"}
Sep 16 01:34:39.449265 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:39.449242    2565 generic.go:356] "Generic (PLEG): container finished" podID="1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f" containerID="8d5036ac6999212790a9a0adb09c98933da18a394c930628cd895389e8f8f95e" exitCode=0
Sep 16 01:34:39.449431 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:39.449278    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7"
Sep 16 01:34:39.449431 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:39.449286    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7" event={"ID":"1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f","Type":"ContainerDied","Data":"8d5036ac6999212790a9a0adb09c98933da18a394c930628cd895389e8f8f95e"}
Sep 16 01:34:39.449431 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:39.449318    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7" event={"ID":"1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f","Type":"ContainerDied","Data":"bb6006a0fdeed37cf8cbc2af3586ebd44ecb48058348e642d8f0619cae4f9515"}
Sep 16 01:34:39.449431 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:39.449371    2565 scope.go:117] "RemoveContainer" containerID="8d5036ac6999212790a9a0adb09c98933da18a394c930628cd895389e8f8f95e"
Sep 16 01:34:39.459257 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:39.459241    2565 scope.go:117] "RemoveContainer" containerID="8d5036ac6999212790a9a0adb09c98933da18a394c930628cd895389e8f8f95e"
Sep 16 01:34:39.459592 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:34:39.459569    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d5036ac6999212790a9a0adb09c98933da18a394c930628cd895389e8f8f95e\": container with ID starting with 8d5036ac6999212790a9a0adb09c98933da18a394c930628cd895389e8f8f95e not found: ID does not exist" containerID="8d5036ac6999212790a9a0adb09c98933da18a394c930628cd895389e8f8f95e"
Sep 16 01:34:39.459667 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:39.459603    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d5036ac6999212790a9a0adb09c98933da18a394c930628cd895389e8f8f95e"} err="failed to get container status \"8d5036ac6999212790a9a0adb09c98933da18a394c930628cd895389e8f8f95e\": rpc error: code = NotFound desc = could not find container \"8d5036ac6999212790a9a0adb09c98933da18a394c930628cd895389e8f8f95e\": container with ID starting with 8d5036ac6999212790a9a0adb09c98933da18a394c930628cd895389e8f8f95e not found: ID does not exist"
Sep 16 01:34:39.468645 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:39.468606    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-60623346-openshift-default-74b46659c6-ttl2k" podStartSLOduration=1.46859345 podStartE2EDuration="1.46859345s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:34:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:34:39.466502778 +0000 UTC m=+1128.789971356" watchObservedRunningTime="2026-09-16 01:34:39.46859345 +0000 UTC m=+1128.792062027"
Sep 16 01:34:39.480238 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:39.480216    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7"]
Sep 16 01:34:39.482090 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:39.482067    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7"]
Sep 16 01:34:39.947257 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:39.947219    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-60623346-openshift-default-74b46659c6-ttl2k"
Sep 16 01:34:40.952703 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:40.952672    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-60623346-openshift-default-74b46659c6-ttl2k"
Sep 16 01:34:41.175001 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:41.174963    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f" path="/var/lib/kubelet/pods/1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f/volumes"
Sep 16 01:34:41.460731 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:41.460695    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-60623346-openshift-default-74b46659c6-ttl2k"
Sep 16 01:34:41.461743 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:41.461722    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-60623346-openshift-default-74b46659c6-ttl2k"
Sep 16 01:34:43.197640 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:43.197601    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-60623346-7dd49cfbc4-h4gjm"]
Sep 16 01:34:43.198045 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:43.197991    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f" containerName="istio-proxy"
Sep 16 01:34:43.198045 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:43.198003    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f" containerName="istio-proxy"
Sep 16 01:34:43.198167 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:43.198069    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1746f0c3-ae1e-4f5e-bbfc-8e5ed286369f" containerName="istio-proxy"
Sep 16 01:34:43.201278 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:43.201257    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-60623346-7dd49cfbc4-h4gjm"
Sep 16 01:34:43.203664 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:43.203637    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-60623346\""
Sep 16 01:34:43.203832 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:43.203698    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-60623346-dockercfg-w2xcv\""
Sep 16 01:34:43.211932 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:43.211896    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-60623346-7dd49cfbc4-h4gjm"]
Sep 16 01:34:43.241554 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:43.241514    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-60623346-7bc746c65f-j2ck5"]
Sep 16 01:34:43.244398 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:43.244374    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-60623346-7bc746c65f-j2ck5"
Sep 16 01:34:43.251850 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:43.251818    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-60623346-7bc746c65f-j2ck5"]
Sep 16 01:34:43.357766 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:43.357727    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/871acb62-9709-4d21-8068-50e68b51f2c2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-60623346-7dd49cfbc4-h4gjm\" (UID: \"871acb62-9709-4d21-8068-50e68b51f2c2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-60623346-7dd49cfbc4-h4gjm"
Sep 16 01:34:43.357766 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:43.357776    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/99111b0d-6fdc-4bd1-b99b-daeb7473afe1-plugins-config-volume\") pod \"payload-processing-e2e-ait-60623346-7bc746c65f-j2ck5\" (UID: \"99111b0d-6fdc-4bd1-b99b-daeb7473afe1\") " pod="openshift-ingress/payload-processing-e2e-ait-60623346-7bc746c65f-j2ck5"
Sep 16 01:34:43.358011 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:43.357805    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lx7jl\" (UniqueName: \"kubernetes.io/projected/99111b0d-6fdc-4bd1-b99b-daeb7473afe1-kube-api-access-lx7jl\") pod \"payload-processing-e2e-ait-60623346-7bc746c65f-j2ck5\" (UID: \"99111b0d-6fdc-4bd1-b99b-daeb7473afe1\") " pod="openshift-ingress/payload-processing-e2e-ait-60623346-7bc746c65f-j2ck5"
Sep 16 01:34:43.358011 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:43.357878    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x2q4\" (UniqueName: \"kubernetes.io/projected/871acb62-9709-4d21-8068-50e68b51f2c2-kube-api-access-9x2q4\") pod \"payload-pre-processing-e2e-ait-60623346-7dd49cfbc4-h4gjm\" (UID: \"871acb62-9709-4d21-8068-50e68b51f2c2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-60623346-7dd49cfbc4-h4gjm"
Sep 16 01:34:43.459100 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:43.458994    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9x2q4\" (UniqueName: \"kubernetes.io/projected/871acb62-9709-4d21-8068-50e68b51f2c2-kube-api-access-9x2q4\") pod \"payload-pre-processing-e2e-ait-60623346-7dd49cfbc4-h4gjm\" (UID: \"871acb62-9709-4d21-8068-50e68b51f2c2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-60623346-7dd49cfbc4-h4gjm"
Sep 16 01:34:43.459100 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:43.459084    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/871acb62-9709-4d21-8068-50e68b51f2c2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-60623346-7dd49cfbc4-h4gjm\" (UID: \"871acb62-9709-4d21-8068-50e68b51f2c2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-60623346-7dd49cfbc4-h4gjm"
Sep 16 01:34:43.459305 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:43.459108    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/99111b0d-6fdc-4bd1-b99b-daeb7473afe1-plugins-config-volume\") pod \"payload-processing-e2e-ait-60623346-7bc746c65f-j2ck5\" (UID: \"99111b0d-6fdc-4bd1-b99b-daeb7473afe1\") " pod="openshift-ingress/payload-processing-e2e-ait-60623346-7bc746c65f-j2ck5"
Sep 16 01:34:43.459305 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:43.459134    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lx7jl\" (UniqueName: \"kubernetes.io/projected/99111b0d-6fdc-4bd1-b99b-daeb7473afe1-kube-api-access-lx7jl\") pod \"payload-processing-e2e-ait-60623346-7bc746c65f-j2ck5\" (UID: \"99111b0d-6fdc-4bd1-b99b-daeb7473afe1\") " pod="openshift-ingress/payload-processing-e2e-ait-60623346-7bc746c65f-j2ck5"
Sep 16 01:34:43.459878 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:43.459856    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/99111b0d-6fdc-4bd1-b99b-daeb7473afe1-plugins-config-volume\") pod \"payload-processing-e2e-ait-60623346-7bc746c65f-j2ck5\" (UID: \"99111b0d-6fdc-4bd1-b99b-daeb7473afe1\") " pod="openshift-ingress/payload-processing-e2e-ait-60623346-7bc746c65f-j2ck5"
Sep 16 01:34:43.459920 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:43.459888    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/871acb62-9709-4d21-8068-50e68b51f2c2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-60623346-7dd49cfbc4-h4gjm\" (UID: \"871acb62-9709-4d21-8068-50e68b51f2c2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-60623346-7dd49cfbc4-h4gjm"
Sep 16 01:34:43.467162 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:43.467132    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x2q4\" (UniqueName: \"kubernetes.io/projected/871acb62-9709-4d21-8068-50e68b51f2c2-kube-api-access-9x2q4\") pod \"payload-pre-processing-e2e-ait-60623346-7dd49cfbc4-h4gjm\" (UID: \"871acb62-9709-4d21-8068-50e68b51f2c2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-60623346-7dd49cfbc4-h4gjm"
Sep 16 01:34:43.467320 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:43.467174    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lx7jl\" (UniqueName: \"kubernetes.io/projected/99111b0d-6fdc-4bd1-b99b-daeb7473afe1-kube-api-access-lx7jl\") pod \"payload-processing-e2e-ait-60623346-7bc746c65f-j2ck5\" (UID: \"99111b0d-6fdc-4bd1-b99b-daeb7473afe1\") " pod="openshift-ingress/payload-processing-e2e-ait-60623346-7bc746c65f-j2ck5"
Sep 16 01:34:43.513760 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:43.513723    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-60623346-7dd49cfbc4-h4gjm"
Sep 16 01:34:43.556776 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:43.556735    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-60623346-7bc746c65f-j2ck5"
Sep 16 01:34:43.791766 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:43.791668    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-60623346-7dd49cfbc4-h4gjm"]
Sep 16 01:34:43.794624 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:34:43.794588    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod871acb62_9709_4d21_8068_50e68b51f2c2.slice/crio-4bfad891b4a5fd301f7b462ca5de2cd2d1123526f8283726db05f5f31fdacf20 WatchSource:0}: Error finding container 4bfad891b4a5fd301f7b462ca5de2cd2d1123526f8283726db05f5f31fdacf20: Status 404 returned error can't find the container with id 4bfad891b4a5fd301f7b462ca5de2cd2d1123526f8283726db05f5f31fdacf20
Sep 16 01:34:43.847898 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:43.847867    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-60623346-7bc746c65f-j2ck5"]
Sep 16 01:34:43.850591 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:34:43.850565    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99111b0d_6fdc_4bd1_b99b_daeb7473afe1.slice/crio-88e12eeacc08ac826870012d71daaab36696fe99024e385b8814f7a95a675fd1 WatchSource:0}: Error finding container 88e12eeacc08ac826870012d71daaab36696fe99024e385b8814f7a95a675fd1: Status 404 returned error can't find the container with id 88e12eeacc08ac826870012d71daaab36696fe99024e385b8814f7a95a675fd1
Sep 16 01:34:44.481917 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:44.481866    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-60623346-7dd49cfbc4-h4gjm" event={"ID":"871acb62-9709-4d21-8068-50e68b51f2c2","Type":"ContainerStarted","Data":"48d2dc0a47a1c5fb1e6660439e64cc051d5f871701a1cbcc629226f46e64aceb"}
Sep 16 01:34:44.482370 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:44.481980    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-60623346-7dd49cfbc4-h4gjm" event={"ID":"871acb62-9709-4d21-8068-50e68b51f2c2","Type":"ContainerStarted","Data":"4bfad891b4a5fd301f7b462ca5de2cd2d1123526f8283726db05f5f31fdacf20"}
Sep 16 01:34:44.483005 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:44.482965    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-60623346-7dd49cfbc4-h4gjm"
Sep 16 01:34:44.484070 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:44.484045    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-60623346-7bc746c65f-j2ck5" event={"ID":"99111b0d-6fdc-4bd1-b99b-daeb7473afe1","Type":"ContainerStarted","Data":"d85dba65ee43e13d6c46371cafa6c86b2a2d65ebd7fdc573906e334d103425a2"}
Sep 16 01:34:44.484201 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:44.484097    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-60623346-7bc746c65f-j2ck5" event={"ID":"99111b0d-6fdc-4bd1-b99b-daeb7473afe1","Type":"ContainerStarted","Data":"88e12eeacc08ac826870012d71daaab36696fe99024e385b8814f7a95a675fd1"}
Sep 16 01:34:44.484201 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:44.484127    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-60623346-7bc746c65f-j2ck5"
Sep 16 01:34:44.499559 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:44.499503    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-60623346-7dd49cfbc4-h4gjm" podStartSLOduration=1.499488256 podStartE2EDuration="1.499488256s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:34:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:34:44.497139087 +0000 UTC m=+1133.820607664" watchObservedRunningTime="2026-09-16 01:34:44.499488256 +0000 UTC m=+1133.822956831"
Sep 16 01:34:44.513306 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:44.513256    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-60623346-7bc746c65f-j2ck5" podStartSLOduration=1.513240023 podStartE2EDuration="1.513240023s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:34:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:34:44.510897737 +0000 UTC m=+1133.834366314" watchObservedRunningTime="2026-09-16 01:34:44.513240023 +0000 UTC m=+1133.836708600"
Sep 16 01:34:55.492220 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:55.492181    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-60623346-7bc746c65f-j2ck5"
Sep 16 01:34:56.497466 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:56.497437    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-60623346-7dd49cfbc4-h4gjm"
Sep 16 01:34:59.052944 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:59.052897    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q"]
Sep 16 01:34:59.057497 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:59.057466    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q"
Sep 16 01:34:59.059715 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:59.059687    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-c0ec73-openshift-default-dockercfg-jsffl\""
Sep 16 01:34:59.070361 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:59.069453    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q"]
Sep 16 01:34:59.098820 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:59.098787    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc8ba9c0-9e0f-4550-9c19-265da23baf55-workload-certs\") pod \"e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q\" (UID: \"fc8ba9c0-9e0f-4550-9c19-265da23baf55\") " pod="openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q"
Sep 16 01:34:59.098975 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:59.098840    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc8ba9c0-9e0f-4550-9c19-265da23baf55-istio-podinfo\") pod \"e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q\" (UID: \"fc8ba9c0-9e0f-4550-9c19-265da23baf55\") " pod="openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q"
Sep 16 01:34:59.098975 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:59.098888    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc8ba9c0-9e0f-4550-9c19-265da23baf55-credential-socket\") pod \"e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q\" (UID: \"fc8ba9c0-9e0f-4550-9c19-265da23baf55\") " pod="openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q"
Sep 16 01:34:59.098975 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:59.098904    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc8ba9c0-9e0f-4550-9c19-265da23baf55-istio-token\") pod \"e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q\" (UID: \"fc8ba9c0-9e0f-4550-9c19-265da23baf55\") " pod="openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q"
Sep 16 01:34:59.099083 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:59.099016    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc8ba9c0-9e0f-4550-9c19-265da23baf55-istio-envoy\") pod \"e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q\" (UID: \"fc8ba9c0-9e0f-4550-9c19-265da23baf55\") " pod="openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q"
Sep 16 01:34:59.099083 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:59.099045    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqx82\" (UniqueName: \"kubernetes.io/projected/fc8ba9c0-9e0f-4550-9c19-265da23baf55-kube-api-access-lqx82\") pod \"e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q\" (UID: \"fc8ba9c0-9e0f-4550-9c19-265da23baf55\") " pod="openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q"
Sep 16 01:34:59.099150 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:59.099091    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc8ba9c0-9e0f-4550-9c19-265da23baf55-istiod-ca-cert\") pod \"e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q\" (UID: \"fc8ba9c0-9e0f-4550-9c19-265da23baf55\") " pod="openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q"
Sep 16 01:34:59.099150 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:59.099124    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc8ba9c0-9e0f-4550-9c19-265da23baf55-workload-socket\") pod \"e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q\" (UID: \"fc8ba9c0-9e0f-4550-9c19-265da23baf55\") " pod="openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q"
Sep 16 01:34:59.099226 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:59.099170    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc8ba9c0-9e0f-4550-9c19-265da23baf55-istio-data\") pod \"e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q\" (UID: \"fc8ba9c0-9e0f-4550-9c19-265da23baf55\") " pod="openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q"
Sep 16 01:34:59.200731 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:59.200696    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc8ba9c0-9e0f-4550-9c19-265da23baf55-workload-socket\") pod \"e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q\" (UID: \"fc8ba9c0-9e0f-4550-9c19-265da23baf55\") " pod="openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q"
Sep 16 01:34:59.200731 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:59.200740    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc8ba9c0-9e0f-4550-9c19-265da23baf55-istio-data\") pod \"e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q\" (UID: \"fc8ba9c0-9e0f-4550-9c19-265da23baf55\") " pod="openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q"
Sep 16 01:34:59.201010 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:59.200777    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc8ba9c0-9e0f-4550-9c19-265da23baf55-workload-certs\") pod \"e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q\" (UID: \"fc8ba9c0-9e0f-4550-9c19-265da23baf55\") " pod="openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q"
Sep 16 01:34:59.201010 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:59.200822    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc8ba9c0-9e0f-4550-9c19-265da23baf55-istio-podinfo\") pod \"e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q\" (UID: \"fc8ba9c0-9e0f-4550-9c19-265da23baf55\") " pod="openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q"
Sep 16 01:34:59.201010 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:59.200860    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc8ba9c0-9e0f-4550-9c19-265da23baf55-credential-socket\") pod \"e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q\" (UID: \"fc8ba9c0-9e0f-4550-9c19-265da23baf55\") " pod="openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q"
Sep 16 01:34:59.201010 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:59.200886    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc8ba9c0-9e0f-4550-9c19-265da23baf55-istio-token\") pod \"e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q\" (UID: \"fc8ba9c0-9e0f-4550-9c19-265da23baf55\") " pod="openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q"
Sep 16 01:34:59.201010 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:59.201006    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc8ba9c0-9e0f-4550-9c19-265da23baf55-istio-envoy\") pod \"e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q\" (UID: \"fc8ba9c0-9e0f-4550-9c19-265da23baf55\") " pod="openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q"
Sep 16 01:34:59.201276 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:59.201040    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqx82\" (UniqueName: \"kubernetes.io/projected/fc8ba9c0-9e0f-4550-9c19-265da23baf55-kube-api-access-lqx82\") pod \"e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q\" (UID: \"fc8ba9c0-9e0f-4550-9c19-265da23baf55\") " pod="openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q"
Sep 16 01:34:59.201276 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:59.201104    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc8ba9c0-9e0f-4550-9c19-265da23baf55-istiod-ca-cert\") pod \"e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q\" (UID: \"fc8ba9c0-9e0f-4550-9c19-265da23baf55\") " pod="openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q"
Sep 16 01:34:59.201276 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:59.201161    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc8ba9c0-9e0f-4550-9c19-265da23baf55-workload-socket\") pod \"e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q\" (UID: \"fc8ba9c0-9e0f-4550-9c19-265da23baf55\") " pod="openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q"
Sep 16 01:34:59.201276 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:59.201257    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc8ba9c0-9e0f-4550-9c19-265da23baf55-workload-certs\") pod \"e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q\" (UID: \"fc8ba9c0-9e0f-4550-9c19-265da23baf55\") " pod="openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q"
Sep 16 01:34:59.201541 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:59.201297    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc8ba9c0-9e0f-4550-9c19-265da23baf55-credential-socket\") pod \"e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q\" (UID: \"fc8ba9c0-9e0f-4550-9c19-265da23baf55\") " pod="openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q"
Sep 16 01:34:59.201594 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:59.201545    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc8ba9c0-9e0f-4550-9c19-265da23baf55-istio-data\") pod \"e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q\" (UID: \"fc8ba9c0-9e0f-4550-9c19-265da23baf55\") " pod="openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q"
Sep 16 01:34:59.201734 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:59.201717    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc8ba9c0-9e0f-4550-9c19-265da23baf55-istiod-ca-cert\") pod \"e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q\" (UID: \"fc8ba9c0-9e0f-4550-9c19-265da23baf55\") " pod="openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q"
Sep 16 01:34:59.203303 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:59.203281    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc8ba9c0-9e0f-4550-9c19-265da23baf55-istio-envoy\") pod \"e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q\" (UID: \"fc8ba9c0-9e0f-4550-9c19-265da23baf55\") " pod="openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q"
Sep 16 01:34:59.203406 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:59.203326    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc8ba9c0-9e0f-4550-9c19-265da23baf55-istio-podinfo\") pod \"e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q\" (UID: \"fc8ba9c0-9e0f-4550-9c19-265da23baf55\") " pod="openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q"
Sep 16 01:34:59.208299 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:59.208277    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc8ba9c0-9e0f-4550-9c19-265da23baf55-istio-token\") pod \"e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q\" (UID: \"fc8ba9c0-9e0f-4550-9c19-265da23baf55\") " pod="openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q"
Sep 16 01:34:59.208516 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:59.208495    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqx82\" (UniqueName: \"kubernetes.io/projected/fc8ba9c0-9e0f-4550-9c19-265da23baf55-kube-api-access-lqx82\") pod \"e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q\" (UID: \"fc8ba9c0-9e0f-4550-9c19-265da23baf55\") " pod="openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q"
Sep 16 01:34:59.370408 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:59.370312    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q"
Sep 16 01:34:59.649747 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:59.649683    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q"]
Sep 16 01:34:59.652064 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:34:59.652030    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc8ba9c0_9e0f_4550_9c19_265da23baf55.slice/crio-dbbbe2147a1ed85f23260dead39535f73568a13d77139eb4c71030ec72cd6afa WatchSource:0}: Error finding container dbbbe2147a1ed85f23260dead39535f73568a13d77139eb4c71030ec72cd6afa: Status 404 returned error can't find the container with id dbbbe2147a1ed85f23260dead39535f73568a13d77139eb4c71030ec72cd6afa
Sep 16 01:34:59.654590 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:59.654557    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:34:59.654673 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:59.654643    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:34:59.654713 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:34:59.654673    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:35:00.572862 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:00.572820    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q" event={"ID":"fc8ba9c0-9e0f-4550-9c19-265da23baf55","Type":"ContainerStarted","Data":"5aa88c2c161fffdf6004ad2b204989b5dcadcdab5c758ac2e724e7de21c18ec4"}
Sep 16 01:35:00.573259 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:00.572879    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q" event={"ID":"fc8ba9c0-9e0f-4550-9c19-265da23baf55","Type":"ContainerStarted","Data":"dbbbe2147a1ed85f23260dead39535f73568a13d77139eb4c71030ec72cd6afa"}
Sep 16 01:35:00.593177 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:00.593129    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q" podStartSLOduration=1.5931144929999999 podStartE2EDuration="1.593114493s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:34:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:35:00.590245527 +0000 UTC m=+1149.913714103" watchObservedRunningTime="2026-09-16 01:35:00.593114493 +0000 UTC m=+1149.916583069"
Sep 16 01:35:01.371507 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:01.371476    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q"
Sep 16 01:35:01.376882 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:01.376858    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q"
Sep 16 01:35:01.582816 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:01.582781    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q"
Sep 16 01:35:01.583908 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:01.583885    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q"
Sep 16 01:35:01.637688 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:01.637590    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-60623346-9hsc4"]
Sep 16 01:35:01.640817 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:01.640794    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-60623346-9hsc4"
Sep 16 01:35:01.643264 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:01.643228    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 01:35:01.643414 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:01.643308    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4ljjd\""
Sep 16 01:35:01.648093 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:01.647710    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-60623346-9hsc4"]
Sep 16 01:35:01.724732 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:01.724695    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0dd697c-39cf-489c-8103-ee9613b55ed3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-60623346-9hsc4\" (UID: \"c0dd697c-39cf-489c-8103-ee9613b55ed3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-60623346-9hsc4"
Sep 16 01:35:01.825749 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:01.825708    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0dd697c-39cf-489c-8103-ee9613b55ed3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-60623346-9hsc4\" (UID: \"c0dd697c-39cf-489c-8103-ee9613b55ed3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-60623346-9hsc4"
Sep 16 01:35:01.826491 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:01.826470    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0dd697c-39cf-489c-8103-ee9613b55ed3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-60623346-9hsc4\" (UID: \"c0dd697c-39cf-489c-8103-ee9613b55ed3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-60623346-9hsc4"
Sep 16 01:35:01.957689 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:01.957651    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-60623346-9hsc4"
Sep 16 01:35:02.230564 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:02.230535    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-60623346-9hsc4"]
Sep 16 01:35:02.233223 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:35:02.233195    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0dd697c_39cf_489c_8103_ee9613b55ed3.slice/crio-9a5fc14301395c531f30eb10e89560044856393a0378d169c9f54c2fa90486f6 WatchSource:0}: Error finding container 9a5fc14301395c531f30eb10e89560044856393a0378d169c9f54c2fa90486f6: Status 404 returned error can't find the container with id 9a5fc14301395c531f30eb10e89560044856393a0378d169c9f54c2fa90486f6
Sep 16 01:35:02.590431 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:02.590371    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-60623346-9hsc4" event={"ID":"c0dd697c-39cf-489c-8103-ee9613b55ed3","Type":"ContainerStarted","Data":"9a5fc14301395c531f30eb10e89560044856393a0378d169c9f54c2fa90486f6"}
Sep 16 01:35:03.597863 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:03.597830    2565 generic.go:356] "Generic (PLEG): container finished" podID="c0dd697c-39cf-489c-8103-ee9613b55ed3" containerID="a2fdd55aa270c3e0036b1d1fd5a9da5aec9e56a91b5ddb8b0ab3eb3f1406b060" exitCode=0
Sep 16 01:35:03.598231 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:03.597915    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-60623346-9hsc4" event={"ID":"c0dd697c-39cf-489c-8103-ee9613b55ed3","Type":"ContainerDied","Data":"a2fdd55aa270c3e0036b1d1fd5a9da5aec9e56a91b5ddb8b0ab3eb3f1406b060"}
Sep 16 01:35:04.795213 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:04.795188    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-60623346-9hsc4"
Sep 16 01:35:04.860014 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:04.859865    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0dd697c-39cf-489c-8103-ee9613b55ed3-maas-api-service-ca\") pod \"c0dd697c-39cf-489c-8103-ee9613b55ed3\" (UID: \"c0dd697c-39cf-489c-8103-ee9613b55ed3\") "
Sep 16 01:35:04.866368 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:04.860254    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0dd697c-39cf-489c-8103-ee9613b55ed3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c0dd697c-39cf-489c-8103-ee9613b55ed3" (UID: "c0dd697c-39cf-489c-8103-ee9613b55ed3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:35:04.866368 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:04.860715    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0dd697c-39cf-489c-8103-ee9613b55ed3-maas-api-service-ca\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:35:05.612024 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:05.611947    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-60623346-9hsc4"
Sep 16 01:35:05.612024 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:05.611986    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-60623346-9hsc4" event={"ID":"c0dd697c-39cf-489c-8103-ee9613b55ed3","Type":"ContainerDied","Data":"9a5fc14301395c531f30eb10e89560044856393a0378d169c9f54c2fa90486f6"}
Sep 16 01:35:05.612200 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:05.612032    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9a5fc14301395c531f30eb10e89560044856393a0378d169c9f54c2fa90486f6"
Sep 16 01:35:05.665361 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:05.663744    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c0ec73-7788cdf566-vqjrj"]
Sep 16 01:35:05.665361 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:05.664571    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0dd697c-39cf-489c-8103-ee9613b55ed3" containerName="revoke-keys"
Sep 16 01:35:05.665361 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:05.664594    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0dd697c-39cf-489c-8103-ee9613b55ed3" containerName="revoke-keys"
Sep 16 01:35:05.665361 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:05.664710    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0dd697c-39cf-489c-8103-ee9613b55ed3" containerName="revoke-keys"
Sep 16 01:35:05.670267 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:05.670238    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c0ec73-7788cdf566-vqjrj"
Sep 16 01:35:05.672743 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:05.672677    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-c0ec73\""
Sep 16 01:35:05.672962 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:05.672947    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-c0ec73-dockercfg-ljzvm\""
Sep 16 01:35:05.677648 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:05.677623    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c0ec73-7788cdf566-vqjrj"]
Sep 16 01:35:05.776356 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:05.775938    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxfdr\" (UniqueName: \"kubernetes.io/projected/1122f057-4180-4b44-9e4f-0b2e15eed8ac-kube-api-access-dxfdr\") pod \"payload-pre-processing-e2e-shared-b-w2-c0ec73-7788cdf566-vqjrj\" (UID: \"1122f057-4180-4b44-9e4f-0b2e15eed8ac\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c0ec73-7788cdf566-vqjrj"
Sep 16 01:35:05.776356 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:05.776039    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1122f057-4180-4b44-9e4f-0b2e15eed8ac-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-c0ec73-7788cdf566-vqjrj\" (UID: \"1122f057-4180-4b44-9e4f-0b2e15eed8ac\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c0ec73-7788cdf566-vqjrj"
Sep 16 01:35:05.877603 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:05.877509    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1122f057-4180-4b44-9e4f-0b2e15eed8ac-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-c0ec73-7788cdf566-vqjrj\" (UID: \"1122f057-4180-4b44-9e4f-0b2e15eed8ac\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c0ec73-7788cdf566-vqjrj"
Sep 16 01:35:05.877946 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:05.877623    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxfdr\" (UniqueName: \"kubernetes.io/projected/1122f057-4180-4b44-9e4f-0b2e15eed8ac-kube-api-access-dxfdr\") pod \"payload-pre-processing-e2e-shared-b-w2-c0ec73-7788cdf566-vqjrj\" (UID: \"1122f057-4180-4b44-9e4f-0b2e15eed8ac\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c0ec73-7788cdf566-vqjrj"
Sep 16 01:35:05.878440 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:05.878420    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1122f057-4180-4b44-9e4f-0b2e15eed8ac-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-c0ec73-7788cdf566-vqjrj\" (UID: \"1122f057-4180-4b44-9e4f-0b2e15eed8ac\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c0ec73-7788cdf566-vqjrj"
Sep 16 01:35:05.884880 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:05.884855    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxfdr\" (UniqueName: \"kubernetes.io/projected/1122f057-4180-4b44-9e4f-0b2e15eed8ac-kube-api-access-dxfdr\") pod \"payload-pre-processing-e2e-shared-b-w2-c0ec73-7788cdf566-vqjrj\" (UID: \"1122f057-4180-4b44-9e4f-0b2e15eed8ac\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c0ec73-7788cdf566-vqjrj"
Sep 16 01:35:05.982775 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:05.982735    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c0ec73-7788cdf566-vqjrj"
Sep 16 01:35:06.255555 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:06.255510    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c0ec73-7788cdf566-vqjrj"]
Sep 16 01:35:06.270554 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:35:06.270518    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1122f057_4180_4b44_9e4f_0b2e15eed8ac.slice/crio-900b1d710dd4e2fc9728339162909294c17faf98aaa710401bac332dc4d22028 WatchSource:0}: Error finding container 900b1d710dd4e2fc9728339162909294c17faf98aaa710401bac332dc4d22028: Status 404 returned error can't find the container with id 900b1d710dd4e2fc9728339162909294c17faf98aaa710401bac332dc4d22028
Sep 16 01:35:06.618311 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:06.618211    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c0ec73-7788cdf566-vqjrj" event={"ID":"1122f057-4180-4b44-9e4f-0b2e15eed8ac","Type":"ContainerStarted","Data":"70671c62e9bb50cdce28245ffdedad1864ee9395c362ace252f6757918d68464"}
Sep 16 01:35:06.618311 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:06.618275    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c0ec73-7788cdf566-vqjrj" event={"ID":"1122f057-4180-4b44-9e4f-0b2e15eed8ac","Type":"ContainerStarted","Data":"900b1d710dd4e2fc9728339162909294c17faf98aaa710401bac332dc4d22028"}
Sep 16 01:35:06.618714 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:06.618687    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c0ec73-7788cdf566-vqjrj"
Sep 16 01:35:06.641367 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:06.636965    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c0ec73-7788cdf566-vqjrj" podStartSLOduration=1.63693973 podStartE2EDuration="1.63693973s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:35:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:35:06.632425181 +0000 UTC m=+1155.955893760" watchObservedRunningTime="2026-09-16 01:35:06.63693973 +0000 UTC m=+1155.960408309"
Sep 16 01:35:12.306441 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:12.306404    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-60623346-7bc746c65f-j2ck5"]
Sep 16 01:35:12.306954 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:12.306625    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-60623346-7bc746c65f-j2ck5" podUID="99111b0d-6fdc-4bd1-b99b-daeb7473afe1" containerName="payload-processing" containerID="cri-o://d85dba65ee43e13d6c46371cafa6c86b2a2d65ebd7fdc573906e334d103425a2" gracePeriod=30
Sep 16 01:35:12.314866 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:12.314834    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-60623346-7dd49cfbc4-h4gjm"]
Sep 16 01:35:12.317997 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:12.315198    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-60623346-7dd49cfbc4-h4gjm" podUID="871acb62-9709-4d21-8068-50e68b51f2c2" containerName="payload-pre-processing" containerID="cri-o://48d2dc0a47a1c5fb1e6660439e64cc051d5f871701a1cbcc629226f46e64aceb" gracePeriod=30
Sep 16 01:35:12.449760 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:12.449511    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-60623346-9hsc4"]
Sep 16 01:35:12.453118 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:12.453083    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-60623346-9hsc4"]
Sep 16 01:35:12.502527 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:12.502486    2565 patch_prober.go:28] interesting pod/e2e-ait-60623346-openshift-default-74b46659c6-ttl2k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 16 01:35:12.502712 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:12.502560    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-60623346-openshift-default-74b46659c6-ttl2k" podUID="01b59193-8317-485d-adb3-f222099d7ae8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 16 01:35:12.602993 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:12.602959    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-60623346-7bc746c65f-j2ck5"
Sep 16 01:35:12.618413 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:12.618380    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-60623346-7dd49cfbc4-h4gjm"
Sep 16 01:35:12.646601 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:12.646569    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/99111b0d-6fdc-4bd1-b99b-daeb7473afe1-plugins-config-volume\") pod \"99111b0d-6fdc-4bd1-b99b-daeb7473afe1\" (UID: \"99111b0d-6fdc-4bd1-b99b-daeb7473afe1\") "
Sep 16 01:35:12.646791 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:12.646672    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9x2q4\" (UniqueName: \"kubernetes.io/projected/871acb62-9709-4d21-8068-50e68b51f2c2-kube-api-access-9x2q4\") pod \"871acb62-9709-4d21-8068-50e68b51f2c2\" (UID: \"871acb62-9709-4d21-8068-50e68b51f2c2\") "
Sep 16 01:35:12.646791 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:12.646699    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/871acb62-9709-4d21-8068-50e68b51f2c2-plugins-config-volume\") pod \"871acb62-9709-4d21-8068-50e68b51f2c2\" (UID: \"871acb62-9709-4d21-8068-50e68b51f2c2\") "
Sep 16 01:35:12.646791 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:12.646745    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lx7jl\" (UniqueName: \"kubernetes.io/projected/99111b0d-6fdc-4bd1-b99b-daeb7473afe1-kube-api-access-lx7jl\") pod \"99111b0d-6fdc-4bd1-b99b-daeb7473afe1\" (UID: \"99111b0d-6fdc-4bd1-b99b-daeb7473afe1\") "
Sep 16 01:35:12.647661 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:12.647615    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/871acb62-9709-4d21-8068-50e68b51f2c2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "871acb62-9709-4d21-8068-50e68b51f2c2" (UID: "871acb62-9709-4d21-8068-50e68b51f2c2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:35:12.647859 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:12.647797    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99111b0d-6fdc-4bd1-b99b-daeb7473afe1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "99111b0d-6fdc-4bd1-b99b-daeb7473afe1" (UID: "99111b0d-6fdc-4bd1-b99b-daeb7473afe1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:35:12.649768 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:12.649729    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99111b0d-6fdc-4bd1-b99b-daeb7473afe1-kube-api-access-lx7jl" (OuterVolumeSpecName: "kube-api-access-lx7jl") pod "99111b0d-6fdc-4bd1-b99b-daeb7473afe1" (UID: "99111b0d-6fdc-4bd1-b99b-daeb7473afe1"). InnerVolumeSpecName "kube-api-access-lx7jl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:35:12.651311 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:12.651285    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/871acb62-9709-4d21-8068-50e68b51f2c2-kube-api-access-9x2q4" (OuterVolumeSpecName: "kube-api-access-9x2q4") pod "871acb62-9709-4d21-8068-50e68b51f2c2" (UID: "871acb62-9709-4d21-8068-50e68b51f2c2"). InnerVolumeSpecName "kube-api-access-9x2q4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:35:12.656032 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:12.656003    2565 generic.go:356] "Generic (PLEG): container finished" podID="871acb62-9709-4d21-8068-50e68b51f2c2" containerID="48d2dc0a47a1c5fb1e6660439e64cc051d5f871701a1cbcc629226f46e64aceb" exitCode=0
Sep 16 01:35:12.656160 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:12.656052    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-60623346-7dd49cfbc4-h4gjm"
Sep 16 01:35:12.656160 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:12.656093    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-60623346-7dd49cfbc4-h4gjm" event={"ID":"871acb62-9709-4d21-8068-50e68b51f2c2","Type":"ContainerDied","Data":"48d2dc0a47a1c5fb1e6660439e64cc051d5f871701a1cbcc629226f46e64aceb"}
Sep 16 01:35:12.656283 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:12.656165    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-60623346-7dd49cfbc4-h4gjm" event={"ID":"871acb62-9709-4d21-8068-50e68b51f2c2","Type":"ContainerDied","Data":"4bfad891b4a5fd301f7b462ca5de2cd2d1123526f8283726db05f5f31fdacf20"}
Sep 16 01:35:12.656283 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:12.656192    2565 scope.go:117] "RemoveContainer" containerID="48d2dc0a47a1c5fb1e6660439e64cc051d5f871701a1cbcc629226f46e64aceb"
Sep 16 01:35:12.657887 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:12.657865    2565 generic.go:356] "Generic (PLEG): container finished" podID="99111b0d-6fdc-4bd1-b99b-daeb7473afe1" containerID="d85dba65ee43e13d6c46371cafa6c86b2a2d65ebd7fdc573906e334d103425a2" exitCode=0
Sep 16 01:35:12.657992 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:12.657907    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-60623346-7bc746c65f-j2ck5" event={"ID":"99111b0d-6fdc-4bd1-b99b-daeb7473afe1","Type":"ContainerDied","Data":"d85dba65ee43e13d6c46371cafa6c86b2a2d65ebd7fdc573906e334d103425a2"}
Sep 16 01:35:12.657992 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:12.657918    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-60623346-7bc746c65f-j2ck5"
Sep 16 01:35:12.657992 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:12.657951    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-60623346-7bc746c65f-j2ck5" event={"ID":"99111b0d-6fdc-4bd1-b99b-daeb7473afe1","Type":"ContainerDied","Data":"88e12eeacc08ac826870012d71daaab36696fe99024e385b8814f7a95a675fd1"}
Sep 16 01:35:12.668657 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:12.668387    2565 scope.go:117] "RemoveContainer" containerID="48d2dc0a47a1c5fb1e6660439e64cc051d5f871701a1cbcc629226f46e64aceb"
Sep 16 01:35:12.669189 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:35:12.669168    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48d2dc0a47a1c5fb1e6660439e64cc051d5f871701a1cbcc629226f46e64aceb\": container with ID starting with 48d2dc0a47a1c5fb1e6660439e64cc051d5f871701a1cbcc629226f46e64aceb not found: ID does not exist" containerID="48d2dc0a47a1c5fb1e6660439e64cc051d5f871701a1cbcc629226f46e64aceb"
Sep 16 01:35:12.669456 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:12.669430    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48d2dc0a47a1c5fb1e6660439e64cc051d5f871701a1cbcc629226f46e64aceb"} err="failed to get container status \"48d2dc0a47a1c5fb1e6660439e64cc051d5f871701a1cbcc629226f46e64aceb\": rpc error: code = NotFound desc = could not find container \"48d2dc0a47a1c5fb1e6660439e64cc051d5f871701a1cbcc629226f46e64aceb\": container with ID starting with 48d2dc0a47a1c5fb1e6660439e64cc051d5f871701a1cbcc629226f46e64aceb not found: ID does not exist"
Sep 16 01:35:12.669641 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:12.669627    2565 scope.go:117] "RemoveContainer" containerID="d85dba65ee43e13d6c46371cafa6c86b2a2d65ebd7fdc573906e334d103425a2"
Sep 16 01:35:12.680503 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:12.680484    2565 scope.go:117] "RemoveContainer" containerID="d85dba65ee43e13d6c46371cafa6c86b2a2d65ebd7fdc573906e334d103425a2"
Sep 16 01:35:12.680792 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:35:12.680774    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d85dba65ee43e13d6c46371cafa6c86b2a2d65ebd7fdc573906e334d103425a2\": container with ID starting with d85dba65ee43e13d6c46371cafa6c86b2a2d65ebd7fdc573906e334d103425a2 not found: ID does not exist" containerID="d85dba65ee43e13d6c46371cafa6c86b2a2d65ebd7fdc573906e334d103425a2"
Sep 16 01:35:12.680853 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:12.680802    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d85dba65ee43e13d6c46371cafa6c86b2a2d65ebd7fdc573906e334d103425a2"} err="failed to get container status \"d85dba65ee43e13d6c46371cafa6c86b2a2d65ebd7fdc573906e334d103425a2\": rpc error: code = NotFound desc = could not find container \"d85dba65ee43e13d6c46371cafa6c86b2a2d65ebd7fdc573906e334d103425a2\": container with ID starting with d85dba65ee43e13d6c46371cafa6c86b2a2d65ebd7fdc573906e334d103425a2 not found: ID does not exist"
Sep 16 01:35:12.692705 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:12.692681    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-60623346-7dd49cfbc4-h4gjm"]
Sep 16 01:35:12.707948 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:12.707925    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-60623346-7dd49cfbc4-h4gjm"]
Sep 16 01:35:12.734060 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:12.734037    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-60623346-7bc746c65f-j2ck5"]
Sep 16 01:35:12.743654 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:12.743629    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-60623346-7bc746c65f-j2ck5"]
Sep 16 01:35:12.748309 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:12.748291    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/99111b0d-6fdc-4bd1-b99b-daeb7473afe1-plugins-config-volume\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:35:12.748380 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:12.748312    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9x2q4\" (UniqueName: \"kubernetes.io/projected/871acb62-9709-4d21-8068-50e68b51f2c2-kube-api-access-9x2q4\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:35:12.748380 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:12.748323    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/871acb62-9709-4d21-8068-50e68b51f2c2-plugins-config-volume\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:35:12.748380 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:12.748332    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lx7jl\" (UniqueName: \"kubernetes.io/projected/99111b0d-6fdc-4bd1-b99b-daeb7473afe1-kube-api-access-lx7jl\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:35:13.170001 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:13.169966    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="871acb62-9709-4d21-8068-50e68b51f2c2" path="/var/lib/kubelet/pods/871acb62-9709-4d21-8068-50e68b51f2c2/volumes"
Sep 16 01:35:13.170388 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:13.170374    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99111b0d-6fdc-4bd1-b99b-daeb7473afe1" path="/var/lib/kubelet/pods/99111b0d-6fdc-4bd1-b99b-daeb7473afe1/volumes"
Sep 16 01:35:13.170682 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:13.170671    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0dd697c-39cf-489c-8103-ee9613b55ed3" path="/var/lib/kubelet/pods/c0dd697c-39cf-489c-8103-ee9613b55ed3/volumes"
Sep 16 01:35:13.666415 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:13.666383    2565 generic.go:356] "Generic (PLEG): container finished" podID="01b59193-8317-485d-adb3-f222099d7ae8" containerID="20cf8fdd76204c044f458010785c67d30e211c6aa69e7baa6839fc9d829b6d00" exitCode=0
Sep 16 01:35:13.666826 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:13.666452    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-60623346-openshift-default-74b46659c6-ttl2k" event={"ID":"01b59193-8317-485d-adb3-f222099d7ae8","Type":"ContainerDied","Data":"20cf8fdd76204c044f458010785c67d30e211c6aa69e7baa6839fc9d829b6d00"}
Sep 16 01:35:13.666870 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:13.666840    2565 scope.go:117] "RemoveContainer" containerID="20cf8fdd76204c044f458010785c67d30e211c6aa69e7baa6839fc9d829b6d00"
Sep 16 01:35:13.667981 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:13.667952    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:35:13.668084 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:13.668025    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:35:13.668084 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:13.668057    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:35:13.789058 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:13.789004    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-60623346-openshift-default-74b46659c6-ttl2k"]
Sep 16 01:35:14.587415 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:14.587376    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9"]
Sep 16 01:35:14.587819 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:14.587796    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="871acb62-9709-4d21-8068-50e68b51f2c2" containerName="payload-pre-processing"
Sep 16 01:35:14.587819 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:14.587816    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="871acb62-9709-4d21-8068-50e68b51f2c2" containerName="payload-pre-processing"
Sep 16 01:35:14.588014 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:14.587831    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99111b0d-6fdc-4bd1-b99b-daeb7473afe1" containerName="payload-processing"
Sep 16 01:35:14.588014 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:14.587839    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="99111b0d-6fdc-4bd1-b99b-daeb7473afe1" containerName="payload-processing"
Sep 16 01:35:14.588014 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:14.587919    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="99111b0d-6fdc-4bd1-b99b-daeb7473afe1" containerName="payload-processing"
Sep 16 01:35:14.588014 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:14.587931    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="871acb62-9709-4d21-8068-50e68b51f2c2" containerName="payload-pre-processing"
Sep 16 01:35:14.590254 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:14.590233    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9"
Sep 16 01:35:14.592583 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:14.592563    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-74a27a74-openshift-default-dockercfg-dp6sf\""
Sep 16 01:35:14.602563 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:14.602543    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9"]
Sep 16 01:35:14.668506 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:14.668477    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec2fbfef-353f-4860-b192-3be6c070ea57-istio-podinfo\") pod \"e2e-derive-74a27a74-openshift-default-ff859598d-56dv9\" (UID: \"ec2fbfef-353f-4860-b192-3be6c070ea57\") " pod="openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9"
Sep 16 01:35:14.668506 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:14.668510    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec2fbfef-353f-4860-b192-3be6c070ea57-istiod-ca-cert\") pod \"e2e-derive-74a27a74-openshift-default-ff859598d-56dv9\" (UID: \"ec2fbfef-353f-4860-b192-3be6c070ea57\") " pod="openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9"
Sep 16 01:35:14.669002 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:14.668550    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec2fbfef-353f-4860-b192-3be6c070ea57-istio-data\") pod \"e2e-derive-74a27a74-openshift-default-ff859598d-56dv9\" (UID: \"ec2fbfef-353f-4860-b192-3be6c070ea57\") " pod="openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9"
Sep 16 01:35:14.669002 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:14.668578    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec2fbfef-353f-4860-b192-3be6c070ea57-credential-socket\") pod \"e2e-derive-74a27a74-openshift-default-ff859598d-56dv9\" (UID: \"ec2fbfef-353f-4860-b192-3be6c070ea57\") " pod="openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9"
Sep 16 01:35:14.669002 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:14.668650    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec2fbfef-353f-4860-b192-3be6c070ea57-workload-certs\") pod \"e2e-derive-74a27a74-openshift-default-ff859598d-56dv9\" (UID: \"ec2fbfef-353f-4860-b192-3be6c070ea57\") " pod="openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9"
Sep 16 01:35:14.669002 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:14.668748    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec2fbfef-353f-4860-b192-3be6c070ea57-istio-envoy\") pod \"e2e-derive-74a27a74-openshift-default-ff859598d-56dv9\" (UID: \"ec2fbfef-353f-4860-b192-3be6c070ea57\") " pod="openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9"
Sep 16 01:35:14.669002 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:14.668790    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec2fbfef-353f-4860-b192-3be6c070ea57-istio-token\") pod \"e2e-derive-74a27a74-openshift-default-ff859598d-56dv9\" (UID: \"ec2fbfef-353f-4860-b192-3be6c070ea57\") " pod="openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9"
Sep 16 01:35:14.669002 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:14.668831    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqk88\" (UniqueName: \"kubernetes.io/projected/ec2fbfef-353f-4860-b192-3be6c070ea57-kube-api-access-mqk88\") pod \"e2e-derive-74a27a74-openshift-default-ff859598d-56dv9\" (UID: \"ec2fbfef-353f-4860-b192-3be6c070ea57\") " pod="openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9"
Sep 16 01:35:14.669002 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:14.668893    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec2fbfef-353f-4860-b192-3be6c070ea57-workload-socket\") pod \"e2e-derive-74a27a74-openshift-default-ff859598d-56dv9\" (UID: \"ec2fbfef-353f-4860-b192-3be6c070ea57\") " pod="openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9"
Sep 16 01:35:14.673854 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:14.673829    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-60623346-openshift-default-74b46659c6-ttl2k" event={"ID":"01b59193-8317-485d-adb3-f222099d7ae8","Type":"ContainerStarted","Data":"e51e2fc37fbc77bf352ac341a8b810ec23fd0a68fd3a86905c110e96abb66e13"}
Sep 16 01:35:14.674004 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:14.673894    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-60623346-openshift-default-74b46659c6-ttl2k" podUID="01b59193-8317-485d-adb3-f222099d7ae8" containerName="istio-proxy" containerID="cri-o://e51e2fc37fbc77bf352ac341a8b810ec23fd0a68fd3a86905c110e96abb66e13" gracePeriod=30
Sep 16 01:35:14.769426 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:14.769385    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec2fbfef-353f-4860-b192-3be6c070ea57-istio-podinfo\") pod \"e2e-derive-74a27a74-openshift-default-ff859598d-56dv9\" (UID: \"ec2fbfef-353f-4860-b192-3be6c070ea57\") " pod="openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9"
Sep 16 01:35:14.769426 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:14.769437    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec2fbfef-353f-4860-b192-3be6c070ea57-istiod-ca-cert\") pod \"e2e-derive-74a27a74-openshift-default-ff859598d-56dv9\" (UID: \"ec2fbfef-353f-4860-b192-3be6c070ea57\") " pod="openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9"
Sep 16 01:35:14.769678 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:14.769468    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec2fbfef-353f-4860-b192-3be6c070ea57-istio-data\") pod \"e2e-derive-74a27a74-openshift-default-ff859598d-56dv9\" (UID: \"ec2fbfef-353f-4860-b192-3be6c070ea57\") " pod="openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9"
Sep 16 01:35:14.769678 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:14.769488    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec2fbfef-353f-4860-b192-3be6c070ea57-credential-socket\") pod \"e2e-derive-74a27a74-openshift-default-ff859598d-56dv9\" (UID: \"ec2fbfef-353f-4860-b192-3be6c070ea57\") " pod="openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9"
Sep 16 01:35:14.769678 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:14.769506    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec2fbfef-353f-4860-b192-3be6c070ea57-workload-certs\") pod \"e2e-derive-74a27a74-openshift-default-ff859598d-56dv9\" (UID: \"ec2fbfef-353f-4860-b192-3be6c070ea57\") " pod="openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9"
Sep 16 01:35:14.769678 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:14.769559    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec2fbfef-353f-4860-b192-3be6c070ea57-istio-envoy\") pod \"e2e-derive-74a27a74-openshift-default-ff859598d-56dv9\" (UID: \"ec2fbfef-353f-4860-b192-3be6c070ea57\") " pod="openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9"
Sep 16 01:35:14.769678 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:14.769599    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec2fbfef-353f-4860-b192-3be6c070ea57-istio-token\") pod \"e2e-derive-74a27a74-openshift-default-ff859598d-56dv9\" (UID: \"ec2fbfef-353f-4860-b192-3be6c070ea57\") " pod="openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9"
Sep 16 01:35:14.769678 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:14.769641    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqk88\" (UniqueName: \"kubernetes.io/projected/ec2fbfef-353f-4860-b192-3be6c070ea57-kube-api-access-mqk88\") pod \"e2e-derive-74a27a74-openshift-default-ff859598d-56dv9\" (UID: \"ec2fbfef-353f-4860-b192-3be6c070ea57\") " pod="openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9"
Sep 16 01:35:14.769989 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:14.769685    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec2fbfef-353f-4860-b192-3be6c070ea57-workload-socket\") pod \"e2e-derive-74a27a74-openshift-default-ff859598d-56dv9\" (UID: \"ec2fbfef-353f-4860-b192-3be6c070ea57\") " pod="openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9"
Sep 16 01:35:14.769989 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:14.769965    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec2fbfef-353f-4860-b192-3be6c070ea57-istio-data\") pod \"e2e-derive-74a27a74-openshift-default-ff859598d-56dv9\" (UID: \"ec2fbfef-353f-4860-b192-3be6c070ea57\") " pod="openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9"
Sep 16 01:35:14.770106 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:14.770087    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec2fbfef-353f-4860-b192-3be6c070ea57-workload-socket\") pod \"e2e-derive-74a27a74-openshift-default-ff859598d-56dv9\" (UID: \"ec2fbfef-353f-4860-b192-3be6c070ea57\") " pod="openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9"
Sep 16 01:35:14.770195 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:14.770173    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec2fbfef-353f-4860-b192-3be6c070ea57-workload-certs\") pod \"e2e-derive-74a27a74-openshift-default-ff859598d-56dv9\" (UID: \"ec2fbfef-353f-4860-b192-3be6c070ea57\") " pod="openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9"
Sep 16 01:35:14.770263 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:14.770217    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec2fbfef-353f-4860-b192-3be6c070ea57-credential-socket\") pod \"e2e-derive-74a27a74-openshift-default-ff859598d-56dv9\" (UID: \"ec2fbfef-353f-4860-b192-3be6c070ea57\") " pod="openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9"
Sep 16 01:35:14.770397 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:14.770374    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec2fbfef-353f-4860-b192-3be6c070ea57-istiod-ca-cert\") pod \"e2e-derive-74a27a74-openshift-default-ff859598d-56dv9\" (UID: \"ec2fbfef-353f-4860-b192-3be6c070ea57\") " pod="openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9"
Sep 16 01:35:14.772269 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:14.772247    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec2fbfef-353f-4860-b192-3be6c070ea57-istio-envoy\") pod \"e2e-derive-74a27a74-openshift-default-ff859598d-56dv9\" (UID: \"ec2fbfef-353f-4860-b192-3be6c070ea57\") " pod="openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9"
Sep 16 01:35:14.772492 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:14.772474    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec2fbfef-353f-4860-b192-3be6c070ea57-istio-podinfo\") pod \"e2e-derive-74a27a74-openshift-default-ff859598d-56dv9\" (UID: \"ec2fbfef-353f-4860-b192-3be6c070ea57\") " pod="openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9"
Sep 16 01:35:14.777547 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:14.777523    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqk88\" (UniqueName: \"kubernetes.io/projected/ec2fbfef-353f-4860-b192-3be6c070ea57-kube-api-access-mqk88\") pod \"e2e-derive-74a27a74-openshift-default-ff859598d-56dv9\" (UID: \"ec2fbfef-353f-4860-b192-3be6c070ea57\") " pod="openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9"
Sep 16 01:35:14.777778 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:14.777760    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec2fbfef-353f-4860-b192-3be6c070ea57-istio-token\") pod \"e2e-derive-74a27a74-openshift-default-ff859598d-56dv9\" (UID: \"ec2fbfef-353f-4860-b192-3be6c070ea57\") " pod="openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9"
Sep 16 01:35:14.901573 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:14.901495    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9"
Sep 16 01:35:15.180584 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:15.180559    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9"]
Sep 16 01:35:15.182420 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:35:15.182388    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec2fbfef_353f_4860_b192_3be6c070ea57.slice/crio-1a515855637f528ea33d8850c1570f1e5bb98926964b65c0f78044bea970ae2d WatchSource:0}: Error finding container 1a515855637f528ea33d8850c1570f1e5bb98926964b65c0f78044bea970ae2d: Status 404 returned error can't find the container with id 1a515855637f528ea33d8850c1570f1e5bb98926964b65c0f78044bea970ae2d
Sep 16 01:35:15.184927 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:15.184878    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:35:15.185000 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:15.184976    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:35:15.185040 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:15.185019    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:35:15.681991 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:15.681954    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9" event={"ID":"ec2fbfef-353f-4860-b192-3be6c070ea57","Type":"ContainerStarted","Data":"d129f907792f3d511ac4f92845c80775daadcbe2213afd02e0aaa5d444f67105"}
Sep 16 01:35:15.682394 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:15.682037    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9" event={"ID":"ec2fbfef-353f-4860-b192-3be6c070ea57","Type":"ContainerStarted","Data":"1a515855637f528ea33d8850c1570f1e5bb98926964b65c0f78044bea970ae2d"}
Sep 16 01:35:15.704263 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:15.704212    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9" podStartSLOduration=1.704194838 podStartE2EDuration="1.704194838s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:35:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:35:15.701722519 +0000 UTC m=+1165.025191097" watchObservedRunningTime="2026-09-16 01:35:15.704194838 +0000 UTC m=+1165.027663414"
Sep 16 01:35:15.902654 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:15.902603    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9"
Sep 16 01:35:16.907540 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:16.907503    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9"
Sep 16 01:35:17.625921 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:17.625888    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c0ec73-7788cdf566-vqjrj"
Sep 16 01:35:17.694139 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:17.694109    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9"
Sep 16 01:35:17.695450 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:17.695422    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9"
Sep 16 01:35:19.983607 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:19.983575    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-60623346-openshift-default-74b46659c6-ttl2k"
Sep 16 01:35:20.027605 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.027572    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cqf67\" (UniqueName: \"kubernetes.io/projected/01b59193-8317-485d-adb3-f222099d7ae8-kube-api-access-cqf67\") pod \"01b59193-8317-485d-adb3-f222099d7ae8\" (UID: \"01b59193-8317-485d-adb3-f222099d7ae8\") "
Sep 16 01:35:20.027806 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.027652    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01b59193-8317-485d-adb3-f222099d7ae8-istio-podinfo\") pod \"01b59193-8317-485d-adb3-f222099d7ae8\" (UID: \"01b59193-8317-485d-adb3-f222099d7ae8\") "
Sep 16 01:35:20.027806 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.027753    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01b59193-8317-485d-adb3-f222099d7ae8-istio-data\") pod \"01b59193-8317-485d-adb3-f222099d7ae8\" (UID: \"01b59193-8317-485d-adb3-f222099d7ae8\") "
Sep 16 01:35:20.027935 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.027814    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01b59193-8317-485d-adb3-f222099d7ae8-istiod-ca-cert\") pod \"01b59193-8317-485d-adb3-f222099d7ae8\" (UID: \"01b59193-8317-485d-adb3-f222099d7ae8\") "
Sep 16 01:35:20.027935 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.027853    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01b59193-8317-485d-adb3-f222099d7ae8-workload-certs\") pod \"01b59193-8317-485d-adb3-f222099d7ae8\" (UID: \"01b59193-8317-485d-adb3-f222099d7ae8\") "
Sep 16 01:35:20.027935 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.027893    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01b59193-8317-485d-adb3-f222099d7ae8-credential-socket\") pod \"01b59193-8317-485d-adb3-f222099d7ae8\" (UID: \"01b59193-8317-485d-adb3-f222099d7ae8\") "
Sep 16 01:35:20.028105 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.027937    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01b59193-8317-485d-adb3-f222099d7ae8-workload-socket\") pod \"01b59193-8317-485d-adb3-f222099d7ae8\" (UID: \"01b59193-8317-485d-adb3-f222099d7ae8\") "
Sep 16 01:35:20.028105 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.027963    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01b59193-8317-485d-adb3-f222099d7ae8-istio-token\") pod \"01b59193-8317-485d-adb3-f222099d7ae8\" (UID: \"01b59193-8317-485d-adb3-f222099d7ae8\") "
Sep 16 01:35:20.028105 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.028000    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01b59193-8317-485d-adb3-f222099d7ae8-istio-envoy\") pod \"01b59193-8317-485d-adb3-f222099d7ae8\" (UID: \"01b59193-8317-485d-adb3-f222099d7ae8\") "
Sep 16 01:35:20.028105 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.028012    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01b59193-8317-485d-adb3-f222099d7ae8-istio-data" (OuterVolumeSpecName: "istio-data") pod "01b59193-8317-485d-adb3-f222099d7ae8" (UID: "01b59193-8317-485d-adb3-f222099d7ae8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:35:20.028105 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.028086    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01b59193-8317-485d-adb3-f222099d7ae8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "01b59193-8317-485d-adb3-f222099d7ae8" (UID: "01b59193-8317-485d-adb3-f222099d7ae8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:35:20.028375 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.028234    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01b59193-8317-485d-adb3-f222099d7ae8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "01b59193-8317-485d-adb3-f222099d7ae8" (UID: "01b59193-8317-485d-adb3-f222099d7ae8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:35:20.028375 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.028276    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01b59193-8317-485d-adb3-f222099d7ae8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "01b59193-8317-485d-adb3-f222099d7ae8" (UID: "01b59193-8317-485d-adb3-f222099d7ae8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:35:20.028486 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.028427    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01b59193-8317-485d-adb3-f222099d7ae8-istio-data\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:35:20.028486 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.028446    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01b59193-8317-485d-adb3-f222099d7ae8-istiod-ca-cert\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:35:20.028592 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.028488    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01b59193-8317-485d-adb3-f222099d7ae8-workload-certs\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:35:20.028592 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.028501    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01b59193-8317-485d-adb3-f222099d7ae8-workload-socket\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:35:20.028592 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.028521    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01b59193-8317-485d-adb3-f222099d7ae8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "01b59193-8317-485d-adb3-f222099d7ae8" (UID: "01b59193-8317-485d-adb3-f222099d7ae8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:35:20.029934 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.029900    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/01b59193-8317-485d-adb3-f222099d7ae8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "01b59193-8317-485d-adb3-f222099d7ae8" (UID: "01b59193-8317-485d-adb3-f222099d7ae8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 01:35:20.030042 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.029957    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01b59193-8317-485d-adb3-f222099d7ae8-kube-api-access-cqf67" (OuterVolumeSpecName: "kube-api-access-cqf67") pod "01b59193-8317-485d-adb3-f222099d7ae8" (UID: "01b59193-8317-485d-adb3-f222099d7ae8"). InnerVolumeSpecName "kube-api-access-cqf67". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:35:20.030618 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.030597    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01b59193-8317-485d-adb3-f222099d7ae8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "01b59193-8317-485d-adb3-f222099d7ae8" (UID: "01b59193-8317-485d-adb3-f222099d7ae8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:35:20.030692 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.030632    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01b59193-8317-485d-adb3-f222099d7ae8-istio-token" (OuterVolumeSpecName: "istio-token") pod "01b59193-8317-485d-adb3-f222099d7ae8" (UID: "01b59193-8317-485d-adb3-f222099d7ae8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:35:20.129595 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.129560    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01b59193-8317-485d-adb3-f222099d7ae8-istio-podinfo\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:35:20.129595 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.129591    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01b59193-8317-485d-adb3-f222099d7ae8-credential-socket\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:35:20.129595 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.129601    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01b59193-8317-485d-adb3-f222099d7ae8-istio-token\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:35:20.129841 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.129612    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01b59193-8317-485d-adb3-f222099d7ae8-istio-envoy\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:35:20.129841 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.129623    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cqf67\" (UniqueName: \"kubernetes.io/projected/01b59193-8317-485d-adb3-f222099d7ae8-kube-api-access-cqf67\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:35:20.297404 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.297310    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-74a27a74-7f4bb45b66-dxr5s"]
Sep 16 01:35:20.297734 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.297721    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01b59193-8317-485d-adb3-f222099d7ae8" containerName="istio-proxy"
Sep 16 01:35:20.297734 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.297735    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="01b59193-8317-485d-adb3-f222099d7ae8" containerName="istio-proxy"
Sep 16 01:35:20.297814 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.297809    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="01b59193-8317-485d-adb3-f222099d7ae8" containerName="istio-proxy"
Sep 16 01:35:20.301202 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.301182    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-74a27a74-7f4bb45b66-dxr5s"
Sep 16 01:35:20.303690 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.303667    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-74a27a74\""
Sep 16 01:35:20.303747 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.303717    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-74a27a74-dockercfg-n2j6p\""
Sep 16 01:35:20.310608 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.310586    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-74a27a74-7f4bb45b66-dxr5s"]
Sep 16 01:35:20.331230 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.331191    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-74a27a74-6d9dc4dbbf-zg26m"]
Sep 16 01:35:20.331870 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.331847    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01b59193-8317-485d-adb3-f222099d7ae8" containerName="istio-proxy"
Sep 16 01:35:20.331934 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.331876    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="01b59193-8317-485d-adb3-f222099d7ae8" containerName="istio-proxy"
Sep 16 01:35:20.332027 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.332012    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="01b59193-8317-485d-adb3-f222099d7ae8" containerName="istio-proxy"
Sep 16 01:35:20.335125 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.335102    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-74a27a74-6d9dc4dbbf-zg26m"
Sep 16 01:35:20.343175 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.343147    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-74a27a74-6d9dc4dbbf-zg26m"]
Sep 16 01:35:20.432661 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.432624    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2fc9ed15-1fe1-4896-a1b6-8a4187664f8a-plugins-config-volume\") pod \"payload-processing-e2e-derive-74a27a74-6d9dc4dbbf-zg26m\" (UID: \"2fc9ed15-1fe1-4896-a1b6-8a4187664f8a\") " pod="openshift-ingress/payload-processing-e2e-derive-74a27a74-6d9dc4dbbf-zg26m"
Sep 16 01:35:20.432870 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.432764    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tzmg\" (UniqueName: \"kubernetes.io/projected/2fc9ed15-1fe1-4896-a1b6-8a4187664f8a-kube-api-access-4tzmg\") pod \"payload-processing-e2e-derive-74a27a74-6d9dc4dbbf-zg26m\" (UID: \"2fc9ed15-1fe1-4896-a1b6-8a4187664f8a\") " pod="openshift-ingress/payload-processing-e2e-derive-74a27a74-6d9dc4dbbf-zg26m"
Sep 16 01:35:20.432870 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.432826    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c0482d09-e212-4085-8cec-68fc1b7708ed-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-74a27a74-7f4bb45b66-dxr5s\" (UID: \"c0482d09-e212-4085-8cec-68fc1b7708ed\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-74a27a74-7f4bb45b66-dxr5s"
Sep 16 01:35:20.432981 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.432955    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txhxd\" (UniqueName: \"kubernetes.io/projected/c0482d09-e212-4085-8cec-68fc1b7708ed-kube-api-access-txhxd\") pod \"payload-pre-processing-e2e-derive-74a27a74-7f4bb45b66-dxr5s\" (UID: \"c0482d09-e212-4085-8cec-68fc1b7708ed\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-74a27a74-7f4bb45b66-dxr5s"
Sep 16 01:35:20.533866 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.533824    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tzmg\" (UniqueName: \"kubernetes.io/projected/2fc9ed15-1fe1-4896-a1b6-8a4187664f8a-kube-api-access-4tzmg\") pod \"payload-processing-e2e-derive-74a27a74-6d9dc4dbbf-zg26m\" (UID: \"2fc9ed15-1fe1-4896-a1b6-8a4187664f8a\") " pod="openshift-ingress/payload-processing-e2e-derive-74a27a74-6d9dc4dbbf-zg26m"
Sep 16 01:35:20.534092 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.533889    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c0482d09-e212-4085-8cec-68fc1b7708ed-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-74a27a74-7f4bb45b66-dxr5s\" (UID: \"c0482d09-e212-4085-8cec-68fc1b7708ed\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-74a27a74-7f4bb45b66-dxr5s"
Sep 16 01:35:20.534092 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.533975    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txhxd\" (UniqueName: \"kubernetes.io/projected/c0482d09-e212-4085-8cec-68fc1b7708ed-kube-api-access-txhxd\") pod \"payload-pre-processing-e2e-derive-74a27a74-7f4bb45b66-dxr5s\" (UID: \"c0482d09-e212-4085-8cec-68fc1b7708ed\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-74a27a74-7f4bb45b66-dxr5s"
Sep 16 01:35:20.534092 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.534023    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2fc9ed15-1fe1-4896-a1b6-8a4187664f8a-plugins-config-volume\") pod \"payload-processing-e2e-derive-74a27a74-6d9dc4dbbf-zg26m\" (UID: \"2fc9ed15-1fe1-4896-a1b6-8a4187664f8a\") " pod="openshift-ingress/payload-processing-e2e-derive-74a27a74-6d9dc4dbbf-zg26m"
Sep 16 01:35:20.534750 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.534721    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c0482d09-e212-4085-8cec-68fc1b7708ed-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-74a27a74-7f4bb45b66-dxr5s\" (UID: \"c0482d09-e212-4085-8cec-68fc1b7708ed\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-74a27a74-7f4bb45b66-dxr5s"
Sep 16 01:35:20.534750 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.534743    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2fc9ed15-1fe1-4896-a1b6-8a4187664f8a-plugins-config-volume\") pod \"payload-processing-e2e-derive-74a27a74-6d9dc4dbbf-zg26m\" (UID: \"2fc9ed15-1fe1-4896-a1b6-8a4187664f8a\") " pod="openshift-ingress/payload-processing-e2e-derive-74a27a74-6d9dc4dbbf-zg26m"
Sep 16 01:35:20.541482 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.541463    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txhxd\" (UniqueName: \"kubernetes.io/projected/c0482d09-e212-4085-8cec-68fc1b7708ed-kube-api-access-txhxd\") pod \"payload-pre-processing-e2e-derive-74a27a74-7f4bb45b66-dxr5s\" (UID: \"c0482d09-e212-4085-8cec-68fc1b7708ed\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-74a27a74-7f4bb45b66-dxr5s"
Sep 16 01:35:20.541580 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.541561    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tzmg\" (UniqueName: \"kubernetes.io/projected/2fc9ed15-1fe1-4896-a1b6-8a4187664f8a-kube-api-access-4tzmg\") pod \"payload-processing-e2e-derive-74a27a74-6d9dc4dbbf-zg26m\" (UID: \"2fc9ed15-1fe1-4896-a1b6-8a4187664f8a\") " pod="openshift-ingress/payload-processing-e2e-derive-74a27a74-6d9dc4dbbf-zg26m"
Sep 16 01:35:20.612873 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.612782    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-74a27a74-7f4bb45b66-dxr5s"
Sep 16 01:35:20.663554 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.663501    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-74a27a74-6d9dc4dbbf-zg26m"
Sep 16 01:35:20.717139 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.717098    2565 generic.go:356] "Generic (PLEG): container finished" podID="01b59193-8317-485d-adb3-f222099d7ae8" containerID="e51e2fc37fbc77bf352ac341a8b810ec23fd0a68fd3a86905c110e96abb66e13" exitCode=0
Sep 16 01:35:20.717355 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.717196    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-60623346-openshift-default-74b46659c6-ttl2k"
Sep 16 01:35:20.717355 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.717199    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-60623346-openshift-default-74b46659c6-ttl2k" event={"ID":"01b59193-8317-485d-adb3-f222099d7ae8","Type":"ContainerDied","Data":"e51e2fc37fbc77bf352ac341a8b810ec23fd0a68fd3a86905c110e96abb66e13"}
Sep 16 01:35:20.717355 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.717323    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-60623346-openshift-default-74b46659c6-ttl2k" event={"ID":"01b59193-8317-485d-adb3-f222099d7ae8","Type":"ContainerDied","Data":"2d4c58c22bdb773a72d503e8f4940b40d0357844f446d17e22c38eab7734e189"}
Sep 16 01:35:20.717544 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.717362    2565 scope.go:117] "RemoveContainer" containerID="e51e2fc37fbc77bf352ac341a8b810ec23fd0a68fd3a86905c110e96abb66e13"
Sep 16 01:35:20.731668 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.731638    2565 scope.go:117] "RemoveContainer" containerID="20cf8fdd76204c044f458010785c67d30e211c6aa69e7baa6839fc9d829b6d00"
Sep 16 01:35:20.755606 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.754516    2565 scope.go:117] "RemoveContainer" containerID="e51e2fc37fbc77bf352ac341a8b810ec23fd0a68fd3a86905c110e96abb66e13"
Sep 16 01:35:20.755606 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.754644    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-60623346-openshift-default-74b46659c6-ttl2k"]
Sep 16 01:35:20.755606 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:35:20.755081    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e51e2fc37fbc77bf352ac341a8b810ec23fd0a68fd3a86905c110e96abb66e13\": container with ID starting with e51e2fc37fbc77bf352ac341a8b810ec23fd0a68fd3a86905c110e96abb66e13 not found: ID does not exist" containerID="e51e2fc37fbc77bf352ac341a8b810ec23fd0a68fd3a86905c110e96abb66e13"
Sep 16 01:35:20.755606 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.755115    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e51e2fc37fbc77bf352ac341a8b810ec23fd0a68fd3a86905c110e96abb66e13"} err="failed to get container status \"e51e2fc37fbc77bf352ac341a8b810ec23fd0a68fd3a86905c110e96abb66e13\": rpc error: code = NotFound desc = could not find container \"e51e2fc37fbc77bf352ac341a8b810ec23fd0a68fd3a86905c110e96abb66e13\": container with ID starting with e51e2fc37fbc77bf352ac341a8b810ec23fd0a68fd3a86905c110e96abb66e13 not found: ID does not exist"
Sep 16 01:35:20.755606 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.755144    2565 scope.go:117] "RemoveContainer" containerID="20cf8fdd76204c044f458010785c67d30e211c6aa69e7baa6839fc9d829b6d00"
Sep 16 01:35:20.756116 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:35:20.756013    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20cf8fdd76204c044f458010785c67d30e211c6aa69e7baa6839fc9d829b6d00\": container with ID starting with 20cf8fdd76204c044f458010785c67d30e211c6aa69e7baa6839fc9d829b6d00 not found: ID does not exist" containerID="20cf8fdd76204c044f458010785c67d30e211c6aa69e7baa6839fc9d829b6d00"
Sep 16 01:35:20.756116 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.756045    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20cf8fdd76204c044f458010785c67d30e211c6aa69e7baa6839fc9d829b6d00"} err="failed to get container status \"20cf8fdd76204c044f458010785c67d30e211c6aa69e7baa6839fc9d829b6d00\": rpc error: code = NotFound desc = could not find container \"20cf8fdd76204c044f458010785c67d30e211c6aa69e7baa6839fc9d829b6d00\": container with ID starting with 20cf8fdd76204c044f458010785c67d30e211c6aa69e7baa6839fc9d829b6d00 not found: ID does not exist"
Sep 16 01:35:20.779374 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.775901    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-60623346-openshift-default-74b46659c6-ttl2k"]
Sep 16 01:35:20.911533 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.911502    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-74a27a74-7f4bb45b66-dxr5s"]
Sep 16 01:35:20.913704 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:35:20.913673    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0482d09_e212_4085_8cec_68fc1b7708ed.slice/crio-878ecee5511290ce91975da8d3753840e23174d34128bd9b343447a5210a9ffc WatchSource:0}: Error finding container 878ecee5511290ce91975da8d3753840e23174d34128bd9b343447a5210a9ffc: Status 404 returned error can't find the container with id 878ecee5511290ce91975da8d3753840e23174d34128bd9b343447a5210a9ffc
Sep 16 01:35:20.965118 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:20.958321    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-74a27a74-6d9dc4dbbf-zg26m"]
Sep 16 01:35:21.181412 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:21.181292    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01b59193-8317-485d-adb3-f222099d7ae8" path="/var/lib/kubelet/pods/01b59193-8317-485d-adb3-f222099d7ae8/volumes"
Sep 16 01:35:21.724714 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:21.724673    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-74a27a74-7f4bb45b66-dxr5s" event={"ID":"c0482d09-e212-4085-8cec-68fc1b7708ed","Type":"ContainerStarted","Data":"ced17f9f2abdd50570544238ea934ac20eb888bbd945349807ae999596f24116"}
Sep 16 01:35:21.724941 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:21.724743    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-74a27a74-7f4bb45b66-dxr5s"
Sep 16 01:35:21.724941 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:21.724770    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-74a27a74-7f4bb45b66-dxr5s" event={"ID":"c0482d09-e212-4085-8cec-68fc1b7708ed","Type":"ContainerStarted","Data":"878ecee5511290ce91975da8d3753840e23174d34128bd9b343447a5210a9ffc"}
Sep 16 01:35:21.726241 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:21.726209    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-74a27a74-6d9dc4dbbf-zg26m" event={"ID":"2fc9ed15-1fe1-4896-a1b6-8a4187664f8a","Type":"ContainerStarted","Data":"d094ae728329780e868af1417abe27803bca93a8dd7b5d87e62e518b6ff48105"}
Sep 16 01:35:21.726381 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:21.726259    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-74a27a74-6d9dc4dbbf-zg26m" event={"ID":"2fc9ed15-1fe1-4896-a1b6-8a4187664f8a","Type":"ContainerStarted","Data":"21abbf42790ea5237cc24a7683f2a6d9e8c741bdb2e2c67841b66fff8833f269"}
Sep 16 01:35:21.726381 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:21.726291    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-74a27a74-6d9dc4dbbf-zg26m"
Sep 16 01:35:21.742521 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:21.742470    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-74a27a74-7f4bb45b66-dxr5s" podStartSLOduration=1.742453057 podStartE2EDuration="1.742453057s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:35:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:35:21.738840512 +0000 UTC m=+1171.062309091" watchObservedRunningTime="2026-09-16 01:35:21.742453057 +0000 UTC m=+1171.065921672"
Sep 16 01:35:21.753164 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:21.753095    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-74a27a74-6d9dc4dbbf-zg26m" podStartSLOduration=1.753073238 podStartE2EDuration="1.753073238s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:35:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:35:21.752330247 +0000 UTC m=+1171.075798824" watchObservedRunningTime="2026-09-16 01:35:21.753073238 +0000 UTC m=+1171.076541815"
Sep 16 01:35:24.163851 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:24.163808    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-processing-5d7dbbd56b-4455c" secret="" err="secret \"payload-processing-dockercfg-kkbcm\" not found"
Sep 16 01:35:25.755414 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:25.755365    2565 generic.go:356] "Generic (PLEG): container finished" podID="fc8ba9c0-9e0f-4550-9c19-265da23baf55" containerID="5aa88c2c161fffdf6004ad2b204989b5dcadcdab5c758ac2e724e7de21c18ec4" exitCode=0
Sep 16 01:35:25.755848 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:25.755425    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q" event={"ID":"fc8ba9c0-9e0f-4550-9c19-265da23baf55","Type":"ContainerDied","Data":"5aa88c2c161fffdf6004ad2b204989b5dcadcdab5c758ac2e724e7de21c18ec4"}
Sep 16 01:35:25.755907 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:25.755883    2565 scope.go:117] "RemoveContainer" containerID="5aa88c2c161fffdf6004ad2b204989b5dcadcdab5c758ac2e724e7de21c18ec4"
Sep 16 01:35:25.757063 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:25.757035    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:35:25.757136 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:25.757101    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:35:25.757173 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:25.757134    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:35:26.767447 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:26.767400    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q" event={"ID":"fc8ba9c0-9e0f-4550-9c19-265da23baf55","Type":"ContainerStarted","Data":"6f7597da3b6acb2c1ad12dd7f2c09c7c46fd8a9b89a9cda168f3569cbb529614"}
Sep 16 01:35:27.371311 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:27.371250    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q"
Sep 16 01:35:27.372430 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:27.372404    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 16 01:35:27.372566 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:27.372453    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q" podUID="fc8ba9c0-9e0f-4550-9c19-265da23baf55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 16 01:35:28.371584 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:28.371537    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 16 01:35:28.371982 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:28.371638    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q" podUID="fc8ba9c0-9e0f-4550-9c19-265da23baf55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 16 01:35:29.371509 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:29.371464    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 16 01:35:29.371689 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:29.371536    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q" podUID="fc8ba9c0-9e0f-4550-9c19-265da23baf55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 16 01:35:30.370821 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:30.370779    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 16 01:35:30.371048 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:30.370846    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q" podUID="fc8ba9c0-9e0f-4550-9c19-265da23baf55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 16 01:35:31.371482 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:31.371441    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 16 01:35:31.371918 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:31.371542    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q" podUID="fc8ba9c0-9e0f-4550-9c19-265da23baf55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 16 01:35:31.583373 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:31.583307    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q"
Sep 16 01:35:32.375718 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:32.375683    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q"
Sep 16 01:35:32.376622 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:32.376603    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q"
Sep 16 01:35:32.737452 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:32.737419    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-74a27a74-7f4bb45b66-dxr5s"
Sep 16 01:35:32.737630 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:32.737497    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-74a27a74-6d9dc4dbbf-zg26m"
Sep 16 01:35:33.168555 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:33.168510    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-6cd864bc95-st4pq" secret="" err="secret \"payload-processing-dockercfg-kkbcm\" not found"
Sep 16 01:35:41.855243 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:41.855158    2565 generic.go:356] "Generic (PLEG): container finished" podID="ec2fbfef-353f-4860-b192-3be6c070ea57" containerID="d129f907792f3d511ac4f92845c80775daadcbe2213afd02e0aaa5d444f67105" exitCode=0
Sep 16 01:35:41.855767 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:41.855230    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9" event={"ID":"ec2fbfef-353f-4860-b192-3be6c070ea57","Type":"ContainerDied","Data":"d129f907792f3d511ac4f92845c80775daadcbe2213afd02e0aaa5d444f67105"}
Sep 16 01:35:41.855840 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:41.855778    2565 scope.go:117] "RemoveContainer" containerID="d129f907792f3d511ac4f92845c80775daadcbe2213afd02e0aaa5d444f67105"
Sep 16 01:35:41.856976 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:41.856944    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:35:41.857065 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:41.857013    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:35:41.857065 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:41.857045    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:35:42.205060 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:42.205017    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-74a27a74-vbxvh"]
Sep 16 01:35:42.207557 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:42.207533    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-74a27a74-vbxvh"
Sep 16 01:35:42.209879 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:42.209852    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4ljjd\""
Sep 16 01:35:42.209879 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:42.209866    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 01:35:42.214566 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:42.214500    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-74a27a74-vbxvh"]
Sep 16 01:35:42.277740 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:42.277702    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92a191ac-defe-4765-bf3e-cf9134709b50-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-74a27a74-vbxvh\" (UID: \"92a191ac-defe-4765-bf3e-cf9134709b50\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-74a27a74-vbxvh"
Sep 16 01:35:42.379124 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:42.379081    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92a191ac-defe-4765-bf3e-cf9134709b50-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-74a27a74-vbxvh\" (UID: \"92a191ac-defe-4765-bf3e-cf9134709b50\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-74a27a74-vbxvh"
Sep 16 01:35:42.379778 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:42.379760    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92a191ac-defe-4765-bf3e-cf9134709b50-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-74a27a74-vbxvh\" (UID: \"92a191ac-defe-4765-bf3e-cf9134709b50\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-74a27a74-vbxvh"
Sep 16 01:35:42.520901 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:42.520807    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-74a27a74-vbxvh"
Sep 16 01:35:42.811281 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:42.811189    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-74a27a74-vbxvh"]
Sep 16 01:35:42.814032 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:35:42.814005    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92a191ac_defe_4765_bf3e_cf9134709b50.slice/crio-368a8b2e109d5479c90afc6aa21186b7bebac506ef2743668b883b2a6ab0f119 WatchSource:0}: Error finding container 368a8b2e109d5479c90afc6aa21186b7bebac506ef2743668b883b2a6ab0f119: Status 404 returned error can't find the container with id 368a8b2e109d5479c90afc6aa21186b7bebac506ef2743668b883b2a6ab0f119
Sep 16 01:35:42.865857 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:42.865811    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-74a27a74-vbxvh" event={"ID":"92a191ac-defe-4765-bf3e-cf9134709b50","Type":"ContainerStarted","Data":"368a8b2e109d5479c90afc6aa21186b7bebac506ef2743668b883b2a6ab0f119"}
Sep 16 01:35:42.868483 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:42.868447    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9" event={"ID":"ec2fbfef-353f-4860-b192-3be6c070ea57","Type":"ContainerStarted","Data":"b2e266f2dcf87b666e1031279f834061e6bf2efa418db90cb1ea9e5b1ad00bf5"}
Sep 16 01:35:42.902634 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:42.902594    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9"
Sep 16 01:35:42.902899 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:42.902876    2565 patch_prober.go:28] interesting pod/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 16 01:35:42.903047 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:42.902934    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9" podUID="ec2fbfef-353f-4860-b192-3be6c070ea57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 16 01:35:43.877213 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:43.877174    2565 generic.go:356] "Generic (PLEG): container finished" podID="92a191ac-defe-4765-bf3e-cf9134709b50" containerID="666fca564015af9d5c59a122befdfaa37918a4b644d8812c065becba436f583a" exitCode=0
Sep 16 01:35:43.877625 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:43.877253    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-74a27a74-vbxvh" event={"ID":"92a191ac-defe-4765-bf3e-cf9134709b50","Type":"ContainerDied","Data":"666fca564015af9d5c59a122befdfaa37918a4b644d8812c065becba436f583a"}
Sep 16 01:35:43.902329 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:43.902294    2565 patch_prober.go:28] interesting pod/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 16 01:35:43.902502 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:43.902369    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9" podUID="ec2fbfef-353f-4860-b192-3be6c070ea57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 16 01:35:44.902125 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:44.902085    2565 patch_prober.go:28] interesting pod/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 16 01:35:44.902593 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:44.902142    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9" podUID="ec2fbfef-353f-4860-b192-3be6c070ea57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 16 01:35:45.033192 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:45.033161    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-74a27a74-vbxvh"
Sep 16 01:35:45.104103 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:45.104070    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92a191ac-defe-4765-bf3e-cf9134709b50-maas-api-service-ca\") pod \"92a191ac-defe-4765-bf3e-cf9134709b50\" (UID: \"92a191ac-defe-4765-bf3e-cf9134709b50\") "
Sep 16 01:35:45.104492 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:45.104470    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92a191ac-defe-4765-bf3e-cf9134709b50-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "92a191ac-defe-4765-bf3e-cf9134709b50" (UID: "92a191ac-defe-4765-bf3e-cf9134709b50"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:35:45.205801 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:45.205767    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92a191ac-defe-4765-bf3e-cf9134709b50-maas-api-service-ca\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:35:45.890242 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:45.890212    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-74a27a74-vbxvh"
Sep 16 01:35:45.890462 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:45.890251    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-74a27a74-vbxvh" event={"ID":"92a191ac-defe-4765-bf3e-cf9134709b50","Type":"ContainerDied","Data":"368a8b2e109d5479c90afc6aa21186b7bebac506ef2743668b883b2a6ab0f119"}
Sep 16 01:35:45.890462 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:45.890299    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="368a8b2e109d5479c90afc6aa21186b7bebac506ef2743668b883b2a6ab0f119"
Sep 16 01:35:45.902618 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:45.902588    2565 patch_prober.go:28] interesting pod/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 16 01:35:45.902982 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:45.902649    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9" podUID="ec2fbfef-353f-4860-b192-3be6c070ea57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 16 01:35:46.902836 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:46.902798    2565 patch_prober.go:28] interesting pod/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 16 01:35:46.903242 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:46.902864    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9" podUID="ec2fbfef-353f-4860-b192-3be6c070ea57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 16 01:35:47.694909 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:47.694874    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9"
Sep 16 01:35:47.902651 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:47.902610    2565 patch_prober.go:28] interesting pod/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 16 01:35:47.902827 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:47.902686    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9" podUID="ec2fbfef-353f-4860-b192-3be6c070ea57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 16 01:35:48.906451 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:48.906423    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9"
Sep 16 01:35:48.907448 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:48.907431    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9"
Sep 16 01:35:49.212152 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:49.212061    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-74a27a74-6d9dc4dbbf-zg26m"]
Sep 16 01:35:49.212348 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:49.212311    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-74a27a74-6d9dc4dbbf-zg26m" podUID="2fc9ed15-1fe1-4896-a1b6-8a4187664f8a" containerName="payload-processing" containerID="cri-o://d094ae728329780e868af1417abe27803bca93a8dd7b5d87e62e518b6ff48105" gracePeriod=30
Sep 16 01:35:49.218539 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:49.218456    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-74a27a74-7f4bb45b66-dxr5s"]
Sep 16 01:35:49.218724 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:49.218687    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-74a27a74-7f4bb45b66-dxr5s" podUID="c0482d09-e212-4085-8cec-68fc1b7708ed" containerName="payload-pre-processing" containerID="cri-o://ced17f9f2abdd50570544238ea934ac20eb888bbd945349807ae999596f24116" gracePeriod=30
Sep 16 01:35:49.364277 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:49.364207    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-74a27a74-vbxvh"]
Sep 16 01:35:49.366283 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:49.366254    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-74a27a74-vbxvh"]
Sep 16 01:35:49.498949 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:49.498869    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9"]
Sep 16 01:35:49.526721 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:49.526694    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-74a27a74-6d9dc4dbbf-zg26m"
Sep 16 01:35:49.531489 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:49.531461    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-74a27a74-7f4bb45b66-dxr5s"
Sep 16 01:35:49.550841 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:49.550805    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2fc9ed15-1fe1-4896-a1b6-8a4187664f8a-plugins-config-volume\") pod \"2fc9ed15-1fe1-4896-a1b6-8a4187664f8a\" (UID: \"2fc9ed15-1fe1-4896-a1b6-8a4187664f8a\") "
Sep 16 01:35:49.551032 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:49.550984    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4tzmg\" (UniqueName: \"kubernetes.io/projected/2fc9ed15-1fe1-4896-a1b6-8a4187664f8a-kube-api-access-4tzmg\") pod \"2fc9ed15-1fe1-4896-a1b6-8a4187664f8a\" (UID: \"2fc9ed15-1fe1-4896-a1b6-8a4187664f8a\") "
Sep 16 01:35:49.551317 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:49.551189    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fc9ed15-1fe1-4896-a1b6-8a4187664f8a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2fc9ed15-1fe1-4896-a1b6-8a4187664f8a" (UID: "2fc9ed15-1fe1-4896-a1b6-8a4187664f8a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:35:49.551461 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:49.551318    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2fc9ed15-1fe1-4896-a1b6-8a4187664f8a-plugins-config-volume\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:35:49.553234 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:49.553203    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fc9ed15-1fe1-4896-a1b6-8a4187664f8a-kube-api-access-4tzmg" (OuterVolumeSpecName: "kube-api-access-4tzmg") pod "2fc9ed15-1fe1-4896-a1b6-8a4187664f8a" (UID: "2fc9ed15-1fe1-4896-a1b6-8a4187664f8a"). InnerVolumeSpecName "kube-api-access-4tzmg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:35:49.652079 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:49.652042    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txhxd\" (UniqueName: \"kubernetes.io/projected/c0482d09-e212-4085-8cec-68fc1b7708ed-kube-api-access-txhxd\") pod \"c0482d09-e212-4085-8cec-68fc1b7708ed\" (UID: \"c0482d09-e212-4085-8cec-68fc1b7708ed\") "
Sep 16 01:35:49.652284 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:49.652170    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c0482d09-e212-4085-8cec-68fc1b7708ed-plugins-config-volume\") pod \"c0482d09-e212-4085-8cec-68fc1b7708ed\" (UID: \"c0482d09-e212-4085-8cec-68fc1b7708ed\") "
Sep 16 01:35:49.652550 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:49.652528    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4tzmg\" (UniqueName: \"kubernetes.io/projected/2fc9ed15-1fe1-4896-a1b6-8a4187664f8a-kube-api-access-4tzmg\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:35:49.652640 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:49.652561    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0482d09-e212-4085-8cec-68fc1b7708ed-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c0482d09-e212-4085-8cec-68fc1b7708ed" (UID: "c0482d09-e212-4085-8cec-68fc1b7708ed"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:35:49.654177 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:49.654159    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0482d09-e212-4085-8cec-68fc1b7708ed-kube-api-access-txhxd" (OuterVolumeSpecName: "kube-api-access-txhxd") pod "c0482d09-e212-4085-8cec-68fc1b7708ed" (UID: "c0482d09-e212-4085-8cec-68fc1b7708ed"). InnerVolumeSpecName "kube-api-access-txhxd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:35:49.753979 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:49.753888    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txhxd\" (UniqueName: \"kubernetes.io/projected/c0482d09-e212-4085-8cec-68fc1b7708ed-kube-api-access-txhxd\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:35:49.753979 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:49.753916    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c0482d09-e212-4085-8cec-68fc1b7708ed-plugins-config-volume\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:35:49.913765 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:49.913728    2565 generic.go:356] "Generic (PLEG): container finished" podID="c0482d09-e212-4085-8cec-68fc1b7708ed" containerID="ced17f9f2abdd50570544238ea934ac20eb888bbd945349807ae999596f24116" exitCode=0
Sep 16 01:35:49.914224 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:49.913773    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-74a27a74-7f4bb45b66-dxr5s"
Sep 16 01:35:49.914224 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:49.913808    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-74a27a74-7f4bb45b66-dxr5s" event={"ID":"c0482d09-e212-4085-8cec-68fc1b7708ed","Type":"ContainerDied","Data":"ced17f9f2abdd50570544238ea934ac20eb888bbd945349807ae999596f24116"}
Sep 16 01:35:49.914224 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:49.913864    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-74a27a74-7f4bb45b66-dxr5s" event={"ID":"c0482d09-e212-4085-8cec-68fc1b7708ed","Type":"ContainerDied","Data":"878ecee5511290ce91975da8d3753840e23174d34128bd9b343447a5210a9ffc"}
Sep 16 01:35:49.914224 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:49.913897    2565 scope.go:117] "RemoveContainer" containerID="ced17f9f2abdd50570544238ea934ac20eb888bbd945349807ae999596f24116"
Sep 16 01:35:49.915332 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:49.915305    2565 generic.go:356] "Generic (PLEG): container finished" podID="2fc9ed15-1fe1-4896-a1b6-8a4187664f8a" containerID="d094ae728329780e868af1417abe27803bca93a8dd7b5d87e62e518b6ff48105" exitCode=0
Sep 16 01:35:49.915332 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:49.915363    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-74a27a74-6d9dc4dbbf-zg26m"
Sep 16 01:35:49.915332 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:49.915381    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-74a27a74-6d9dc4dbbf-zg26m" event={"ID":"2fc9ed15-1fe1-4896-a1b6-8a4187664f8a","Type":"ContainerDied","Data":"d094ae728329780e868af1417abe27803bca93a8dd7b5d87e62e518b6ff48105"}
Sep 16 01:35:49.915332 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:49.915434    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-74a27a74-6d9dc4dbbf-zg26m" event={"ID":"2fc9ed15-1fe1-4896-a1b6-8a4187664f8a","Type":"ContainerDied","Data":"21abbf42790ea5237cc24a7683f2a6d9e8c741bdb2e2c67841b66fff8833f269"}
Sep 16 01:35:49.915788 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:49.915767    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9" secret="" err="secret \"e2e-derive-74a27a74-openshift-default-dockercfg-dp6sf\" not found"
Sep 16 01:35:49.924543 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:49.924524    2565 scope.go:117] "RemoveContainer" containerID="ced17f9f2abdd50570544238ea934ac20eb888bbd945349807ae999596f24116"
Sep 16 01:35:49.924858 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:35:49.924842    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ced17f9f2abdd50570544238ea934ac20eb888bbd945349807ae999596f24116\": container with ID starting with ced17f9f2abdd50570544238ea934ac20eb888bbd945349807ae999596f24116 not found: ID does not exist" containerID="ced17f9f2abdd50570544238ea934ac20eb888bbd945349807ae999596f24116"
Sep 16 01:35:49.924913 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:49.924866    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ced17f9f2abdd50570544238ea934ac20eb888bbd945349807ae999596f24116"} err="failed to get container status \"ced17f9f2abdd50570544238ea934ac20eb888bbd945349807ae999596f24116\": rpc error: code = NotFound desc = could not find container \"ced17f9f2abdd50570544238ea934ac20eb888bbd945349807ae999596f24116\": container with ID starting with ced17f9f2abdd50570544238ea934ac20eb888bbd945349807ae999596f24116 not found: ID does not exist"
Sep 16 01:35:49.924913 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:49.924882    2565 scope.go:117] "RemoveContainer" containerID="d094ae728329780e868af1417abe27803bca93a8dd7b5d87e62e518b6ff48105"
Sep 16 01:35:49.933697 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:49.933680    2565 scope.go:117] "RemoveContainer" containerID="d094ae728329780e868af1417abe27803bca93a8dd7b5d87e62e518b6ff48105"
Sep 16 01:35:49.933951 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:35:49.933934    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d094ae728329780e868af1417abe27803bca93a8dd7b5d87e62e518b6ff48105\": container with ID starting with d094ae728329780e868af1417abe27803bca93a8dd7b5d87e62e518b6ff48105 not found: ID does not exist" containerID="d094ae728329780e868af1417abe27803bca93a8dd7b5d87e62e518b6ff48105"
Sep 16 01:35:49.934014 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:49.933958    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d094ae728329780e868af1417abe27803bca93a8dd7b5d87e62e518b6ff48105"} err="failed to get container status \"d094ae728329780e868af1417abe27803bca93a8dd7b5d87e62e518b6ff48105\": rpc error: code = NotFound desc = could not find container \"d094ae728329780e868af1417abe27803bca93a8dd7b5d87e62e518b6ff48105\": container with ID starting with d094ae728329780e868af1417abe27803bca93a8dd7b5d87e62e518b6ff48105 not found: ID does not exist"
Sep 16 01:35:49.947543 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:49.947521    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-74a27a74-7f4bb45b66-dxr5s"]
Sep 16 01:35:49.969450 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:49.969428    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-74a27a74-7f4bb45b66-dxr5s"]
Sep 16 01:35:49.985938 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:49.985916    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-74a27a74-6d9dc4dbbf-zg26m"]
Sep 16 01:35:49.988453 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:49.988432    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-74a27a74-6d9dc4dbbf-zg26m"]
Sep 16 01:35:50.922883 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:50.922846    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9" podUID="ec2fbfef-353f-4860-b192-3be6c070ea57" containerName="istio-proxy" containerID="cri-o://b2e266f2dcf87b666e1031279f834061e6bf2efa418db90cb1ea9e5b1ad00bf5" gracePeriod=30
Sep 16 01:35:51.170884 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:51.170853    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fc9ed15-1fe1-4896-a1b6-8a4187664f8a" path="/var/lib/kubelet/pods/2fc9ed15-1fe1-4896-a1b6-8a4187664f8a/volumes"
Sep 16 01:35:51.171323 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:51.171301    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92a191ac-defe-4765-bf3e-cf9134709b50" path="/var/lib/kubelet/pods/92a191ac-defe-4765-bf3e-cf9134709b50/volumes"
Sep 16 01:35:51.171785 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:51.171769    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0482d09-e212-4085-8cec-68fc1b7708ed" path="/var/lib/kubelet/pods/c0482d09-e212-4085-8cec-68fc1b7708ed/volumes"
Sep 16 01:35:56.168923 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:56.168897    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9"
Sep 16 01:35:56.209067 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:56.208989    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec2fbfef-353f-4860-b192-3be6c070ea57-istio-token\") pod \"ec2fbfef-353f-4860-b192-3be6c070ea57\" (UID: \"ec2fbfef-353f-4860-b192-3be6c070ea57\") "
Sep 16 01:35:56.209205 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:56.209070    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec2fbfef-353f-4860-b192-3be6c070ea57-workload-certs\") pod \"ec2fbfef-353f-4860-b192-3be6c070ea57\" (UID: \"ec2fbfef-353f-4860-b192-3be6c070ea57\") "
Sep 16 01:35:56.209205 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:56.209108    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec2fbfef-353f-4860-b192-3be6c070ea57-istiod-ca-cert\") pod \"ec2fbfef-353f-4860-b192-3be6c070ea57\" (UID: \"ec2fbfef-353f-4860-b192-3be6c070ea57\") "
Sep 16 01:35:56.209205 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:56.209185    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec2fbfef-353f-4860-b192-3be6c070ea57-istio-podinfo\") pod \"ec2fbfef-353f-4860-b192-3be6c070ea57\" (UID: \"ec2fbfef-353f-4860-b192-3be6c070ea57\") "
Sep 16 01:35:56.209380 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:56.209215    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec2fbfef-353f-4860-b192-3be6c070ea57-credential-socket\") pod \"ec2fbfef-353f-4860-b192-3be6c070ea57\" (UID: \"ec2fbfef-353f-4860-b192-3be6c070ea57\") "
Sep 16 01:35:56.209380 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:56.209245    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec2fbfef-353f-4860-b192-3be6c070ea57-istio-data\") pod \"ec2fbfef-353f-4860-b192-3be6c070ea57\" (UID: \"ec2fbfef-353f-4860-b192-3be6c070ea57\") "
Sep 16 01:35:56.209492 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:56.209374    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec2fbfef-353f-4860-b192-3be6c070ea57-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ec2fbfef-353f-4860-b192-3be6c070ea57" (UID: "ec2fbfef-353f-4860-b192-3be6c070ea57"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:35:56.209556 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:56.209496    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec2fbfef-353f-4860-b192-3be6c070ea57-workload-socket\") pod \"ec2fbfef-353f-4860-b192-3be6c070ea57\" (UID: \"ec2fbfef-353f-4860-b192-3be6c070ea57\") "
Sep 16 01:35:56.209556 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:56.209500    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec2fbfef-353f-4860-b192-3be6c070ea57-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ec2fbfef-353f-4860-b192-3be6c070ea57" (UID: "ec2fbfef-353f-4860-b192-3be6c070ea57"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:35:56.209556 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:56.209512    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec2fbfef-353f-4860-b192-3be6c070ea57-istio-data" (OuterVolumeSpecName: "istio-data") pod "ec2fbfef-353f-4860-b192-3be6c070ea57" (UID: "ec2fbfef-353f-4860-b192-3be6c070ea57"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:35:56.209556 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:56.209543    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mqk88\" (UniqueName: \"kubernetes.io/projected/ec2fbfef-353f-4860-b192-3be6c070ea57-kube-api-access-mqk88\") pod \"ec2fbfef-353f-4860-b192-3be6c070ea57\" (UID: \"ec2fbfef-353f-4860-b192-3be6c070ea57\") "
Sep 16 01:35:56.209748 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:56.209582    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec2fbfef-353f-4860-b192-3be6c070ea57-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ec2fbfef-353f-4860-b192-3be6c070ea57" (UID: "ec2fbfef-353f-4860-b192-3be6c070ea57"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:35:56.209748 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:56.209600    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec2fbfef-353f-4860-b192-3be6c070ea57-istio-envoy\") pod \"ec2fbfef-353f-4860-b192-3be6c070ea57\" (UID: \"ec2fbfef-353f-4860-b192-3be6c070ea57\") "
Sep 16 01:35:56.209748 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:56.209720    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec2fbfef-353f-4860-b192-3be6c070ea57-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ec2fbfef-353f-4860-b192-3be6c070ea57" (UID: "ec2fbfef-353f-4860-b192-3be6c070ea57"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:35:56.210007 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:56.209982    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec2fbfef-353f-4860-b192-3be6c070ea57-workload-certs\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:35:56.210007 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:56.210008    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec2fbfef-353f-4860-b192-3be6c070ea57-istiod-ca-cert\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:35:56.210195 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:56.210022    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec2fbfef-353f-4860-b192-3be6c070ea57-credential-socket\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:35:56.210195 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:56.210038    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec2fbfef-353f-4860-b192-3be6c070ea57-istio-data\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:35:56.210195 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:56.210053    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec2fbfef-353f-4860-b192-3be6c070ea57-workload-socket\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:35:56.211387 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:56.211323    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec2fbfef-353f-4860-b192-3be6c070ea57-istio-token" (OuterVolumeSpecName: "istio-token") pod "ec2fbfef-353f-4860-b192-3be6c070ea57" (UID: "ec2fbfef-353f-4860-b192-3be6c070ea57"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:35:56.211612 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:56.211582    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ec2fbfef-353f-4860-b192-3be6c070ea57-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ec2fbfef-353f-4860-b192-3be6c070ea57" (UID: "ec2fbfef-353f-4860-b192-3be6c070ea57"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 01:35:56.212006 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:56.211986    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec2fbfef-353f-4860-b192-3be6c070ea57-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ec2fbfef-353f-4860-b192-3be6c070ea57" (UID: "ec2fbfef-353f-4860-b192-3be6c070ea57"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:35:56.212085 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:56.212002    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec2fbfef-353f-4860-b192-3be6c070ea57-kube-api-access-mqk88" (OuterVolumeSpecName: "kube-api-access-mqk88") pod "ec2fbfef-353f-4860-b192-3be6c070ea57" (UID: "ec2fbfef-353f-4860-b192-3be6c070ea57"). InnerVolumeSpecName "kube-api-access-mqk88". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:35:56.311230 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:56.311198    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mqk88\" (UniqueName: \"kubernetes.io/projected/ec2fbfef-353f-4860-b192-3be6c070ea57-kube-api-access-mqk88\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:35:56.311230 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:56.311226    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec2fbfef-353f-4860-b192-3be6c070ea57-istio-envoy\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:35:56.311230 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:56.311236    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec2fbfef-353f-4860-b192-3be6c070ea57-istio-token\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:35:56.311471 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:56.311244    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec2fbfef-353f-4860-b192-3be6c070ea57-istio-podinfo\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:35:56.955352 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:56.955313    2565 generic.go:356] "Generic (PLEG): container finished" podID="ec2fbfef-353f-4860-b192-3be6c070ea57" containerID="b2e266f2dcf87b666e1031279f834061e6bf2efa418db90cb1ea9e5b1ad00bf5" exitCode=0
Sep 16 01:35:56.955543 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:56.955392    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9"
Sep 16 01:35:56.955543 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:56.955402    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9" event={"ID":"ec2fbfef-353f-4860-b192-3be6c070ea57","Type":"ContainerDied","Data":"b2e266f2dcf87b666e1031279f834061e6bf2efa418db90cb1ea9e5b1ad00bf5"}
Sep 16 01:35:56.955543 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:56.955469    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9" event={"ID":"ec2fbfef-353f-4860-b192-3be6c070ea57","Type":"ContainerDied","Data":"1a515855637f528ea33d8850c1570f1e5bb98926964b65c0f78044bea970ae2d"}
Sep 16 01:35:56.955543 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:56.955502    2565 scope.go:117] "RemoveContainer" containerID="b2e266f2dcf87b666e1031279f834061e6bf2efa418db90cb1ea9e5b1ad00bf5"
Sep 16 01:35:56.965248 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:56.965230    2565 scope.go:117] "RemoveContainer" containerID="d129f907792f3d511ac4f92845c80775daadcbe2213afd02e0aaa5d444f67105"
Sep 16 01:35:56.973393 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:56.973377    2565 scope.go:117] "RemoveContainer" containerID="b2e266f2dcf87b666e1031279f834061e6bf2efa418db90cb1ea9e5b1ad00bf5"
Sep 16 01:35:56.973722 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:35:56.973688    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2e266f2dcf87b666e1031279f834061e6bf2efa418db90cb1ea9e5b1ad00bf5\": container with ID starting with b2e266f2dcf87b666e1031279f834061e6bf2efa418db90cb1ea9e5b1ad00bf5 not found: ID does not exist" containerID="b2e266f2dcf87b666e1031279f834061e6bf2efa418db90cb1ea9e5b1ad00bf5"
Sep 16 01:35:56.973846 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:56.973723    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2e266f2dcf87b666e1031279f834061e6bf2efa418db90cb1ea9e5b1ad00bf5"} err="failed to get container status \"b2e266f2dcf87b666e1031279f834061e6bf2efa418db90cb1ea9e5b1ad00bf5\": rpc error: code = NotFound desc = could not find container \"b2e266f2dcf87b666e1031279f834061e6bf2efa418db90cb1ea9e5b1ad00bf5\": container with ID starting with b2e266f2dcf87b666e1031279f834061e6bf2efa418db90cb1ea9e5b1ad00bf5 not found: ID does not exist"
Sep 16 01:35:56.973846 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:56.973747    2565 scope.go:117] "RemoveContainer" containerID="d129f907792f3d511ac4f92845c80775daadcbe2213afd02e0aaa5d444f67105"
Sep 16 01:35:56.974070 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:35:56.974041    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d129f907792f3d511ac4f92845c80775daadcbe2213afd02e0aaa5d444f67105\": container with ID starting with d129f907792f3d511ac4f92845c80775daadcbe2213afd02e0aaa5d444f67105 not found: ID does not exist" containerID="d129f907792f3d511ac4f92845c80775daadcbe2213afd02e0aaa5d444f67105"
Sep 16 01:35:56.974153 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:56.974085    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d129f907792f3d511ac4f92845c80775daadcbe2213afd02e0aaa5d444f67105"} err="failed to get container status \"d129f907792f3d511ac4f92845c80775daadcbe2213afd02e0aaa5d444f67105\": rpc error: code = NotFound desc = could not find container \"d129f907792f3d511ac4f92845c80775daadcbe2213afd02e0aaa5d444f67105\": container with ID starting with d129f907792f3d511ac4f92845c80775daadcbe2213afd02e0aaa5d444f67105 not found: ID does not exist"
Sep 16 01:35:56.976499 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:56.976478    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9"]
Sep 16 01:35:56.980624 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:56.980600    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9"]
Sep 16 01:35:57.170458 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:35:57.170419    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec2fbfef-353f-4860-b192-3be6c070ea57" path="/var/lib/kubelet/pods/ec2fbfef-353f-4860-b192-3be6c070ea57/volumes"
Sep 16 01:36:16.299530 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:36:16.299221    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-482177/distinct-2-w0-482177-kserve-bd674567-qpw2p"]
Sep 16 01:36:16.300151 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:36:16.299795    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0482d09-e212-4085-8cec-68fc1b7708ed" containerName="payload-pre-processing"
Sep 16 01:36:16.300151 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:36:16.299814    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0482d09-e212-4085-8cec-68fc1b7708ed" containerName="payload-pre-processing"
Sep 16 01:36:16.300151 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:36:16.299835    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec2fbfef-353f-4860-b192-3be6c070ea57" containerName="istio-proxy"
Sep 16 01:36:16.300151 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:36:16.299841    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec2fbfef-353f-4860-b192-3be6c070ea57" containerName="istio-proxy"
Sep 16 01:36:16.300151 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:36:16.299851    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fc9ed15-1fe1-4896-a1b6-8a4187664f8a" containerName="payload-processing"
Sep 16 01:36:16.300151 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:36:16.299856    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fc9ed15-1fe1-4896-a1b6-8a4187664f8a" containerName="payload-processing"
Sep 16 01:36:16.300151 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:36:16.299869    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec2fbfef-353f-4860-b192-3be6c070ea57" containerName="istio-proxy"
Sep 16 01:36:16.300151 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:36:16.299874    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec2fbfef-353f-4860-b192-3be6c070ea57" containerName="istio-proxy"
Sep 16 01:36:16.300151 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:36:16.299881    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92a191ac-defe-4765-bf3e-cf9134709b50" containerName="revoke-keys"
Sep 16 01:36:16.300151 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:36:16.299886    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="92a191ac-defe-4765-bf3e-cf9134709b50" containerName="revoke-keys"
Sep 16 01:36:16.300151 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:36:16.299964    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec2fbfef-353f-4860-b192-3be6c070ea57" containerName="istio-proxy"
Sep 16 01:36:16.300151 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:36:16.299973    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec2fbfef-353f-4860-b192-3be6c070ea57" containerName="istio-proxy"
Sep 16 01:36:16.300151 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:36:16.299979    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="92a191ac-defe-4765-bf3e-cf9134709b50" containerName="revoke-keys"
Sep 16 01:36:16.300151 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:36:16.299985    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0482d09-e212-4085-8cec-68fc1b7708ed" containerName="payload-pre-processing"
Sep 16 01:36:16.300151 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:36:16.299991    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fc9ed15-1fe1-4896-a1b6-8a4187664f8a" containerName="payload-processing"
Sep 16 01:36:16.304751 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:36:16.304726    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-482177/distinct-2-w0-482177-kserve-bd674567-qpw2p"
Sep 16 01:36:16.311348 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:36:16.311296    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-482177\"/\"openshift-service-ca.crt\""
Sep 16 01:36:16.311627 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:36:16.311606    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-482177\"/\"distinct-2-w0-482177-kserve-self-signed-certs\""
Sep 16 01:36:16.311913 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:36:16.311894    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-482177\"/\"default-dockercfg-ttnmg\""
Sep 16 01:36:16.312157 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:36:16.312139    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-482177\"/\"kube-root-ca.crt\""
Sep 16 01:36:16.318013 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:36:16.317985    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-482177/distinct-2-w0-482177-kserve-bd674567-qpw2p"]
Sep 16 01:36:16.397677 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:36:16.397645    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8104f42-d393-4b5c-a923-e12716883afb-tls-certs\") pod \"distinct-2-w0-482177-kserve-bd674567-qpw2p\" (UID: \"b8104f42-d393-4b5c-a923-e12716883afb\") " pod="e2e-models-e2e-worker-w0-482177/distinct-2-w0-482177-kserve-bd674567-qpw2p"
Sep 16 01:36:16.397828 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:36:16.397697    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8104f42-d393-4b5c-a923-e12716883afb-dshm\") pod \"distinct-2-w0-482177-kserve-bd674567-qpw2p\" (UID: \"b8104f42-d393-4b5c-a923-e12716883afb\") " pod="e2e-models-e2e-worker-w0-482177/distinct-2-w0-482177-kserve-bd674567-qpw2p"
Sep 16 01:36:16.397828 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:36:16.397758    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgdcl\" (UniqueName: \"kubernetes.io/projected/b8104f42-d393-4b5c-a923-e12716883afb-kube-api-access-dgdcl\") pod \"distinct-2-w0-482177-kserve-bd674567-qpw2p\" (UID: \"b8104f42-d393-4b5c-a923-e12716883afb\") " pod="e2e-models-e2e-worker-w0-482177/distinct-2-w0-482177-kserve-bd674567-qpw2p"
Sep 16 01:36:16.397828 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:36:16.397802    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8104f42-d393-4b5c-a923-e12716883afb-model-cache\") pod \"distinct-2-w0-482177-kserve-bd674567-qpw2p\" (UID: \"b8104f42-d393-4b5c-a923-e12716883afb\") " pod="e2e-models-e2e-worker-w0-482177/distinct-2-w0-482177-kserve-bd674567-qpw2p"
Sep 16 01:36:16.397938 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:36:16.397828    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8104f42-d393-4b5c-a923-e12716883afb-tmp-dir\") pod \"distinct-2-w0-482177-kserve-bd674567-qpw2p\" (UID: \"b8104f42-d393-4b5c-a923-e12716883afb\") " pod="e2e-models-e2e-worker-w0-482177/distinct-2-w0-482177-kserve-bd674567-qpw2p"
Sep 16 01:36:16.397938 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:36:16.397899    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8104f42-d393-4b5c-a923-e12716883afb-home\") pod \"distinct-2-w0-482177-kserve-bd674567-qpw2p\" (UID: \"b8104f42-d393-4b5c-a923-e12716883afb\") " pod="e2e-models-e2e-worker-w0-482177/distinct-2-w0-482177-kserve-bd674567-qpw2p"
Sep 16 01:36:16.498518 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:36:16.498482    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8104f42-d393-4b5c-a923-e12716883afb-dshm\") pod \"distinct-2-w0-482177-kserve-bd674567-qpw2p\" (UID: \"b8104f42-d393-4b5c-a923-e12716883afb\") " pod="e2e-models-e2e-worker-w0-482177/distinct-2-w0-482177-kserve-bd674567-qpw2p"
Sep 16 01:36:16.498708 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:36:16.498528    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgdcl\" (UniqueName: \"kubernetes.io/projected/b8104f42-d393-4b5c-a923-e12716883afb-kube-api-access-dgdcl\") pod \"distinct-2-w0-482177-kserve-bd674567-qpw2p\" (UID: \"b8104f42-d393-4b5c-a923-e12716883afb\") " pod="e2e-models-e2e-worker-w0-482177/distinct-2-w0-482177-kserve-bd674567-qpw2p"
Sep 16 01:36:16.498708 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:36:16.498549    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8104f42-d393-4b5c-a923-e12716883afb-model-cache\") pod \"distinct-2-w0-482177-kserve-bd674567-qpw2p\" (UID: \"b8104f42-d393-4b5c-a923-e12716883afb\") " pod="e2e-models-e2e-worker-w0-482177/distinct-2-w0-482177-kserve-bd674567-qpw2p"
Sep 16 01:36:16.498708 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:36:16.498571    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8104f42-d393-4b5c-a923-e12716883afb-tmp-dir\") pod \"distinct-2-w0-482177-kserve-bd674567-qpw2p\" (UID: \"b8104f42-d393-4b5c-a923-e12716883afb\") " pod="e2e-models-e2e-worker-w0-482177/distinct-2-w0-482177-kserve-bd674567-qpw2p"
Sep 16 01:36:16.498708 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:36:16.498623    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8104f42-d393-4b5c-a923-e12716883afb-home\") pod \"distinct-2-w0-482177-kserve-bd674567-qpw2p\" (UID: \"b8104f42-d393-4b5c-a923-e12716883afb\") " pod="e2e-models-e2e-worker-w0-482177/distinct-2-w0-482177-kserve-bd674567-qpw2p"
Sep 16 01:36:16.498928 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:36:16.498762    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8104f42-d393-4b5c-a923-e12716883afb-tls-certs\") pod \"distinct-2-w0-482177-kserve-bd674567-qpw2p\" (UID: \"b8104f42-d393-4b5c-a923-e12716883afb\") " pod="e2e-models-e2e-worker-w0-482177/distinct-2-w0-482177-kserve-bd674567-qpw2p"
Sep 16 01:36:16.498987 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:36:16.498941    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8104f42-d393-4b5c-a923-e12716883afb-home\") pod \"distinct-2-w0-482177-kserve-bd674567-qpw2p\" (UID: \"b8104f42-d393-4b5c-a923-e12716883afb\") " pod="e2e-models-e2e-worker-w0-482177/distinct-2-w0-482177-kserve-bd674567-qpw2p"
Sep 16 01:36:16.499050 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:36:16.499031    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8104f42-d393-4b5c-a923-e12716883afb-model-cache\") pod \"distinct-2-w0-482177-kserve-bd674567-qpw2p\" (UID: \"b8104f42-d393-4b5c-a923-e12716883afb\") " pod="e2e-models-e2e-worker-w0-482177/distinct-2-w0-482177-kserve-bd674567-qpw2p"
Sep 16 01:36:16.499095 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:36:16.499051    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8104f42-d393-4b5c-a923-e12716883afb-tmp-dir\") pod \"distinct-2-w0-482177-kserve-bd674567-qpw2p\" (UID: \"b8104f42-d393-4b5c-a923-e12716883afb\") " pod="e2e-models-e2e-worker-w0-482177/distinct-2-w0-482177-kserve-bd674567-qpw2p"
Sep 16 01:36:16.500709 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:36:16.500685    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8104f42-d393-4b5c-a923-e12716883afb-dshm\") pod \"distinct-2-w0-482177-kserve-bd674567-qpw2p\" (UID: \"b8104f42-d393-4b5c-a923-e12716883afb\") " pod="e2e-models-e2e-worker-w0-482177/distinct-2-w0-482177-kserve-bd674567-qpw2p"
Sep 16 01:36:16.501108 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:36:16.501092    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8104f42-d393-4b5c-a923-e12716883afb-tls-certs\") pod \"distinct-2-w0-482177-kserve-bd674567-qpw2p\" (UID: \"b8104f42-d393-4b5c-a923-e12716883afb\") " pod="e2e-models-e2e-worker-w0-482177/distinct-2-w0-482177-kserve-bd674567-qpw2p"
Sep 16 01:36:16.505676 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:36:16.505655    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgdcl\" (UniqueName: \"kubernetes.io/projected/b8104f42-d393-4b5c-a923-e12716883afb-kube-api-access-dgdcl\") pod \"distinct-2-w0-482177-kserve-bd674567-qpw2p\" (UID: \"b8104f42-d393-4b5c-a923-e12716883afb\") " pod="e2e-models-e2e-worker-w0-482177/distinct-2-w0-482177-kserve-bd674567-qpw2p"
Sep 16 01:36:16.624461 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:36:16.624390    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-482177/distinct-2-w0-482177-kserve-bd674567-qpw2p"
Sep 16 01:36:16.899740 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:36:16.899710    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-482177/distinct-2-w0-482177-kserve-bd674567-qpw2p"]
Sep 16 01:36:16.901306 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:36:16.901278    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb8104f42_d393_4b5c_a923_e12716883afb.slice/crio-8aee58b5822f900d172dc42a942d191ce7b87cf217fd5ca05067b8b41ad1dc04 WatchSource:0}: Error finding container 8aee58b5822f900d172dc42a942d191ce7b87cf217fd5ca05067b8b41ad1dc04: Status 404 returned error can't find the container with id 8aee58b5822f900d172dc42a942d191ce7b87cf217fd5ca05067b8b41ad1dc04
Sep 16 01:36:17.069015 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:36:17.068979    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-482177/distinct-2-w0-482177-kserve-bd674567-qpw2p" event={"ID":"b8104f42-d393-4b5c-a923-e12716883afb","Type":"ContainerStarted","Data":"55910ce2b43f2fbc523790ecbec1523e511ded59d0e74926a948ad0877de0554"}
Sep 16 01:36:17.069208 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:36:17.069028    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-482177/distinct-2-w0-482177-kserve-bd674567-qpw2p" event={"ID":"b8104f42-d393-4b5c-a923-e12716883afb","Type":"ContainerStarted","Data":"8aee58b5822f900d172dc42a942d191ce7b87cf217fd5ca05067b8b41ad1dc04"}
Sep 16 01:36:17.085196 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:36:17.085151    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-482177/distinct-2-w0-482177-kserve-bd674567-qpw2p" podStartSLOduration=1.085136601 podStartE2EDuration="1.085136601s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:36:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:36:17.083651421 +0000 UTC m=+1226.407119999" watchObservedRunningTime="2026-09-16 01:36:17.085136601 +0000 UTC m=+1226.408605178"
Sep 16 01:36:26.625082 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:36:26.625035    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-482177/distinct-2-w0-482177-kserve-bd674567-qpw2p"
Sep 16 01:36:26.625082 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:36:26.625094    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-482177/distinct-2-w0-482177-kserve-bd674567-qpw2p"
Sep 16 01:36:26.637853 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:36:26.637830    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-482177/distinct-2-w0-482177-kserve-bd674567-qpw2p"
Sep 16 01:36:27.134585 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:36:27.134556    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-482177/distinct-2-w0-482177-kserve-bd674567-qpw2p"
Sep 16 01:36:32.163793 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:36:32.163760    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-processing-5d7dbbd56b-4455c" secret="" err="secret \"payload-processing-dockercfg-kkbcm\" not found"
Sep 16 01:37:00.585623 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:00.585576    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-482177-gh6zv"]
Sep 16 01:37:00.590420 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:00.590394    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-482177-gh6zv"
Sep 16 01:37:00.593379 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:00.593328    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 01:37:00.593542 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:00.593439    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4ljjd\""
Sep 16 01:37:00.595479 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:00.595452    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-482177-gh6zv"]
Sep 16 01:37:00.712861 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:00.712813    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e32705b-be62-4a11-a29a-accf9ac117a7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-482177-gh6zv\" (UID: \"7e32705b-be62-4a11-a29a-accf9ac117a7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-482177-gh6zv"
Sep 16 01:37:00.814289 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:00.814242    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e32705b-be62-4a11-a29a-accf9ac117a7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-482177-gh6zv\" (UID: \"7e32705b-be62-4a11-a29a-accf9ac117a7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-482177-gh6zv"
Sep 16 01:37:00.814995 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:00.814960    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e32705b-be62-4a11-a29a-accf9ac117a7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-482177-gh6zv\" (UID: \"7e32705b-be62-4a11-a29a-accf9ac117a7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-482177-gh6zv"
Sep 16 01:37:00.904477 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:00.904446    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-482177-gh6zv"
Sep 16 01:37:01.186649 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:01.186623    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-482177-gh6zv"]
Sep 16 01:37:01.188988 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:37:01.188947    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e32705b_be62_4a11_a29a_accf9ac117a7.slice/crio-c19899b7eeef77564e1e2ac6a82f51d14b83924d99906f7823eda278c19d60b1 WatchSource:0}: Error finding container c19899b7eeef77564e1e2ac6a82f51d14b83924d99906f7823eda278c19d60b1: Status 404 returned error can't find the container with id c19899b7eeef77564e1e2ac6a82f51d14b83924d99906f7823eda278c19d60b1
Sep 16 01:37:01.304575 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:01.304537    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-482177-gh6zv" event={"ID":"7e32705b-be62-4a11-a29a-accf9ac117a7","Type":"ContainerStarted","Data":"c19899b7eeef77564e1e2ac6a82f51d14b83924d99906f7823eda278c19d60b1"}
Sep 16 01:37:02.311438 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:02.311316    2565 generic.go:356] "Generic (PLEG): container finished" podID="7e32705b-be62-4a11-a29a-accf9ac117a7" containerID="0f70a2305905020a7d1dcf0602459a3b093ac9e0f2072e092d1b85c515806077" exitCode=0
Sep 16 01:37:02.311438 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:02.311386    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-482177-gh6zv" event={"ID":"7e32705b-be62-4a11-a29a-accf9ac117a7","Type":"ContainerDied","Data":"0f70a2305905020a7d1dcf0602459a3b093ac9e0f2072e092d1b85c515806077"}
Sep 16 01:37:03.169995 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:03.169949    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-6cd864bc95-st4pq" secret="" err="secret \"payload-processing-dockercfg-kkbcm\" not found"
Sep 16 01:37:03.455217 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:03.455188    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-482177-gh6zv"
Sep 16 01:37:03.542129 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:03.542088    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e32705b-be62-4a11-a29a-accf9ac117a7-maas-api-service-ca\") pod \"7e32705b-be62-4a11-a29a-accf9ac117a7\" (UID: \"7e32705b-be62-4a11-a29a-accf9ac117a7\") "
Sep 16 01:37:03.542512 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:03.542483    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e32705b-be62-4a11-a29a-accf9ac117a7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7e32705b-be62-4a11-a29a-accf9ac117a7" (UID: "7e32705b-be62-4a11-a29a-accf9ac117a7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:37:03.643558 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:03.643514    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e32705b-be62-4a11-a29a-accf9ac117a7-maas-api-service-ca\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:37:04.323603 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:04.323561    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-482177-gh6zv" event={"ID":"7e32705b-be62-4a11-a29a-accf9ac117a7","Type":"ContainerDied","Data":"c19899b7eeef77564e1e2ac6a82f51d14b83924d99906f7823eda278c19d60b1"}
Sep 16 01:37:04.323603 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:04.323590    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-482177-gh6zv"
Sep 16 01:37:04.323831 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:04.323621    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c19899b7eeef77564e1e2ac6a82f51d14b83924d99906f7823eda278c19d60b1"
Sep 16 01:37:05.448368 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:05.448319    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-482177/distinct-2-w0-482177-kserve-bd674567-qpw2p"]
Sep 16 01:37:16.290083 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:16.290048    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-482177-29825370-759fx"]
Sep 16 01:37:16.292122 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:16.292094    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-482177-29825370-759fx"]
Sep 16 01:37:16.317674 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:16.317640    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-482177-75756ff869-sjdhh"]
Sep 16 01:37:16.317994 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:16.317966    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w0-482177-75756ff869-sjdhh" podUID="abb32465-86ce-48c3-a7a3-43744b06d950" containerName="payload-processing" containerID="cri-o://bb5e2c0468780dbe194874a8f58ae428800c4d5e56d8b1b337ebdf765f380800" gracePeriod=30
Sep 16 01:37:16.324760 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:16.324730    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-482177-5469cc445d-d7r55"]
Sep 16 01:37:16.325660 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:16.325609    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-482177-5469cc445d-d7r55" podUID="0ec1ab84-143f-4022-b78d-feaa05abad21" containerName="payload-pre-processing" containerID="cri-o://12bb7761aaea0008c7953d0edbf01845c55aa9f58785adf10f7ff98a942aacae" gracePeriod=30
Sep 16 01:37:16.474037 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:16.473962    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-482177-gh6zv"]
Sep 16 01:37:16.476609 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:16.476581    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-482177-gh6zv"]
Sep 16 01:37:16.607879 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:16.607851    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-482177-75756ff869-sjdhh"
Sep 16 01:37:16.612688 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:16.612661    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-482177-5469cc445d-d7r55"
Sep 16 01:37:16.667035 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:16.667004    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xcq28\" (UniqueName: \"kubernetes.io/projected/abb32465-86ce-48c3-a7a3-43744b06d950-kube-api-access-xcq28\") pod \"abb32465-86ce-48c3-a7a3-43744b06d950\" (UID: \"abb32465-86ce-48c3-a7a3-43744b06d950\") "
Sep 16 01:37:16.667219 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:16.667078    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/abb32465-86ce-48c3-a7a3-43744b06d950-plugins-config-volume\") pod \"abb32465-86ce-48c3-a7a3-43744b06d950\" (UID: \"abb32465-86ce-48c3-a7a3-43744b06d950\") "
Sep 16 01:37:16.667219 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:16.667107    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9nm5\" (UniqueName: \"kubernetes.io/projected/0ec1ab84-143f-4022-b78d-feaa05abad21-kube-api-access-f9nm5\") pod \"0ec1ab84-143f-4022-b78d-feaa05abad21\" (UID: \"0ec1ab84-143f-4022-b78d-feaa05abad21\") "
Sep 16 01:37:16.667219 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:16.667170    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ec1ab84-143f-4022-b78d-feaa05abad21-plugins-config-volume\") pod \"0ec1ab84-143f-4022-b78d-feaa05abad21\" (UID: \"0ec1ab84-143f-4022-b78d-feaa05abad21\") "
Sep 16 01:37:16.667626 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:16.667588    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abb32465-86ce-48c3-a7a3-43744b06d950-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "abb32465-86ce-48c3-a7a3-43744b06d950" (UID: "abb32465-86ce-48c3-a7a3-43744b06d950"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:37:16.667731 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:16.667629    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ec1ab84-143f-4022-b78d-feaa05abad21-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0ec1ab84-143f-4022-b78d-feaa05abad21" (UID: "0ec1ab84-143f-4022-b78d-feaa05abad21"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:37:16.669200 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:16.669178    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abb32465-86ce-48c3-a7a3-43744b06d950-kube-api-access-xcq28" (OuterVolumeSpecName: "kube-api-access-xcq28") pod "abb32465-86ce-48c3-a7a3-43744b06d950" (UID: "abb32465-86ce-48c3-a7a3-43744b06d950"). InnerVolumeSpecName "kube-api-access-xcq28". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:37:16.669287 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:16.669265    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ec1ab84-143f-4022-b78d-feaa05abad21-kube-api-access-f9nm5" (OuterVolumeSpecName: "kube-api-access-f9nm5") pod "0ec1ab84-143f-4022-b78d-feaa05abad21" (UID: "0ec1ab84-143f-4022-b78d-feaa05abad21"). InnerVolumeSpecName "kube-api-access-f9nm5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:37:16.768811 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:16.768766    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xcq28\" (UniqueName: \"kubernetes.io/projected/abb32465-86ce-48c3-a7a3-43744b06d950-kube-api-access-xcq28\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:37:16.768811 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:16.768803    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/abb32465-86ce-48c3-a7a3-43744b06d950-plugins-config-volume\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:37:16.768811 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:16.768813    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9nm5\" (UniqueName: \"kubernetes.io/projected/0ec1ab84-143f-4022-b78d-feaa05abad21-kube-api-access-f9nm5\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:37:16.769075 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:16.768827    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ec1ab84-143f-4022-b78d-feaa05abad21-plugins-config-volume\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:37:17.171356 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:17.171299    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e32705b-be62-4a11-a29a-accf9ac117a7" path="/var/lib/kubelet/pods/7e32705b-be62-4a11-a29a-accf9ac117a7/volumes"
Sep 16 01:37:17.171735 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:17.171714    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d544c0ff-3b52-4886-bffa-ed27f739369d" path="/var/lib/kubelet/pods/d544c0ff-3b52-4886-bffa-ed27f739369d/volumes"
Sep 16 01:37:17.394727 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:17.394689    2565 generic.go:356] "Generic (PLEG): container finished" podID="0ec1ab84-143f-4022-b78d-feaa05abad21" containerID="12bb7761aaea0008c7953d0edbf01845c55aa9f58785adf10f7ff98a942aacae" exitCode=0
Sep 16 01:37:17.395163 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:17.394750    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-482177-5469cc445d-d7r55"
Sep 16 01:37:17.395163 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:17.394779    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-482177-5469cc445d-d7r55" event={"ID":"0ec1ab84-143f-4022-b78d-feaa05abad21","Type":"ContainerDied","Data":"12bb7761aaea0008c7953d0edbf01845c55aa9f58785adf10f7ff98a942aacae"}
Sep 16 01:37:17.395163 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:17.394837    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-482177-5469cc445d-d7r55" event={"ID":"0ec1ab84-143f-4022-b78d-feaa05abad21","Type":"ContainerDied","Data":"bf262103dedcdc3f09782a81140e0a3e1d647c64cb58fa1448e6b39ff1438af3"}
Sep 16 01:37:17.395163 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:17.394865    2565 scope.go:117] "RemoveContainer" containerID="12bb7761aaea0008c7953d0edbf01845c55aa9f58785adf10f7ff98a942aacae"
Sep 16 01:37:17.396431 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:17.396410    2565 generic.go:356] "Generic (PLEG): container finished" podID="abb32465-86ce-48c3-a7a3-43744b06d950" containerID="bb5e2c0468780dbe194874a8f58ae428800c4d5e56d8b1b337ebdf765f380800" exitCode=0
Sep 16 01:37:17.396527 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:17.396447    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-482177-75756ff869-sjdhh"
Sep 16 01:37:17.396527 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:17.396482    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-482177-75756ff869-sjdhh" event={"ID":"abb32465-86ce-48c3-a7a3-43744b06d950","Type":"ContainerDied","Data":"bb5e2c0468780dbe194874a8f58ae428800c4d5e56d8b1b337ebdf765f380800"}
Sep 16 01:37:17.396527 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:17.396514    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-482177-75756ff869-sjdhh" event={"ID":"abb32465-86ce-48c3-a7a3-43744b06d950","Type":"ContainerDied","Data":"8cc654faa6a177eb9746e08a118ba8b0860168dfd4226d1a727ee613d53b46d2"}
Sep 16 01:37:17.406996 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:17.406950    2565 scope.go:117] "RemoveContainer" containerID="12bb7761aaea0008c7953d0edbf01845c55aa9f58785adf10f7ff98a942aacae"
Sep 16 01:37:17.407448 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:37:17.407419    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12bb7761aaea0008c7953d0edbf01845c55aa9f58785adf10f7ff98a942aacae\": container with ID starting with 12bb7761aaea0008c7953d0edbf01845c55aa9f58785adf10f7ff98a942aacae not found: ID does not exist" containerID="12bb7761aaea0008c7953d0edbf01845c55aa9f58785adf10f7ff98a942aacae"
Sep 16 01:37:17.407569 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:17.407459    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12bb7761aaea0008c7953d0edbf01845c55aa9f58785adf10f7ff98a942aacae"} err="failed to get container status \"12bb7761aaea0008c7953d0edbf01845c55aa9f58785adf10f7ff98a942aacae\": rpc error: code = NotFound desc = could not find container \"12bb7761aaea0008c7953d0edbf01845c55aa9f58785adf10f7ff98a942aacae\": container with ID starting with 12bb7761aaea0008c7953d0edbf01845c55aa9f58785adf10f7ff98a942aacae not found: ID does not exist"
Sep 16 01:37:17.407569 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:17.407482    2565 scope.go:117] "RemoveContainer" containerID="bb5e2c0468780dbe194874a8f58ae428800c4d5e56d8b1b337ebdf765f380800"
Sep 16 01:37:17.412790 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:17.412764    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-482177-75756ff869-sjdhh"]
Sep 16 01:37:17.416749 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:17.416720    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-482177-75756ff869-sjdhh"]
Sep 16 01:37:17.417520 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:17.417502    2565 scope.go:117] "RemoveContainer" containerID="bb5e2c0468780dbe194874a8f58ae428800c4d5e56d8b1b337ebdf765f380800"
Sep 16 01:37:17.417860 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:37:17.417840    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb5e2c0468780dbe194874a8f58ae428800c4d5e56d8b1b337ebdf765f380800\": container with ID starting with bb5e2c0468780dbe194874a8f58ae428800c4d5e56d8b1b337ebdf765f380800 not found: ID does not exist" containerID="bb5e2c0468780dbe194874a8f58ae428800c4d5e56d8b1b337ebdf765f380800"
Sep 16 01:37:17.417929 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:17.417868    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb5e2c0468780dbe194874a8f58ae428800c4d5e56d8b1b337ebdf765f380800"} err="failed to get container status \"bb5e2c0468780dbe194874a8f58ae428800c4d5e56d8b1b337ebdf765f380800\": rpc error: code = NotFound desc = could not find container \"bb5e2c0468780dbe194874a8f58ae428800c4d5e56d8b1b337ebdf765f380800\": container with ID starting with bb5e2c0468780dbe194874a8f58ae428800c4d5e56d8b1b337ebdf765f380800 not found: ID does not exist"
Sep 16 01:37:17.426300 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:17.426235    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-482177-5469cc445d-d7r55"]
Sep 16 01:37:17.430500 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:17.430474    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-482177-5469cc445d-d7r55"]
Sep 16 01:37:19.174618 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:19.172047    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ec1ab84-143f-4022-b78d-feaa05abad21" path="/var/lib/kubelet/pods/0ec1ab84-143f-4022-b78d-feaa05abad21/volumes"
Sep 16 01:37:19.174618 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:19.172631    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abb32465-86ce-48c3-a7a3-43744b06d950" path="/var/lib/kubelet/pods/abb32465-86ce-48c3-a7a3-43744b06d950/volumes"
Sep 16 01:37:20.468413 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:20.468371    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-482177/distinct-2-w0-482177-kserve-bd674567-qpw2p" podUID="b8104f42-d393-4b5c-a923-e12716883afb" containerName="main" containerID="cri-o://55910ce2b43f2fbc523790ecbec1523e511ded59d0e74926a948ad0877de0554" gracePeriod=45
Sep 16 01:37:20.721684 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:20.721622    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-482177/distinct-2-w0-482177-kserve-bd674567-qpw2p"
Sep 16 01:37:20.806572 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:20.806539    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8104f42-d393-4b5c-a923-e12716883afb-home\") pod \"b8104f42-d393-4b5c-a923-e12716883afb\" (UID: \"b8104f42-d393-4b5c-a923-e12716883afb\") "
Sep 16 01:37:20.806720 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:20.806586    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8104f42-d393-4b5c-a923-e12716883afb-tls-certs\") pod \"b8104f42-d393-4b5c-a923-e12716883afb\" (UID: \"b8104f42-d393-4b5c-a923-e12716883afb\") "
Sep 16 01:37:20.806720 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:20.806609    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8104f42-d393-4b5c-a923-e12716883afb-dshm\") pod \"b8104f42-d393-4b5c-a923-e12716883afb\" (UID: \"b8104f42-d393-4b5c-a923-e12716883afb\") "
Sep 16 01:37:20.806720 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:20.806658    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8104f42-d393-4b5c-a923-e12716883afb-model-cache\") pod \"b8104f42-d393-4b5c-a923-e12716883afb\" (UID: \"b8104f42-d393-4b5c-a923-e12716883afb\") "
Sep 16 01:37:20.806853 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:20.806736    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8104f42-d393-4b5c-a923-e12716883afb-tmp-dir\") pod \"b8104f42-d393-4b5c-a923-e12716883afb\" (UID: \"b8104f42-d393-4b5c-a923-e12716883afb\") "
Sep 16 01:37:20.806853 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:20.806763    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dgdcl\" (UniqueName: \"kubernetes.io/projected/b8104f42-d393-4b5c-a923-e12716883afb-kube-api-access-dgdcl\") pod \"b8104f42-d393-4b5c-a923-e12716883afb\" (UID: \"b8104f42-d393-4b5c-a923-e12716883afb\") "
Sep 16 01:37:20.806935 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:20.806839    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8104f42-d393-4b5c-a923-e12716883afb-home" (OuterVolumeSpecName: "home") pod "b8104f42-d393-4b5c-a923-e12716883afb" (UID: "b8104f42-d393-4b5c-a923-e12716883afb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:37:20.807037 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:20.807013    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8104f42-d393-4b5c-a923-e12716883afb-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b8104f42-d393-4b5c-a923-e12716883afb" (UID: "b8104f42-d393-4b5c-a923-e12716883afb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:37:20.807096 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:20.807031    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8104f42-d393-4b5c-a923-e12716883afb-model-cache" (OuterVolumeSpecName: "model-cache") pod "b8104f42-d393-4b5c-a923-e12716883afb" (UID: "b8104f42-d393-4b5c-a923-e12716883afb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:37:20.807206 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:20.807107    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8104f42-d393-4b5c-a923-e12716883afb-tmp-dir\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:37:20.807206 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:20.807125    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8104f42-d393-4b5c-a923-e12716883afb-home\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:37:20.808804 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:20.808775    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8104f42-d393-4b5c-a923-e12716883afb-dshm" (OuterVolumeSpecName: "dshm") pod "b8104f42-d393-4b5c-a923-e12716883afb" (UID: "b8104f42-d393-4b5c-a923-e12716883afb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:37:20.808930 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:20.808894    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8104f42-d393-4b5c-a923-e12716883afb-kube-api-access-dgdcl" (OuterVolumeSpecName: "kube-api-access-dgdcl") pod "b8104f42-d393-4b5c-a923-e12716883afb" (UID: "b8104f42-d393-4b5c-a923-e12716883afb"). InnerVolumeSpecName "kube-api-access-dgdcl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:37:20.808930 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:20.808902    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8104f42-d393-4b5c-a923-e12716883afb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b8104f42-d393-4b5c-a923-e12716883afb" (UID: "b8104f42-d393-4b5c-a923-e12716883afb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 01:37:20.907870 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:20.907832    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dgdcl\" (UniqueName: \"kubernetes.io/projected/b8104f42-d393-4b5c-a923-e12716883afb-kube-api-access-dgdcl\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:37:20.907870 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:20.907861    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8104f42-d393-4b5c-a923-e12716883afb-tls-certs\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:37:20.907870 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:20.907871    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8104f42-d393-4b5c-a923-e12716883afb-dshm\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:37:20.907870 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:20.907878    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8104f42-d393-4b5c-a923-e12716883afb-model-cache\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:37:21.420541 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:21.420504    2565 generic.go:356] "Generic (PLEG): container finished" podID="b8104f42-d393-4b5c-a923-e12716883afb" containerID="55910ce2b43f2fbc523790ecbec1523e511ded59d0e74926a948ad0877de0554" exitCode=0
Sep 16 01:37:21.420737 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:21.420554    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-482177/distinct-2-w0-482177-kserve-bd674567-qpw2p"
Sep 16 01:37:21.420737 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:21.420576    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-482177/distinct-2-w0-482177-kserve-bd674567-qpw2p" event={"ID":"b8104f42-d393-4b5c-a923-e12716883afb","Type":"ContainerDied","Data":"55910ce2b43f2fbc523790ecbec1523e511ded59d0e74926a948ad0877de0554"}
Sep 16 01:37:21.420737 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:21.420617    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-482177/distinct-2-w0-482177-kserve-bd674567-qpw2p" event={"ID":"b8104f42-d393-4b5c-a923-e12716883afb","Type":"ContainerDied","Data":"8aee58b5822f900d172dc42a942d191ce7b87cf217fd5ca05067b8b41ad1dc04"}
Sep 16 01:37:21.420737 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:21.420641    2565 scope.go:117] "RemoveContainer" containerID="55910ce2b43f2fbc523790ecbec1523e511ded59d0e74926a948ad0877de0554"
Sep 16 01:37:21.429468 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:21.429429    2565 scope.go:117] "RemoveContainer" containerID="55910ce2b43f2fbc523790ecbec1523e511ded59d0e74926a948ad0877de0554"
Sep 16 01:37:21.429716 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:37:21.429697    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55910ce2b43f2fbc523790ecbec1523e511ded59d0e74926a948ad0877de0554\": container with ID starting with 55910ce2b43f2fbc523790ecbec1523e511ded59d0e74926a948ad0877de0554 not found: ID does not exist" containerID="55910ce2b43f2fbc523790ecbec1523e511ded59d0e74926a948ad0877de0554"
Sep 16 01:37:21.429780 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:21.429728    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55910ce2b43f2fbc523790ecbec1523e511ded59d0e74926a948ad0877de0554"} err="failed to get container status \"55910ce2b43f2fbc523790ecbec1523e511ded59d0e74926a948ad0877de0554\": rpc error: code = NotFound desc = could not find container \"55910ce2b43f2fbc523790ecbec1523e511ded59d0e74926a948ad0877de0554\": container with ID starting with 55910ce2b43f2fbc523790ecbec1523e511ded59d0e74926a948ad0877de0554 not found: ID does not exist"
Sep 16 01:37:21.436464 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:21.436415    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-482177/distinct-2-w0-482177-kserve-bd674567-qpw2p"]
Sep 16 01:37:21.438172 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:21.438149    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-482177/distinct-2-w0-482177-kserve-bd674567-qpw2p"]
Sep 16 01:37:23.169463 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:23.169421    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8104f42-d393-4b5c-a923-e12716883afb" path="/var/lib/kubelet/pods/b8104f42-d393-4b5c-a923-e12716883afb/volumes"
Sep 16 01:37:25.836314 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:25.836277    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84"]
Sep 16 01:37:25.837488 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:25.837460    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ec1ab84-143f-4022-b78d-feaa05abad21" containerName="payload-pre-processing"
Sep 16 01:37:25.837657 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:25.837645    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ec1ab84-143f-4022-b78d-feaa05abad21" containerName="payload-pre-processing"
Sep 16 01:37:25.837742 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:25.837733    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e32705b-be62-4a11-a29a-accf9ac117a7" containerName="revoke-keys"
Sep 16 01:37:25.837813 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:25.837805    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e32705b-be62-4a11-a29a-accf9ac117a7" containerName="revoke-keys"
Sep 16 01:37:25.837909 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:25.837900    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8104f42-d393-4b5c-a923-e12716883afb" containerName="main"
Sep 16 01:37:25.837978 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:25.837970    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8104f42-d393-4b5c-a923-e12716883afb" containerName="main"
Sep 16 01:37:25.838051 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:25.838043    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abb32465-86ce-48c3-a7a3-43744b06d950" containerName="payload-processing"
Sep 16 01:37:25.838119 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:25.838112    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="abb32465-86ce-48c3-a7a3-43744b06d950" containerName="payload-processing"
Sep 16 01:37:25.838287 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:25.838276    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="abb32465-86ce-48c3-a7a3-43744b06d950" containerName="payload-processing"
Sep 16 01:37:25.838391 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:25.838380    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e32705b-be62-4a11-a29a-accf9ac117a7" containerName="revoke-keys"
Sep 16 01:37:25.838474 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:25.838466    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ec1ab84-143f-4022-b78d-feaa05abad21" containerName="payload-pre-processing"
Sep 16 01:37:25.838550 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:25.838542    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8104f42-d393-4b5c-a923-e12716883afb" containerName="main"
Sep 16 01:37:25.848124 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:25.848091    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84"
Sep 16 01:37:25.850264 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:25.850234    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84"]
Sep 16 01:37:25.851062 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:25.851032    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-61dff065-openshift-default-dockercfg-9vg44\""
Sep 16 01:37:25.956409 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:25.956331    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32de387d-dac6-4d69-ac25-9f1fb1132bc5-workload-certs\") pod \"e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84\" (UID: \"32de387d-dac6-4d69-ac25-9f1fb1132bc5\") " pod="openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84"
Sep 16 01:37:25.956720 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:25.956699    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32de387d-dac6-4d69-ac25-9f1fb1132bc5-credential-socket\") pod \"e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84\" (UID: \"32de387d-dac6-4d69-ac25-9f1fb1132bc5\") " pod="openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84"
Sep 16 01:37:25.956892 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:25.956859    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32de387d-dac6-4d69-ac25-9f1fb1132bc5-istio-podinfo\") pod \"e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84\" (UID: \"32de387d-dac6-4d69-ac25-9f1fb1132bc5\") " pod="openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84"
Sep 16 01:37:25.957055 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:25.956961    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32de387d-dac6-4d69-ac25-9f1fb1132bc5-istio-token\") pod \"e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84\" (UID: \"32de387d-dac6-4d69-ac25-9f1fb1132bc5\") " pod="openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84"
Sep 16 01:37:25.957055 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:25.957019    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32de387d-dac6-4d69-ac25-9f1fb1132bc5-istiod-ca-cert\") pod \"e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84\" (UID: \"32de387d-dac6-4d69-ac25-9f1fb1132bc5\") " pod="openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84"
Sep 16 01:37:25.957055 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:25.957044    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32de387d-dac6-4d69-ac25-9f1fb1132bc5-istio-envoy\") pod \"e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84\" (UID: \"32de387d-dac6-4d69-ac25-9f1fb1132bc5\") " pod="openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84"
Sep 16 01:37:25.957238 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:25.957072    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32de387d-dac6-4d69-ac25-9f1fb1132bc5-workload-socket\") pod \"e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84\" (UID: \"32de387d-dac6-4d69-ac25-9f1fb1132bc5\") " pod="openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84"
Sep 16 01:37:25.957238 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:25.957117    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7gkl\" (UniqueName: \"kubernetes.io/projected/32de387d-dac6-4d69-ac25-9f1fb1132bc5-kube-api-access-j7gkl\") pod \"e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84\" (UID: \"32de387d-dac6-4d69-ac25-9f1fb1132bc5\") " pod="openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84"
Sep 16 01:37:25.957238 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:25.957147    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32de387d-dac6-4d69-ac25-9f1fb1132bc5-istio-data\") pod \"e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84\" (UID: \"32de387d-dac6-4d69-ac25-9f1fb1132bc5\") " pod="openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84"
Sep 16 01:37:26.057739 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:26.057700    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32de387d-dac6-4d69-ac25-9f1fb1132bc5-istiod-ca-cert\") pod \"e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84\" (UID: \"32de387d-dac6-4d69-ac25-9f1fb1132bc5\") " pod="openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84"
Sep 16 01:37:26.057739 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:26.057738    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32de387d-dac6-4d69-ac25-9f1fb1132bc5-istio-envoy\") pod \"e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84\" (UID: \"32de387d-dac6-4d69-ac25-9f1fb1132bc5\") " pod="openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84"
Sep 16 01:37:26.058019 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:26.057764    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32de387d-dac6-4d69-ac25-9f1fb1132bc5-workload-socket\") pod \"e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84\" (UID: \"32de387d-dac6-4d69-ac25-9f1fb1132bc5\") " pod="openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84"
Sep 16 01:37:26.058019 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:26.057792    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7gkl\" (UniqueName: \"kubernetes.io/projected/32de387d-dac6-4d69-ac25-9f1fb1132bc5-kube-api-access-j7gkl\") pod \"e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84\" (UID: \"32de387d-dac6-4d69-ac25-9f1fb1132bc5\") " pod="openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84"
Sep 16 01:37:26.058019 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:26.057810    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32de387d-dac6-4d69-ac25-9f1fb1132bc5-istio-data\") pod \"e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84\" (UID: \"32de387d-dac6-4d69-ac25-9f1fb1132bc5\") " pod="openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84"
Sep 16 01:37:26.058019 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:26.057865    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32de387d-dac6-4d69-ac25-9f1fb1132bc5-workload-certs\") pod \"e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84\" (UID: \"32de387d-dac6-4d69-ac25-9f1fb1132bc5\") " pod="openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84"
Sep 16 01:37:26.058019 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:26.057894    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32de387d-dac6-4d69-ac25-9f1fb1132bc5-credential-socket\") pod \"e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84\" (UID: \"32de387d-dac6-4d69-ac25-9f1fb1132bc5\") " pod="openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84"
Sep 16 01:37:26.058019 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:26.057942    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32de387d-dac6-4d69-ac25-9f1fb1132bc5-istio-podinfo\") pod \"e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84\" (UID: \"32de387d-dac6-4d69-ac25-9f1fb1132bc5\") " pod="openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84"
Sep 16 01:37:26.058316 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:26.058033    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32de387d-dac6-4d69-ac25-9f1fb1132bc5-istio-token\") pod \"e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84\" (UID: \"32de387d-dac6-4d69-ac25-9f1fb1132bc5\") " pod="openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84"
Sep 16 01:37:26.058316 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:26.058212    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32de387d-dac6-4d69-ac25-9f1fb1132bc5-workload-socket\") pod \"e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84\" (UID: \"32de387d-dac6-4d69-ac25-9f1fb1132bc5\") " pod="openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84"
Sep 16 01:37:26.058316 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:26.058252    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32de387d-dac6-4d69-ac25-9f1fb1132bc5-istio-data\") pod \"e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84\" (UID: \"32de387d-dac6-4d69-ac25-9f1fb1132bc5\") " pod="openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84"
Sep 16 01:37:26.058466 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:26.058400    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32de387d-dac6-4d69-ac25-9f1fb1132bc5-workload-certs\") pod \"e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84\" (UID: \"32de387d-dac6-4d69-ac25-9f1fb1132bc5\") " pod="openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84"
Sep 16 01:37:26.058466 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:26.058428    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32de387d-dac6-4d69-ac25-9f1fb1132bc5-credential-socket\") pod \"e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84\" (UID: \"32de387d-dac6-4d69-ac25-9f1fb1132bc5\") " pod="openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84"
Sep 16 01:37:26.058570 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:26.058554    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32de387d-dac6-4d69-ac25-9f1fb1132bc5-istiod-ca-cert\") pod \"e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84\" (UID: \"32de387d-dac6-4d69-ac25-9f1fb1132bc5\") " pod="openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84"
Sep 16 01:37:26.060234 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:26.060210    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32de387d-dac6-4d69-ac25-9f1fb1132bc5-istio-envoy\") pod \"e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84\" (UID: \"32de387d-dac6-4d69-ac25-9f1fb1132bc5\") " pod="openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84"
Sep 16 01:37:26.060508 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:26.060490    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32de387d-dac6-4d69-ac25-9f1fb1132bc5-istio-podinfo\") pod \"e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84\" (UID: \"32de387d-dac6-4d69-ac25-9f1fb1132bc5\") " pod="openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84"
Sep 16 01:37:26.067097 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:26.067072    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32de387d-dac6-4d69-ac25-9f1fb1132bc5-istio-token\") pod \"e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84\" (UID: \"32de387d-dac6-4d69-ac25-9f1fb1132bc5\") " pod="openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84"
Sep 16 01:37:26.067278 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:26.067257    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7gkl\" (UniqueName: \"kubernetes.io/projected/32de387d-dac6-4d69-ac25-9f1fb1132bc5-kube-api-access-j7gkl\") pod \"e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84\" (UID: \"32de387d-dac6-4d69-ac25-9f1fb1132bc5\") " pod="openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84"
Sep 16 01:37:26.160924 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:26.160891    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84"
Sep 16 01:37:26.434029 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:26.434003    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84"]
Sep 16 01:37:26.436227 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:37:26.436199    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32de387d_dac6_4d69_ac25_9f1fb1132bc5.slice/crio-a2c01239b253ead1a52dcacb423f7ec0162fa65b79ae8e76caa795efdf000ee5 WatchSource:0}: Error finding container a2c01239b253ead1a52dcacb423f7ec0162fa65b79ae8e76caa795efdf000ee5: Status 404 returned error can't find the container with id a2c01239b253ead1a52dcacb423f7ec0162fa65b79ae8e76caa795efdf000ee5
Sep 16 01:37:26.438462 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:26.438427    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:37:26.438576 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:26.438509    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:37:26.438576 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:26.438554    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:37:26.449804 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:26.449780    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84" event={"ID":"32de387d-dac6-4d69-ac25-9f1fb1132bc5","Type":"ContainerStarted","Data":"a2c01239b253ead1a52dcacb423f7ec0162fa65b79ae8e76caa795efdf000ee5"}
Sep 16 01:37:27.456077 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:27.456046    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84" event={"ID":"32de387d-dac6-4d69-ac25-9f1fb1132bc5","Type":"ContainerStarted","Data":"ac8bb03953e15058a3ef24e22c28375160f09419dc05dd0fe53696a3dec2b6ac"}
Sep 16 01:37:27.474846 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:27.474794    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84" podStartSLOduration=2.474777413 podStartE2EDuration="2.474777413s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:37:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:37:27.473780856 +0000 UTC m=+1296.797249445" watchObservedRunningTime="2026-09-16 01:37:27.474777413 +0000 UTC m=+1296.798245990"
Sep 16 01:37:28.161707 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:28.161663    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84"
Sep 16 01:37:28.166978 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:28.166951    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84"
Sep 16 01:37:28.461455 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:28.461353    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84"
Sep 16 01:37:28.462252 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:28.462234    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84"
Sep 16 01:37:31.841992 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:31.841950    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-61dff065-687c64f7cd-qsnjs"]
Sep 16 01:37:31.845816 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:31.845793    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-61dff065-687c64f7cd-qsnjs"
Sep 16 01:37:31.849648 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:31.849626    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-61dff065-dockercfg-5cwdb\""
Sep 16 01:37:31.850661 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:31.850637    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-61dff065\""
Sep 16 01:37:31.857228 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:31.857202    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-61dff065-687c64f7cd-qsnjs"]
Sep 16 01:37:31.916683 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:31.916644    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjscg\" (UniqueName: \"kubernetes.io/projected/c6eda8e6-3047-4932-b814-28f5f549c1d5-kube-api-access-pjscg\") pod \"payload-pre-processing-e2e-mt-61dff065-687c64f7cd-qsnjs\" (UID: \"c6eda8e6-3047-4932-b814-28f5f549c1d5\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-61dff065-687c64f7cd-qsnjs"
Sep 16 01:37:31.916863 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:31.916694    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6eda8e6-3047-4932-b814-28f5f549c1d5-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-61dff065-687c64f7cd-qsnjs\" (UID: \"c6eda8e6-3047-4932-b814-28f5f549c1d5\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-61dff065-687c64f7cd-qsnjs"
Sep 16 01:37:32.018067 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:32.018028    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjscg\" (UniqueName: \"kubernetes.io/projected/c6eda8e6-3047-4932-b814-28f5f549c1d5-kube-api-access-pjscg\") pod \"payload-pre-processing-e2e-mt-61dff065-687c64f7cd-qsnjs\" (UID: \"c6eda8e6-3047-4932-b814-28f5f549c1d5\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-61dff065-687c64f7cd-qsnjs"
Sep 16 01:37:32.018067 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:32.018072    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6eda8e6-3047-4932-b814-28f5f549c1d5-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-61dff065-687c64f7cd-qsnjs\" (UID: \"c6eda8e6-3047-4932-b814-28f5f549c1d5\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-61dff065-687c64f7cd-qsnjs"
Sep 16 01:37:32.018803 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:32.018784    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6eda8e6-3047-4932-b814-28f5f549c1d5-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-61dff065-687c64f7cd-qsnjs\" (UID: \"c6eda8e6-3047-4932-b814-28f5f549c1d5\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-61dff065-687c64f7cd-qsnjs"
Sep 16 01:37:32.026121 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:32.026096    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjscg\" (UniqueName: \"kubernetes.io/projected/c6eda8e6-3047-4932-b814-28f5f549c1d5-kube-api-access-pjscg\") pod \"payload-pre-processing-e2e-mt-61dff065-687c64f7cd-qsnjs\" (UID: \"c6eda8e6-3047-4932-b814-28f5f549c1d5\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-61dff065-687c64f7cd-qsnjs"
Sep 16 01:37:32.158490 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:32.158453    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-61dff065-687c64f7cd-qsnjs"
Sep 16 01:37:32.430565 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:32.430537    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-61dff065-687c64f7cd-qsnjs"]
Sep 16 01:37:32.433102 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:37:32.433072    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6eda8e6_3047_4932_b814_28f5f549c1d5.slice/crio-909d5ef23d2533c8c11bdbc7425c092265e975b181056190b5a1490183fb41f0 WatchSource:0}: Error finding container 909d5ef23d2533c8c11bdbc7425c092265e975b181056190b5a1490183fb41f0: Status 404 returned error can't find the container with id 909d5ef23d2533c8c11bdbc7425c092265e975b181056190b5a1490183fb41f0
Sep 16 01:37:32.489209 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:32.489175    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-61dff065-687c64f7cd-qsnjs" event={"ID":"c6eda8e6-3047-4932-b814-28f5f549c1d5","Type":"ContainerStarted","Data":"909d5ef23d2533c8c11bdbc7425c092265e975b181056190b5a1490183fb41f0"}
Sep 16 01:37:33.496432 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:33.496397    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-61dff065-687c64f7cd-qsnjs" event={"ID":"c6eda8e6-3047-4932-b814-28f5f549c1d5","Type":"ContainerStarted","Data":"b753d1ce2c397fe3fb7d9467699560476085348f7726c45a79fc3b7cb8c3bba2"}
Sep 16 01:37:33.496890 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:33.496476    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-61dff065-687c64f7cd-qsnjs"
Sep 16 01:37:33.511909 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:33.511860    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-61dff065-687c64f7cd-qsnjs" podStartSLOduration=2.511843756 podStartE2EDuration="2.511843756s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:37:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:37:33.510371508 +0000 UTC m=+1302.833840079" watchObservedRunningTime="2026-09-16 01:37:33.511843756 +0000 UTC m=+1302.835312332"
Sep 16 01:37:43.166013 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:43.165964    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-processing-5d7dbbd56b-4455c" secret="" err="secret \"payload-processing-dockercfg-kkbcm\" not found"
Sep 16 01:37:44.503906 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:44.503875    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-61dff065-687c64f7cd-qsnjs"
Sep 16 01:37:49.591596 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:49.591512    2565 generic.go:356] "Generic (PLEG): container finished" podID="32de387d-dac6-4d69-ac25-9f1fb1132bc5" containerID="ac8bb03953e15058a3ef24e22c28375160f09419dc05dd0fe53696a3dec2b6ac" exitCode=0
Sep 16 01:37:49.592092 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:49.591590    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84" event={"ID":"32de387d-dac6-4d69-ac25-9f1fb1132bc5","Type":"ContainerDied","Data":"ac8bb03953e15058a3ef24e22c28375160f09419dc05dd0fe53696a3dec2b6ac"}
Sep 16 01:37:49.592163 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:49.592130    2565 scope.go:117] "RemoveContainer" containerID="ac8bb03953e15058a3ef24e22c28375160f09419dc05dd0fe53696a3dec2b6ac"
Sep 16 01:37:49.593224 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:49.593194    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:37:49.593319 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:49.593260    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:37:49.593319 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:49.593291    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:37:50.601662 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:50.601616    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84" event={"ID":"32de387d-dac6-4d69-ac25-9f1fb1132bc5","Type":"ContainerStarted","Data":"f8986cbb44c9343844f888dd5a11e6661e3ed3af108524d38e33bc93f5c93ca7"}
Sep 16 01:37:51.162383 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:51.161927    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84"
Sep 16 01:37:51.162383 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:51.162055    2565 patch_prober.go:28] interesting pod/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 16 01:37:51.162383 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:51.162099    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84" podUID="32de387d-dac6-4d69-ac25-9f1fb1132bc5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 16 01:37:51.294582 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:51.294549    2565 scope.go:117] "RemoveContainer" containerID="53f06110cf995527eef7dc4fe917fbe2a1de895da77abe18b9368fea3a6210db"
Sep 16 01:37:52.161391 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:52.161328    2565 patch_prober.go:28] interesting pod/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 16 01:37:52.161923 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:52.161428    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84" podUID="32de387d-dac6-4d69-ac25-9f1fb1132bc5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 16 01:37:53.161641 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:53.161598    2565 patch_prober.go:28] interesting pod/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 16 01:37:53.162250 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:53.162202    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84" podUID="32de387d-dac6-4d69-ac25-9f1fb1132bc5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 16 01:37:54.167362 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:54.166638    2565 patch_prober.go:28] interesting pod/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 16 01:37:54.167362 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:54.166709    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84" podUID="32de387d-dac6-4d69-ac25-9f1fb1132bc5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 16 01:37:55.161678 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:55.161631    2565 patch_prober.go:28] interesting pod/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 16 01:37:55.161901 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:55.161718    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84" podUID="32de387d-dac6-4d69-ac25-9f1fb1132bc5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 16 01:37:56.353607 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:56.353567    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84"
Sep 16 01:37:56.354125 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:56.354101    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84"
Sep 16 01:37:56.355575 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:37:56.355549    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84"
Sep 16 01:38:01.687773 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:01.687742    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-61dff065-wpdzh"]
Sep 16 01:38:01.691119 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:01.691100    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-61dff065-wpdzh"
Sep 16 01:38:01.693688 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:01.693664    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 01:38:01.693688 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:01.693674    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4ljjd\""
Sep 16 01:38:01.698984 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:01.698960    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-61dff065-wpdzh"]
Sep 16 01:38:01.794423 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:01.794392    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/73db6b52-4d84-4fed-9d58-6c56ba739eef-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-61dff065-wpdzh\" (UID: \"73db6b52-4d84-4fed-9d58-6c56ba739eef\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-61dff065-wpdzh"
Sep 16 01:38:01.895776 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:01.895732    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/73db6b52-4d84-4fed-9d58-6c56ba739eef-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-61dff065-wpdzh\" (UID: \"73db6b52-4d84-4fed-9d58-6c56ba739eef\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-61dff065-wpdzh"
Sep 16 01:38:01.896430 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:01.896409    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/73db6b52-4d84-4fed-9d58-6c56ba739eef-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-61dff065-wpdzh\" (UID: \"73db6b52-4d84-4fed-9d58-6c56ba739eef\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-61dff065-wpdzh"
Sep 16 01:38:02.002640 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:02.002553    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-61dff065-wpdzh"
Sep 16 01:38:02.270774 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:02.270747    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-61dff065-wpdzh"]
Sep 16 01:38:02.273541 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:38:02.273506    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73db6b52_4d84_4fed_9d58_6c56ba739eef.slice/crio-0b90e6da5e41ed65600e8af0a32ddb251773e5e50510fa09d2c9b38b7462e940 WatchSource:0}: Error finding container 0b90e6da5e41ed65600e8af0a32ddb251773e5e50510fa09d2c9b38b7462e940: Status 404 returned error can't find the container with id 0b90e6da5e41ed65600e8af0a32ddb251773e5e50510fa09d2c9b38b7462e940
Sep 16 01:38:02.668673 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:02.668636    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-61dff065-wpdzh" event={"ID":"73db6b52-4d84-4fed-9d58-6c56ba739eef","Type":"ContainerStarted","Data":"c3de36d105260aff3a558c499ec12757490f2dc5b8a9678c389d1f43b599f5ce"}
Sep 16 01:38:02.668829 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:02.668701    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-61dff065-wpdzh" event={"ID":"73db6b52-4d84-4fed-9d58-6c56ba739eef","Type":"ContainerStarted","Data":"0b90e6da5e41ed65600e8af0a32ddb251773e5e50510fa09d2c9b38b7462e940"}
Sep 16 01:38:02.686576 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:02.686526    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-61dff065-wpdzh" podStartSLOduration=1.686509607 podStartE2EDuration="1.686509607s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:38:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:38:02.684619791 +0000 UTC m=+1332.008088368" watchObservedRunningTime="2026-09-16 01:38:02.686509607 +0000 UTC m=+1332.009978184"
Sep 16 01:38:03.675416 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:03.675381    2565 generic.go:356] "Generic (PLEG): container finished" podID="73db6b52-4d84-4fed-9d58-6c56ba739eef" containerID="c3de36d105260aff3a558c499ec12757490f2dc5b8a9678c389d1f43b599f5ce" exitCode=0
Sep 16 01:38:03.675806 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:03.675459    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-61dff065-wpdzh" event={"ID":"73db6b52-4d84-4fed-9d58-6c56ba739eef","Type":"ContainerDied","Data":"c3de36d105260aff3a558c499ec12757490f2dc5b8a9678c389d1f43b599f5ce"}
Sep 16 01:38:04.812610 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:04.812585    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-61dff065-wpdzh"
Sep 16 01:38:04.825393 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:04.825332    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/73db6b52-4d84-4fed-9d58-6c56ba739eef-maas-api-service-ca\") pod \"73db6b52-4d84-4fed-9d58-6c56ba739eef\" (UID: \"73db6b52-4d84-4fed-9d58-6c56ba739eef\") "
Sep 16 01:38:04.825773 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:04.825746    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73db6b52-4d84-4fed-9d58-6c56ba739eef-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "73db6b52-4d84-4fed-9d58-6c56ba739eef" (UID: "73db6b52-4d84-4fed-9d58-6c56ba739eef"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:38:04.926780 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:04.926745    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/73db6b52-4d84-4fed-9d58-6c56ba739eef-maas-api-service-ca\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:38:05.687162 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:05.687111    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-61dff065-wpdzh"
Sep 16 01:38:05.687162 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:05.687148    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-61dff065-wpdzh" event={"ID":"73db6b52-4d84-4fed-9d58-6c56ba739eef","Type":"ContainerDied","Data":"0b90e6da5e41ed65600e8af0a32ddb251773e5e50510fa09d2c9b38b7462e940"}
Sep 16 01:38:05.687404 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:05.687199    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0b90e6da5e41ed65600e8af0a32ddb251773e5e50510fa09d2c9b38b7462e940"
Sep 16 01:38:12.286066 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:12.286024    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-61dff065-687c64f7cd-qsnjs"]
Sep 16 01:38:12.286587 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:12.286322    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-61dff065-687c64f7cd-qsnjs" podUID="c6eda8e6-3047-4932-b814-28f5f549c1d5" containerName="payload-pre-processing" containerID="cri-o://b753d1ce2c397fe3fb7d9467699560476085348f7726c45a79fc3b7cb8c3bba2" gracePeriod=30
Sep 16 01:38:12.438242 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:12.438204    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-61dff065-wpdzh"]
Sep 16 01:38:12.440392 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:12.440351    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-61dff065-wpdzh"]
Sep 16 01:38:12.561732 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:12.561671    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-61dff065-687c64f7cd-qsnjs"
Sep 16 01:38:12.599629 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:12.599598    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6eda8e6-3047-4932-b814-28f5f549c1d5-plugins-config-volume\") pod \"c6eda8e6-3047-4932-b814-28f5f549c1d5\" (UID: \"c6eda8e6-3047-4932-b814-28f5f549c1d5\") "
Sep 16 01:38:12.599796 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:12.599691    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pjscg\" (UniqueName: \"kubernetes.io/projected/c6eda8e6-3047-4932-b814-28f5f549c1d5-kube-api-access-pjscg\") pod \"c6eda8e6-3047-4932-b814-28f5f549c1d5\" (UID: \"c6eda8e6-3047-4932-b814-28f5f549c1d5\") "
Sep 16 01:38:12.599994 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:12.599966    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6eda8e6-3047-4932-b814-28f5f549c1d5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c6eda8e6-3047-4932-b814-28f5f549c1d5" (UID: "c6eda8e6-3047-4932-b814-28f5f549c1d5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:38:12.601775 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:12.601751    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6eda8e6-3047-4932-b814-28f5f549c1d5-kube-api-access-pjscg" (OuterVolumeSpecName: "kube-api-access-pjscg") pod "c6eda8e6-3047-4932-b814-28f5f549c1d5" (UID: "c6eda8e6-3047-4932-b814-28f5f549c1d5"). InnerVolumeSpecName "kube-api-access-pjscg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:38:12.701500 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:12.701447    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6eda8e6-3047-4932-b814-28f5f549c1d5-plugins-config-volume\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:38:12.701500 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:12.701493    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pjscg\" (UniqueName: \"kubernetes.io/projected/c6eda8e6-3047-4932-b814-28f5f549c1d5-kube-api-access-pjscg\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:38:12.725368 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:12.725307    2565 generic.go:356] "Generic (PLEG): container finished" podID="c6eda8e6-3047-4932-b814-28f5f549c1d5" containerID="b753d1ce2c397fe3fb7d9467699560476085348f7726c45a79fc3b7cb8c3bba2" exitCode=0
Sep 16 01:38:12.725368 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:12.725366    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-61dff065-687c64f7cd-qsnjs"
Sep 16 01:38:12.725368 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:12.725372    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-61dff065-687c64f7cd-qsnjs" event={"ID":"c6eda8e6-3047-4932-b814-28f5f549c1d5","Type":"ContainerDied","Data":"b753d1ce2c397fe3fb7d9467699560476085348f7726c45a79fc3b7cb8c3bba2"}
Sep 16 01:38:12.725657 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:12.725426    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-61dff065-687c64f7cd-qsnjs" event={"ID":"c6eda8e6-3047-4932-b814-28f5f549c1d5","Type":"ContainerDied","Data":"909d5ef23d2533c8c11bdbc7425c092265e975b181056190b5a1490183fb41f0"}
Sep 16 01:38:12.725657 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:12.725455    2565 scope.go:117] "RemoveContainer" containerID="b753d1ce2c397fe3fb7d9467699560476085348f7726c45a79fc3b7cb8c3bba2"
Sep 16 01:38:12.737674 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:12.737652    2565 scope.go:117] "RemoveContainer" containerID="b753d1ce2c397fe3fb7d9467699560476085348f7726c45a79fc3b7cb8c3bba2"
Sep 16 01:38:12.738108 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:38:12.738084    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b753d1ce2c397fe3fb7d9467699560476085348f7726c45a79fc3b7cb8c3bba2\": container with ID starting with b753d1ce2c397fe3fb7d9467699560476085348f7726c45a79fc3b7cb8c3bba2 not found: ID does not exist" containerID="b753d1ce2c397fe3fb7d9467699560476085348f7726c45a79fc3b7cb8c3bba2"
Sep 16 01:38:12.738209 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:12.738116    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b753d1ce2c397fe3fb7d9467699560476085348f7726c45a79fc3b7cb8c3bba2"} err="failed to get container status \"b753d1ce2c397fe3fb7d9467699560476085348f7726c45a79fc3b7cb8c3bba2\": rpc error: code = NotFound desc = could not find container \"b753d1ce2c397fe3fb7d9467699560476085348f7726c45a79fc3b7cb8c3bba2\": container with ID starting with b753d1ce2c397fe3fb7d9467699560476085348f7726c45a79fc3b7cb8c3bba2 not found: ID does not exist"
Sep 16 01:38:12.754709 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:12.754671    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-61dff065-687c64f7cd-qsnjs"]
Sep 16 01:38:12.772567 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:12.772536    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-61dff065-687c64f7cd-qsnjs"]
Sep 16 01:38:13.169990 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:13.169958    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73db6b52-4d84-4fed-9d58-6c56ba739eef" path="/var/lib/kubelet/pods/73db6b52-4d84-4fed-9d58-6c56ba739eef/volumes"
Sep 16 01:38:13.170322 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:13.170309    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6eda8e6-3047-4932-b814-28f5f549c1d5" path="/var/lib/kubelet/pods/c6eda8e6-3047-4932-b814-28f5f549c1d5/volumes"
Sep 16 01:38:18.711930 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:18.711887    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84"]
Sep 16 01:38:18.712398 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:18.712148    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84" podUID="32de387d-dac6-4d69-ac25-9f1fb1132bc5" containerName="istio-proxy" containerID="cri-o://f8986cbb44c9343844f888dd5a11e6661e3ed3af108524d38e33bc93f5c93ca7" gracePeriod=30
Sep 16 01:38:21.166346 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:21.166294    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-6cd864bc95-st4pq" secret="" err="secret \"payload-processing-dockercfg-kkbcm\" not found"
Sep 16 01:38:23.970436 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:23.970406    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84"
Sep 16 01:38:24.105584 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:24.105505    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32de387d-dac6-4d69-ac25-9f1fb1132bc5-istio-podinfo\") pod \"32de387d-dac6-4d69-ac25-9f1fb1132bc5\" (UID: \"32de387d-dac6-4d69-ac25-9f1fb1132bc5\") "
Sep 16 01:38:24.105584 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:24.105560    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32de387d-dac6-4d69-ac25-9f1fb1132bc5-workload-certs\") pod \"32de387d-dac6-4d69-ac25-9f1fb1132bc5\" (UID: \"32de387d-dac6-4d69-ac25-9f1fb1132bc5\") "
Sep 16 01:38:24.105584 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:24.105578    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32de387d-dac6-4d69-ac25-9f1fb1132bc5-istiod-ca-cert\") pod \"32de387d-dac6-4d69-ac25-9f1fb1132bc5\" (UID: \"32de387d-dac6-4d69-ac25-9f1fb1132bc5\") "
Sep 16 01:38:24.105842 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:24.105606    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32de387d-dac6-4d69-ac25-9f1fb1132bc5-istio-data\") pod \"32de387d-dac6-4d69-ac25-9f1fb1132bc5\" (UID: \"32de387d-dac6-4d69-ac25-9f1fb1132bc5\") "
Sep 16 01:38:24.105842 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:24.105645    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32de387d-dac6-4d69-ac25-9f1fb1132bc5-istio-envoy\") pod \"32de387d-dac6-4d69-ac25-9f1fb1132bc5\" (UID: \"32de387d-dac6-4d69-ac25-9f1fb1132bc5\") "
Sep 16 01:38:24.105842 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:24.105678    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32de387d-dac6-4d69-ac25-9f1fb1132bc5-istio-token\") pod \"32de387d-dac6-4d69-ac25-9f1fb1132bc5\" (UID: \"32de387d-dac6-4d69-ac25-9f1fb1132bc5\") "
Sep 16 01:38:24.105842 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:24.105711    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32de387d-dac6-4d69-ac25-9f1fb1132bc5-credential-socket\") pod \"32de387d-dac6-4d69-ac25-9f1fb1132bc5\" (UID: \"32de387d-dac6-4d69-ac25-9f1fb1132bc5\") "
Sep 16 01:38:24.105842 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:24.105752    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32de387d-dac6-4d69-ac25-9f1fb1132bc5-workload-socket\") pod \"32de387d-dac6-4d69-ac25-9f1fb1132bc5\" (UID: \"32de387d-dac6-4d69-ac25-9f1fb1132bc5\") "
Sep 16 01:38:24.105842 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:24.105779    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j7gkl\" (UniqueName: \"kubernetes.io/projected/32de387d-dac6-4d69-ac25-9f1fb1132bc5-kube-api-access-j7gkl\") pod \"32de387d-dac6-4d69-ac25-9f1fb1132bc5\" (UID: \"32de387d-dac6-4d69-ac25-9f1fb1132bc5\") "
Sep 16 01:38:24.105842 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:24.105833    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32de387d-dac6-4d69-ac25-9f1fb1132bc5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "32de387d-dac6-4d69-ac25-9f1fb1132bc5" (UID: "32de387d-dac6-4d69-ac25-9f1fb1132bc5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:38:24.106193 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:24.106066    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32de387d-dac6-4d69-ac25-9f1fb1132bc5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "32de387d-dac6-4d69-ac25-9f1fb1132bc5" (UID: "32de387d-dac6-4d69-ac25-9f1fb1132bc5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:38:24.106193 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:24.106081    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32de387d-dac6-4d69-ac25-9f1fb1132bc5-workload-certs\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:38:24.106193 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:24.106086    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32de387d-dac6-4d69-ac25-9f1fb1132bc5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "32de387d-dac6-4d69-ac25-9f1fb1132bc5" (UID: "32de387d-dac6-4d69-ac25-9f1fb1132bc5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:38:24.106369 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:24.106191    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32de387d-dac6-4d69-ac25-9f1fb1132bc5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "32de387d-dac6-4d69-ac25-9f1fb1132bc5" (UID: "32de387d-dac6-4d69-ac25-9f1fb1132bc5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:38:24.106369 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:24.106207    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32de387d-dac6-4d69-ac25-9f1fb1132bc5-istio-data" (OuterVolumeSpecName: "istio-data") pod "32de387d-dac6-4d69-ac25-9f1fb1132bc5" (UID: "32de387d-dac6-4d69-ac25-9f1fb1132bc5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:38:24.107847 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:24.107823    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/32de387d-dac6-4d69-ac25-9f1fb1132bc5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "32de387d-dac6-4d69-ac25-9f1fb1132bc5" (UID: "32de387d-dac6-4d69-ac25-9f1fb1132bc5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 01:38:24.107847 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:24.107819    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32de387d-dac6-4d69-ac25-9f1fb1132bc5-istio-token" (OuterVolumeSpecName: "istio-token") pod "32de387d-dac6-4d69-ac25-9f1fb1132bc5" (UID: "32de387d-dac6-4d69-ac25-9f1fb1132bc5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:38:24.108023 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:24.107951    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32de387d-dac6-4d69-ac25-9f1fb1132bc5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "32de387d-dac6-4d69-ac25-9f1fb1132bc5" (UID: "32de387d-dac6-4d69-ac25-9f1fb1132bc5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:38:24.108064 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:24.108054    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32de387d-dac6-4d69-ac25-9f1fb1132bc5-kube-api-access-j7gkl" (OuterVolumeSpecName: "kube-api-access-j7gkl") pod "32de387d-dac6-4d69-ac25-9f1fb1132bc5" (UID: "32de387d-dac6-4d69-ac25-9f1fb1132bc5"). InnerVolumeSpecName "kube-api-access-j7gkl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:38:24.206786 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:24.206754    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32de387d-dac6-4d69-ac25-9f1fb1132bc5-istio-token\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:38:24.206786 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:24.206782    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32de387d-dac6-4d69-ac25-9f1fb1132bc5-credential-socket\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:38:24.206786 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:24.206792    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32de387d-dac6-4d69-ac25-9f1fb1132bc5-workload-socket\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:38:24.206989 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:24.206801    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7gkl\" (UniqueName: \"kubernetes.io/projected/32de387d-dac6-4d69-ac25-9f1fb1132bc5-kube-api-access-j7gkl\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:38:24.206989 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:24.206809    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32de387d-dac6-4d69-ac25-9f1fb1132bc5-istio-podinfo\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:38:24.206989 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:24.206818    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32de387d-dac6-4d69-ac25-9f1fb1132bc5-istiod-ca-cert\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:38:24.206989 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:24.206827    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32de387d-dac6-4d69-ac25-9f1fb1132bc5-istio-data\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:38:24.206989 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:24.206835    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32de387d-dac6-4d69-ac25-9f1fb1132bc5-istio-envoy\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:38:24.789406 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:24.789371    2565 generic.go:356] "Generic (PLEG): container finished" podID="32de387d-dac6-4d69-ac25-9f1fb1132bc5" containerID="f8986cbb44c9343844f888dd5a11e6661e3ed3af108524d38e33bc93f5c93ca7" exitCode=0
Sep 16 01:38:24.789659 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:24.789452    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84"
Sep 16 01:38:24.789659 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:24.789466    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84" event={"ID":"32de387d-dac6-4d69-ac25-9f1fb1132bc5","Type":"ContainerDied","Data":"f8986cbb44c9343844f888dd5a11e6661e3ed3af108524d38e33bc93f5c93ca7"}
Sep 16 01:38:24.789659 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:24.789525    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84" event={"ID":"32de387d-dac6-4d69-ac25-9f1fb1132bc5","Type":"ContainerDied","Data":"a2c01239b253ead1a52dcacb423f7ec0162fa65b79ae8e76caa795efdf000ee5"}
Sep 16 01:38:24.789659 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:24.789551    2565 scope.go:117] "RemoveContainer" containerID="f8986cbb44c9343844f888dd5a11e6661e3ed3af108524d38e33bc93f5c93ca7"
Sep 16 01:38:24.799080 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:24.799064    2565 scope.go:117] "RemoveContainer" containerID="ac8bb03953e15058a3ef24e22c28375160f09419dc05dd0fe53696a3dec2b6ac"
Sep 16 01:38:24.806942 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:24.806925    2565 scope.go:117] "RemoveContainer" containerID="f8986cbb44c9343844f888dd5a11e6661e3ed3af108524d38e33bc93f5c93ca7"
Sep 16 01:38:24.807202 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:38:24.807182    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8986cbb44c9343844f888dd5a11e6661e3ed3af108524d38e33bc93f5c93ca7\": container with ID starting with f8986cbb44c9343844f888dd5a11e6661e3ed3af108524d38e33bc93f5c93ca7 not found: ID does not exist" containerID="f8986cbb44c9343844f888dd5a11e6661e3ed3af108524d38e33bc93f5c93ca7"
Sep 16 01:38:24.807266 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:24.807210    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8986cbb44c9343844f888dd5a11e6661e3ed3af108524d38e33bc93f5c93ca7"} err="failed to get container status \"f8986cbb44c9343844f888dd5a11e6661e3ed3af108524d38e33bc93f5c93ca7\": rpc error: code = NotFound desc = could not find container \"f8986cbb44c9343844f888dd5a11e6661e3ed3af108524d38e33bc93f5c93ca7\": container with ID starting with f8986cbb44c9343844f888dd5a11e6661e3ed3af108524d38e33bc93f5c93ca7 not found: ID does not exist"
Sep 16 01:38:24.807266 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:24.807227    2565 scope.go:117] "RemoveContainer" containerID="ac8bb03953e15058a3ef24e22c28375160f09419dc05dd0fe53696a3dec2b6ac"
Sep 16 01:38:24.807486 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:38:24.807472    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac8bb03953e15058a3ef24e22c28375160f09419dc05dd0fe53696a3dec2b6ac\": container with ID starting with ac8bb03953e15058a3ef24e22c28375160f09419dc05dd0fe53696a3dec2b6ac not found: ID does not exist" containerID="ac8bb03953e15058a3ef24e22c28375160f09419dc05dd0fe53696a3dec2b6ac"
Sep 16 01:38:24.807535 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:24.807491    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac8bb03953e15058a3ef24e22c28375160f09419dc05dd0fe53696a3dec2b6ac"} err="failed to get container status \"ac8bb03953e15058a3ef24e22c28375160f09419dc05dd0fe53696a3dec2b6ac\": rpc error: code = NotFound desc = could not find container \"ac8bb03953e15058a3ef24e22c28375160f09419dc05dd0fe53696a3dec2b6ac\": container with ID starting with ac8bb03953e15058a3ef24e22c28375160f09419dc05dd0fe53696a3dec2b6ac not found: ID does not exist"
Sep 16 01:38:24.811292 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:24.811271    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84"]
Sep 16 01:38:24.814849 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:24.814828    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84"]
Sep 16 01:38:25.169613 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:25.169579    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32de387d-dac6-4d69-ac25-9f1fb1132bc5" path="/var/lib/kubelet/pods/32de387d-dac6-4d69-ac25-9f1fb1132bc5/volumes"
Sep 16 01:38:29.540155 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:29.540054    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-d0c9f2-lvjtb"]
Sep 16 01:38:29.540707 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:29.540636    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73db6b52-4d84-4fed-9d58-6c56ba739eef" containerName="revoke-keys"
Sep 16 01:38:29.540707 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:29.540658    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="73db6b52-4d84-4fed-9d58-6c56ba739eef" containerName="revoke-keys"
Sep 16 01:38:29.540707 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:29.540677    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6eda8e6-3047-4932-b814-28f5f549c1d5" containerName="payload-pre-processing"
Sep 16 01:38:29.540707 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:29.540686    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6eda8e6-3047-4932-b814-28f5f549c1d5" containerName="payload-pre-processing"
Sep 16 01:38:29.540707 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:29.540703    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32de387d-dac6-4d69-ac25-9f1fb1132bc5" containerName="istio-proxy"
Sep 16 01:38:29.540981 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:29.540713    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="32de387d-dac6-4d69-ac25-9f1fb1132bc5" containerName="istio-proxy"
Sep 16 01:38:29.540981 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:29.540730    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32de387d-dac6-4d69-ac25-9f1fb1132bc5" containerName="istio-proxy"
Sep 16 01:38:29.540981 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:29.540740    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="32de387d-dac6-4d69-ac25-9f1fb1132bc5" containerName="istio-proxy"
Sep 16 01:38:29.540981 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:29.540834    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="32de387d-dac6-4d69-ac25-9f1fb1132bc5" containerName="istio-proxy"
Sep 16 01:38:29.540981 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:29.540844    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="73db6b52-4d84-4fed-9d58-6c56ba739eef" containerName="revoke-keys"
Sep 16 01:38:29.540981 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:29.540858    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6eda8e6-3047-4932-b814-28f5f549c1d5" containerName="payload-pre-processing"
Sep 16 01:38:29.545528 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:29.545505    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-d0c9f2-lvjtb"
Sep 16 01:38:29.548206 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:29.548183    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4ljjd\""
Sep 16 01:38:29.548377 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:29.548182    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 01:38:29.549935 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:29.549909    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-d0c9f2-lvjtb"]
Sep 16 01:38:29.656786 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:29.656746    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d87f00e2-21bc-44e5-b636-15601d013d26-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w3-d0c9f2-lvjtb\" (UID: \"d87f00e2-21bc-44e5-b636-15601d013d26\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-d0c9f2-lvjtb"
Sep 16 01:38:29.757819 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:29.757780    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d87f00e2-21bc-44e5-b636-15601d013d26-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w3-d0c9f2-lvjtb\" (UID: \"d87f00e2-21bc-44e5-b636-15601d013d26\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-d0c9f2-lvjtb"
Sep 16 01:38:29.758393 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:29.758376    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d87f00e2-21bc-44e5-b636-15601d013d26-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w3-d0c9f2-lvjtb\" (UID: \"d87f00e2-21bc-44e5-b636-15601d013d26\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-d0c9f2-lvjtb"
Sep 16 01:38:29.858542 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:29.858436    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-d0c9f2-lvjtb"
Sep 16 01:38:30.127319 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:30.127292    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-d0c9f2-lvjtb"]
Sep 16 01:38:30.129294 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:38:30.129265    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd87f00e2_21bc_44e5_b636_15601d013d26.slice/crio-6c9c88953d7ea29dcf4b0fc3bfc97b82a180166b6256be00114e4ff34c45550d WatchSource:0}: Error finding container 6c9c88953d7ea29dcf4b0fc3bfc97b82a180166b6256be00114e4ff34c45550d: Status 404 returned error can't find the container with id 6c9c88953d7ea29dcf4b0fc3bfc97b82a180166b6256be00114e4ff34c45550d
Sep 16 01:38:30.823716 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:30.823621    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-d0c9f2-lvjtb" event={"ID":"d87f00e2-21bc-44e5-b636-15601d013d26","Type":"ContainerStarted","Data":"73d2440179ce5f4685207af63fc08763984e0261386e33f6f37e146d5ed41206"}
Sep 16 01:38:30.823716 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:30.823680    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-d0c9f2-lvjtb" event={"ID":"d87f00e2-21bc-44e5-b636-15601d013d26","Type":"ContainerStarted","Data":"6c9c88953d7ea29dcf4b0fc3bfc97b82a180166b6256be00114e4ff34c45550d"}
Sep 16 01:38:30.839112 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:30.839062    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-d0c9f2-lvjtb" podStartSLOduration=1.839046423 podStartE2EDuration="1.839046423s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:38:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:38:30.837685304 +0000 UTC m=+1360.161153882" watchObservedRunningTime="2026-09-16 01:38:30.839046423 +0000 UTC m=+1360.162514999"
Sep 16 01:38:31.830776 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:31.830744    2565 generic.go:356] "Generic (PLEG): container finished" podID="d87f00e2-21bc-44e5-b636-15601d013d26" containerID="73d2440179ce5f4685207af63fc08763984e0261386e33f6f37e146d5ed41206" exitCode=0
Sep 16 01:38:31.831148 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:31.830838    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-d0c9f2-lvjtb" event={"ID":"d87f00e2-21bc-44e5-b636-15601d013d26","Type":"ContainerDied","Data":"73d2440179ce5f4685207af63fc08763984e0261386e33f6f37e146d5ed41206"}
Sep 16 01:38:32.266348 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:32.266299    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb"]
Sep 16 01:38:32.266766 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:32.266751    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="32de387d-dac6-4d69-ac25-9f1fb1132bc5" containerName="istio-proxy"
Sep 16 01:38:32.269795 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:32.269774    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb"
Sep 16 01:38:32.272147 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:32.272127    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w1-4bc0fb-openshift-default-dockercfg-xlcrt\""
Sep 16 01:38:32.281881 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:32.281858    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb"]
Sep 16 01:38:32.381466 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:32.381428    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59023c4f-45b1-480e-a110-50c6fe86586a-workload-socket\") pod \"e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb\" (UID: \"59023c4f-45b1-480e-a110-50c6fe86586a\") " pod="openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb"
Sep 16 01:38:32.381657 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:32.381488    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59023c4f-45b1-480e-a110-50c6fe86586a-credential-socket\") pod \"e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb\" (UID: \"59023c4f-45b1-480e-a110-50c6fe86586a\") " pod="openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb"
Sep 16 01:38:32.381657 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:32.381532    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59023c4f-45b1-480e-a110-50c6fe86586a-istio-data\") pod \"e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb\" (UID: \"59023c4f-45b1-480e-a110-50c6fe86586a\") " pod="openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb"
Sep 16 01:38:32.381779 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:32.381670    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4szgl\" (UniqueName: \"kubernetes.io/projected/59023c4f-45b1-480e-a110-50c6fe86586a-kube-api-access-4szgl\") pod \"e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb\" (UID: \"59023c4f-45b1-480e-a110-50c6fe86586a\") " pod="openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb"
Sep 16 01:38:32.381779 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:32.381718    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59023c4f-45b1-480e-a110-50c6fe86586a-istio-podinfo\") pod \"e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb\" (UID: \"59023c4f-45b1-480e-a110-50c6fe86586a\") " pod="openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb"
Sep 16 01:38:32.381895 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:32.381813    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59023c4f-45b1-480e-a110-50c6fe86586a-istiod-ca-cert\") pod \"e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb\" (UID: \"59023c4f-45b1-480e-a110-50c6fe86586a\") " pod="openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb"
Sep 16 01:38:32.381895 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:32.381858    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59023c4f-45b1-480e-a110-50c6fe86586a-istio-envoy\") pod \"e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb\" (UID: \"59023c4f-45b1-480e-a110-50c6fe86586a\") " pod="openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb"
Sep 16 01:38:32.381895 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:32.381890    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59023c4f-45b1-480e-a110-50c6fe86586a-istio-token\") pod \"e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb\" (UID: \"59023c4f-45b1-480e-a110-50c6fe86586a\") " pod="openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb"
Sep 16 01:38:32.382033 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:32.381920    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59023c4f-45b1-480e-a110-50c6fe86586a-workload-certs\") pod \"e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb\" (UID: \"59023c4f-45b1-480e-a110-50c6fe86586a\") " pod="openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb"
Sep 16 01:38:32.482918 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:32.482884    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4szgl\" (UniqueName: \"kubernetes.io/projected/59023c4f-45b1-480e-a110-50c6fe86586a-kube-api-access-4szgl\") pod \"e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb\" (UID: \"59023c4f-45b1-480e-a110-50c6fe86586a\") " pod="openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb"
Sep 16 01:38:32.482918 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:32.482919    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59023c4f-45b1-480e-a110-50c6fe86586a-istio-podinfo\") pod \"e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb\" (UID: \"59023c4f-45b1-480e-a110-50c6fe86586a\") " pod="openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb"
Sep 16 01:38:32.483178 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:32.482950    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59023c4f-45b1-480e-a110-50c6fe86586a-istiod-ca-cert\") pod \"e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb\" (UID: \"59023c4f-45b1-480e-a110-50c6fe86586a\") " pod="openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb"
Sep 16 01:38:32.483178 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:32.483073    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59023c4f-45b1-480e-a110-50c6fe86586a-istio-envoy\") pod \"e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb\" (UID: \"59023c4f-45b1-480e-a110-50c6fe86586a\") " pod="openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb"
Sep 16 01:38:32.483178 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:32.483109    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59023c4f-45b1-480e-a110-50c6fe86586a-istio-token\") pod \"e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb\" (UID: \"59023c4f-45b1-480e-a110-50c6fe86586a\") " pod="openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb"
Sep 16 01:38:32.483178 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:32.483142    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59023c4f-45b1-480e-a110-50c6fe86586a-workload-certs\") pod \"e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb\" (UID: \"59023c4f-45b1-480e-a110-50c6fe86586a\") " pod="openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb"
Sep 16 01:38:32.483527 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:32.483193    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59023c4f-45b1-480e-a110-50c6fe86586a-workload-socket\") pod \"e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb\" (UID: \"59023c4f-45b1-480e-a110-50c6fe86586a\") " pod="openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb"
Sep 16 01:38:32.483527 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:32.483229    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59023c4f-45b1-480e-a110-50c6fe86586a-credential-socket\") pod \"e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb\" (UID: \"59023c4f-45b1-480e-a110-50c6fe86586a\") " pod="openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb"
Sep 16 01:38:32.483527 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:32.483273    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59023c4f-45b1-480e-a110-50c6fe86586a-istio-data\") pod \"e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb\" (UID: \"59023c4f-45b1-480e-a110-50c6fe86586a\") " pod="openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb"
Sep 16 01:38:32.483694 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:32.483670    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59023c4f-45b1-480e-a110-50c6fe86586a-workload-socket\") pod \"e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb\" (UID: \"59023c4f-45b1-480e-a110-50c6fe86586a\") " pod="openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb"
Sep 16 01:38:32.483765 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:32.483691    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59023c4f-45b1-480e-a110-50c6fe86586a-workload-certs\") pod \"e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb\" (UID: \"59023c4f-45b1-480e-a110-50c6fe86586a\") " pod="openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb"
Sep 16 01:38:32.483765 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:32.483695    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59023c4f-45b1-480e-a110-50c6fe86586a-istiod-ca-cert\") pod \"e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb\" (UID: \"59023c4f-45b1-480e-a110-50c6fe86586a\") " pod="openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb"
Sep 16 01:38:32.483765 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:32.483721    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59023c4f-45b1-480e-a110-50c6fe86586a-credential-socket\") pod \"e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb\" (UID: \"59023c4f-45b1-480e-a110-50c6fe86586a\") " pod="openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb"
Sep 16 01:38:32.483765 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:32.483753    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59023c4f-45b1-480e-a110-50c6fe86586a-istio-data\") pod \"e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb\" (UID: \"59023c4f-45b1-480e-a110-50c6fe86586a\") " pod="openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb"
Sep 16 01:38:32.485384 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:32.485361    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59023c4f-45b1-480e-a110-50c6fe86586a-istio-envoy\") pod \"e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb\" (UID: \"59023c4f-45b1-480e-a110-50c6fe86586a\") " pod="openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb"
Sep 16 01:38:32.485531 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:32.485514    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59023c4f-45b1-480e-a110-50c6fe86586a-istio-podinfo\") pod \"e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb\" (UID: \"59023c4f-45b1-480e-a110-50c6fe86586a\") " pod="openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb"
Sep 16 01:38:32.492707 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:32.492675    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59023c4f-45b1-480e-a110-50c6fe86586a-istio-token\") pod \"e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb\" (UID: \"59023c4f-45b1-480e-a110-50c6fe86586a\") " pod="openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb"
Sep 16 01:38:32.493033 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:32.493012    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4szgl\" (UniqueName: \"kubernetes.io/projected/59023c4f-45b1-480e-a110-50c6fe86586a-kube-api-access-4szgl\") pod \"e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb\" (UID: \"59023c4f-45b1-480e-a110-50c6fe86586a\") " pod="openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb"
Sep 16 01:38:32.582303 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:32.582235    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb"
Sep 16 01:38:32.859455 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:32.859420    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb"]
Sep 16 01:38:32.860290 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:38:32.860261    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59023c4f_45b1_480e_a110_50c6fe86586a.slice/crio-5fc07a3690099424fc384ca06d70a2da62e07bd65932011b5294f296a1c3a38c WatchSource:0}: Error finding container 5fc07a3690099424fc384ca06d70a2da62e07bd65932011b5294f296a1c3a38c: Status 404 returned error can't find the container with id 5fc07a3690099424fc384ca06d70a2da62e07bd65932011b5294f296a1c3a38c
Sep 16 01:38:32.862752 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:32.862708    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:38:32.862830 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:32.862800    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:38:32.862871 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:32.862843    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:38:32.962804 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:32.962775    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-d0c9f2-lvjtb"
Sep 16 01:38:33.088568 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:33.088476    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d87f00e2-21bc-44e5-b636-15601d013d26-maas-api-service-ca\") pod \"d87f00e2-21bc-44e5-b636-15601d013d26\" (UID: \"d87f00e2-21bc-44e5-b636-15601d013d26\") "
Sep 16 01:38:33.088880 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:33.088845    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d87f00e2-21bc-44e5-b636-15601d013d26-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d87f00e2-21bc-44e5-b636-15601d013d26" (UID: "d87f00e2-21bc-44e5-b636-15601d013d26"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:38:33.189641 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:33.189609    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d87f00e2-21bc-44e5-b636-15601d013d26-maas-api-service-ca\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:38:33.842391 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:33.842296    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-d0c9f2-lvjtb"
Sep 16 01:38:33.842391 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:33.842366    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-d0c9f2-lvjtb" event={"ID":"d87f00e2-21bc-44e5-b636-15601d013d26","Type":"ContainerDied","Data":"6c9c88953d7ea29dcf4b0fc3bfc97b82a180166b6256be00114e4ff34c45550d"}
Sep 16 01:38:33.842579 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:33.842426    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6c9c88953d7ea29dcf4b0fc3bfc97b82a180166b6256be00114e4ff34c45550d"
Sep 16 01:38:33.844147 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:33.844114    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb" event={"ID":"59023c4f-45b1-480e-a110-50c6fe86586a","Type":"ContainerStarted","Data":"fc49086c4becc28eac0ef825429214d9b3f1582bda25ae1be779b281aa71f663"}
Sep 16 01:38:33.844282 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:33.844170    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb" event={"ID":"59023c4f-45b1-480e-a110-50c6fe86586a","Type":"ContainerStarted","Data":"5fc07a3690099424fc384ca06d70a2da62e07bd65932011b5294f296a1c3a38c"}
Sep 16 01:38:33.865660 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:33.865617    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb" podStartSLOduration=1.8656035439999998 podStartE2EDuration="1.865603544s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:38:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:38:33.863848239 +0000 UTC m=+1363.187316828" watchObservedRunningTime="2026-09-16 01:38:33.865603544 +0000 UTC m=+1363.189072121"
Sep 16 01:38:34.412928 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:34.412896    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-d0c9f2/distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk"]
Sep 16 01:38:34.583204 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:34.583164    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb"
Sep 16 01:38:34.588259 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:34.588233    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb"
Sep 16 01:38:34.849891 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:34.849806    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb"
Sep 16 01:38:34.850807 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:34.850790    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb"
Sep 16 01:38:38.052410 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:38.052373    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w1-4bc0fb-68cfb59b4b-wftkw"]
Sep 16 01:38:38.052827 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:38.052742    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d87f00e2-21bc-44e5-b636-15601d013d26" containerName="revoke-keys"
Sep 16 01:38:38.052827 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:38.052755    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d87f00e2-21bc-44e5-b636-15601d013d26" containerName="revoke-keys"
Sep 16 01:38:38.052913 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:38.052830    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d87f00e2-21bc-44e5-b636-15601d013d26" containerName="revoke-keys"
Sep 16 01:38:38.056108 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:38.056093    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-4bc0fb-68cfb59b4b-wftkw"
Sep 16 01:38:38.058626 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:38.058603    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w1-4bc0fb-dockercfg-7rgbg\""
Sep 16 01:38:38.058626 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:38.058606    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w1-4bc0fb\""
Sep 16 01:38:38.064931 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:38.064905    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w1-4bc0fb-68cfb59b4b-wftkw"]
Sep 16 01:38:38.234892 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:38.234853    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46h6p\" (UniqueName: \"kubernetes.io/projected/3279b4cf-5e53-46f6-a93c-6f524902689f-kube-api-access-46h6p\") pod \"payload-pre-processing-e2e-shared-a-w1-4bc0fb-68cfb59b4b-wftkw\" (UID: \"3279b4cf-5e53-46f6-a93c-6f524902689f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-4bc0fb-68cfb59b4b-wftkw"
Sep 16 01:38:38.235065 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:38.234978    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3279b4cf-5e53-46f6-a93c-6f524902689f-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w1-4bc0fb-68cfb59b4b-wftkw\" (UID: \"3279b4cf-5e53-46f6-a93c-6f524902689f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-4bc0fb-68cfb59b4b-wftkw"
Sep 16 01:38:38.336228 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:38.336133    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46h6p\" (UniqueName: \"kubernetes.io/projected/3279b4cf-5e53-46f6-a93c-6f524902689f-kube-api-access-46h6p\") pod \"payload-pre-processing-e2e-shared-a-w1-4bc0fb-68cfb59b4b-wftkw\" (UID: \"3279b4cf-5e53-46f6-a93c-6f524902689f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-4bc0fb-68cfb59b4b-wftkw"
Sep 16 01:38:38.336421 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:38.336256    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3279b4cf-5e53-46f6-a93c-6f524902689f-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w1-4bc0fb-68cfb59b4b-wftkw\" (UID: \"3279b4cf-5e53-46f6-a93c-6f524902689f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-4bc0fb-68cfb59b4b-wftkw"
Sep 16 01:38:38.336995 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:38.336972    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3279b4cf-5e53-46f6-a93c-6f524902689f-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w1-4bc0fb-68cfb59b4b-wftkw\" (UID: \"3279b4cf-5e53-46f6-a93c-6f524902689f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-4bc0fb-68cfb59b4b-wftkw"
Sep 16 01:38:38.344011 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:38.343987    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46h6p\" (UniqueName: \"kubernetes.io/projected/3279b4cf-5e53-46f6-a93c-6f524902689f-kube-api-access-46h6p\") pod \"payload-pre-processing-e2e-shared-a-w1-4bc0fb-68cfb59b4b-wftkw\" (UID: \"3279b4cf-5e53-46f6-a93c-6f524902689f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-4bc0fb-68cfb59b4b-wftkw"
Sep 16 01:38:38.367024 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:38.366999    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-4bc0fb-68cfb59b4b-wftkw"
Sep 16 01:38:38.637461 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:38.637435    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w1-4bc0fb-68cfb59b4b-wftkw"]
Sep 16 01:38:38.639838 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:38:38.639813    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3279b4cf_5e53_46f6_a93c_6f524902689f.slice/crio-f870c87025f8af7cd11c8e1e0369ee9a66fb44a728d2bef03a4f67d2eaca2b27 WatchSource:0}: Error finding container f870c87025f8af7cd11c8e1e0369ee9a66fb44a728d2bef03a4f67d2eaca2b27: Status 404 returned error can't find the container with id f870c87025f8af7cd11c8e1e0369ee9a66fb44a728d2bef03a4f67d2eaca2b27
Sep 16 01:38:38.873630 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:38.873587    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-4bc0fb-68cfb59b4b-wftkw" event={"ID":"3279b4cf-5e53-46f6-a93c-6f524902689f","Type":"ContainerStarted","Data":"7f15446bfd2157799d6f310750665039917d10a7189759827263a379354ba452"}
Sep 16 01:38:38.873825 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:38.873655    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-4bc0fb-68cfb59b4b-wftkw" event={"ID":"3279b4cf-5e53-46f6-a93c-6f524902689f","Type":"ContainerStarted","Data":"f870c87025f8af7cd11c8e1e0369ee9a66fb44a728d2bef03a4f67d2eaca2b27"}
Sep 16 01:38:38.873825 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:38.873759    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-4bc0fb-68cfb59b4b-wftkw"
Sep 16 01:38:38.892057 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:38.891960    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-4bc0fb-68cfb59b4b-wftkw" podStartSLOduration=0.89194405 podStartE2EDuration="891.94405ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:38:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:38:38.890271738 +0000 UTC m=+1368.213740316" watchObservedRunningTime="2026-09-16 01:38:38.89194405 +0000 UTC m=+1368.215412638"
Sep 16 01:38:45.402786 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:45.402751    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-d0c9f2-29825370-ckkdv"]
Sep 16 01:38:45.404648 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:45.404617    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-d0c9f2-29825370-ckkdv"]
Sep 16 01:38:45.419914 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:45.419884    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-d0c9f2-7699d77785-z7vsl"]
Sep 16 01:38:45.420180 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:45.420144    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w3-d0c9f2-7699d77785-z7vsl" podUID="b535c84b-48d5-4b66-a1f8-39df2c359ace" containerName="payload-processing" containerID="cri-o://3ce216abbbeea353338c22e8b7e8e2ab6e048dddd633393145d9aa125d13cec3" gracePeriod=30
Sep 16 01:38:45.555573 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:45.555524    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-d0c9f2-lvjtb"]
Sep 16 01:38:45.557452 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:45.557430    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-d0c9f2-lvjtb"]
Sep 16 01:38:45.697888 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:45.697862    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-d0c9f2-7699d77785-z7vsl"
Sep 16 01:38:45.698252 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:45.698232    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqm72\" (UniqueName: \"kubernetes.io/projected/b535c84b-48d5-4b66-a1f8-39df2c359ace-kube-api-access-wqm72\") pod \"b535c84b-48d5-4b66-a1f8-39df2c359ace\" (UID: \"b535c84b-48d5-4b66-a1f8-39df2c359ace\") "
Sep 16 01:38:45.698402 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:45.698295    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b535c84b-48d5-4b66-a1f8-39df2c359ace-plugins-config-volume\") pod \"b535c84b-48d5-4b66-a1f8-39df2c359ace\" (UID: \"b535c84b-48d5-4b66-a1f8-39df2c359ace\") "
Sep 16 01:38:45.698639 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:45.698615    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b535c84b-48d5-4b66-a1f8-39df2c359ace-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b535c84b-48d5-4b66-a1f8-39df2c359ace" (UID: "b535c84b-48d5-4b66-a1f8-39df2c359ace"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:38:45.700402 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:45.700379    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b535c84b-48d5-4b66-a1f8-39df2c359ace-kube-api-access-wqm72" (OuterVolumeSpecName: "kube-api-access-wqm72") pod "b535c84b-48d5-4b66-a1f8-39df2c359ace" (UID: "b535c84b-48d5-4b66-a1f8-39df2c359ace"). InnerVolumeSpecName "kube-api-access-wqm72". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:38:45.799432 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:45.799402    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqm72\" (UniqueName: \"kubernetes.io/projected/b535c84b-48d5-4b66-a1f8-39df2c359ace-kube-api-access-wqm72\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:38:45.799571 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:45.799448    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b535c84b-48d5-4b66-a1f8-39df2c359ace-plugins-config-volume\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:38:45.911812 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:45.911780    2565 generic.go:356] "Generic (PLEG): container finished" podID="b535c84b-48d5-4b66-a1f8-39df2c359ace" containerID="3ce216abbbeea353338c22e8b7e8e2ab6e048dddd633393145d9aa125d13cec3" exitCode=0
Sep 16 01:38:45.911951 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:45.911826    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-d0c9f2-7699d77785-z7vsl"
Sep 16 01:38:45.911951 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:45.911868    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-d0c9f2-7699d77785-z7vsl" event={"ID":"b535c84b-48d5-4b66-a1f8-39df2c359ace","Type":"ContainerDied","Data":"3ce216abbbeea353338c22e8b7e8e2ab6e048dddd633393145d9aa125d13cec3"}
Sep 16 01:38:45.911951 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:45.911921    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-d0c9f2-7699d77785-z7vsl" event={"ID":"b535c84b-48d5-4b66-a1f8-39df2c359ace","Type":"ContainerDied","Data":"b7cb83fa9b478c141d4d48f7de69e3fb269b967ec46b72381ce22b50539a93d4"}
Sep 16 01:38:45.911951 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:45.911947    2565 scope.go:117] "RemoveContainer" containerID="3ce216abbbeea353338c22e8b7e8e2ab6e048dddd633393145d9aa125d13cec3"
Sep 16 01:38:45.920571 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:45.920556    2565 scope.go:117] "RemoveContainer" containerID="3ce216abbbeea353338c22e8b7e8e2ab6e048dddd633393145d9aa125d13cec3"
Sep 16 01:38:45.920833 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:38:45.920810    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ce216abbbeea353338c22e8b7e8e2ab6e048dddd633393145d9aa125d13cec3\": container with ID starting with 3ce216abbbeea353338c22e8b7e8e2ab6e048dddd633393145d9aa125d13cec3 not found: ID does not exist" containerID="3ce216abbbeea353338c22e8b7e8e2ab6e048dddd633393145d9aa125d13cec3"
Sep 16 01:38:45.920911 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:45.920838    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ce216abbbeea353338c22e8b7e8e2ab6e048dddd633393145d9aa125d13cec3"} err="failed to get container status \"3ce216abbbeea353338c22e8b7e8e2ab6e048dddd633393145d9aa125d13cec3\": rpc error: code = NotFound desc = could not find container \"3ce216abbbeea353338c22e8b7e8e2ab6e048dddd633393145d9aa125d13cec3\": container with ID starting with 3ce216abbbeea353338c22e8b7e8e2ab6e048dddd633393145d9aa125d13cec3 not found: ID does not exist"
Sep 16 01:38:45.931405 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:45.931353    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-d0c9f2-7699d77785-z7vsl"]
Sep 16 01:38:45.935553 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:45.935534    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-d0c9f2-7699d77785-z7vsl"]
Sep 16 01:38:47.169691 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:47.169660    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80ab198d-a996-496c-813f-477f399db72e" path="/var/lib/kubelet/pods/80ab198d-a996-496c-813f-477f399db72e/volumes"
Sep 16 01:38:47.170079 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:47.170004    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b535c84b-48d5-4b66-a1f8-39df2c359ace" path="/var/lib/kubelet/pods/b535c84b-48d5-4b66-a1f8-39df2c359ace/volumes"
Sep 16 01:38:47.170306 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:47.170294    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d87f00e2-21bc-44e5-b636-15601d013d26" path="/var/lib/kubelet/pods/d87f00e2-21bc-44e5-b636-15601d013d26/volumes"
Sep 16 01:38:49.432303 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:49.432264    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-d0c9f2/distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk" podUID="6c626f1e-51c2-4e1f-9005-8d545708aa58" containerName="main" containerID="cri-o://4a74e13ecde61cb3409d232d1d4cbad20bc3d72afb810f4c3e2b3bdb4de8a078" gracePeriod=45
Sep 16 01:38:49.668725 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:49.668693    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-d0c9f2/distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk"
Sep 16 01:38:49.728249 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:49.728177    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c626f1e-51c2-4e1f-9005-8d545708aa58-home\") pod \"6c626f1e-51c2-4e1f-9005-8d545708aa58\" (UID: \"6c626f1e-51c2-4e1f-9005-8d545708aa58\") "
Sep 16 01:38:49.728249 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:49.728234    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9lgt\" (UniqueName: \"kubernetes.io/projected/6c626f1e-51c2-4e1f-9005-8d545708aa58-kube-api-access-q9lgt\") pod \"6c626f1e-51c2-4e1f-9005-8d545708aa58\" (UID: \"6c626f1e-51c2-4e1f-9005-8d545708aa58\") "
Sep 16 01:38:49.728465 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:49.728260    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c626f1e-51c2-4e1f-9005-8d545708aa58-tls-certs\") pod \"6c626f1e-51c2-4e1f-9005-8d545708aa58\" (UID: \"6c626f1e-51c2-4e1f-9005-8d545708aa58\") "
Sep 16 01:38:49.728465 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:49.728301    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c626f1e-51c2-4e1f-9005-8d545708aa58-tmp-dir\") pod \"6c626f1e-51c2-4e1f-9005-8d545708aa58\" (UID: \"6c626f1e-51c2-4e1f-9005-8d545708aa58\") "
Sep 16 01:38:49.728465 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:49.728373    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c626f1e-51c2-4e1f-9005-8d545708aa58-model-cache\") pod \"6c626f1e-51c2-4e1f-9005-8d545708aa58\" (UID: \"6c626f1e-51c2-4e1f-9005-8d545708aa58\") "
Sep 16 01:38:49.728630 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:49.728522    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c626f1e-51c2-4e1f-9005-8d545708aa58-home" (OuterVolumeSpecName: "home") pod "6c626f1e-51c2-4e1f-9005-8d545708aa58" (UID: "6c626f1e-51c2-4e1f-9005-8d545708aa58"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:38:49.728718 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:49.728691    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c626f1e-51c2-4e1f-9005-8d545708aa58-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6c626f1e-51c2-4e1f-9005-8d545708aa58" (UID: "6c626f1e-51c2-4e1f-9005-8d545708aa58"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:38:49.728718 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:49.728706    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c626f1e-51c2-4e1f-9005-8d545708aa58-model-cache" (OuterVolumeSpecName: "model-cache") pod "6c626f1e-51c2-4e1f-9005-8d545708aa58" (UID: "6c626f1e-51c2-4e1f-9005-8d545708aa58"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:38:49.728825 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:49.728755    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c626f1e-51c2-4e1f-9005-8d545708aa58-home\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:38:49.730732 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:49.730708    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c626f1e-51c2-4e1f-9005-8d545708aa58-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6c626f1e-51c2-4e1f-9005-8d545708aa58" (UID: "6c626f1e-51c2-4e1f-9005-8d545708aa58"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 01:38:49.730849 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:49.730774    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c626f1e-51c2-4e1f-9005-8d545708aa58-kube-api-access-q9lgt" (OuterVolumeSpecName: "kube-api-access-q9lgt") pod "6c626f1e-51c2-4e1f-9005-8d545708aa58" (UID: "6c626f1e-51c2-4e1f-9005-8d545708aa58"). InnerVolumeSpecName "kube-api-access-q9lgt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:38:49.829037 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:49.829006    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c626f1e-51c2-4e1f-9005-8d545708aa58-dshm\") pod \"6c626f1e-51c2-4e1f-9005-8d545708aa58\" (UID: \"6c626f1e-51c2-4e1f-9005-8d545708aa58\") "
Sep 16 01:38:49.829204 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:49.829189    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9lgt\" (UniqueName: \"kubernetes.io/projected/6c626f1e-51c2-4e1f-9005-8d545708aa58-kube-api-access-q9lgt\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:38:49.829204 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:49.829200    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c626f1e-51c2-4e1f-9005-8d545708aa58-tls-certs\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:38:49.829383 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:49.829211    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c626f1e-51c2-4e1f-9005-8d545708aa58-tmp-dir\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:38:49.829383 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:49.829220    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c626f1e-51c2-4e1f-9005-8d545708aa58-model-cache\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:38:49.830913 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:49.830890    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c626f1e-51c2-4e1f-9005-8d545708aa58-dshm" (OuterVolumeSpecName: "dshm") pod "6c626f1e-51c2-4e1f-9005-8d545708aa58" (UID: "6c626f1e-51c2-4e1f-9005-8d545708aa58"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:38:49.882078 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:49.882052    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-4bc0fb-68cfb59b4b-wftkw"
Sep 16 01:38:49.929665 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:49.929640    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c626f1e-51c2-4e1f-9005-8d545708aa58-dshm\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:38:49.936144 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:49.936118    2565 generic.go:356] "Generic (PLEG): container finished" podID="6c626f1e-51c2-4e1f-9005-8d545708aa58" containerID="4a74e13ecde61cb3409d232d1d4cbad20bc3d72afb810f4c3e2b3bdb4de8a078" exitCode=0
Sep 16 01:38:49.936284 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:49.936150    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-d0c9f2/distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk" event={"ID":"6c626f1e-51c2-4e1f-9005-8d545708aa58","Type":"ContainerDied","Data":"4a74e13ecde61cb3409d232d1d4cbad20bc3d72afb810f4c3e2b3bdb4de8a078"}
Sep 16 01:38:49.936284 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:49.936166    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-d0c9f2/distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk"
Sep 16 01:38:49.936284 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:49.936185    2565 scope.go:117] "RemoveContainer" containerID="4a74e13ecde61cb3409d232d1d4cbad20bc3d72afb810f4c3e2b3bdb4de8a078"
Sep 16 01:38:49.936284 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:49.936176    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-d0c9f2/distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk" event={"ID":"6c626f1e-51c2-4e1f-9005-8d545708aa58","Type":"ContainerDied","Data":"002bcebbc2d5ed58d4b5f85f6849641bb6737a6c146eb4a01e4905bfc33a71cf"}
Sep 16 01:38:49.946124 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:49.946105    2565 scope.go:117] "RemoveContainer" containerID="4a74e13ecde61cb3409d232d1d4cbad20bc3d72afb810f4c3e2b3bdb4de8a078"
Sep 16 01:38:49.946434 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:38:49.946414    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a74e13ecde61cb3409d232d1d4cbad20bc3d72afb810f4c3e2b3bdb4de8a078\": container with ID starting with 4a74e13ecde61cb3409d232d1d4cbad20bc3d72afb810f4c3e2b3bdb4de8a078 not found: ID does not exist" containerID="4a74e13ecde61cb3409d232d1d4cbad20bc3d72afb810f4c3e2b3bdb4de8a078"
Sep 16 01:38:49.946504 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:49.946443    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a74e13ecde61cb3409d232d1d4cbad20bc3d72afb810f4c3e2b3bdb4de8a078"} err="failed to get container status \"4a74e13ecde61cb3409d232d1d4cbad20bc3d72afb810f4c3e2b3bdb4de8a078\": rpc error: code = NotFound desc = could not find container \"4a74e13ecde61cb3409d232d1d4cbad20bc3d72afb810f4c3e2b3bdb4de8a078\": container with ID starting with 4a74e13ecde61cb3409d232d1d4cbad20bc3d72afb810f4c3e2b3bdb4de8a078 not found: ID does not exist"
Sep 16 01:38:49.957093 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:49.957071    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-d0c9f2/distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk"]
Sep 16 01:38:49.959319 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:49.959294    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-d0c9f2/distinct-w3-d0c9f2-kserve-d9d4f44-sb8bk"]
Sep 16 01:38:51.172074 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:51.172044    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c626f1e-51c2-4e1f-9005-8d545708aa58" path="/var/lib/kubelet/pods/6c626f1e-51c2-4e1f-9005-8d545708aa58/volumes"
Sep 16 01:38:51.251071 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:51.251030    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj"]
Sep 16 01:38:51.251888 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:51.251860    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b535c84b-48d5-4b66-a1f8-39df2c359ace" containerName="payload-processing"
Sep 16 01:38:51.252044 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:51.252031    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b535c84b-48d5-4b66-a1f8-39df2c359ace" containerName="payload-processing"
Sep 16 01:38:51.252143 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:51.252132    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c626f1e-51c2-4e1f-9005-8d545708aa58" containerName="main"
Sep 16 01:38:51.252221 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:51.252212    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c626f1e-51c2-4e1f-9005-8d545708aa58" containerName="main"
Sep 16 01:38:51.252436 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:51.252422    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c626f1e-51c2-4e1f-9005-8d545708aa58" containerName="main"
Sep 16 01:38:51.252528 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:51.252519    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b535c84b-48d5-4b66-a1f8-39df2c359ace" containerName="payload-processing"
Sep 16 01:38:51.257148 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:51.256637    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj"
Sep 16 01:38:51.280479 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:51.280449    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w1-0d2655-openshift-default-dockercfg-6xl8v\""
Sep 16 01:38:51.288741 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:51.286940    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj"]
Sep 16 01:38:51.324807 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:51.324743    2565 scope.go:117] "RemoveContainer" containerID="264c2cba3a2407ddf07070dbbdb49f32165bd170cf86d17d17c935cb23744769"
Sep 16 01:38:51.341610 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:51.341584    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1074617b-d56c-4638-8f7d-c9b5db5f6c68-istio-token\") pod \"e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj\" (UID: \"1074617b-d56c-4638-8f7d-c9b5db5f6c68\") " pod="openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj"
Sep 16 01:38:51.341685 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:51.341624    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1074617b-d56c-4638-8f7d-c9b5db5f6c68-credential-socket\") pod \"e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj\" (UID: \"1074617b-d56c-4638-8f7d-c9b5db5f6c68\") " pod="openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj"
Sep 16 01:38:51.341685 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:51.341648    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1074617b-d56c-4638-8f7d-c9b5db5f6c68-istio-envoy\") pod \"e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj\" (UID: \"1074617b-d56c-4638-8f7d-c9b5db5f6c68\") " pod="openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj"
Sep 16 01:38:51.341787 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:51.341685    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bt2kr\" (UniqueName: \"kubernetes.io/projected/1074617b-d56c-4638-8f7d-c9b5db5f6c68-kube-api-access-bt2kr\") pod \"e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj\" (UID: \"1074617b-d56c-4638-8f7d-c9b5db5f6c68\") " pod="openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj"
Sep 16 01:38:51.341787 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:51.341723    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1074617b-d56c-4638-8f7d-c9b5db5f6c68-istio-podinfo\") pod \"e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj\" (UID: \"1074617b-d56c-4638-8f7d-c9b5db5f6c68\") " pod="openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj"
Sep 16 01:38:51.341787 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:51.341776    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1074617b-d56c-4638-8f7d-c9b5db5f6c68-istio-data\") pod \"e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj\" (UID: \"1074617b-d56c-4638-8f7d-c9b5db5f6c68\") " pod="openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj"
Sep 16 01:38:51.341923 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:51.341796    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1074617b-d56c-4638-8f7d-c9b5db5f6c68-workload-certs\") pod \"e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj\" (UID: \"1074617b-d56c-4638-8f7d-c9b5db5f6c68\") " pod="openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj"
Sep 16 01:38:51.341923 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:51.341847    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1074617b-d56c-4638-8f7d-c9b5db5f6c68-workload-socket\") pod \"e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj\" (UID: \"1074617b-d56c-4638-8f7d-c9b5db5f6c68\") " pod="openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj"
Sep 16 01:38:51.341923 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:51.341876    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1074617b-d56c-4638-8f7d-c9b5db5f6c68-istiod-ca-cert\") pod \"e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj\" (UID: \"1074617b-d56c-4638-8f7d-c9b5db5f6c68\") " pod="openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj"
Sep 16 01:38:51.443134 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:51.443053    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1074617b-d56c-4638-8f7d-c9b5db5f6c68-workload-socket\") pod \"e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj\" (UID: \"1074617b-d56c-4638-8f7d-c9b5db5f6c68\") " pod="openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj"
Sep 16 01:38:51.443134 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:51.443105    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1074617b-d56c-4638-8f7d-c9b5db5f6c68-istiod-ca-cert\") pod \"e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj\" (UID: \"1074617b-d56c-4638-8f7d-c9b5db5f6c68\") " pod="openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj"
Sep 16 01:38:51.443376 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:51.443175    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1074617b-d56c-4638-8f7d-c9b5db5f6c68-istio-token\") pod \"e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj\" (UID: \"1074617b-d56c-4638-8f7d-c9b5db5f6c68\") " pod="openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj"
Sep 16 01:38:51.443376 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:51.443204    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1074617b-d56c-4638-8f7d-c9b5db5f6c68-credential-socket\") pod \"e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj\" (UID: \"1074617b-d56c-4638-8f7d-c9b5db5f6c68\") " pod="openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj"
Sep 16 01:38:51.443376 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:51.443228    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1074617b-d56c-4638-8f7d-c9b5db5f6c68-istio-envoy\") pod \"e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj\" (UID: \"1074617b-d56c-4638-8f7d-c9b5db5f6c68\") " pod="openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj"
Sep 16 01:38:51.443376 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:51.443269    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bt2kr\" (UniqueName: \"kubernetes.io/projected/1074617b-d56c-4638-8f7d-c9b5db5f6c68-kube-api-access-bt2kr\") pod \"e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj\" (UID: \"1074617b-d56c-4638-8f7d-c9b5db5f6c68\") " pod="openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj"
Sep 16 01:38:51.443376 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:51.443315    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1074617b-d56c-4638-8f7d-c9b5db5f6c68-istio-podinfo\") pod \"e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj\" (UID: \"1074617b-d56c-4638-8f7d-c9b5db5f6c68\") " pod="openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj"
Sep 16 01:38:51.443646 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:51.443385    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1074617b-d56c-4638-8f7d-c9b5db5f6c68-istio-data\") pod \"e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj\" (UID: \"1074617b-d56c-4638-8f7d-c9b5db5f6c68\") " pod="openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj"
Sep 16 01:38:51.443646 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:51.443412    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1074617b-d56c-4638-8f7d-c9b5db5f6c68-workload-certs\") pod \"e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj\" (UID: \"1074617b-d56c-4638-8f7d-c9b5db5f6c68\") " pod="openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj"
Sep 16 01:38:51.443646 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:51.443536    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1074617b-d56c-4638-8f7d-c9b5db5f6c68-workload-socket\") pod \"e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj\" (UID: \"1074617b-d56c-4638-8f7d-c9b5db5f6c68\") " pod="openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj"
Sep 16 01:38:51.443646 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:51.443632    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1074617b-d56c-4638-8f7d-c9b5db5f6c68-credential-socket\") pod \"e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj\" (UID: \"1074617b-d56c-4638-8f7d-c9b5db5f6c68\") " pod="openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj"
Sep 16 01:38:51.443839 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:51.443715    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1074617b-d56c-4638-8f7d-c9b5db5f6c68-workload-certs\") pod \"e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj\" (UID: \"1074617b-d56c-4638-8f7d-c9b5db5f6c68\") " pod="openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj"
Sep 16 01:38:51.443839 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:51.443784    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1074617b-d56c-4638-8f7d-c9b5db5f6c68-istio-data\") pod \"e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj\" (UID: \"1074617b-d56c-4638-8f7d-c9b5db5f6c68\") " pod="openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj"
Sep 16 01:38:51.444001 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:51.443980    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1074617b-d56c-4638-8f7d-c9b5db5f6c68-istiod-ca-cert\") pod \"e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj\" (UID: \"1074617b-d56c-4638-8f7d-c9b5db5f6c68\") " pod="openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj"
Sep 16 01:38:51.453928 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:51.453897    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1074617b-d56c-4638-8f7d-c9b5db5f6c68-istio-token\") pod \"e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj\" (UID: \"1074617b-d56c-4638-8f7d-c9b5db5f6c68\") " pod="openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj"
Sep 16 01:38:51.454155 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:51.453991    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bt2kr\" (UniqueName: \"kubernetes.io/projected/1074617b-d56c-4638-8f7d-c9b5db5f6c68-kube-api-access-bt2kr\") pod \"e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj\" (UID: \"1074617b-d56c-4638-8f7d-c9b5db5f6c68\") " pod="openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj"
Sep 16 01:38:51.463729 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:51.463662    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1074617b-d56c-4638-8f7d-c9b5db5f6c68-istio-envoy\") pod \"e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj\" (UID: \"1074617b-d56c-4638-8f7d-c9b5db5f6c68\") " pod="openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj"
Sep 16 01:38:51.465982 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:51.465943    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1074617b-d56c-4638-8f7d-c9b5db5f6c68-istio-podinfo\") pod \"e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj\" (UID: \"1074617b-d56c-4638-8f7d-c9b5db5f6c68\") " pod="openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj"
Sep 16 01:38:51.578473 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:51.578433    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj"
Sep 16 01:38:51.860440 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:51.860409    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj"]
Sep 16 01:38:51.865158 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:38:51.865118    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1074617b_d56c_4638_8f7d_c9b5db5f6c68.slice/crio-5a8ea3f14ca8704bbc56b5eedd4d7b52b3c5375684d202f0bfeda71e81f30095 WatchSource:0}: Error finding container 5a8ea3f14ca8704bbc56b5eedd4d7b52b3c5375684d202f0bfeda71e81f30095: Status 404 returned error can't find the container with id 5a8ea3f14ca8704bbc56b5eedd4d7b52b3c5375684d202f0bfeda71e81f30095
Sep 16 01:38:51.873199 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:51.873165    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:38:51.873294 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:51.873242    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:38:51.873294 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:51.873285    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:38:51.960360 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:51.959536    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj" event={"ID":"1074617b-d56c-4638-8f7d-c9b5db5f6c68","Type":"ContainerStarted","Data":"eb7adc38712b66dd2ac0e19df83bb197eaf67756d1e47af20c3a909b913294e3"}
Sep 16 01:38:51.960360 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:51.959622    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj" event={"ID":"1074617b-d56c-4638-8f7d-c9b5db5f6c68","Type":"ContainerStarted","Data":"5a8ea3f14ca8704bbc56b5eedd4d7b52b3c5375684d202f0bfeda71e81f30095"}
Sep 16 01:38:51.979684 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:51.979620    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj" podStartSLOduration=0.979603779 podStartE2EDuration="979.603779ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:38:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:38:51.977832591 +0000 UTC m=+1381.301301169" watchObservedRunningTime="2026-09-16 01:38:51.979603779 +0000 UTC m=+1381.303072356"
Sep 16 01:38:52.578790 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:52.578752    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj"
Sep 16 01:38:52.584650 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:52.584624    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj"
Sep 16 01:38:52.850421 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:52.847135    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb"]
Sep 16 01:38:52.856584 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:52.856543    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb" podUID="48e1a301-c2e1-4ae8-ab6d-36e149b88454" containerName="istio-proxy" containerID="cri-o://5e0496f4069e7b8ffe815aaacd517d38817583768413cc6a617e851bed4631e8" gracePeriod=30
Sep 16 01:38:52.970315 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:52.969397    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj"
Sep 16 01:38:52.971706 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:52.971673    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj"
Sep 16 01:38:56.249851 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:56.249813    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w1-0d2655-76cd8f4d9d-htct8"]
Sep 16 01:38:56.266555 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:56.266528    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w1-0d2655-76cd8f4d9d-htct8"]
Sep 16 01:38:56.266875 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:56.266860    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-0d2655-76cd8f4d9d-htct8"
Sep 16 01:38:56.270869 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:56.270836    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w1-0d2655-dockercfg-ltmnc\""
Sep 16 01:38:56.271224 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:56.270928    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w1-0d2655\""
Sep 16 01:38:56.284241 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:56.284216    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w1-0d2655-575888b5b9-7t6dn"]
Sep 16 01:38:56.288289 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:56.288267    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-0d2655-575888b5b9-7t6dn"
Sep 16 01:38:56.296202 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:56.296183    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w1-0d2655-575888b5b9-7t6dn"]
Sep 16 01:38:56.304209 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:56.304187    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzm4n\" (UniqueName: \"kubernetes.io/projected/365650a0-930f-4ea1-8e5d-a3588fa1891e-kube-api-access-zzm4n\") pod \"payload-processing-e2e-shared-b-w1-0d2655-575888b5b9-7t6dn\" (UID: \"365650a0-930f-4ea1-8e5d-a3588fa1891e\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w1-0d2655-575888b5b9-7t6dn"
Sep 16 01:38:56.304348 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:56.304239    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92ftq\" (UniqueName: \"kubernetes.io/projected/073574ba-86a1-466b-8a0a-2b6fb97b6c68-kube-api-access-92ftq\") pod \"payload-pre-processing-e2e-shared-b-w1-0d2655-76cd8f4d9d-htct8\" (UID: \"073574ba-86a1-466b-8a0a-2b6fb97b6c68\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-0d2655-76cd8f4d9d-htct8"
Sep 16 01:38:56.304348 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:56.304306    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/365650a0-930f-4ea1-8e5d-a3588fa1891e-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w1-0d2655-575888b5b9-7t6dn\" (UID: \"365650a0-930f-4ea1-8e5d-a3588fa1891e\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w1-0d2655-575888b5b9-7t6dn"
Sep 16 01:38:56.304488 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:56.304390    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/073574ba-86a1-466b-8a0a-2b6fb97b6c68-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w1-0d2655-76cd8f4d9d-htct8\" (UID: \"073574ba-86a1-466b-8a0a-2b6fb97b6c68\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-0d2655-76cd8f4d9d-htct8"
Sep 16 01:38:56.405206 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:56.405165    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/365650a0-930f-4ea1-8e5d-a3588fa1891e-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w1-0d2655-575888b5b9-7t6dn\" (UID: \"365650a0-930f-4ea1-8e5d-a3588fa1891e\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w1-0d2655-575888b5b9-7t6dn"
Sep 16 01:38:56.405415 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:56.405295    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/073574ba-86a1-466b-8a0a-2b6fb97b6c68-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w1-0d2655-76cd8f4d9d-htct8\" (UID: \"073574ba-86a1-466b-8a0a-2b6fb97b6c68\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-0d2655-76cd8f4d9d-htct8"
Sep 16 01:38:56.405415 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:56.405356    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzm4n\" (UniqueName: \"kubernetes.io/projected/365650a0-930f-4ea1-8e5d-a3588fa1891e-kube-api-access-zzm4n\") pod \"payload-processing-e2e-shared-b-w1-0d2655-575888b5b9-7t6dn\" (UID: \"365650a0-930f-4ea1-8e5d-a3588fa1891e\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w1-0d2655-575888b5b9-7t6dn"
Sep 16 01:38:56.405561 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:56.405420    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92ftq\" (UniqueName: \"kubernetes.io/projected/073574ba-86a1-466b-8a0a-2b6fb97b6c68-kube-api-access-92ftq\") pod \"payload-pre-processing-e2e-shared-b-w1-0d2655-76cd8f4d9d-htct8\" (UID: \"073574ba-86a1-466b-8a0a-2b6fb97b6c68\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-0d2655-76cd8f4d9d-htct8"
Sep 16 01:38:56.406148 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:56.406121    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/073574ba-86a1-466b-8a0a-2b6fb97b6c68-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w1-0d2655-76cd8f4d9d-htct8\" (UID: \"073574ba-86a1-466b-8a0a-2b6fb97b6c68\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-0d2655-76cd8f4d9d-htct8"
Sep 16 01:38:56.406279 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:56.406258    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/365650a0-930f-4ea1-8e5d-a3588fa1891e-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w1-0d2655-575888b5b9-7t6dn\" (UID: \"365650a0-930f-4ea1-8e5d-a3588fa1891e\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w1-0d2655-575888b5b9-7t6dn"
Sep 16 01:38:56.412675 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:56.412652    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92ftq\" (UniqueName: \"kubernetes.io/projected/073574ba-86a1-466b-8a0a-2b6fb97b6c68-kube-api-access-92ftq\") pod \"payload-pre-processing-e2e-shared-b-w1-0d2655-76cd8f4d9d-htct8\" (UID: \"073574ba-86a1-466b-8a0a-2b6fb97b6c68\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-0d2655-76cd8f4d9d-htct8"
Sep 16 01:38:56.412778 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:56.412739    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzm4n\" (UniqueName: \"kubernetes.io/projected/365650a0-930f-4ea1-8e5d-a3588fa1891e-kube-api-access-zzm4n\") pod \"payload-processing-e2e-shared-b-w1-0d2655-575888b5b9-7t6dn\" (UID: \"365650a0-930f-4ea1-8e5d-a3588fa1891e\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w1-0d2655-575888b5b9-7t6dn"
Sep 16 01:38:56.582204 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:56.582113    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-0d2655-76cd8f4d9d-htct8"
Sep 16 01:38:56.598523 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:56.598494    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-0d2655-575888b5b9-7t6dn"
Sep 16 01:38:56.855736 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:56.855644    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w1-0d2655-76cd8f4d9d-htct8"]
Sep 16 01:38:56.858309 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:38:56.858284    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod073574ba_86a1_466b_8a0a_2b6fb97b6c68.slice/crio-258fc251f0516903a9c6b1a7275814c60ed018c90cee956cb153b00bb995c556 WatchSource:0}: Error finding container 258fc251f0516903a9c6b1a7275814c60ed018c90cee956cb153b00bb995c556: Status 404 returned error can't find the container with id 258fc251f0516903a9c6b1a7275814c60ed018c90cee956cb153b00bb995c556
Sep 16 01:38:56.892212 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:56.892190    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w1-0d2655-575888b5b9-7t6dn"]
Sep 16 01:38:56.894567 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:38:56.894537    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod365650a0_930f_4ea1_8e5d_a3588fa1891e.slice/crio-4e638f21ece9efe9884d24b0a4aeb66eb7223911aae822f01f795210da0378ed WatchSource:0}: Error finding container 4e638f21ece9efe9884d24b0a4aeb66eb7223911aae822f01f795210da0378ed: Status 404 returned error can't find the container with id 4e638f21ece9efe9884d24b0a4aeb66eb7223911aae822f01f795210da0378ed
Sep 16 01:38:56.992768 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:56.992708    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-0d2655-76cd8f4d9d-htct8" event={"ID":"073574ba-86a1-466b-8a0a-2b6fb97b6c68","Type":"ContainerStarted","Data":"d5b3f296174b057f8ec80c71c39631f3fe556ea1ab1426552e109e15bd12103d"}
Sep 16 01:38:56.992974 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:56.992775    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-0d2655-76cd8f4d9d-htct8" event={"ID":"073574ba-86a1-466b-8a0a-2b6fb97b6c68","Type":"ContainerStarted","Data":"258fc251f0516903a9c6b1a7275814c60ed018c90cee956cb153b00bb995c556"}
Sep 16 01:38:56.992974 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:56.992808    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-0d2655-76cd8f4d9d-htct8"
Sep 16 01:38:56.994478 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:56.994423    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-0d2655-575888b5b9-7t6dn" event={"ID":"365650a0-930f-4ea1-8e5d-a3588fa1891e","Type":"ContainerStarted","Data":"fff4651193f1eaa577ff983a3608592cb465494b47f48c51905e884570e26599"}
Sep 16 01:38:56.994606 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:56.994513    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-0d2655-575888b5b9-7t6dn"
Sep 16 01:38:56.994606 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:56.994546    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-0d2655-575888b5b9-7t6dn" event={"ID":"365650a0-930f-4ea1-8e5d-a3588fa1891e","Type":"ContainerStarted","Data":"4e638f21ece9efe9884d24b0a4aeb66eb7223911aae822f01f795210da0378ed"}
Sep 16 01:38:57.008702 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:57.008639    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-0d2655-76cd8f4d9d-htct8" podStartSLOduration=1.0086226 podStartE2EDuration="1.0086226s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:38:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:38:57.00673772 +0000 UTC m=+1386.330206300" watchObservedRunningTime="2026-09-16 01:38:57.0086226 +0000 UTC m=+1386.332091176"
Sep 16 01:38:57.021931 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:57.021878    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-0d2655-575888b5b9-7t6dn" podStartSLOduration=1.021864302 podStartE2EDuration="1.021864302s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:38:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:38:57.020253249 +0000 UTC m=+1386.343721827" watchObservedRunningTime="2026-09-16 01:38:57.021864302 +0000 UTC m=+1386.345332880"
Sep 16 01:38:58.002263 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:58.002232    2565 generic.go:356] "Generic (PLEG): container finished" podID="48e1a301-c2e1-4ae8-ab6d-36e149b88454" containerID="5e0496f4069e7b8ffe815aaacd517d38817583768413cc6a617e851bed4631e8" exitCode=0
Sep 16 01:38:58.002727 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:58.002307    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb" event={"ID":"48e1a301-c2e1-4ae8-ab6d-36e149b88454","Type":"ContainerDied","Data":"5e0496f4069e7b8ffe815aaacd517d38817583768413cc6a617e851bed4631e8"}
Sep 16 01:38:58.002727 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:58.002393    2565 scope.go:117] "RemoveContainer" containerID="852d3afc8c224f16a4179e3ebd6ee6869b2552e6240ef86a6469c2eb4c476a75"
Sep 16 01:38:58.152295 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:58.152269    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb"
Sep 16 01:38:58.232238 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:58.232205    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48e1a301-c2e1-4ae8-ab6d-36e149b88454-credential-socket\") pod \"48e1a301-c2e1-4ae8-ab6d-36e149b88454\" (UID: \"48e1a301-c2e1-4ae8-ab6d-36e149b88454\") "
Sep 16 01:38:58.232404 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:58.232255    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48e1a301-c2e1-4ae8-ab6d-36e149b88454-istiod-ca-cert\") pod \"48e1a301-c2e1-4ae8-ab6d-36e149b88454\" (UID: \"48e1a301-c2e1-4ae8-ab6d-36e149b88454\") "
Sep 16 01:38:58.232404 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:58.232307    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48e1a301-c2e1-4ae8-ab6d-36e149b88454-istio-podinfo\") pod \"48e1a301-c2e1-4ae8-ab6d-36e149b88454\" (UID: \"48e1a301-c2e1-4ae8-ab6d-36e149b88454\") "
Sep 16 01:38:58.232404 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:58.232346    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48e1a301-c2e1-4ae8-ab6d-36e149b88454-istio-token\") pod \"48e1a301-c2e1-4ae8-ab6d-36e149b88454\" (UID: \"48e1a301-c2e1-4ae8-ab6d-36e149b88454\") "
Sep 16 01:38:58.232404 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:58.232374    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48e1a301-c2e1-4ae8-ab6d-36e149b88454-workload-certs\") pod \"48e1a301-c2e1-4ae8-ab6d-36e149b88454\" (UID: \"48e1a301-c2e1-4ae8-ab6d-36e149b88454\") "
Sep 16 01:38:58.232649 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:58.232413    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48e1a301-c2e1-4ae8-ab6d-36e149b88454-istio-envoy\") pod \"48e1a301-c2e1-4ae8-ab6d-36e149b88454\" (UID: \"48e1a301-c2e1-4ae8-ab6d-36e149b88454\") "
Sep 16 01:38:58.232649 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:58.232484    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gr9j\" (UniqueName: \"kubernetes.io/projected/48e1a301-c2e1-4ae8-ab6d-36e149b88454-kube-api-access-2gr9j\") pod \"48e1a301-c2e1-4ae8-ab6d-36e149b88454\" (UID: \"48e1a301-c2e1-4ae8-ab6d-36e149b88454\") "
Sep 16 01:38:58.232649 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:58.232520    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48e1a301-c2e1-4ae8-ab6d-36e149b88454-istio-data\") pod \"48e1a301-c2e1-4ae8-ab6d-36e149b88454\" (UID: \"48e1a301-c2e1-4ae8-ab6d-36e149b88454\") "
Sep 16 01:38:58.232649 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:58.232528    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48e1a301-c2e1-4ae8-ab6d-36e149b88454-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "48e1a301-c2e1-4ae8-ab6d-36e149b88454" (UID: "48e1a301-c2e1-4ae8-ab6d-36e149b88454"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:38:58.232649 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:58.232545    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48e1a301-c2e1-4ae8-ab6d-36e149b88454-workload-socket\") pod \"48e1a301-c2e1-4ae8-ab6d-36e149b88454\" (UID: \"48e1a301-c2e1-4ae8-ab6d-36e149b88454\") "
Sep 16 01:38:58.232916 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:58.232720    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48e1a301-c2e1-4ae8-ab6d-36e149b88454-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "48e1a301-c2e1-4ae8-ab6d-36e149b88454" (UID: "48e1a301-c2e1-4ae8-ab6d-36e149b88454"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:38:58.232916 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:58.232724    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48e1a301-c2e1-4ae8-ab6d-36e149b88454-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "48e1a301-c2e1-4ae8-ab6d-36e149b88454" (UID: "48e1a301-c2e1-4ae8-ab6d-36e149b88454"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:38:58.232916 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:58.232740    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48e1a301-c2e1-4ae8-ab6d-36e149b88454-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "48e1a301-c2e1-4ae8-ab6d-36e149b88454" (UID: "48e1a301-c2e1-4ae8-ab6d-36e149b88454"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:38:58.233096 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:58.232976    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48e1a301-c2e1-4ae8-ab6d-36e149b88454-istio-data" (OuterVolumeSpecName: "istio-data") pod "48e1a301-c2e1-4ae8-ab6d-36e149b88454" (UID: "48e1a301-c2e1-4ae8-ab6d-36e149b88454"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:38:58.233096 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:58.233058    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48e1a301-c2e1-4ae8-ab6d-36e149b88454-istiod-ca-cert\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:38:58.233096 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:58.233080    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48e1a301-c2e1-4ae8-ab6d-36e149b88454-workload-certs\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:38:58.233096 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:58.233095    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48e1a301-c2e1-4ae8-ab6d-36e149b88454-workload-socket\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:38:58.233250 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:58.233108    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48e1a301-c2e1-4ae8-ab6d-36e149b88454-credential-socket\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:38:58.234608 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:58.234576    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48e1a301-c2e1-4ae8-ab6d-36e149b88454-istio-token" (OuterVolumeSpecName: "istio-token") pod "48e1a301-c2e1-4ae8-ab6d-36e149b88454" (UID: "48e1a301-c2e1-4ae8-ab6d-36e149b88454"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:38:58.235230 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:58.235210    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/48e1a301-c2e1-4ae8-ab6d-36e149b88454-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "48e1a301-c2e1-4ae8-ab6d-36e149b88454" (UID: "48e1a301-c2e1-4ae8-ab6d-36e149b88454"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 01:38:58.235230 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:58.235220    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48e1a301-c2e1-4ae8-ab6d-36e149b88454-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "48e1a301-c2e1-4ae8-ab6d-36e149b88454" (UID: "48e1a301-c2e1-4ae8-ab6d-36e149b88454"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:38:58.235429 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:58.235215    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48e1a301-c2e1-4ae8-ab6d-36e149b88454-kube-api-access-2gr9j" (OuterVolumeSpecName: "kube-api-access-2gr9j") pod "48e1a301-c2e1-4ae8-ab6d-36e149b88454" (UID: "48e1a301-c2e1-4ae8-ab6d-36e149b88454"). InnerVolumeSpecName "kube-api-access-2gr9j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:38:58.333796 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:58.333769    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48e1a301-c2e1-4ae8-ab6d-36e149b88454-istio-data\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:38:58.333796 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:58.333791    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48e1a301-c2e1-4ae8-ab6d-36e149b88454-istio-podinfo\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:38:58.333920 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:58.333801    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48e1a301-c2e1-4ae8-ab6d-36e149b88454-istio-token\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:38:58.333920 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:58.333809    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48e1a301-c2e1-4ae8-ab6d-36e149b88454-istio-envoy\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:38:58.333920 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:58.333817    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gr9j\" (UniqueName: \"kubernetes.io/projected/48e1a301-c2e1-4ae8-ab6d-36e149b88454-kube-api-access-2gr9j\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:38:59.010491 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:59.010460    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb"
Sep 16 01:38:59.010887 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:59.010461    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb" event={"ID":"48e1a301-c2e1-4ae8-ab6d-36e149b88454","Type":"ContainerDied","Data":"1fbc538e2d229fd1452b6a4702e6e9f59ab5928d8b6fc84907c3a65e4fd17efe"}
Sep 16 01:38:59.010887 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:59.010605    2565 scope.go:117] "RemoveContainer" containerID="5e0496f4069e7b8ffe815aaacd517d38817583768413cc6a617e851bed4631e8"
Sep 16 01:38:59.034154 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:59.034128    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb"]
Sep 16 01:38:59.038615 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:59.038589    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb"]
Sep 16 01:38:59.169802 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:38:59.169772    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48e1a301-c2e1-4ae8-ab6d-36e149b88454" path="/var/lib/kubelet/pods/48e1a301-c2e1-4ae8-ab6d-36e149b88454/volumes"
Sep 16 01:39:00.019070 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:00.019039    2565 generic.go:356] "Generic (PLEG): container finished" podID="59023c4f-45b1-480e-a110-50c6fe86586a" containerID="fc49086c4becc28eac0ef825429214d9b3f1582bda25ae1be779b281aa71f663" exitCode=0
Sep 16 01:39:00.019495 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:00.019119    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb" event={"ID":"59023c4f-45b1-480e-a110-50c6fe86586a","Type":"ContainerDied","Data":"fc49086c4becc28eac0ef825429214d9b3f1582bda25ae1be779b281aa71f663"}
Sep 16 01:39:00.019544 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:00.019517    2565 scope.go:117] "RemoveContainer" containerID="fc49086c4becc28eac0ef825429214d9b3f1582bda25ae1be779b281aa71f663"
Sep 16 01:39:00.020565 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:00.020537    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:39:00.020628 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:00.020607    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:39:00.020664 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:00.020637    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:39:01.027469 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:01.027429    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb" event={"ID":"59023c4f-45b1-480e-a110-50c6fe86586a","Type":"ContainerStarted","Data":"fe7627e57f95022e696a4c6331932f85b83101e0b86a56e0990b0165f8e3a4d7"}
Sep 16 01:39:01.582753 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:01.582718    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb"
Sep 16 01:39:01.583978 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:01.583948    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Sep 16 01:39:01.584115 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:01.584000    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb" podUID="59023c4f-45b1-480e-a110-50c6fe86586a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Sep 16 01:39:02.583088 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:02.583053    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Sep 16 01:39:02.583493 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:02.583109    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb" podUID="59023c4f-45b1-480e-a110-50c6fe86586a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Sep 16 01:39:03.583262 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:03.583224    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Sep 16 01:39:03.583653 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:03.583307    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb" podUID="59023c4f-45b1-480e-a110-50c6fe86586a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Sep 16 01:39:04.583641 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:04.583600    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Sep 16 01:39:04.584251 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:04.584219    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb" podUID="59023c4f-45b1-480e-a110-50c6fe86586a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Sep 16 01:39:04.850520 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:04.850422    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb"
Sep 16 01:39:05.583660 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:05.583621    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Sep 16 01:39:05.584243 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:05.584214    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb" podUID="59023c4f-45b1-480e-a110-50c6fe86586a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Sep 16 01:39:06.586763 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:06.586731    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb"
Sep 16 01:39:06.587663 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:06.587638    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb"
Sep 16 01:39:07.164277 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:07.164246    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-processing-5d7dbbd56b-4455c" secret="" err="secret \"payload-processing-dockercfg-kkbcm\" not found"
Sep 16 01:39:08.004969 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:08.004930    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-0d2655-575888b5b9-7t6dn"
Sep 16 01:39:08.005372 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:08.005010    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-0d2655-76cd8f4d9d-htct8"
Sep 16 01:39:13.109381 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:13.109316    2565 generic.go:356] "Generic (PLEG): container finished" podID="1074617b-d56c-4638-8f7d-c9b5db5f6c68" containerID="eb7adc38712b66dd2ac0e19df83bb197eaf67756d1e47af20c3a909b913294e3" exitCode=0
Sep 16 01:39:13.109859 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:13.109401    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj" event={"ID":"1074617b-d56c-4638-8f7d-c9b5db5f6c68","Type":"ContainerDied","Data":"eb7adc38712b66dd2ac0e19df83bb197eaf67756d1e47af20c3a909b913294e3"}
Sep 16 01:39:13.109859 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:13.109837    2565 scope.go:117] "RemoveContainer" containerID="eb7adc38712b66dd2ac0e19df83bb197eaf67756d1e47af20c3a909b913294e3"
Sep 16 01:39:13.110922 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:13.110895    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:39:13.110980 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:13.110966    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:39:13.111013 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:13.111000    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:39:14.116943 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:14.116903    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj" event={"ID":"1074617b-d56c-4638-8f7d-c9b5db5f6c68","Type":"ContainerStarted","Data":"f6957c5bde994dc8aa960193c553d8a8cf1eff3ca6917882dd3e3b247b02e9b7"}
Sep 16 01:39:14.579424 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:14.579382    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj"
Sep 16 01:39:14.579608 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:14.579571    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Sep 16 01:39:14.579659 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:14.579636    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj" podUID="1074617b-d56c-4638-8f7d-c9b5db5f6c68" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Sep 16 01:39:15.578962 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:15.578918    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Sep 16 01:39:15.579378 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:15.578985    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj" podUID="1074617b-d56c-4638-8f7d-c9b5db5f6c68" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Sep 16 01:39:16.579568 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:16.579521    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Sep 16 01:39:16.579994 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:16.579604    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj" podUID="1074617b-d56c-4638-8f7d-c9b5db5f6c68" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Sep 16 01:39:17.578939 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:17.578901    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Sep 16 01:39:17.579129 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:17.578971    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj" podUID="1074617b-d56c-4638-8f7d-c9b5db5f6c68" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Sep 16 01:39:18.579228 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:18.579185    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Sep 16 01:39:18.579660 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:18.579248    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj" podUID="1074617b-d56c-4638-8f7d-c9b5db5f6c68" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Sep 16 01:39:19.584237 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:19.584197    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj"
Sep 16 01:39:19.584635 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:19.584549    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj"
Sep 16 01:39:19.585313 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:19.585291    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj"
Sep 16 01:39:29.970087 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:29.970048    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8"]
Sep 16 01:39:29.970578 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:29.970563    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48e1a301-c2e1-4ae8-ab6d-36e149b88454" containerName="istio-proxy"
Sep 16 01:39:29.970628 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:29.970581    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="48e1a301-c2e1-4ae8-ab6d-36e149b88454" containerName="istio-proxy"
Sep 16 01:39:29.970628 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:29.970594    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48e1a301-c2e1-4ae8-ab6d-36e149b88454" containerName="istio-proxy"
Sep 16 01:39:29.970628 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:29.970599    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="48e1a301-c2e1-4ae8-ab6d-36e149b88454" containerName="istio-proxy"
Sep 16 01:39:29.970742 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:29.970673    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="48e1a301-c2e1-4ae8-ab6d-36e149b88454" containerName="istio-proxy"
Sep 16 01:39:29.970742 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:29.970681    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="48e1a301-c2e1-4ae8-ab6d-36e149b88454" containerName="istio-proxy"
Sep 16 01:39:29.973938 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:29.973920    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8"
Sep 16 01:39:29.976295 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:29.976272    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-3b6e6489-openshift-default-dockercfg-2bqhj\""
Sep 16 01:39:29.985226 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:29.985199    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8"]
Sep 16 01:39:30.130529 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:30.130483    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98958b53-2d08-49a9-a08f-1528d99996f9-istio-podinfo\") pod \"e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8\" (UID: \"98958b53-2d08-49a9-a08f-1528d99996f9\") " pod="openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8"
Sep 16 01:39:30.130726 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:30.130550    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98958b53-2d08-49a9-a08f-1528d99996f9-istio-envoy\") pod \"e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8\" (UID: \"98958b53-2d08-49a9-a08f-1528d99996f9\") " pod="openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8"
Sep 16 01:39:30.130726 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:30.130575    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98958b53-2d08-49a9-a08f-1528d99996f9-istiod-ca-cert\") pod \"e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8\" (UID: \"98958b53-2d08-49a9-a08f-1528d99996f9\") " pod="openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8"
Sep 16 01:39:30.130726 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:30.130605    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98958b53-2d08-49a9-a08f-1528d99996f9-credential-socket\") pod \"e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8\" (UID: \"98958b53-2d08-49a9-a08f-1528d99996f9\") " pod="openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8"
Sep 16 01:39:30.130726 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:30.130702    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98958b53-2d08-49a9-a08f-1528d99996f9-istio-token\") pod \"e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8\" (UID: \"98958b53-2d08-49a9-a08f-1528d99996f9\") " pod="openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8"
Sep 16 01:39:30.130895 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:30.130737    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98958b53-2d08-49a9-a08f-1528d99996f9-workload-certs\") pod \"e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8\" (UID: \"98958b53-2d08-49a9-a08f-1528d99996f9\") " pod="openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8"
Sep 16 01:39:30.130895 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:30.130759    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98958b53-2d08-49a9-a08f-1528d99996f9-istio-data\") pod \"e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8\" (UID: \"98958b53-2d08-49a9-a08f-1528d99996f9\") " pod="openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8"
Sep 16 01:39:30.130895 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:30.130787    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49gt6\" (UniqueName: \"kubernetes.io/projected/98958b53-2d08-49a9-a08f-1528d99996f9-kube-api-access-49gt6\") pod \"e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8\" (UID: \"98958b53-2d08-49a9-a08f-1528d99996f9\") " pod="openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8"
Sep 16 01:39:30.130895 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:30.130831    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98958b53-2d08-49a9-a08f-1528d99996f9-workload-socket\") pod \"e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8\" (UID: \"98958b53-2d08-49a9-a08f-1528d99996f9\") " pod="openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8"
Sep 16 01:39:30.232168 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:30.232072    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98958b53-2d08-49a9-a08f-1528d99996f9-workload-certs\") pod \"e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8\" (UID: \"98958b53-2d08-49a9-a08f-1528d99996f9\") " pod="openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8"
Sep 16 01:39:30.232168 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:30.232113    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98958b53-2d08-49a9-a08f-1528d99996f9-istio-data\") pod \"e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8\" (UID: \"98958b53-2d08-49a9-a08f-1528d99996f9\") " pod="openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8"
Sep 16 01:39:30.232168 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:30.232134    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49gt6\" (UniqueName: \"kubernetes.io/projected/98958b53-2d08-49a9-a08f-1528d99996f9-kube-api-access-49gt6\") pod \"e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8\" (UID: \"98958b53-2d08-49a9-a08f-1528d99996f9\") " pod="openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8"
Sep 16 01:39:30.232486 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:30.232174    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98958b53-2d08-49a9-a08f-1528d99996f9-workload-socket\") pod \"e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8\" (UID: \"98958b53-2d08-49a9-a08f-1528d99996f9\") " pod="openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8"
Sep 16 01:39:30.232486 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:30.232196    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98958b53-2d08-49a9-a08f-1528d99996f9-istio-podinfo\") pod \"e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8\" (UID: \"98958b53-2d08-49a9-a08f-1528d99996f9\") " pod="openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8"
Sep 16 01:39:30.232486 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:30.232265    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98958b53-2d08-49a9-a08f-1528d99996f9-istio-envoy\") pod \"e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8\" (UID: \"98958b53-2d08-49a9-a08f-1528d99996f9\") " pod="openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8"
Sep 16 01:39:30.232486 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:30.232320    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98958b53-2d08-49a9-a08f-1528d99996f9-istiod-ca-cert\") pod \"e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8\" (UID: \"98958b53-2d08-49a9-a08f-1528d99996f9\") " pod="openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8"
Sep 16 01:39:30.232720 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:30.232523    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98958b53-2d08-49a9-a08f-1528d99996f9-workload-certs\") pod \"e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8\" (UID: \"98958b53-2d08-49a9-a08f-1528d99996f9\") " pod="openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8"
Sep 16 01:39:30.232720 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:30.232559    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98958b53-2d08-49a9-a08f-1528d99996f9-credential-socket\") pod \"e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8\" (UID: \"98958b53-2d08-49a9-a08f-1528d99996f9\") " pod="openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8"
Sep 16 01:39:30.232720 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:30.232598    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98958b53-2d08-49a9-a08f-1528d99996f9-istio-data\") pod \"e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8\" (UID: \"98958b53-2d08-49a9-a08f-1528d99996f9\") " pod="openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8"
Sep 16 01:39:30.232720 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:30.232612    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98958b53-2d08-49a9-a08f-1528d99996f9-workload-socket\") pod \"e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8\" (UID: \"98958b53-2d08-49a9-a08f-1528d99996f9\") " pod="openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8"
Sep 16 01:39:30.232720 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:30.232673    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98958b53-2d08-49a9-a08f-1528d99996f9-istio-token\") pod \"e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8\" (UID: \"98958b53-2d08-49a9-a08f-1528d99996f9\") " pod="openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8"
Sep 16 01:39:30.233016 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:30.232908    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98958b53-2d08-49a9-a08f-1528d99996f9-credential-socket\") pod \"e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8\" (UID: \"98958b53-2d08-49a9-a08f-1528d99996f9\") " pod="openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8"
Sep 16 01:39:30.233218 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:30.233198    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98958b53-2d08-49a9-a08f-1528d99996f9-istiod-ca-cert\") pod \"e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8\" (UID: \"98958b53-2d08-49a9-a08f-1528d99996f9\") " pod="openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8"
Sep 16 01:39:30.234524 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:30.234503    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98958b53-2d08-49a9-a08f-1528d99996f9-istio-envoy\") pod \"e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8\" (UID: \"98958b53-2d08-49a9-a08f-1528d99996f9\") " pod="openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8"
Sep 16 01:39:30.234754 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:30.234734    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98958b53-2d08-49a9-a08f-1528d99996f9-istio-podinfo\") pod \"e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8\" (UID: \"98958b53-2d08-49a9-a08f-1528d99996f9\") " pod="openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8"
Sep 16 01:39:30.239818 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:30.239796    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98958b53-2d08-49a9-a08f-1528d99996f9-istio-token\") pod \"e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8\" (UID: \"98958b53-2d08-49a9-a08f-1528d99996f9\") " pod="openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8"
Sep 16 01:39:30.239945 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:30.239930    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49gt6\" (UniqueName: \"kubernetes.io/projected/98958b53-2d08-49a9-a08f-1528d99996f9-kube-api-access-49gt6\") pod \"e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8\" (UID: \"98958b53-2d08-49a9-a08f-1528d99996f9\") " pod="openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8"
Sep 16 01:39:30.286261 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:30.286209    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8"
Sep 16 01:39:30.564871 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:30.564845    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8"]
Sep 16 01:39:30.566463 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:39:30.566441    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98958b53_2d08_49a9_a08f_1528d99996f9.slice/crio-8e82c54dc2ec727936127a6a022913fa8a0269b3550e2509cd8b7b4176fc2b48 WatchSource:0}: Error finding container 8e82c54dc2ec727936127a6a022913fa8a0269b3550e2509cd8b7b4176fc2b48: Status 404 returned error can't find the container with id 8e82c54dc2ec727936127a6a022913fa8a0269b3550e2509cd8b7b4176fc2b48
Sep 16 01:39:30.568939 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:30.568904    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:39:30.569027 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:30.568978    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:39:30.569027 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:30.569006    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:39:31.204891 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:31.204853    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8" event={"ID":"98958b53-2d08-49a9-a08f-1528d99996f9","Type":"ContainerStarted","Data":"236d0d9e39571b32e817be7d9489184f8d54394ccb2b6a3c88e0ff54c78975be"}
Sep 16 01:39:31.205366 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:31.204909    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8" event={"ID":"98958b53-2d08-49a9-a08f-1528d99996f9","Type":"ContainerStarted","Data":"8e82c54dc2ec727936127a6a022913fa8a0269b3550e2509cd8b7b4176fc2b48"}
Sep 16 01:39:31.224199 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:31.224149    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8" podStartSLOduration=2.224132148 podStartE2EDuration="2.224132148s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:39:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:39:31.221949058 +0000 UTC m=+1420.545417648" watchObservedRunningTime="2026-09-16 01:39:31.224132148 +0000 UTC m=+1420.547600724"
Sep 16 01:39:31.287206 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:31.287163    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8"
Sep 16 01:39:31.293057 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:31.293029    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8"
Sep 16 01:39:32.210442 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:32.210400    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8"
Sep 16 01:39:32.211262 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:32.211241    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8"
Sep 16 01:39:39.164126 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:39.164093    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-6cd864bc95-st4pq" secret="" err="secret \"payload-processing-dockercfg-kkbcm\" not found"
Sep 16 01:39:55.333239 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:55.333195    2565 generic.go:356] "Generic (PLEG): container finished" podID="98958b53-2d08-49a9-a08f-1528d99996f9" containerID="236d0d9e39571b32e817be7d9489184f8d54394ccb2b6a3c88e0ff54c78975be" exitCode=0
Sep 16 01:39:55.333685 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:55.333264    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8" event={"ID":"98958b53-2d08-49a9-a08f-1528d99996f9","Type":"ContainerDied","Data":"236d0d9e39571b32e817be7d9489184f8d54394ccb2b6a3c88e0ff54c78975be"}
Sep 16 01:39:55.333685 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:55.333668    2565 scope.go:117] "RemoveContainer" containerID="236d0d9e39571b32e817be7d9489184f8d54394ccb2b6a3c88e0ff54c78975be"
Sep 16 01:39:55.334744 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:55.334715    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:39:55.334815 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:55.334782    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:39:55.334856 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:55.334815    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:39:56.352556 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:56.350986    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8" event={"ID":"98958b53-2d08-49a9-a08f-1528d99996f9","Type":"ContainerStarted","Data":"01313b52dd62ea314cd3ef95055dd9913e54f24f63d5c7aca9f52c40c69f81bd"}
Sep 16 01:39:57.287651 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:57.287610    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8"
Sep 16 01:39:57.287836 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:57.287797    2565 patch_prober.go:28] interesting pod/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Sep 16 01:39:57.287881 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:57.287846    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8" podUID="98958b53-2d08-49a9-a08f-1528d99996f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Sep 16 01:39:58.287363 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:58.287308    2565 patch_prober.go:28] interesting pod/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Sep 16 01:39:58.287749 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:58.287394    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8" podUID="98958b53-2d08-49a9-a08f-1528d99996f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Sep 16 01:39:59.287935 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:59.287894    2565 patch_prober.go:28] interesting pod/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Sep 16 01:39:59.288384 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:39:59.287994    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8" podUID="98958b53-2d08-49a9-a08f-1528d99996f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Sep 16 01:40:00.287300 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:00.287258    2565 patch_prober.go:28] interesting pod/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Sep 16 01:40:00.287509 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:00.287319    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8" podUID="98958b53-2d08-49a9-a08f-1528d99996f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Sep 16 01:40:01.287116 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:01.287076    2565 patch_prober.go:28] interesting pod/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Sep 16 01:40:01.287564 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:01.287150    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8" podUID="98958b53-2d08-49a9-a08f-1528d99996f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Sep 16 01:40:02.210734 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:02.210697    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8"
Sep 16 01:40:02.292159 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:02.292118    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8"
Sep 16 01:40:02.392526 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:02.392496    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8"
Sep 16 01:40:21.172807 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:21.168565    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-processing-5d7dbbd56b-4455c" secret="" err="secret \"payload-processing-dockercfg-kkbcm\" not found"
Sep 16 01:40:23.631259 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:23.631222    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-9138-96cff6"]
Sep 16 01:40:23.634616 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:23.634597    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9138-96cff6"
Sep 16 01:40:23.636907 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:23.636873    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-6n2fb\""
Sep 16 01:40:23.638458 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:23.638430    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-9138-96cff6"]
Sep 16 01:40:23.663111 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:23.663084    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbnxt\" (UniqueName: \"kubernetes.io/projected/4be4ec07-e67d-45ba-95ae-85977a30b9f4-kube-api-access-tbnxt\") pod \"test-curl-9138-96cff6\" (UID: \"4be4ec07-e67d-45ba-95ae-85977a30b9f4\") " pod="opendatahub/test-curl-9138-96cff6"
Sep 16 01:40:23.763826 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:23.763786    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbnxt\" (UniqueName: \"kubernetes.io/projected/4be4ec07-e67d-45ba-95ae-85977a30b9f4-kube-api-access-tbnxt\") pod \"test-curl-9138-96cff6\" (UID: \"4be4ec07-e67d-45ba-95ae-85977a30b9f4\") " pod="opendatahub/test-curl-9138-96cff6"
Sep 16 01:40:23.771500 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:23.771477    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbnxt\" (UniqueName: \"kubernetes.io/projected/4be4ec07-e67d-45ba-95ae-85977a30b9f4-kube-api-access-tbnxt\") pod \"test-curl-9138-96cff6\" (UID: \"4be4ec07-e67d-45ba-95ae-85977a30b9f4\") " pod="opendatahub/test-curl-9138-96cff6"
Sep 16 01:40:23.946176 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:23.946129    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9138-96cff6"
Sep 16 01:40:24.219066 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:24.218960    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-9138-96cff6"]
Sep 16 01:40:24.221971 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:40:24.221929    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4be4ec07_e67d_45ba_95ae_85977a30b9f4.slice/crio-f7ffc8536e1983715dae4290ad0547a01284749d729402c4ef999f07f0680d7f WatchSource:0}: Error finding container f7ffc8536e1983715dae4290ad0547a01284749d729402c4ef999f07f0680d7f: Status 404 returned error can't find the container with id f7ffc8536e1983715dae4290ad0547a01284749d729402c4ef999f07f0680d7f
Sep 16 01:40:24.510442 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:24.510332    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-9138-96cff6" event={"ID":"4be4ec07-e67d-45ba-95ae-85977a30b9f4","Type":"ContainerStarted","Data":"3ed7a800ce4f03a8064bbefc8d354e1317989686be6d6f0a929c0681389b34d0"}
Sep 16 01:40:24.510442 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:24.510398    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-9138-96cff6" event={"ID":"4be4ec07-e67d-45ba-95ae-85977a30b9f4","Type":"ContainerStarted","Data":"f7ffc8536e1983715dae4290ad0547a01284749d729402c4ef999f07f0680d7f"}
Sep 16 01:40:24.524646 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:24.524591    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-9138-96cff6" podStartSLOduration=1.524572155 podStartE2EDuration="1.524572155s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:40:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:40:24.523027367 +0000 UTC m=+1473.846495948" watchObservedRunningTime="2026-09-16 01:40:24.524572155 +0000 UTC m=+1473.848040731"
Sep 16 01:40:25.157105 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:25.157061    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-9138-96cff6"]
Sep 16 01:40:25.160736 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:25.160704    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-9138-96cff6"]
Sep 16 01:40:25.515497 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:40:25.515463    2565 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-9138-96cff6" container="test-curl-9138-96cff6"
Sep 16 01:40:26.524149 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:26.524071    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-9138-96cff6" podUID="4be4ec07-e67d-45ba-95ae-85977a30b9f4" containerName="test-curl-9138-96cff6" containerID="cri-o://3ed7a800ce4f03a8064bbefc8d354e1317989686be6d6f0a929c0681389b34d0" gracePeriod=2
Sep 16 01:40:28.700698 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:28.700672    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9138-96cff6"
Sep 16 01:40:28.810246 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:28.810152    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbnxt\" (UniqueName: \"kubernetes.io/projected/4be4ec07-e67d-45ba-95ae-85977a30b9f4-kube-api-access-tbnxt\") pod \"4be4ec07-e67d-45ba-95ae-85977a30b9f4\" (UID: \"4be4ec07-e67d-45ba-95ae-85977a30b9f4\") "
Sep 16 01:40:28.812229 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:28.812202    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4be4ec07-e67d-45ba-95ae-85977a30b9f4-kube-api-access-tbnxt" (OuterVolumeSpecName: "kube-api-access-tbnxt") pod "4be4ec07-e67d-45ba-95ae-85977a30b9f4" (UID: "4be4ec07-e67d-45ba-95ae-85977a30b9f4"). InnerVolumeSpecName "kube-api-access-tbnxt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:40:28.911563 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:28.911523    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbnxt\" (UniqueName: \"kubernetes.io/projected/4be4ec07-e67d-45ba-95ae-85977a30b9f4-kube-api-access-tbnxt\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:40:29.169246 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:29.169209    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4be4ec07-e67d-45ba-95ae-85977a30b9f4" path="/var/lib/kubelet/pods/4be4ec07-e67d-45ba-95ae-85977a30b9f4/volumes"
Sep 16 01:40:29.542504 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:29.542402    2565 generic.go:356] "Generic (PLEG): container finished" podID="4be4ec07-e67d-45ba-95ae-85977a30b9f4" containerID="3ed7a800ce4f03a8064bbefc8d354e1317989686be6d6f0a929c0681389b34d0" exitCode=137
Sep 16 01:40:29.542504 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:29.542450    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9138-96cff6"
Sep 16 01:40:29.542769 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:29.542515    2565 scope.go:117] "RemoveContainer" containerID="3ed7a800ce4f03a8064bbefc8d354e1317989686be6d6f0a929c0681389b34d0"
Sep 16 01:40:29.551404 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:29.551391    2565 scope.go:117] "RemoveContainer" containerID="3ed7a800ce4f03a8064bbefc8d354e1317989686be6d6f0a929c0681389b34d0"
Sep 16 01:40:29.551718 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:40:29.551698    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ed7a800ce4f03a8064bbefc8d354e1317989686be6d6f0a929c0681389b34d0\": container with ID starting with 3ed7a800ce4f03a8064bbefc8d354e1317989686be6d6f0a929c0681389b34d0 not found: ID does not exist" containerID="3ed7a800ce4f03a8064bbefc8d354e1317989686be6d6f0a929c0681389b34d0"
Sep 16 01:40:29.551780 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:29.551727    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ed7a800ce4f03a8064bbefc8d354e1317989686be6d6f0a929c0681389b34d0"} err="failed to get container status \"3ed7a800ce4f03a8064bbefc8d354e1317989686be6d6f0a929c0681389b34d0\": rpc error: code = NotFound desc = could not find container \"3ed7a800ce4f03a8064bbefc8d354e1317989686be6d6f0a929c0681389b34d0\": container with ID starting with 3ed7a800ce4f03a8064bbefc8d354e1317989686be6d6f0a929c0681389b34d0 not found: ID does not exist"
Sep 16 01:40:38.085366 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:38.085315    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b6e6489-fz4vd"]
Sep 16 01:40:38.085789 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:38.085727    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4be4ec07-e67d-45ba-95ae-85977a30b9f4" containerName="test-curl-9138-96cff6"
Sep 16 01:40:38.085789 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:38.085740    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4be4ec07-e67d-45ba-95ae-85977a30b9f4" containerName="test-curl-9138-96cff6"
Sep 16 01:40:38.085872 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:38.085815    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4be4ec07-e67d-45ba-95ae-85977a30b9f4" containerName="test-curl-9138-96cff6"
Sep 16 01:40:38.090241 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:38.090223    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b6e6489-fz4vd"
Sep 16 01:40:38.092799 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:38.092774    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4ljjd\""
Sep 16 01:40:38.092929 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:38.092836    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 01:40:38.094976 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:38.094955    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b6e6489-fz4vd"]
Sep 16 01:40:38.203659 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:38.203626    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbd4fca2-f46a-41d9-bbbf-f0e598417884-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-3b6e6489-fz4vd\" (UID: \"fbd4fca2-f46a-41d9-bbbf-f0e598417884\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b6e6489-fz4vd"
Sep 16 01:40:38.304784 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:38.304743    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbd4fca2-f46a-41d9-bbbf-f0e598417884-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-3b6e6489-fz4vd\" (UID: \"fbd4fca2-f46a-41d9-bbbf-f0e598417884\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b6e6489-fz4vd"
Sep 16 01:40:38.305516 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:38.305491    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbd4fca2-f46a-41d9-bbbf-f0e598417884-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-3b6e6489-fz4vd\" (UID: \"fbd4fca2-f46a-41d9-bbbf-f0e598417884\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b6e6489-fz4vd"
Sep 16 01:40:38.402483 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:38.402374    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b6e6489-fz4vd"
Sep 16 01:40:38.673198 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:38.673166    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b6e6489-fz4vd"]
Sep 16 01:40:38.675384 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:40:38.675317    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbd4fca2_f46a_41d9_bbbf_f0e598417884.slice/crio-4d048c7e54a4f810bdb77644c41810c0552675ba1f7428fb5a5db817e3ad2375 WatchSource:0}: Error finding container 4d048c7e54a4f810bdb77644c41810c0552675ba1f7428fb5a5db817e3ad2375: Status 404 returned error can't find the container with id 4d048c7e54a4f810bdb77644c41810c0552675ba1f7428fb5a5db817e3ad2375
Sep 16 01:40:39.600907 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:39.600866    2565 generic.go:356] "Generic (PLEG): container finished" podID="fbd4fca2-f46a-41d9-bbbf-f0e598417884" containerID="155b8888432277ccad9169651a5ab3c92b801492c9434f60238c55fbbb6c532c" exitCode=0
Sep 16 01:40:39.601285 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:39.600953    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b6e6489-fz4vd" event={"ID":"fbd4fca2-f46a-41d9-bbbf-f0e598417884","Type":"ContainerDied","Data":"155b8888432277ccad9169651a5ab3c92b801492c9434f60238c55fbbb6c532c"}
Sep 16 01:40:39.601285 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:39.601009    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b6e6489-fz4vd" event={"ID":"fbd4fca2-f46a-41d9-bbbf-f0e598417884","Type":"ContainerStarted","Data":"4d048c7e54a4f810bdb77644c41810c0552675ba1f7428fb5a5db817e3ad2375"}
Sep 16 01:40:40.739316 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:40.739291    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b6e6489-fz4vd"
Sep 16 01:40:40.832685 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:40.832645    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbd4fca2-f46a-41d9-bbbf-f0e598417884-maas-api-service-ca\") pod \"fbd4fca2-f46a-41d9-bbbf-f0e598417884\" (UID: \"fbd4fca2-f46a-41d9-bbbf-f0e598417884\") "
Sep 16 01:40:40.833052 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:40.833026    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbd4fca2-f46a-41d9-bbbf-f0e598417884-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fbd4fca2-f46a-41d9-bbbf-f0e598417884" (UID: "fbd4fca2-f46a-41d9-bbbf-f0e598417884"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:40:40.934201 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:40.934163    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbd4fca2-f46a-41d9-bbbf-f0e598417884-maas-api-service-ca\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:40:41.613943 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:41.613913    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b6e6489-fz4vd"
Sep 16 01:40:41.614097 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:41.613946    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b6e6489-fz4vd" event={"ID":"fbd4fca2-f46a-41d9-bbbf-f0e598417884","Type":"ContainerDied","Data":"4d048c7e54a4f810bdb77644c41810c0552675ba1f7428fb5a5db817e3ad2375"}
Sep 16 01:40:41.614097 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:41.613992    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4d048c7e54a4f810bdb77644c41810c0552675ba1f7428fb5a5db817e3ad2375"
Sep 16 01:40:51.391304 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:51.391267    2565 scope.go:117] "RemoveContainer" containerID="57059548cc01cebea823b3f6beca4f33f8ee5c47f370419fdb4330382bd14f6f"
Sep 16 01:40:51.400255 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:51.400235    2565 scope.go:117] "RemoveContainer" containerID="89c2c37c01ae17e34cdfbd30be4c4480cc00c8496ba1badf4ed8180e5187f922"
Sep 16 01:40:51.408956 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:51.408929    2565 scope.go:117] "RemoveContainer" containerID="6547491b2f082f6f86d7db70559a1e69815bb3f8de933b54979299ef4995e155"
Sep 16 01:40:53.730202 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:53.730134    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b6e6489-fz4vd"]
Sep 16 01:40:53.732540 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:53.732515    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b6e6489-fz4vd"]
Sep 16 01:40:55.172968 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:55.172931    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbd4fca2-f46a-41d9-bbbf-f0e598417884" path="/var/lib/kubelet/pods/fbd4fca2-f46a-41d9-bbbf-f0e598417884/volumes"
Sep 16 01:40:58.163452 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:40:58.163415    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-6cd864bc95-st4pq" secret="" err="secret \"payload-processing-dockercfg-kkbcm\" not found"
Sep 16 01:41:37.164417 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:41:37.164369    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-processing-5d7dbbd56b-4455c" secret="" err="secret \"payload-processing-dockercfg-kkbcm\" not found"
Sep 16 01:41:50.481710 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:41:50.481668    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8"]
Sep 16 01:41:50.482206 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:41:50.481963    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8" podUID="98958b53-2d08-49a9-a08f-1528d99996f9" containerName="istio-proxy" containerID="cri-o://01313b52dd62ea314cd3ef95055dd9913e54f24f63d5c7aca9f52c40c69f81bd" gracePeriod=30
Sep 16 01:41:51.443172 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:41:51.443138    2565 scope.go:117] "RemoveContainer" containerID="666fca564015af9d5c59a122befdfaa37918a4b644d8812c065becba436f583a"
Sep 16 01:41:51.451765 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:41:51.451740    2565 scope.go:117] "RemoveContainer" containerID="a2fdd55aa270c3e0036b1d1fd5a9da5aec9e56a91b5ddb8b0ab3eb3f1406b060"
Sep 16 01:41:55.744588 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:41:55.744559    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8"
Sep 16 01:41:55.841257 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:41:55.841172    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98958b53-2d08-49a9-a08f-1528d99996f9-workload-certs\") pod \"98958b53-2d08-49a9-a08f-1528d99996f9\" (UID: \"98958b53-2d08-49a9-a08f-1528d99996f9\") "
Sep 16 01:41:55.841257 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:41:55.841205    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98958b53-2d08-49a9-a08f-1528d99996f9-credential-socket\") pod \"98958b53-2d08-49a9-a08f-1528d99996f9\" (UID: \"98958b53-2d08-49a9-a08f-1528d99996f9\") "
Sep 16 01:41:55.841257 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:41:55.841224    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98958b53-2d08-49a9-a08f-1528d99996f9-istio-envoy\") pod \"98958b53-2d08-49a9-a08f-1528d99996f9\" (UID: \"98958b53-2d08-49a9-a08f-1528d99996f9\") "
Sep 16 01:41:55.841257 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:41:55.841248    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-49gt6\" (UniqueName: \"kubernetes.io/projected/98958b53-2d08-49a9-a08f-1528d99996f9-kube-api-access-49gt6\") pod \"98958b53-2d08-49a9-a08f-1528d99996f9\" (UID: \"98958b53-2d08-49a9-a08f-1528d99996f9\") "
Sep 16 01:41:55.841610 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:41:55.841326    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98958b53-2d08-49a9-a08f-1528d99996f9-istio-data\") pod \"98958b53-2d08-49a9-a08f-1528d99996f9\" (UID: \"98958b53-2d08-49a9-a08f-1528d99996f9\") "
Sep 16 01:41:55.841610 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:41:55.841362    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98958b53-2d08-49a9-a08f-1528d99996f9-workload-socket\") pod \"98958b53-2d08-49a9-a08f-1528d99996f9\" (UID: \"98958b53-2d08-49a9-a08f-1528d99996f9\") "
Sep 16 01:41:55.841610 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:41:55.841418    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98958b53-2d08-49a9-a08f-1528d99996f9-istio-token\") pod \"98958b53-2d08-49a9-a08f-1528d99996f9\" (UID: \"98958b53-2d08-49a9-a08f-1528d99996f9\") "
Sep 16 01:41:55.841610 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:41:55.841450    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98958b53-2d08-49a9-a08f-1528d99996f9-istiod-ca-cert\") pod \"98958b53-2d08-49a9-a08f-1528d99996f9\" (UID: \"98958b53-2d08-49a9-a08f-1528d99996f9\") "
Sep 16 01:41:55.841610 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:41:55.841494    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98958b53-2d08-49a9-a08f-1528d99996f9-istio-podinfo\") pod \"98958b53-2d08-49a9-a08f-1528d99996f9\" (UID: \"98958b53-2d08-49a9-a08f-1528d99996f9\") "
Sep 16 01:41:55.841610 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:41:55.841509    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98958b53-2d08-49a9-a08f-1528d99996f9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "98958b53-2d08-49a9-a08f-1528d99996f9" (UID: "98958b53-2d08-49a9-a08f-1528d99996f9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:41:55.841610 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:41:55.841601    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98958b53-2d08-49a9-a08f-1528d99996f9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "98958b53-2d08-49a9-a08f-1528d99996f9" (UID: "98958b53-2d08-49a9-a08f-1528d99996f9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:41:55.841966 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:41:55.841666    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98958b53-2d08-49a9-a08f-1528d99996f9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "98958b53-2d08-49a9-a08f-1528d99996f9" (UID: "98958b53-2d08-49a9-a08f-1528d99996f9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:41:55.841966 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:41:55.841819    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98958b53-2d08-49a9-a08f-1528d99996f9-istio-data" (OuterVolumeSpecName: "istio-data") pod "98958b53-2d08-49a9-a08f-1528d99996f9" (UID: "98958b53-2d08-49a9-a08f-1528d99996f9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:41:55.841966 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:41:55.841924    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98958b53-2d08-49a9-a08f-1528d99996f9-workload-certs\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:41:55.841966 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:41:55.841945    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98958b53-2d08-49a9-a08f-1528d99996f9-credential-socket\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:41:55.841966 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:41:55.841961    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98958b53-2d08-49a9-a08f-1528d99996f9-workload-socket\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:41:55.842232 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:41:55.842071    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98958b53-2d08-49a9-a08f-1528d99996f9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "98958b53-2d08-49a9-a08f-1528d99996f9" (UID: "98958b53-2d08-49a9-a08f-1528d99996f9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:41:55.843716 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:41:55.843686    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98958b53-2d08-49a9-a08f-1528d99996f9-istio-token" (OuterVolumeSpecName: "istio-token") pod "98958b53-2d08-49a9-a08f-1528d99996f9" (UID: "98958b53-2d08-49a9-a08f-1528d99996f9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:41:55.843834 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:41:55.843707    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98958b53-2d08-49a9-a08f-1528d99996f9-kube-api-access-49gt6" (OuterVolumeSpecName: "kube-api-access-49gt6") pod "98958b53-2d08-49a9-a08f-1528d99996f9" (UID: "98958b53-2d08-49a9-a08f-1528d99996f9"). InnerVolumeSpecName "kube-api-access-49gt6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:41:55.843834 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:41:55.843786    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98958b53-2d08-49a9-a08f-1528d99996f9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "98958b53-2d08-49a9-a08f-1528d99996f9" (UID: "98958b53-2d08-49a9-a08f-1528d99996f9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:41:55.844201 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:41:55.844185    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/98958b53-2d08-49a9-a08f-1528d99996f9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "98958b53-2d08-49a9-a08f-1528d99996f9" (UID: "98958b53-2d08-49a9-a08f-1528d99996f9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 01:41:55.942900 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:41:55.942853    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98958b53-2d08-49a9-a08f-1528d99996f9-istiod-ca-cert\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:41:55.942900 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:41:55.942890    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98958b53-2d08-49a9-a08f-1528d99996f9-istio-podinfo\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:41:55.942900 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:41:55.942903    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98958b53-2d08-49a9-a08f-1528d99996f9-istio-envoy\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:41:55.943167 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:41:55.942916    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-49gt6\" (UniqueName: \"kubernetes.io/projected/98958b53-2d08-49a9-a08f-1528d99996f9-kube-api-access-49gt6\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:41:55.943167 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:41:55.942930    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98958b53-2d08-49a9-a08f-1528d99996f9-istio-data\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:41:55.943167 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:41:55.942941    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98958b53-2d08-49a9-a08f-1528d99996f9-istio-token\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:41:56.021919 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:41:56.021880    2565 generic.go:356] "Generic (PLEG): container finished" podID="98958b53-2d08-49a9-a08f-1528d99996f9" containerID="01313b52dd62ea314cd3ef95055dd9913e54f24f63d5c7aca9f52c40c69f81bd" exitCode=0
Sep 16 01:41:56.022095 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:41:56.021939    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8"
Sep 16 01:41:56.022095 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:41:56.021941    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8" event={"ID":"98958b53-2d08-49a9-a08f-1528d99996f9","Type":"ContainerDied","Data":"01313b52dd62ea314cd3ef95055dd9913e54f24f63d5c7aca9f52c40c69f81bd"}
Sep 16 01:41:56.022095 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:41:56.022060    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8" event={"ID":"98958b53-2d08-49a9-a08f-1528d99996f9","Type":"ContainerDied","Data":"8e82c54dc2ec727936127a6a022913fa8a0269b3550e2509cd8b7b4176fc2b48"}
Sep 16 01:41:56.022095 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:41:56.022088    2565 scope.go:117] "RemoveContainer" containerID="01313b52dd62ea314cd3ef95055dd9913e54f24f63d5c7aca9f52c40c69f81bd"
Sep 16 01:41:56.032661 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:41:56.032623    2565 scope.go:117] "RemoveContainer" containerID="236d0d9e39571b32e817be7d9489184f8d54394ccb2b6a3c88e0ff54c78975be"
Sep 16 01:41:56.041658 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:41:56.041634    2565 scope.go:117] "RemoveContainer" containerID="01313b52dd62ea314cd3ef95055dd9913e54f24f63d5c7aca9f52c40c69f81bd"
Sep 16 01:41:56.042007 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:41:56.041983    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01313b52dd62ea314cd3ef95055dd9913e54f24f63d5c7aca9f52c40c69f81bd\": container with ID starting with 01313b52dd62ea314cd3ef95055dd9913e54f24f63d5c7aca9f52c40c69f81bd not found: ID does not exist" containerID="01313b52dd62ea314cd3ef95055dd9913e54f24f63d5c7aca9f52c40c69f81bd"
Sep 16 01:41:56.042095 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:41:56.042015    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01313b52dd62ea314cd3ef95055dd9913e54f24f63d5c7aca9f52c40c69f81bd"} err="failed to get container status \"01313b52dd62ea314cd3ef95055dd9913e54f24f63d5c7aca9f52c40c69f81bd\": rpc error: code = NotFound desc = could not find container \"01313b52dd62ea314cd3ef95055dd9913e54f24f63d5c7aca9f52c40c69f81bd\": container with ID starting with 01313b52dd62ea314cd3ef95055dd9913e54f24f63d5c7aca9f52c40c69f81bd not found: ID does not exist"
Sep 16 01:41:56.042095 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:41:56.042034    2565 scope.go:117] "RemoveContainer" containerID="236d0d9e39571b32e817be7d9489184f8d54394ccb2b6a3c88e0ff54c78975be"
Sep 16 01:41:56.042327 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:41:56.042306    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"236d0d9e39571b32e817be7d9489184f8d54394ccb2b6a3c88e0ff54c78975be\": container with ID starting with 236d0d9e39571b32e817be7d9489184f8d54394ccb2b6a3c88e0ff54c78975be not found: ID does not exist" containerID="236d0d9e39571b32e817be7d9489184f8d54394ccb2b6a3c88e0ff54c78975be"
Sep 16 01:41:56.042462 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:41:56.042399    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"236d0d9e39571b32e817be7d9489184f8d54394ccb2b6a3c88e0ff54c78975be"} err="failed to get container status \"236d0d9e39571b32e817be7d9489184f8d54394ccb2b6a3c88e0ff54c78975be\": rpc error: code = NotFound desc = could not find container \"236d0d9e39571b32e817be7d9489184f8d54394ccb2b6a3c88e0ff54c78975be\": container with ID starting with 236d0d9e39571b32e817be7d9489184f8d54394ccb2b6a3c88e0ff54c78975be not found: ID does not exist"
Sep 16 01:41:56.043971 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:41:56.043946    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8"]
Sep 16 01:41:56.047128 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:41:56.047105    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8"]
Sep 16 01:41:57.170142 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:41:57.170106    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98958b53-2d08-49a9-a08f-1528d99996f9" path="/var/lib/kubelet/pods/98958b53-2d08-49a9-a08f-1528d99996f9/volumes"
Sep 16 01:41:59.163694 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:41:59.163660    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-6cd864bc95-st4pq" secret="" err="secret \"payload-processing-dockercfg-kkbcm\" not found"
Sep 16 01:42:42.542603 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:42.542570    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h"]
Sep 16 01:42:42.543918 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:42.543884    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98958b53-2d08-49a9-a08f-1528d99996f9" containerName="istio-proxy"
Sep 16 01:42:42.543918 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:42.543923    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="98958b53-2d08-49a9-a08f-1528d99996f9" containerName="istio-proxy"
Sep 16 01:42:42.544147 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:42.543985    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98958b53-2d08-49a9-a08f-1528d99996f9" containerName="istio-proxy"
Sep 16 01:42:42.544147 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:42.543995    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="98958b53-2d08-49a9-a08f-1528d99996f9" containerName="istio-proxy"
Sep 16 01:42:42.544147 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:42.544034    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbd4fca2-f46a-41d9-bbbf-f0e598417884" containerName="revoke-keys"
Sep 16 01:42:42.544147 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:42.544043    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbd4fca2-f46a-41d9-bbbf-f0e598417884" containerName="revoke-keys"
Sep 16 01:42:42.544385 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:42.544260    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="98958b53-2d08-49a9-a08f-1528d99996f9" containerName="istio-proxy"
Sep 16 01:42:42.544385 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:42.544277    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbd4fca2-f46a-41d9-bbbf-f0e598417884" containerName="revoke-keys"
Sep 16 01:42:42.544385 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:42.544293    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="98958b53-2d08-49a9-a08f-1528d99996f9" containerName="istio-proxy"
Sep 16 01:42:42.550438 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:42.550136    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h"
Sep 16 01:42:42.553393 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:42.553366    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-8d230b-openshift-default-dockercfg-2t45x\""
Sep 16 01:42:42.558785 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:42.558759    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h"]
Sep 16 01:42:42.698262 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:42.698220    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec30d4ef-5d57-47da-b2a4-ae1e43795f22-workload-certs\") pod \"e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h\" (UID: \"ec30d4ef-5d57-47da-b2a4-ae1e43795f22\") " pod="openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h"
Sep 16 01:42:42.698262 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:42.698262    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec30d4ef-5d57-47da-b2a4-ae1e43795f22-istiod-ca-cert\") pod \"e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h\" (UID: \"ec30d4ef-5d57-47da-b2a4-ae1e43795f22\") " pod="openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h"
Sep 16 01:42:42.698515 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:42.698302    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec30d4ef-5d57-47da-b2a4-ae1e43795f22-istio-data\") pod \"e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h\" (UID: \"ec30d4ef-5d57-47da-b2a4-ae1e43795f22\") " pod="openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h"
Sep 16 01:42:42.698515 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:42.698405    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec30d4ef-5d57-47da-b2a4-ae1e43795f22-istio-envoy\") pod \"e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h\" (UID: \"ec30d4ef-5d57-47da-b2a4-ae1e43795f22\") " pod="openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h"
Sep 16 01:42:42.698515 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:42.698445    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec30d4ef-5d57-47da-b2a4-ae1e43795f22-istio-token\") pod \"e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h\" (UID: \"ec30d4ef-5d57-47da-b2a4-ae1e43795f22\") " pod="openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h"
Sep 16 01:42:42.698515 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:42.698467    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec30d4ef-5d57-47da-b2a4-ae1e43795f22-credential-socket\") pod \"e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h\" (UID: \"ec30d4ef-5d57-47da-b2a4-ae1e43795f22\") " pod="openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h"
Sep 16 01:42:42.698661 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:42.698523    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec30d4ef-5d57-47da-b2a4-ae1e43795f22-istio-podinfo\") pod \"e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h\" (UID: \"ec30d4ef-5d57-47da-b2a4-ae1e43795f22\") " pod="openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h"
Sep 16 01:42:42.698661 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:42.698592    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7528p\" (UniqueName: \"kubernetes.io/projected/ec30d4ef-5d57-47da-b2a4-ae1e43795f22-kube-api-access-7528p\") pod \"e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h\" (UID: \"ec30d4ef-5d57-47da-b2a4-ae1e43795f22\") " pod="openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h"
Sep 16 01:42:42.698661 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:42.698607    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec30d4ef-5d57-47da-b2a4-ae1e43795f22-workload-socket\") pod \"e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h\" (UID: \"ec30d4ef-5d57-47da-b2a4-ae1e43795f22\") " pod="openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h"
Sep 16 01:42:42.799414 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:42.799297    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec30d4ef-5d57-47da-b2a4-ae1e43795f22-istio-envoy\") pod \"e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h\" (UID: \"ec30d4ef-5d57-47da-b2a4-ae1e43795f22\") " pod="openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h"
Sep 16 01:42:42.799414 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:42.799356    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec30d4ef-5d57-47da-b2a4-ae1e43795f22-istio-token\") pod \"e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h\" (UID: \"ec30d4ef-5d57-47da-b2a4-ae1e43795f22\") " pod="openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h"
Sep 16 01:42:42.799414 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:42.799393    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec30d4ef-5d57-47da-b2a4-ae1e43795f22-credential-socket\") pod \"e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h\" (UID: \"ec30d4ef-5d57-47da-b2a4-ae1e43795f22\") " pod="openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h"
Sep 16 01:42:42.799699 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:42.799439    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec30d4ef-5d57-47da-b2a4-ae1e43795f22-istio-podinfo\") pod \"e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h\" (UID: \"ec30d4ef-5d57-47da-b2a4-ae1e43795f22\") " pod="openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h"
Sep 16 01:42:42.799699 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:42.799504    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7528p\" (UniqueName: \"kubernetes.io/projected/ec30d4ef-5d57-47da-b2a4-ae1e43795f22-kube-api-access-7528p\") pod \"e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h\" (UID: \"ec30d4ef-5d57-47da-b2a4-ae1e43795f22\") " pod="openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h"
Sep 16 01:42:42.799699 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:42.799528    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec30d4ef-5d57-47da-b2a4-ae1e43795f22-workload-socket\") pod \"e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h\" (UID: \"ec30d4ef-5d57-47da-b2a4-ae1e43795f22\") " pod="openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h"
Sep 16 01:42:42.799699 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:42.799558    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec30d4ef-5d57-47da-b2a4-ae1e43795f22-workload-certs\") pod \"e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h\" (UID: \"ec30d4ef-5d57-47da-b2a4-ae1e43795f22\") " pod="openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h"
Sep 16 01:42:42.799699 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:42.799582    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec30d4ef-5d57-47da-b2a4-ae1e43795f22-istiod-ca-cert\") pod \"e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h\" (UID: \"ec30d4ef-5d57-47da-b2a4-ae1e43795f22\") " pod="openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h"
Sep 16 01:42:42.799699 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:42.799630    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec30d4ef-5d57-47da-b2a4-ae1e43795f22-istio-data\") pod \"e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h\" (UID: \"ec30d4ef-5d57-47da-b2a4-ae1e43795f22\") " pod="openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h"
Sep 16 01:42:42.800028 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:42.799826    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec30d4ef-5d57-47da-b2a4-ae1e43795f22-credential-socket\") pod \"e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h\" (UID: \"ec30d4ef-5d57-47da-b2a4-ae1e43795f22\") " pod="openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h"
Sep 16 01:42:42.800028 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:42.799917    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec30d4ef-5d57-47da-b2a4-ae1e43795f22-workload-socket\") pod \"e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h\" (UID: \"ec30d4ef-5d57-47da-b2a4-ae1e43795f22\") " pod="openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h"
Sep 16 01:42:42.800028 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:42.799928    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec30d4ef-5d57-47da-b2a4-ae1e43795f22-workload-certs\") pod \"e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h\" (UID: \"ec30d4ef-5d57-47da-b2a4-ae1e43795f22\") " pod="openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h"
Sep 16 01:42:42.800028 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:42.799994    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec30d4ef-5d57-47da-b2a4-ae1e43795f22-istio-data\") pod \"e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h\" (UID: \"ec30d4ef-5d57-47da-b2a4-ae1e43795f22\") " pod="openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h"
Sep 16 01:42:42.800374 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:42.800324    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec30d4ef-5d57-47da-b2a4-ae1e43795f22-istiod-ca-cert\") pod \"e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h\" (UID: \"ec30d4ef-5d57-47da-b2a4-ae1e43795f22\") " pod="openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h"
Sep 16 01:42:42.801827 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:42.801806    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec30d4ef-5d57-47da-b2a4-ae1e43795f22-istio-envoy\") pod \"e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h\" (UID: \"ec30d4ef-5d57-47da-b2a4-ae1e43795f22\") " pod="openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h"
Sep 16 01:42:42.802075 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:42.802058    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec30d4ef-5d57-47da-b2a4-ae1e43795f22-istio-podinfo\") pod \"e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h\" (UID: \"ec30d4ef-5d57-47da-b2a4-ae1e43795f22\") " pod="openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h"
Sep 16 01:42:42.806646 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:42.806620    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec30d4ef-5d57-47da-b2a4-ae1e43795f22-istio-token\") pod \"e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h\" (UID: \"ec30d4ef-5d57-47da-b2a4-ae1e43795f22\") " pod="openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h"
Sep 16 01:42:42.806751 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:42.806729    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7528p\" (UniqueName: \"kubernetes.io/projected/ec30d4ef-5d57-47da-b2a4-ae1e43795f22-kube-api-access-7528p\") pod \"e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h\" (UID: \"ec30d4ef-5d57-47da-b2a4-ae1e43795f22\") " pod="openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h"
Sep 16 01:42:42.865576 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:42.865543    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h"
Sep 16 01:42:43.138528 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:43.138500    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h"]
Sep 16 01:42:43.140244 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:42:43.140213    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec30d4ef_5d57_47da_b2a4_ae1e43795f22.slice/crio-3ab70ffe8ce4126a10303059111f2966be913171677cc6b134058c90d2adbbe2 WatchSource:0}: Error finding container 3ab70ffe8ce4126a10303059111f2966be913171677cc6b134058c90d2adbbe2: Status 404 returned error can't find the container with id 3ab70ffe8ce4126a10303059111f2966be913171677cc6b134058c90d2adbbe2
Sep 16 01:42:43.142730 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:43.142688    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:42:43.142819 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:43.142776    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:42:43.142862 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:43.142816    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:42:43.279053 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:43.279021    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h" event={"ID":"ec30d4ef-5d57-47da-b2a4-ae1e43795f22","Type":"ContainerStarted","Data":"821271b970fdffbed54bef6e9853db915eddbf246dd13d8f8e85b1d50c2b161e"}
Sep 16 01:42:43.279228 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:43.279080    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h" event={"ID":"ec30d4ef-5d57-47da-b2a4-ae1e43795f22","Type":"ContainerStarted","Data":"3ab70ffe8ce4126a10303059111f2966be913171677cc6b134058c90d2adbbe2"}
Sep 16 01:42:43.298735 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:43.298668    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h" podStartSLOduration=1.298649366 podStartE2EDuration="1.298649366s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:42:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:42:43.296241648 +0000 UTC m=+1612.619710226" watchObservedRunningTime="2026-09-16 01:42:43.298649366 +0000 UTC m=+1612.622117939"
Sep 16 01:42:43.865819 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:43.865786    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h"
Sep 16 01:42:44.872329 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:44.872285    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h"
Sep 16 01:42:45.290677 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:45.290640    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h"
Sep 16 01:42:45.291694 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:45.291673    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h"
Sep 16 01:42:48.856970 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:48.856936    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-8d230b-5c8bf9cb4c-ctjr5"]
Sep 16 01:42:48.860883 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:48.860835    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-8d230b-5c8bf9cb4c-ctjr5"
Sep 16 01:42:48.863312 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:48.863287    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-8d230b-dockercfg-9mq7j\""
Sep 16 01:42:48.863492 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:48.863469    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-8d230b\""
Sep 16 01:42:48.870837 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:48.870807    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-8d230b-5c8bf9cb4c-ctjr5"]
Sep 16 01:42:48.964499 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:48.964457    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/def1a514-7c74-4788-a673-6c523d029b57-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-8d230b-5c8bf9cb4c-ctjr5\" (UID: \"def1a514-7c74-4788-a673-6c523d029b57\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-8d230b-5c8bf9cb4c-ctjr5"
Sep 16 01:42:48.964745 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:48.964658    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54hl7\" (UniqueName: \"kubernetes.io/projected/def1a514-7c74-4788-a673-6c523d029b57-kube-api-access-54hl7\") pod \"payload-processing-e2e-ipp-a-8d230b-5c8bf9cb4c-ctjr5\" (UID: \"def1a514-7c74-4788-a673-6c523d029b57\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-8d230b-5c8bf9cb4c-ctjr5"
Sep 16 01:42:49.066213 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:49.066174    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54hl7\" (UniqueName: \"kubernetes.io/projected/def1a514-7c74-4788-a673-6c523d029b57-kube-api-access-54hl7\") pod \"payload-processing-e2e-ipp-a-8d230b-5c8bf9cb4c-ctjr5\" (UID: \"def1a514-7c74-4788-a673-6c523d029b57\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-8d230b-5c8bf9cb4c-ctjr5"
Sep 16 01:42:49.066482 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:49.066250    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/def1a514-7c74-4788-a673-6c523d029b57-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-8d230b-5c8bf9cb4c-ctjr5\" (UID: \"def1a514-7c74-4788-a673-6c523d029b57\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-8d230b-5c8bf9cb4c-ctjr5"
Sep 16 01:42:49.067038 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:49.067010    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/def1a514-7c74-4788-a673-6c523d029b57-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-8d230b-5c8bf9cb4c-ctjr5\" (UID: \"def1a514-7c74-4788-a673-6c523d029b57\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-8d230b-5c8bf9cb4c-ctjr5"
Sep 16 01:42:49.073949 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:49.073919    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54hl7\" (UniqueName: \"kubernetes.io/projected/def1a514-7c74-4788-a673-6c523d029b57-kube-api-access-54hl7\") pod \"payload-processing-e2e-ipp-a-8d230b-5c8bf9cb4c-ctjr5\" (UID: \"def1a514-7c74-4788-a673-6c523d029b57\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-8d230b-5c8bf9cb4c-ctjr5"
Sep 16 01:42:49.173381 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:49.173331    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-8d230b-5c8bf9cb4c-ctjr5"
Sep 16 01:42:49.447776 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:49.447744    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-8d230b-5c8bf9cb4c-ctjr5"]
Sep 16 01:42:49.449782 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:42:49.449753    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddef1a514_7c74_4788_a673_6c523d029b57.slice/crio-ac7af51b6c17aac52d9b6ed7a68107a76c63874d5af2961f2a34d05266c4fec1 WatchSource:0}: Error finding container ac7af51b6c17aac52d9b6ed7a68107a76c63874d5af2961f2a34d05266c4fec1: Status 404 returned error can't find the container with id ac7af51b6c17aac52d9b6ed7a68107a76c63874d5af2961f2a34d05266c4fec1
Sep 16 01:42:50.318156 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:50.318113    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-8d230b-5c8bf9cb4c-ctjr5" event={"ID":"def1a514-7c74-4788-a673-6c523d029b57","Type":"ContainerStarted","Data":"167e02a5da5ec2cb73b0c13fc09dac7ae7b4d833464f7df4ffdd476cd3e17722"}
Sep 16 01:42:50.318594 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:50.318178    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-8d230b-5c8bf9cb4c-ctjr5" event={"ID":"def1a514-7c74-4788-a673-6c523d029b57","Type":"ContainerStarted","Data":"ac7af51b6c17aac52d9b6ed7a68107a76c63874d5af2961f2a34d05266c4fec1"}
Sep 16 01:42:50.318594 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:50.318360    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-8d230b-5c8bf9cb4c-ctjr5"
Sep 16 01:42:50.334679 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:50.334629    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-8d230b-5c8bf9cb4c-ctjr5" podStartSLOduration=2.334611567 podStartE2EDuration="2.334611567s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:42:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:42:50.334281333 +0000 UTC m=+1619.657749901" watchObservedRunningTime="2026-09-16 01:42:50.334611567 +0000 UTC m=+1619.658080141"
Sep 16 01:42:51.268986 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:51.268951    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-7d0959-58f8bfc4d7-bqznw"]
Sep 16 01:42:51.272649 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:51.272631    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-7d0959-58f8bfc4d7-bqznw"
Sep 16 01:42:51.274861 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:51.274839    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-7d0959\""
Sep 16 01:42:51.274986 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:51.274908    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-7d0959-dockercfg-fwgzk\""
Sep 16 01:42:51.281640 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:51.281616    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-7d0959-58f8bfc4d7-bqznw"]
Sep 16 01:42:51.288982 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:51.288950    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dbd54817-26da-4dae-9af0-0d0bad587400-plugins-config-volume\") pod \"payload-processing-e2e-api-a-7d0959-58f8bfc4d7-bqznw\" (UID: \"dbd54817-26da-4dae-9af0-0d0bad587400\") " pod="openshift-ingress/payload-processing-e2e-api-a-7d0959-58f8bfc4d7-bqznw"
Sep 16 01:42:51.289120 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:51.289095    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4jq5\" (UniqueName: \"kubernetes.io/projected/dbd54817-26da-4dae-9af0-0d0bad587400-kube-api-access-k4jq5\") pod \"payload-processing-e2e-api-a-7d0959-58f8bfc4d7-bqznw\" (UID: \"dbd54817-26da-4dae-9af0-0d0bad587400\") " pod="openshift-ingress/payload-processing-e2e-api-a-7d0959-58f8bfc4d7-bqznw"
Sep 16 01:42:51.389864 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:51.389825    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dbd54817-26da-4dae-9af0-0d0bad587400-plugins-config-volume\") pod \"payload-processing-e2e-api-a-7d0959-58f8bfc4d7-bqznw\" (UID: \"dbd54817-26da-4dae-9af0-0d0bad587400\") " pod="openshift-ingress/payload-processing-e2e-api-a-7d0959-58f8bfc4d7-bqznw"
Sep 16 01:42:51.390352 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:51.389904    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4jq5\" (UniqueName: \"kubernetes.io/projected/dbd54817-26da-4dae-9af0-0d0bad587400-kube-api-access-k4jq5\") pod \"payload-processing-e2e-api-a-7d0959-58f8bfc4d7-bqznw\" (UID: \"dbd54817-26da-4dae-9af0-0d0bad587400\") " pod="openshift-ingress/payload-processing-e2e-api-a-7d0959-58f8bfc4d7-bqznw"
Sep 16 01:42:51.390602 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:51.390580    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dbd54817-26da-4dae-9af0-0d0bad587400-plugins-config-volume\") pod \"payload-processing-e2e-api-a-7d0959-58f8bfc4d7-bqznw\" (UID: \"dbd54817-26da-4dae-9af0-0d0bad587400\") " pod="openshift-ingress/payload-processing-e2e-api-a-7d0959-58f8bfc4d7-bqznw"
Sep 16 01:42:51.397286 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:51.397263    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4jq5\" (UniqueName: \"kubernetes.io/projected/dbd54817-26da-4dae-9af0-0d0bad587400-kube-api-access-k4jq5\") pod \"payload-processing-e2e-api-a-7d0959-58f8bfc4d7-bqznw\" (UID: \"dbd54817-26da-4dae-9af0-0d0bad587400\") " pod="openshift-ingress/payload-processing-e2e-api-a-7d0959-58f8bfc4d7-bqznw"
Sep 16 01:42:51.586218 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:51.586129    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-7d0959-58f8bfc4d7-bqznw"
Sep 16 01:42:51.861149 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:51.861125    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-7d0959-58f8bfc4d7-bqznw"]
Sep 16 01:42:51.863181 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:42:51.863142    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbd54817_26da_4dae_9af0_0d0bad587400.slice/crio-963b2103d3091b6097457764fd6fc3421f8298dcd0cff2630254286ed382e4b2 WatchSource:0}: Error finding container 963b2103d3091b6097457764fd6fc3421f8298dcd0cff2630254286ed382e4b2: Status 404 returned error can't find the container with id 963b2103d3091b6097457764fd6fc3421f8298dcd0cff2630254286ed382e4b2
Sep 16 01:42:52.333450 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:52.333408    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-7d0959-58f8bfc4d7-bqznw" event={"ID":"dbd54817-26da-4dae-9af0-0d0bad587400","Type":"ContainerStarted","Data":"5963bf056d0944be3b4ad469cac1a2427c762d3cdd79470c8d3e88d8ccb906b4"}
Sep 16 01:42:52.333626 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:52.333471    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-7d0959-58f8bfc4d7-bqznw" event={"ID":"dbd54817-26da-4dae-9af0-0d0bad587400","Type":"ContainerStarted","Data":"963b2103d3091b6097457764fd6fc3421f8298dcd0cff2630254286ed382e4b2"}
Sep 16 01:42:52.333626 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:52.333587    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-7d0959-58f8bfc4d7-bqznw"
Sep 16 01:42:52.348731 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:52.348653    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-7d0959-58f8bfc4d7-bqznw" podStartSLOduration=1.348633673 podStartE2EDuration="1.348633673s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:42:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:42:52.347747515 +0000 UTC m=+1621.671216094" watchObservedRunningTime="2026-09-16 01:42:52.348633673 +0000 UTC m=+1621.672102253"
Sep 16 01:42:57.163524 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:42:57.163485    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-processing-5d7dbbd56b-4455c" secret="" err="secret \"payload-processing-dockercfg-kkbcm\" not found"
Sep 16 01:43:01.168314 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:01.168266    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-6cd864bc95-st4pq" secret="" err="secret \"payload-processing-dockercfg-kkbcm\" not found"
Sep 16 01:43:01.328753 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:01.328719    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-8d230b-5c8bf9cb4c-ctjr5"
Sep 16 01:43:03.340598 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:03.340565    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-7d0959-58f8bfc4d7-bqznw"
Sep 16 01:43:07.423601 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:07.423567    2565 generic.go:356] "Generic (PLEG): container finished" podID="ec30d4ef-5d57-47da-b2a4-ae1e43795f22" containerID="821271b970fdffbed54bef6e9853db915eddbf246dd13d8f8e85b1d50c2b161e" exitCode=0
Sep 16 01:43:07.424026 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:07.423636    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h" event={"ID":"ec30d4ef-5d57-47da-b2a4-ae1e43795f22","Type":"ContainerDied","Data":"821271b970fdffbed54bef6e9853db915eddbf246dd13d8f8e85b1d50c2b161e"}
Sep 16 01:43:07.424071 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:07.424058    2565 scope.go:117] "RemoveContainer" containerID="821271b970fdffbed54bef6e9853db915eddbf246dd13d8f8e85b1d50c2b161e"
Sep 16 01:43:07.425220 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:07.425193    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:43:07.425274 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:07.425262    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:43:07.425310 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:07.425295    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 01:43:08.430947 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:08.430914    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h" event={"ID":"ec30d4ef-5d57-47da-b2a4-ae1e43795f22","Type":"ContainerStarted","Data":"db6fdb63d6b52ff05b598a77aa467a9e583293f355b7ce7bbdc5f672ed8104ea"}
Sep 16 01:43:08.866805 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:08.866685    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h"
Sep 16 01:43:08.867041 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:08.867012    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Sep 16 01:43:08.867135 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:08.867074    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h" podUID="ec30d4ef-5d57-47da-b2a4-ae1e43795f22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Sep 16 01:43:09.866877 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:09.866823    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Sep 16 01:43:09.867411 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:09.866917    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h" podUID="ec30d4ef-5d57-47da-b2a4-ae1e43795f22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Sep 16 01:43:10.866623 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:10.866582    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Sep 16 01:43:10.866920 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:10.866889    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h" podUID="ec30d4ef-5d57-47da-b2a4-ae1e43795f22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Sep 16 01:43:11.866986 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:11.866941    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Sep 16 01:43:11.867498 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:11.867010    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h" podUID="ec30d4ef-5d57-47da-b2a4-ae1e43795f22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Sep 16 01:43:12.866170 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:12.866026    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Sep 16 01:43:12.866524 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:12.866472    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h" podUID="ec30d4ef-5d57-47da-b2a4-ae1e43795f22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Sep 16 01:43:13.870996 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:13.870950    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h"
Sep 16 01:43:13.871541 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:13.871513    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h"
Sep 16 01:43:13.872215 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:13.872191    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h"
Sep 16 01:43:18.801523 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:18.801487    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-a42101-7ffd868b8b-tgdbf"]
Sep 16 01:43:18.804753 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:18.804733    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a42101-7ffd868b8b-tgdbf"
Sep 16 01:43:18.807213 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:18.807189    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-a42101\""
Sep 16 01:43:18.816522 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:18.816501    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-a42101-7ffd868b8b-tgdbf"]
Sep 16 01:43:18.885992 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:18.885945    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvr44\" (UniqueName: \"kubernetes.io/projected/63b15286-47cd-49dd-a1e2-cc5e4f9eae9a-kube-api-access-nvr44\") pod \"payload-pre-processing-e2e-ipp-b-a42101-7ffd868b8b-tgdbf\" (UID: \"63b15286-47cd-49dd-a1e2-cc5e4f9eae9a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a42101-7ffd868b8b-tgdbf"
Sep 16 01:43:18.886181 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:18.886136    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63b15286-47cd-49dd-a1e2-cc5e4f9eae9a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-a42101-7ffd868b8b-tgdbf\" (UID: \"63b15286-47cd-49dd-a1e2-cc5e4f9eae9a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a42101-7ffd868b8b-tgdbf"
Sep 16 01:43:18.987039 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:18.986993    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvr44\" (UniqueName: \"kubernetes.io/projected/63b15286-47cd-49dd-a1e2-cc5e4f9eae9a-kube-api-access-nvr44\") pod \"payload-pre-processing-e2e-ipp-b-a42101-7ffd868b8b-tgdbf\" (UID: \"63b15286-47cd-49dd-a1e2-cc5e4f9eae9a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a42101-7ffd868b8b-tgdbf"
Sep 16 01:43:18.987218 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:18.987110    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63b15286-47cd-49dd-a1e2-cc5e4f9eae9a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-a42101-7ffd868b8b-tgdbf\" (UID: \"63b15286-47cd-49dd-a1e2-cc5e4f9eae9a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a42101-7ffd868b8b-tgdbf"
Sep 16 01:43:18.987826 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:18.987806    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63b15286-47cd-49dd-a1e2-cc5e4f9eae9a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-a42101-7ffd868b8b-tgdbf\" (UID: \"63b15286-47cd-49dd-a1e2-cc5e4f9eae9a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a42101-7ffd868b8b-tgdbf"
Sep 16 01:43:18.994457 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:18.994427    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvr44\" (UniqueName: \"kubernetes.io/projected/63b15286-47cd-49dd-a1e2-cc5e4f9eae9a-kube-api-access-nvr44\") pod \"payload-pre-processing-e2e-ipp-b-a42101-7ffd868b8b-tgdbf\" (UID: \"63b15286-47cd-49dd-a1e2-cc5e4f9eae9a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a42101-7ffd868b8b-tgdbf"
Sep 16 01:43:19.116356 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:19.116255    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a42101-7ffd868b8b-tgdbf"
Sep 16 01:43:19.386659 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:19.386628    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-a42101-7ffd868b8b-tgdbf"]
Sep 16 01:43:19.388625 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:43:19.388594    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63b15286_47cd_49dd_a1e2_cc5e4f9eae9a.slice/crio-9f2fa9f92d0eb363f8af6fc4033e207d5500d99febf83b68728f9a2f486e8995 WatchSource:0}: Error finding container 9f2fa9f92d0eb363f8af6fc4033e207d5500d99febf83b68728f9a2f486e8995: Status 404 returned error can't find the container with id 9f2fa9f92d0eb363f8af6fc4033e207d5500d99febf83b68728f9a2f486e8995
Sep 16 01:43:19.498246 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:19.498214    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a42101-7ffd868b8b-tgdbf" event={"ID":"63b15286-47cd-49dd-a1e2-cc5e4f9eae9a","Type":"ContainerStarted","Data":"79db34be21f0a89af5fd1fc86cac5150f5c68d8961f39df9bf37189ec5c0dfbe"}
Sep 16 01:43:19.498428 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:19.498269    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a42101-7ffd868b8b-tgdbf" event={"ID":"63b15286-47cd-49dd-a1e2-cc5e4f9eae9a","Type":"ContainerStarted","Data":"9f2fa9f92d0eb363f8af6fc4033e207d5500d99febf83b68728f9a2f486e8995"}
Sep 16 01:43:19.498428 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:19.498354    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a42101-7ffd868b8b-tgdbf"
Sep 16 01:43:19.512207 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:19.512152    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a42101-7ffd868b8b-tgdbf" podStartSLOduration=1.512133257 podStartE2EDuration="1.512133257s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:43:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:43:19.511879414 +0000 UTC m=+1648.835347992" watchObservedRunningTime="2026-09-16 01:43:19.512133257 +0000 UTC m=+1648.835601836"
Sep 16 01:43:28.010984 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:28.010951    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-4e1413-7dc56cb5c8-dv2s4"]
Sep 16 01:43:28.013968 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:28.013946    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4e1413-7dc56cb5c8-dv2s4"
Sep 16 01:43:28.016509 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:28.016486    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-4e1413-dockercfg-skwbg\""
Sep 16 01:43:28.016509 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:28.016503    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-4e1413\""
Sep 16 01:43:28.025777 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:28.025754    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-4e1413-7dc56cb5c8-dv2s4"]
Sep 16 01:43:28.049915 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:28.049890    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-4e1413-69564c5dfc-h2bz7"]
Sep 16 01:43:28.052448 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:28.052427    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-4e1413-69564c5dfc-h2bz7"
Sep 16 01:43:28.064237 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:28.064216    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-4e1413-69564c5dfc-h2bz7"]
Sep 16 01:43:28.078228 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:28.078189    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4de07554-859e-4ac3-b8b6-38b78abb93b3-plugins-config-volume\") pod \"payload-processing-e2e-api-b-4e1413-69564c5dfc-h2bz7\" (UID: \"4de07554-859e-4ac3-b8b6-38b78abb93b3\") " pod="openshift-ingress/payload-processing-e2e-api-b-4e1413-69564c5dfc-h2bz7"
Sep 16 01:43:28.078425 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:28.078359    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szj42\" (UniqueName: \"kubernetes.io/projected/e05cb475-70b9-4f74-9263-bdbe0a3070b8-kube-api-access-szj42\") pod \"payload-pre-processing-e2e-api-b-4e1413-7dc56cb5c8-dv2s4\" (UID: \"e05cb475-70b9-4f74-9263-bdbe0a3070b8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-4e1413-7dc56cb5c8-dv2s4"
Sep 16 01:43:28.078520 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:28.078456    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e05cb475-70b9-4f74-9263-bdbe0a3070b8-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-4e1413-7dc56cb5c8-dv2s4\" (UID: \"e05cb475-70b9-4f74-9263-bdbe0a3070b8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-4e1413-7dc56cb5c8-dv2s4"
Sep 16 01:43:28.078520 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:28.078499    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djqnl\" (UniqueName: \"kubernetes.io/projected/4de07554-859e-4ac3-b8b6-38b78abb93b3-kube-api-access-djqnl\") pod \"payload-processing-e2e-api-b-4e1413-69564c5dfc-h2bz7\" (UID: \"4de07554-859e-4ac3-b8b6-38b78abb93b3\") " pod="openshift-ingress/payload-processing-e2e-api-b-4e1413-69564c5dfc-h2bz7"
Sep 16 01:43:28.179520 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:28.179478    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4de07554-859e-4ac3-b8b6-38b78abb93b3-plugins-config-volume\") pod \"payload-processing-e2e-api-b-4e1413-69564c5dfc-h2bz7\" (UID: \"4de07554-859e-4ac3-b8b6-38b78abb93b3\") " pod="openshift-ingress/payload-processing-e2e-api-b-4e1413-69564c5dfc-h2bz7"
Sep 16 01:43:28.179520 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:28.179524    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szj42\" (UniqueName: \"kubernetes.io/projected/e05cb475-70b9-4f74-9263-bdbe0a3070b8-kube-api-access-szj42\") pod \"payload-pre-processing-e2e-api-b-4e1413-7dc56cb5c8-dv2s4\" (UID: \"e05cb475-70b9-4f74-9263-bdbe0a3070b8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-4e1413-7dc56cb5c8-dv2s4"
Sep 16 01:43:28.179764 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:28.179563    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e05cb475-70b9-4f74-9263-bdbe0a3070b8-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-4e1413-7dc56cb5c8-dv2s4\" (UID: \"e05cb475-70b9-4f74-9263-bdbe0a3070b8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-4e1413-7dc56cb5c8-dv2s4"
Sep 16 01:43:28.179764 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:28.179589    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djqnl\" (UniqueName: \"kubernetes.io/projected/4de07554-859e-4ac3-b8b6-38b78abb93b3-kube-api-access-djqnl\") pod \"payload-processing-e2e-api-b-4e1413-69564c5dfc-h2bz7\" (UID: \"4de07554-859e-4ac3-b8b6-38b78abb93b3\") " pod="openshift-ingress/payload-processing-e2e-api-b-4e1413-69564c5dfc-h2bz7"
Sep 16 01:43:28.180271 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:28.180247    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4de07554-859e-4ac3-b8b6-38b78abb93b3-plugins-config-volume\") pod \"payload-processing-e2e-api-b-4e1413-69564c5dfc-h2bz7\" (UID: \"4de07554-859e-4ac3-b8b6-38b78abb93b3\") " pod="openshift-ingress/payload-processing-e2e-api-b-4e1413-69564c5dfc-h2bz7"
Sep 16 01:43:28.180271 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:28.180264    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e05cb475-70b9-4f74-9263-bdbe0a3070b8-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-4e1413-7dc56cb5c8-dv2s4\" (UID: \"e05cb475-70b9-4f74-9263-bdbe0a3070b8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-4e1413-7dc56cb5c8-dv2s4"
Sep 16 01:43:28.187327 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:28.187302    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szj42\" (UniqueName: \"kubernetes.io/projected/e05cb475-70b9-4f74-9263-bdbe0a3070b8-kube-api-access-szj42\") pod \"payload-pre-processing-e2e-api-b-4e1413-7dc56cb5c8-dv2s4\" (UID: \"e05cb475-70b9-4f74-9263-bdbe0a3070b8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-4e1413-7dc56cb5c8-dv2s4"
Sep 16 01:43:28.187480 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:28.187429    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djqnl\" (UniqueName: \"kubernetes.io/projected/4de07554-859e-4ac3-b8b6-38b78abb93b3-kube-api-access-djqnl\") pod \"payload-processing-e2e-api-b-4e1413-69564c5dfc-h2bz7\" (UID: \"4de07554-859e-4ac3-b8b6-38b78abb93b3\") " pod="openshift-ingress/payload-processing-e2e-api-b-4e1413-69564c5dfc-h2bz7"
Sep 16 01:43:28.325897 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:28.325798    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4e1413-7dc56cb5c8-dv2s4"
Sep 16 01:43:28.363035 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:28.363003    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-4e1413-69564c5dfc-h2bz7"
Sep 16 01:43:28.606855 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:28.606828    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-4e1413-7dc56cb5c8-dv2s4"]
Sep 16 01:43:28.608911 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:43:28.608880    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode05cb475_70b9_4f74_9263_bdbe0a3070b8.slice/crio-f2635b57c9cc621fe88521dc86e520847b97caae5964c5e3177938d80477165f WatchSource:0}: Error finding container f2635b57c9cc621fe88521dc86e520847b97caae5964c5e3177938d80477165f: Status 404 returned error can't find the container with id f2635b57c9cc621fe88521dc86e520847b97caae5964c5e3177938d80477165f
Sep 16 01:43:28.645410 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:28.645378    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-4e1413-69564c5dfc-h2bz7"]
Sep 16 01:43:28.646698 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:43:28.646669    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4de07554_859e_4ac3_b8b6_38b78abb93b3.slice/crio-86f0dc2cdeddbd96036a9b6a8389fbe5976b369294eae4e3aeddc1b323cc7b3d WatchSource:0}: Error finding container 86f0dc2cdeddbd96036a9b6a8389fbe5976b369294eae4e3aeddc1b323cc7b3d: Status 404 returned error can't find the container with id 86f0dc2cdeddbd96036a9b6a8389fbe5976b369294eae4e3aeddc1b323cc7b3d
Sep 16 01:43:29.555864 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:29.555745    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4e1413-7dc56cb5c8-dv2s4" event={"ID":"e05cb475-70b9-4f74-9263-bdbe0a3070b8","Type":"ContainerStarted","Data":"4518be857e3ae94666342c22ee16f3e1055cae50889b133706938f7d430a8fd0"}
Sep 16 01:43:29.555864 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:29.555813    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4e1413-7dc56cb5c8-dv2s4" event={"ID":"e05cb475-70b9-4f74-9263-bdbe0a3070b8","Type":"ContainerStarted","Data":"f2635b57c9cc621fe88521dc86e520847b97caae5964c5e3177938d80477165f"}
Sep 16 01:43:29.555864 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:29.555845    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4e1413-7dc56cb5c8-dv2s4"
Sep 16 01:43:29.557654 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:29.557628    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-4e1413-69564c5dfc-h2bz7" event={"ID":"4de07554-859e-4ac3-b8b6-38b78abb93b3","Type":"ContainerStarted","Data":"75be6859bdfe9563fc4d65954fe35748e9bcade7fdd01257d9a1c5edf4d2335b"}
Sep 16 01:43:29.557808 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:29.557669    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-4e1413-69564c5dfc-h2bz7" event={"ID":"4de07554-859e-4ac3-b8b6-38b78abb93b3","Type":"ContainerStarted","Data":"86f0dc2cdeddbd96036a9b6a8389fbe5976b369294eae4e3aeddc1b323cc7b3d"}
Sep 16 01:43:29.557808 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:29.557710    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-4e1413-69564c5dfc-h2bz7"
Sep 16 01:43:29.574232 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:29.574177    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4e1413-7dc56cb5c8-dv2s4" podStartSLOduration=2.574157047 podStartE2EDuration="2.574157047s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:43:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:43:29.570717418 +0000 UTC m=+1658.894185995" watchObservedRunningTime="2026-09-16 01:43:29.574157047 +0000 UTC m=+1658.897625625"
Sep 16 01:43:29.588989 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:29.588941    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-4e1413-69564c5dfc-h2bz7" podStartSLOduration=1.588929756 podStartE2EDuration="1.588929756s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:43:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:43:29.586660273 +0000 UTC m=+1658.910128850" watchObservedRunningTime="2026-09-16 01:43:29.588929756 +0000 UTC m=+1658.912398333"
Sep 16 01:43:30.508104 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:30.508073    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a42101-7ffd868b8b-tgdbf"
Sep 16 01:43:40.052917 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:40.052884    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5d7dbbd56b-4455c_6c67aa80-4f89-4425-8726-a2a63b6a3121/payload-processing/0.log"
Sep 16 01:43:40.179631 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:40.179594    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5d7dbbd56b-4455c_6c67aa80-4f89-4425-8726-a2a63b6a3121/payload-processing/0.log"
Sep 16 01:43:40.566935 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:40.566901    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4e1413-7dc56cb5c8-dv2s4"
Sep 16 01:43:40.567153 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:40.567098    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-4e1413-69564c5dfc-h2bz7"
Sep 16 01:43:51.487779 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:51.487739    2565 scope.go:117] "RemoveContainer" containerID="0f70a2305905020a7d1dcf0602459a3b093ac9e0f2072e092d1b85c515806077"
Sep 16 01:43:55.129875 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:55.129833    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7d0959-z9nb7"]
Sep 16 01:43:55.132715 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:55.132696    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7d0959-z9nb7"
Sep 16 01:43:55.135238 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:55.135198    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 01:43:55.135400 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:55.135276    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4ljjd\""
Sep 16 01:43:55.140823 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:55.140798    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7d0959-z9nb7"]
Sep 16 01:43:55.251292 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:55.251243    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e4d0c2d-c4b3-4a35-b4ec-f8811612d740-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-7d0959-z9nb7\" (UID: \"1e4d0c2d-c4b3-4a35-b4ec-f8811612d740\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7d0959-z9nb7"
Sep 16 01:43:55.352034 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:55.351990    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e4d0c2d-c4b3-4a35-b4ec-f8811612d740-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-7d0959-z9nb7\" (UID: \"1e4d0c2d-c4b3-4a35-b4ec-f8811612d740\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7d0959-z9nb7"
Sep 16 01:43:55.352639 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:55.352618    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e4d0c2d-c4b3-4a35-b4ec-f8811612d740-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-7d0959-z9nb7\" (UID: \"1e4d0c2d-c4b3-4a35-b4ec-f8811612d740\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7d0959-z9nb7"
Sep 16 01:43:55.446078 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:55.446018    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7d0959-z9nb7"
Sep 16 01:43:55.720684 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:55.720656    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7d0959-z9nb7"]
Sep 16 01:43:55.722407 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:43:55.722368    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e4d0c2d_c4b3_4a35_b4ec_f8811612d740.slice/crio-67414300a52a4226d9fb16bbd0308d780b0a9327aacb306a29534251f50b5a49 WatchSource:0}: Error finding container 67414300a52a4226d9fb16bbd0308d780b0a9327aacb306a29534251f50b5a49: Status 404 returned error can't find the container with id 67414300a52a4226d9fb16bbd0308d780b0a9327aacb306a29534251f50b5a49
Sep 16 01:43:56.714513 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:56.714413    2565 generic.go:356] "Generic (PLEG): container finished" podID="1e4d0c2d-c4b3-4a35-b4ec-f8811612d740" containerID="6c1accfea06f582b933ba39ef8bc8894fe5df2a3d66e57b5a0d2f07419159793" exitCode=0
Sep 16 01:43:56.714869 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:56.714503    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7d0959-z9nb7" event={"ID":"1e4d0c2d-c4b3-4a35-b4ec-f8811612d740","Type":"ContainerDied","Data":"6c1accfea06f582b933ba39ef8bc8894fe5df2a3d66e57b5a0d2f07419159793"}
Sep 16 01:43:56.714869 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:56.714565    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7d0959-z9nb7" event={"ID":"1e4d0c2d-c4b3-4a35-b4ec-f8811612d740","Type":"ContainerStarted","Data":"67414300a52a4226d9fb16bbd0308d780b0a9327aacb306a29534251f50b5a49"}
Sep 16 01:43:57.853118 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:57.853092    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7d0959-z9nb7"
Sep 16 01:43:57.978980 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:57.978893    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e4d0c2d-c4b3-4a35-b4ec-f8811612d740-maas-api-service-ca\") pod \"1e4d0c2d-c4b3-4a35-b4ec-f8811612d740\" (UID: \"1e4d0c2d-c4b3-4a35-b4ec-f8811612d740\") "
Sep 16 01:43:57.979280 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:57.979257    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e4d0c2d-c4b3-4a35-b4ec-f8811612d740-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1e4d0c2d-c4b3-4a35-b4ec-f8811612d740" (UID: "1e4d0c2d-c4b3-4a35-b4ec-f8811612d740"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:43:58.079803 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:58.079764    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e4d0c2d-c4b3-4a35-b4ec-f8811612d740-maas-api-service-ca\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:43:58.726863 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:58.726833    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7d0959-z9nb7"
Sep 16 01:43:58.727070 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:58.726877    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7d0959-z9nb7" event={"ID":"1e4d0c2d-c4b3-4a35-b4ec-f8811612d740","Type":"ContainerDied","Data":"67414300a52a4226d9fb16bbd0308d780b0a9327aacb306a29534251f50b5a49"}
Sep 16 01:43:58.727070 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:43:58.726930    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="67414300a52a4226d9fb16bbd0308d780b0a9327aacb306a29534251f50b5a49"
Sep 16 01:44:07.163893 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:07.163852    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-processing-5d7dbbd56b-4455c" secret="" err="secret \"payload-processing-dockercfg-kkbcm\" not found"
Sep 16 01:44:10.837047 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:10.837007    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-7d0959-58f8bfc4d7-bqznw"]
Sep 16 01:44:10.837565 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:10.837266    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-7d0959-58f8bfc4d7-bqznw" podUID="dbd54817-26da-4dae-9af0-0d0bad587400" containerName="payload-processing" containerID="cri-o://5963bf056d0944be3b4ad469cac1a2427c762d3cdd79470c8d3e88d8ccb906b4" gracePeriod=30
Sep 16 01:44:10.991050 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:10.991013    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7d0959-z9nb7"]
Sep 16 01:44:10.993824 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:10.993798    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7d0959-z9nb7"]
Sep 16 01:44:11.099248 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:11.099173    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-7d0959-58f8bfc4d7-bqznw"
Sep 16 01:44:11.113641 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:11.113560    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dbd54817-26da-4dae-9af0-0d0bad587400-plugins-config-volume\") pod \"dbd54817-26da-4dae-9af0-0d0bad587400\" (UID: \"dbd54817-26da-4dae-9af0-0d0bad587400\") "
Sep 16 01:44:11.113856 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:11.113664    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k4jq5\" (UniqueName: \"kubernetes.io/projected/dbd54817-26da-4dae-9af0-0d0bad587400-kube-api-access-k4jq5\") pod \"dbd54817-26da-4dae-9af0-0d0bad587400\" (UID: \"dbd54817-26da-4dae-9af0-0d0bad587400\") "
Sep 16 01:44:11.115787 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:11.115532    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbd54817-26da-4dae-9af0-0d0bad587400-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "dbd54817-26da-4dae-9af0-0d0bad587400" (UID: "dbd54817-26da-4dae-9af0-0d0bad587400"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:44:11.116412 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:11.116381    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbd54817-26da-4dae-9af0-0d0bad587400-kube-api-access-k4jq5" (OuterVolumeSpecName: "kube-api-access-k4jq5") pod "dbd54817-26da-4dae-9af0-0d0bad587400" (UID: "dbd54817-26da-4dae-9af0-0d0bad587400"). InnerVolumeSpecName "kube-api-access-k4jq5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:44:11.170747 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:11.165683    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-6cd864bc95-st4pq" secret="" err="secret \"payload-processing-dockercfg-kkbcm\" not found"
Sep 16 01:44:11.181791 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:11.181468    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e4d0c2d-c4b3-4a35-b4ec-f8811612d740" path="/var/lib/kubelet/pods/1e4d0c2d-c4b3-4a35-b4ec-f8811612d740/volumes"
Sep 16 01:44:11.214932 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:11.214892    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dbd54817-26da-4dae-9af0-0d0bad587400-plugins-config-volume\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:44:11.214932 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:11.214930    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4jq5\" (UniqueName: \"kubernetes.io/projected/dbd54817-26da-4dae-9af0-0d0bad587400-kube-api-access-k4jq5\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:44:11.802168 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:11.802132    2565 generic.go:356] "Generic (PLEG): container finished" podID="dbd54817-26da-4dae-9af0-0d0bad587400" containerID="5963bf056d0944be3b4ad469cac1a2427c762d3cdd79470c8d3e88d8ccb906b4" exitCode=0
Sep 16 01:44:11.802408 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:11.802177    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-7d0959-58f8bfc4d7-bqznw"
Sep 16 01:44:11.802408 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:11.802215    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-7d0959-58f8bfc4d7-bqznw" event={"ID":"dbd54817-26da-4dae-9af0-0d0bad587400","Type":"ContainerDied","Data":"5963bf056d0944be3b4ad469cac1a2427c762d3cdd79470c8d3e88d8ccb906b4"}
Sep 16 01:44:11.802408 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:11.802269    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-7d0959-58f8bfc4d7-bqznw" event={"ID":"dbd54817-26da-4dae-9af0-0d0bad587400","Type":"ContainerDied","Data":"963b2103d3091b6097457764fd6fc3421f8298dcd0cff2630254286ed382e4b2"}
Sep 16 01:44:11.802408 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:11.802293    2565 scope.go:117] "RemoveContainer" containerID="5963bf056d0944be3b4ad469cac1a2427c762d3cdd79470c8d3e88d8ccb906b4"
Sep 16 01:44:11.811805 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:11.811787    2565 scope.go:117] "RemoveContainer" containerID="5963bf056d0944be3b4ad469cac1a2427c762d3cdd79470c8d3e88d8ccb906b4"
Sep 16 01:44:11.812106 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:44:11.812088    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5963bf056d0944be3b4ad469cac1a2427c762d3cdd79470c8d3e88d8ccb906b4\": container with ID starting with 5963bf056d0944be3b4ad469cac1a2427c762d3cdd79470c8d3e88d8ccb906b4 not found: ID does not exist" containerID="5963bf056d0944be3b4ad469cac1a2427c762d3cdd79470c8d3e88d8ccb906b4"
Sep 16 01:44:11.812171 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:11.812116    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5963bf056d0944be3b4ad469cac1a2427c762d3cdd79470c8d3e88d8ccb906b4"} err="failed to get container status \"5963bf056d0944be3b4ad469cac1a2427c762d3cdd79470c8d3e88d8ccb906b4\": rpc error: code = NotFound desc = could not find container \"5963bf056d0944be3b4ad469cac1a2427c762d3cdd79470c8d3e88d8ccb906b4\": container with ID starting with 5963bf056d0944be3b4ad469cac1a2427c762d3cdd79470c8d3e88d8ccb906b4 not found: ID does not exist"
Sep 16 01:44:11.818255 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:11.818220    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-7d0959-58f8bfc4d7-bqznw"]
Sep 16 01:44:11.820289 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:11.820265    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-7d0959-58f8bfc4d7-bqznw"]
Sep 16 01:44:13.170639 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:13.170599    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbd54817-26da-4dae-9af0-0d0bad587400" path="/var/lib/kubelet/pods/dbd54817-26da-4dae-9af0-0d0bad587400/volumes"
Sep 16 01:44:17.812391 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:17.812353    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4e1413-p6r2d"]
Sep 16 01:44:17.812874 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:17.812854    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbd54817-26da-4dae-9af0-0d0bad587400" containerName="payload-processing"
Sep 16 01:44:17.812925 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:17.812876    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbd54817-26da-4dae-9af0-0d0bad587400" containerName="payload-processing"
Sep 16 01:44:17.812925 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:17.812900    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e4d0c2d-c4b3-4a35-b4ec-f8811612d740" containerName="revoke-keys"
Sep 16 01:44:17.812925 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:17.812906    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e4d0c2d-c4b3-4a35-b4ec-f8811612d740" containerName="revoke-keys"
Sep 16 01:44:17.813042 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:17.812982    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e4d0c2d-c4b3-4a35-b4ec-f8811612d740" containerName="revoke-keys"
Sep 16 01:44:17.813042 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:17.812991    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbd54817-26da-4dae-9af0-0d0bad587400" containerName="payload-processing"
Sep 16 01:44:17.815995 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:17.815976    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4e1413-p6r2d"
Sep 16 01:44:17.818534 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:17.818517    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 01:44:17.818615 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:17.818527    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4ljjd\""
Sep 16 01:44:17.831845 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:17.831812    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4e1413-p6r2d"]
Sep 16 01:44:17.875799 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:17.875758    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd0913b6-5d96-4f33-8d32-c4b0b07540f3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-4e1413-p6r2d\" (UID: \"bd0913b6-5d96-4f33-8d32-c4b0b07540f3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4e1413-p6r2d"
Sep 16 01:44:17.976862 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:17.976820    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd0913b6-5d96-4f33-8d32-c4b0b07540f3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-4e1413-p6r2d\" (UID: \"bd0913b6-5d96-4f33-8d32-c4b0b07540f3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4e1413-p6r2d"
Sep 16 01:44:17.977575 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:17.977547    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd0913b6-5d96-4f33-8d32-c4b0b07540f3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-4e1413-p6r2d\" (UID: \"bd0913b6-5d96-4f33-8d32-c4b0b07540f3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4e1413-p6r2d"
Sep 16 01:44:18.126313 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:18.126210    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4e1413-p6r2d"
Sep 16 01:44:18.402695 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:18.402664    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4e1413-p6r2d"]
Sep 16 01:44:18.405018 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:44:18.404991    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd0913b6_5d96_4f33_8d32_c4b0b07540f3.slice/crio-ed14791188c98c25838ded1ad1f1b0fcd8a1af4103ca390a15f37bef07687d73 WatchSource:0}: Error finding container ed14791188c98c25838ded1ad1f1b0fcd8a1af4103ca390a15f37bef07687d73: Status 404 returned error can't find the container with id ed14791188c98c25838ded1ad1f1b0fcd8a1af4103ca390a15f37bef07687d73
Sep 16 01:44:18.843791 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:18.843749    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4e1413-p6r2d" event={"ID":"bd0913b6-5d96-4f33-8d32-c4b0b07540f3","Type":"ContainerStarted","Data":"93d478b0fc9fb02fb10c8e801de5d12a6dc2dcc94b4a4f291ed46aa31a308b12"}
Sep 16 01:44:18.844162 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:18.843819    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4e1413-p6r2d" event={"ID":"bd0913b6-5d96-4f33-8d32-c4b0b07540f3","Type":"ContainerStarted","Data":"ed14791188c98c25838ded1ad1f1b0fcd8a1af4103ca390a15f37bef07687d73"}
Sep 16 01:44:18.857864 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:18.857777    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4e1413-p6r2d" podStartSLOduration=1.857757044 podStartE2EDuration="1.857757044s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:44:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:44:18.857238035 +0000 UTC m=+1708.180706614" watchObservedRunningTime="2026-09-16 01:44:18.857757044 +0000 UTC m=+1708.181225623"
Sep 16 01:44:19.851192 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:19.851156    2565 generic.go:356] "Generic (PLEG): container finished" podID="bd0913b6-5d96-4f33-8d32-c4b0b07540f3" containerID="93d478b0fc9fb02fb10c8e801de5d12a6dc2dcc94b4a4f291ed46aa31a308b12" exitCode=0
Sep 16 01:44:19.851585 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:19.851245    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4e1413-p6r2d" event={"ID":"bd0913b6-5d96-4f33-8d32-c4b0b07540f3","Type":"ContainerDied","Data":"93d478b0fc9fb02fb10c8e801de5d12a6dc2dcc94b4a4f291ed46aa31a308b12"}
Sep 16 01:44:20.994111 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:20.994084    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4e1413-p6r2d"
Sep 16 01:44:21.112713 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:21.112626    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd0913b6-5d96-4f33-8d32-c4b0b07540f3-maas-api-service-ca\") pod \"bd0913b6-5d96-4f33-8d32-c4b0b07540f3\" (UID: \"bd0913b6-5d96-4f33-8d32-c4b0b07540f3\") "
Sep 16 01:44:21.113013 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:21.112987    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd0913b6-5d96-4f33-8d32-c4b0b07540f3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bd0913b6-5d96-4f33-8d32-c4b0b07540f3" (UID: "bd0913b6-5d96-4f33-8d32-c4b0b07540f3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:44:21.214180 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:21.214136    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd0913b6-5d96-4f33-8d32-c4b0b07540f3-maas-api-service-ca\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:44:21.863516 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:21.863481    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4e1413-p6r2d"
Sep 16 01:44:21.863704 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:21.863510    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4e1413-p6r2d" event={"ID":"bd0913b6-5d96-4f33-8d32-c4b0b07540f3","Type":"ContainerDied","Data":"ed14791188c98c25838ded1ad1f1b0fcd8a1af4103ca390a15f37bef07687d73"}
Sep 16 01:44:21.863704 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:21.863567    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ed14791188c98c25838ded1ad1f1b0fcd8a1af4103ca390a15f37bef07687d73"
Sep 16 01:44:26.061798 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:26.061744    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-8d230b-5c8bf9cb4c-ctjr5_def1a514-7c74-4788-a673-6c523d029b57/payload-processing/0.log"
Sep 16 01:44:26.190514 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:26.190484    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5d7dbbd56b-4455c_6c67aa80-4f89-4425-8726-a2a63b6a3121/payload-processing/0.log"
Sep 16 01:44:26.308949 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:26.308911    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5d7dbbd56b-4455c_6c67aa80-4f89-4425-8726-a2a63b6a3121/payload-processing/0.log"
Sep 16 01:44:30.394516 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:30.394466    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-4e1413-69564c5dfc-h2bz7"]
Sep 16 01:44:30.395716 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:30.395681    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-4e1413-69564c5dfc-h2bz7" podUID="4de07554-859e-4ac3-b8b6-38b78abb93b3" containerName="payload-processing" containerID="cri-o://75be6859bdfe9563fc4d65954fe35748e9bcade7fdd01257d9a1c5edf4d2335b" gracePeriod=30
Sep 16 01:44:30.401641 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:30.401168    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-4e1413-7dc56cb5c8-dv2s4"]
Sep 16 01:44:30.401845 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:30.401791    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4e1413-7dc56cb5c8-dv2s4" podUID="e05cb475-70b9-4f74-9263-bdbe0a3070b8" containerName="payload-pre-processing" containerID="cri-o://4518be857e3ae94666342c22ee16f3e1055cae50889b133706938f7d430a8fd0" gracePeriod=30
Sep 16 01:44:30.564738 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:30.564696    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4e1413-7dc56cb5c8-dv2s4" podUID="e05cb475-70b9-4f74-9263-bdbe0a3070b8" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.133.0.85:9004: connect: connection refused"
Sep 16 01:44:30.564933 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:30.564696    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-api-b-4e1413-69564c5dfc-h2bz7" podUID="4de07554-859e-4ac3-b8b6-38b78abb93b3" containerName="payload-processing" probeResult="failure" output="dial tcp 10.133.0.86:9004: connect: connection refused"
Sep 16 01:44:30.689369 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:30.689328    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-4e1413-69564c5dfc-h2bz7"
Sep 16 01:44:30.723759 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:30.723733    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4e1413-7dc56cb5c8-dv2s4"
Sep 16 01:44:30.740049 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:30.740017    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4e1413-p6r2d"]
Sep 16 01:44:30.742015 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:30.741992    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4e1413-p6r2d"]
Sep 16 01:44:30.814730 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:30.814693    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4de07554-859e-4ac3-b8b6-38b78abb93b3-plugins-config-volume\") pod \"4de07554-859e-4ac3-b8b6-38b78abb93b3\" (UID: \"4de07554-859e-4ac3-b8b6-38b78abb93b3\") "
Sep 16 01:44:30.814730 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:30.814732    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e05cb475-70b9-4f74-9263-bdbe0a3070b8-plugins-config-volume\") pod \"e05cb475-70b9-4f74-9263-bdbe0a3070b8\" (UID: \"e05cb475-70b9-4f74-9263-bdbe0a3070b8\") "
Sep 16 01:44:30.814986 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:30.814762    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djqnl\" (UniqueName: \"kubernetes.io/projected/4de07554-859e-4ac3-b8b6-38b78abb93b3-kube-api-access-djqnl\") pod \"4de07554-859e-4ac3-b8b6-38b78abb93b3\" (UID: \"4de07554-859e-4ac3-b8b6-38b78abb93b3\") "
Sep 16 01:44:30.814986 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:30.814837    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-szj42\" (UniqueName: \"kubernetes.io/projected/e05cb475-70b9-4f74-9263-bdbe0a3070b8-kube-api-access-szj42\") pod \"e05cb475-70b9-4f74-9263-bdbe0a3070b8\" (UID: \"e05cb475-70b9-4f74-9263-bdbe0a3070b8\") "
Sep 16 01:44:30.815415 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:30.815148    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4de07554-859e-4ac3-b8b6-38b78abb93b3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4de07554-859e-4ac3-b8b6-38b78abb93b3" (UID: "4de07554-859e-4ac3-b8b6-38b78abb93b3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:44:30.815415 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:30.815299    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e05cb475-70b9-4f74-9263-bdbe0a3070b8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e05cb475-70b9-4f74-9263-bdbe0a3070b8" (UID: "e05cb475-70b9-4f74-9263-bdbe0a3070b8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:44:30.815415 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:30.815322    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4de07554-859e-4ac3-b8b6-38b78abb93b3-plugins-config-volume\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:44:30.817007 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:30.816982    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e05cb475-70b9-4f74-9263-bdbe0a3070b8-kube-api-access-szj42" (OuterVolumeSpecName: "kube-api-access-szj42") pod "e05cb475-70b9-4f74-9263-bdbe0a3070b8" (UID: "e05cb475-70b9-4f74-9263-bdbe0a3070b8"). InnerVolumeSpecName "kube-api-access-szj42". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:44:30.817089 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:30.817054    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4de07554-859e-4ac3-b8b6-38b78abb93b3-kube-api-access-djqnl" (OuterVolumeSpecName: "kube-api-access-djqnl") pod "4de07554-859e-4ac3-b8b6-38b78abb93b3" (UID: "4de07554-859e-4ac3-b8b6-38b78abb93b3"). InnerVolumeSpecName "kube-api-access-djqnl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:44:30.914677 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:30.914636    2565 generic.go:356] "Generic (PLEG): container finished" podID="e05cb475-70b9-4f74-9263-bdbe0a3070b8" containerID="4518be857e3ae94666342c22ee16f3e1055cae50889b133706938f7d430a8fd0" exitCode=0
Sep 16 01:44:30.914878 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:30.914685    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4e1413-7dc56cb5c8-dv2s4"
Sep 16 01:44:30.914878 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:30.914734    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4e1413-7dc56cb5c8-dv2s4" event={"ID":"e05cb475-70b9-4f74-9263-bdbe0a3070b8","Type":"ContainerDied","Data":"4518be857e3ae94666342c22ee16f3e1055cae50889b133706938f7d430a8fd0"}
Sep 16 01:44:30.914878 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:30.914805    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4e1413-7dc56cb5c8-dv2s4" event={"ID":"e05cb475-70b9-4f74-9263-bdbe0a3070b8","Type":"ContainerDied","Data":"f2635b57c9cc621fe88521dc86e520847b97caae5964c5e3177938d80477165f"}
Sep 16 01:44:30.914878 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:30.914836    2565 scope.go:117] "RemoveContainer" containerID="4518be857e3ae94666342c22ee16f3e1055cae50889b133706938f7d430a8fd0"
Sep 16 01:44:30.915968 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:30.915935    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e05cb475-70b9-4f74-9263-bdbe0a3070b8-plugins-config-volume\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:44:30.915968 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:30.915960    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djqnl\" (UniqueName: \"kubernetes.io/projected/4de07554-859e-4ac3-b8b6-38b78abb93b3-kube-api-access-djqnl\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:44:30.915968 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:30.915970    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-szj42\" (UniqueName: \"kubernetes.io/projected/e05cb475-70b9-4f74-9263-bdbe0a3070b8-kube-api-access-szj42\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:44:30.916430 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:30.916392    2565 generic.go:356] "Generic (PLEG): container finished" podID="4de07554-859e-4ac3-b8b6-38b78abb93b3" containerID="75be6859bdfe9563fc4d65954fe35748e9bcade7fdd01257d9a1c5edf4d2335b" exitCode=0
Sep 16 01:44:30.916574 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:30.916433    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-4e1413-69564c5dfc-h2bz7"
Sep 16 01:44:30.916574 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:30.916459    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-4e1413-69564c5dfc-h2bz7" event={"ID":"4de07554-859e-4ac3-b8b6-38b78abb93b3","Type":"ContainerDied","Data":"75be6859bdfe9563fc4d65954fe35748e9bcade7fdd01257d9a1c5edf4d2335b"}
Sep 16 01:44:30.916574 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:30.916519    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-4e1413-69564c5dfc-h2bz7" event={"ID":"4de07554-859e-4ac3-b8b6-38b78abb93b3","Type":"ContainerDied","Data":"86f0dc2cdeddbd96036a9b6a8389fbe5976b369294eae4e3aeddc1b323cc7b3d"}
Sep 16 01:44:30.925316 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:30.925083    2565 scope.go:117] "RemoveContainer" containerID="4518be857e3ae94666342c22ee16f3e1055cae50889b133706938f7d430a8fd0"
Sep 16 01:44:30.925666 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:44:30.925531    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4518be857e3ae94666342c22ee16f3e1055cae50889b133706938f7d430a8fd0\": container with ID starting with 4518be857e3ae94666342c22ee16f3e1055cae50889b133706938f7d430a8fd0 not found: ID does not exist" containerID="4518be857e3ae94666342c22ee16f3e1055cae50889b133706938f7d430a8fd0"
Sep 16 01:44:30.925666 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:30.925569    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4518be857e3ae94666342c22ee16f3e1055cae50889b133706938f7d430a8fd0"} err="failed to get container status \"4518be857e3ae94666342c22ee16f3e1055cae50889b133706938f7d430a8fd0\": rpc error: code = NotFound desc = could not find container \"4518be857e3ae94666342c22ee16f3e1055cae50889b133706938f7d430a8fd0\": container with ID starting with 4518be857e3ae94666342c22ee16f3e1055cae50889b133706938f7d430a8fd0 not found: ID does not exist"
Sep 16 01:44:30.925666 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:30.925591    2565 scope.go:117] "RemoveContainer" containerID="75be6859bdfe9563fc4d65954fe35748e9bcade7fdd01257d9a1c5edf4d2335b"
Sep 16 01:44:30.935765 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:30.935749    2565 scope.go:117] "RemoveContainer" containerID="75be6859bdfe9563fc4d65954fe35748e9bcade7fdd01257d9a1c5edf4d2335b"
Sep 16 01:44:30.936020 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:44:30.936004    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75be6859bdfe9563fc4d65954fe35748e9bcade7fdd01257d9a1c5edf4d2335b\": container with ID starting with 75be6859bdfe9563fc4d65954fe35748e9bcade7fdd01257d9a1c5edf4d2335b not found: ID does not exist" containerID="75be6859bdfe9563fc4d65954fe35748e9bcade7fdd01257d9a1c5edf4d2335b"
Sep 16 01:44:30.936089 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:30.936024    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75be6859bdfe9563fc4d65954fe35748e9bcade7fdd01257d9a1c5edf4d2335b"} err="failed to get container status \"75be6859bdfe9563fc4d65954fe35748e9bcade7fdd01257d9a1c5edf4d2335b\": rpc error: code = NotFound desc = could not find container \"75be6859bdfe9563fc4d65954fe35748e9bcade7fdd01257d9a1c5edf4d2335b\": container with ID starting with 75be6859bdfe9563fc4d65954fe35748e9bcade7fdd01257d9a1c5edf4d2335b not found: ID does not exist"
Sep 16 01:44:30.946101 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:30.946076    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-4e1413-7dc56cb5c8-dv2s4"]
Sep 16 01:44:30.951627 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:30.951605    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-4e1413-7dc56cb5c8-dv2s4"]
Sep 16 01:44:30.960342 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:30.960312    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-4e1413-69564c5dfc-h2bz7"]
Sep 16 01:44:30.963717 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:30.963693    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-4e1413-69564c5dfc-h2bz7"]
Sep 16 01:44:31.170348 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:31.170258    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4de07554-859e-4ac3-b8b6-38b78abb93b3" path="/var/lib/kubelet/pods/4de07554-859e-4ac3-b8b6-38b78abb93b3/volumes"
Sep 16 01:44:31.170642 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:31.170629    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd0913b6-5d96-4f33-8d32-c4b0b07540f3" path="/var/lib/kubelet/pods/bd0913b6-5d96-4f33-8d32-c4b0b07540f3/volumes"
Sep 16 01:44:31.170945 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:31.170933    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e05cb475-70b9-4f74-9263-bdbe0a3070b8" path="/var/lib/kubelet/pods/e05cb475-70b9-4f74-9263-bdbe0a3070b8/volumes"
Sep 16 01:44:35.019137 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:35.019098    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f73a36-58c64c5bcd-p5vws"]
Sep 16 01:44:35.019547 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:35.019526    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd0913b6-5d96-4f33-8d32-c4b0b07540f3" containerName="revoke-keys"
Sep 16 01:44:35.019547 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:35.019538    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd0913b6-5d96-4f33-8d32-c4b0b07540f3" containerName="revoke-keys"
Sep 16 01:44:35.019547 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:35.019548    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e05cb475-70b9-4f74-9263-bdbe0a3070b8" containerName="payload-pre-processing"
Sep 16 01:44:35.019652 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:35.019553    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e05cb475-70b9-4f74-9263-bdbe0a3070b8" containerName="payload-pre-processing"
Sep 16 01:44:35.019652 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:35.019562    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4de07554-859e-4ac3-b8b6-38b78abb93b3" containerName="payload-processing"
Sep 16 01:44:35.019652 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:35.019568    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4de07554-859e-4ac3-b8b6-38b78abb93b3" containerName="payload-processing"
Sep 16 01:44:35.019652 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:35.019638    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e05cb475-70b9-4f74-9263-bdbe0a3070b8" containerName="payload-pre-processing"
Sep 16 01:44:35.019652 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:35.019646    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4de07554-859e-4ac3-b8b6-38b78abb93b3" containerName="payload-processing"
Sep 16 01:44:35.019652 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:35.019654    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd0913b6-5d96-4f33-8d32-c4b0b07540f3" containerName="revoke-keys"
Sep 16 01:44:35.024186 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:35.024162    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f73a36-58c64c5bcd-p5vws"
Sep 16 01:44:35.026449 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:35.026421    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-f73a36\""
Sep 16 01:44:35.026572 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:35.026453    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-f73a36-dockercfg-v5r9c\""
Sep 16 01:44:35.033210 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:35.033185    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f73a36-58c64c5bcd-p5vws"]
Sep 16 01:44:35.059553 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:35.059521    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-f73a36-64c867f7f-5r4jq"]
Sep 16 01:44:35.063181 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:35.063162    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f73a36-64c867f7f-5r4jq"
Sep 16 01:44:35.072272 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:35.072244    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-f73a36-64c867f7f-5r4jq"]
Sep 16 01:44:35.159281 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:35.159235    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgjf4\" (UniqueName: \"kubernetes.io/projected/24808b82-6a76-4697-a33c-a6d48deb960a-kube-api-access-zgjf4\") pod \"payload-pre-processing-e2e-ipp-cleanup-f73a36-58c64c5bcd-p5vws\" (UID: \"24808b82-6a76-4697-a33c-a6d48deb960a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f73a36-58c64c5bcd-p5vws"
Sep 16 01:44:35.159491 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:35.159292    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7jrs\" (UniqueName: \"kubernetes.io/projected/624281d6-9174-4107-80a7-320782f096ff-kube-api-access-q7jrs\") pod \"payload-processing-e2e-ipp-cleanup-f73a36-64c867f7f-5r4jq\" (UID: \"624281d6-9174-4107-80a7-320782f096ff\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f73a36-64c867f7f-5r4jq"
Sep 16 01:44:35.159491 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:35.159321    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24808b82-6a76-4697-a33c-a6d48deb960a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-f73a36-58c64c5bcd-p5vws\" (UID: \"24808b82-6a76-4697-a33c-a6d48deb960a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f73a36-58c64c5bcd-p5vws"
Sep 16 01:44:35.159491 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:35.159417    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/624281d6-9174-4107-80a7-320782f096ff-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-f73a36-64c867f7f-5r4jq\" (UID: \"624281d6-9174-4107-80a7-320782f096ff\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f73a36-64c867f7f-5r4jq"
Sep 16 01:44:35.260453 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:35.260416    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7jrs\" (UniqueName: \"kubernetes.io/projected/624281d6-9174-4107-80a7-320782f096ff-kube-api-access-q7jrs\") pod \"payload-processing-e2e-ipp-cleanup-f73a36-64c867f7f-5r4jq\" (UID: \"624281d6-9174-4107-80a7-320782f096ff\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f73a36-64c867f7f-5r4jq"
Sep 16 01:44:35.260453 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:35.260462    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24808b82-6a76-4697-a33c-a6d48deb960a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-f73a36-58c64c5bcd-p5vws\" (UID: \"24808b82-6a76-4697-a33c-a6d48deb960a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f73a36-58c64c5bcd-p5vws"
Sep 16 01:44:35.260698 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:35.260522    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/624281d6-9174-4107-80a7-320782f096ff-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-f73a36-64c867f7f-5r4jq\" (UID: \"624281d6-9174-4107-80a7-320782f096ff\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f73a36-64c867f7f-5r4jq"
Sep 16 01:44:35.260698 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:35.260604    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgjf4\" (UniqueName: \"kubernetes.io/projected/24808b82-6a76-4697-a33c-a6d48deb960a-kube-api-access-zgjf4\") pod \"payload-pre-processing-e2e-ipp-cleanup-f73a36-58c64c5bcd-p5vws\" (UID: \"24808b82-6a76-4697-a33c-a6d48deb960a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f73a36-58c64c5bcd-p5vws"
Sep 16 01:44:35.261369 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:35.261317    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24808b82-6a76-4697-a33c-a6d48deb960a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-f73a36-58c64c5bcd-p5vws\" (UID: \"24808b82-6a76-4697-a33c-a6d48deb960a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f73a36-58c64c5bcd-p5vws"
Sep 16 01:44:35.261432 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:35.261317    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/624281d6-9174-4107-80a7-320782f096ff-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-f73a36-64c867f7f-5r4jq\" (UID: \"624281d6-9174-4107-80a7-320782f096ff\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f73a36-64c867f7f-5r4jq"
Sep 16 01:44:35.270033 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:35.269954    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7jrs\" (UniqueName: \"kubernetes.io/projected/624281d6-9174-4107-80a7-320782f096ff-kube-api-access-q7jrs\") pod \"payload-processing-e2e-ipp-cleanup-f73a36-64c867f7f-5r4jq\" (UID: \"624281d6-9174-4107-80a7-320782f096ff\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f73a36-64c867f7f-5r4jq"
Sep 16 01:44:35.270033 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:35.269978    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgjf4\" (UniqueName: \"kubernetes.io/projected/24808b82-6a76-4697-a33c-a6d48deb960a-kube-api-access-zgjf4\") pod \"payload-pre-processing-e2e-ipp-cleanup-f73a36-58c64c5bcd-p5vws\" (UID: \"24808b82-6a76-4697-a33c-a6d48deb960a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f73a36-58c64c5bcd-p5vws"
Sep 16 01:44:35.335215 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:35.335171    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f73a36-58c64c5bcd-p5vws"
Sep 16 01:44:35.375940 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:35.375901    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f73a36-64c867f7f-5r4jq"
Sep 16 01:44:35.621309 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:35.621281    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f73a36-58c64c5bcd-p5vws"]
Sep 16 01:44:35.622511 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:44:35.622485    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24808b82_6a76_4697_a33c_a6d48deb960a.slice/crio-e0bd5607d2ec5dcca5a7f31e2fb277db8908b7336bd2785c856de61284f70d32 WatchSource:0}: Error finding container e0bd5607d2ec5dcca5a7f31e2fb277db8908b7336bd2785c856de61284f70d32: Status 404 returned error can't find the container with id e0bd5607d2ec5dcca5a7f31e2fb277db8908b7336bd2785c856de61284f70d32
Sep 16 01:44:35.657554 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:35.657529    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-f73a36-64c867f7f-5r4jq"]
Sep 16 01:44:35.659580 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:44:35.659557    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod624281d6_9174_4107_80a7_320782f096ff.slice/crio-1931996ef6f638323c867c08c9c6835e3d8b8754220534feef0667e86fd64b7d WatchSource:0}: Error finding container 1931996ef6f638323c867c08c9c6835e3d8b8754220534feef0667e86fd64b7d: Status 404 returned error can't find the container with id 1931996ef6f638323c867c08c9c6835e3d8b8754220534feef0667e86fd64b7d
Sep 16 01:44:35.950430 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:35.950385    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f73a36-58c64c5bcd-p5vws" event={"ID":"24808b82-6a76-4697-a33c-a6d48deb960a","Type":"ContainerStarted","Data":"ae3ad61c03b2c0a53891daee267464fd516409e6cf2b1884f16818e7229b50f8"}
Sep 16 01:44:35.950654 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:35.950449    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f73a36-58c64c5bcd-p5vws" event={"ID":"24808b82-6a76-4697-a33c-a6d48deb960a","Type":"ContainerStarted","Data":"e0bd5607d2ec5dcca5a7f31e2fb277db8908b7336bd2785c856de61284f70d32"}
Sep 16 01:44:35.950654 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:35.950570    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f73a36-58c64c5bcd-p5vws"
Sep 16 01:44:35.952296 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:35.952268    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f73a36-64c867f7f-5r4jq" event={"ID":"624281d6-9174-4107-80a7-320782f096ff","Type":"ContainerStarted","Data":"f7d8d1640312212695df279a7be16f9e3ed9026eb4d1e8530dd67debe942f60d"}
Sep 16 01:44:35.952451 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:35.952309    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f73a36-64c867f7f-5r4jq" event={"ID":"624281d6-9174-4107-80a7-320782f096ff","Type":"ContainerStarted","Data":"1931996ef6f638323c867c08c9c6835e3d8b8754220534feef0667e86fd64b7d"}
Sep 16 01:44:35.952451 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:35.952367    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f73a36-64c867f7f-5r4jq"
Sep 16 01:44:35.971389 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:35.971314    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f73a36-58c64c5bcd-p5vws" podStartSLOduration=0.971299549 podStartE2EDuration="971.299549ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:44:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:44:35.968510153 +0000 UTC m=+1725.291978735" watchObservedRunningTime="2026-09-16 01:44:35.971299549 +0000 UTC m=+1725.294768127"
Sep 16 01:44:35.983669 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:35.983618    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f73a36-64c867f7f-5r4jq" podStartSLOduration=0.983602905 podStartE2EDuration="983.602905ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:44:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:44:35.98293264 +0000 UTC m=+1725.306401217" watchObservedRunningTime="2026-09-16 01:44:35.983602905 +0000 UTC m=+1725.307071482"
Sep 16 01:44:38.062192 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:38.062153    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-4bc0fb-58rjh"]
Sep 16 01:44:38.066037 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:38.066012    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-4bc0fb-58rjh"
Sep 16 01:44:38.068232 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:38.068209    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 01:44:38.068379 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:38.068300    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4ljjd\""
Sep 16 01:44:38.072401 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:38.072378    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-4bc0fb-58rjh"]
Sep 16 01:44:38.189387 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:38.189320    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e130352a-563a-4732-b1b3-b0ff71ee2a90-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w1-4bc0fb-58rjh\" (UID: \"e130352a-563a-4732-b1b3-b0ff71ee2a90\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-4bc0fb-58rjh"
Sep 16 01:44:38.290528 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:38.290491    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e130352a-563a-4732-b1b3-b0ff71ee2a90-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w1-4bc0fb-58rjh\" (UID: \"e130352a-563a-4732-b1b3-b0ff71ee2a90\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-4bc0fb-58rjh"
Sep 16 01:44:38.291164 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:38.291143    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e130352a-563a-4732-b1b3-b0ff71ee2a90-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w1-4bc0fb-58rjh\" (UID: \"e130352a-563a-4732-b1b3-b0ff71ee2a90\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-4bc0fb-58rjh"
Sep 16 01:44:38.379656 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:38.379566    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-4bc0fb-58rjh"
Sep 16 01:44:38.664482 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:38.664448    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-4bc0fb-58rjh"]
Sep 16 01:44:38.666212 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:44:38.666176    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode130352a_563a_4732_b1b3_b0ff71ee2a90.slice/crio-dbb64953e042003d3b3919a659a2e6183282a14c725861017dfda83963e1c16d WatchSource:0}: Error finding container dbb64953e042003d3b3919a659a2e6183282a14c725861017dfda83963e1c16d: Status 404 returned error can't find the container with id dbb64953e042003d3b3919a659a2e6183282a14c725861017dfda83963e1c16d
Sep 16 01:44:38.971608 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:38.971574    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-4bc0fb-58rjh" event={"ID":"e130352a-563a-4732-b1b3-b0ff71ee2a90","Type":"ContainerStarted","Data":"e6da476d95c32b9a1c4d9ffb052301f56c32e8f908764893e63180f34e4585a1"}
Sep 16 01:44:38.971767 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:38.971636    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-4bc0fb-58rjh" event={"ID":"e130352a-563a-4732-b1b3-b0ff71ee2a90","Type":"ContainerStarted","Data":"dbb64953e042003d3b3919a659a2e6183282a14c725861017dfda83963e1c16d"}
Sep 16 01:44:38.986647 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:38.986594    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-4bc0fb-58rjh" podStartSLOduration=0.986576468 podStartE2EDuration="986.576468ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:44:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:44:38.983935442 +0000 UTC m=+1728.307404020" watchObservedRunningTime="2026-09-16 01:44:38.986576468 +0000 UTC m=+1728.310045045"
Sep 16 01:44:39.978855 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:39.978820    2565 generic.go:356] "Generic (PLEG): container finished" podID="e130352a-563a-4732-b1b3-b0ff71ee2a90" containerID="e6da476d95c32b9a1c4d9ffb052301f56c32e8f908764893e63180f34e4585a1" exitCode=0
Sep 16 01:44:39.979288 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:39.978903    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-4bc0fb-58rjh" event={"ID":"e130352a-563a-4732-b1b3-b0ff71ee2a90","Type":"ContainerDied","Data":"e6da476d95c32b9a1c4d9ffb052301f56c32e8f908764893e63180f34e4585a1"}
Sep 16 01:44:41.124550 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:41.124522    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-4bc0fb-58rjh"
Sep 16 01:44:41.225944 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:41.225907    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e130352a-563a-4732-b1b3-b0ff71ee2a90-maas-api-service-ca\") pod \"e130352a-563a-4732-b1b3-b0ff71ee2a90\" (UID: \"e130352a-563a-4732-b1b3-b0ff71ee2a90\") "
Sep 16 01:44:41.226327 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:41.226298    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e130352a-563a-4732-b1b3-b0ff71ee2a90-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e130352a-563a-4732-b1b3-b0ff71ee2a90" (UID: "e130352a-563a-4732-b1b3-b0ff71ee2a90"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:44:41.327807 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:41.327720    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e130352a-563a-4732-b1b3-b0ff71ee2a90-maas-api-service-ca\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:44:41.992051 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:41.992019    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-4bc0fb-58rjh"
Sep 16 01:44:41.992238 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:41.992018    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-4bc0fb-58rjh" event={"ID":"e130352a-563a-4732-b1b3-b0ff71ee2a90","Type":"ContainerDied","Data":"dbb64953e042003d3b3919a659a2e6183282a14c725861017dfda83963e1c16d"}
Sep 16 01:44:41.992238 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:41.992149    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dbb64953e042003d3b3919a659a2e6183282a14c725861017dfda83963e1c16d"
Sep 16 01:44:46.960759 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:46.960723    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f73a36-58c64c5bcd-p5vws"
Sep 16 01:44:46.961151 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:46.960813    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f73a36-64c867f7f-5r4jq"
Sep 16 01:44:48.820314 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:48.820280    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w1-4bc0fb-68cfb59b4b-wftkw"]
Sep 16 01:44:48.820777 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:48.820558    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-4bc0fb-68cfb59b4b-wftkw" podUID="3279b4cf-5e53-46f6-a93c-6f524902689f" containerName="payload-pre-processing" containerID="cri-o://7f15446bfd2157799d6f310750665039917d10a7189759827263a379354ba452" gracePeriod=30
Sep 16 01:44:48.957836 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:48.957803    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-4bc0fb-58rjh"]
Sep 16 01:44:48.960602 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:48.960561    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-4bc0fb-58rjh"]
Sep 16 01:44:49.039596 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:49.038937    2565 generic.go:356] "Generic (PLEG): container finished" podID="3279b4cf-5e53-46f6-a93c-6f524902689f" containerID="7f15446bfd2157799d6f310750665039917d10a7189759827263a379354ba452" exitCode=0
Sep 16 01:44:49.039596 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:49.038995    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-4bc0fb-68cfb59b4b-wftkw" event={"ID":"3279b4cf-5e53-46f6-a93c-6f524902689f","Type":"ContainerDied","Data":"7f15446bfd2157799d6f310750665039917d10a7189759827263a379354ba452"}
Sep 16 01:44:49.118400 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:49.118376    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-4bc0fb-68cfb59b4b-wftkw"
Sep 16 01:44:49.173466 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:49.173425    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e130352a-563a-4732-b1b3-b0ff71ee2a90" path="/var/lib/kubelet/pods/e130352a-563a-4732-b1b3-b0ff71ee2a90/volumes"
Sep 16 01:44:49.208160 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:49.208129    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-46h6p\" (UniqueName: \"kubernetes.io/projected/3279b4cf-5e53-46f6-a93c-6f524902689f-kube-api-access-46h6p\") pod \"3279b4cf-5e53-46f6-a93c-6f524902689f\" (UID: \"3279b4cf-5e53-46f6-a93c-6f524902689f\") "
Sep 16 01:44:49.208160 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:49.208167    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3279b4cf-5e53-46f6-a93c-6f524902689f-plugins-config-volume\") pod \"3279b4cf-5e53-46f6-a93c-6f524902689f\" (UID: \"3279b4cf-5e53-46f6-a93c-6f524902689f\") "
Sep 16 01:44:49.208683 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:49.208652    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3279b4cf-5e53-46f6-a93c-6f524902689f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3279b4cf-5e53-46f6-a93c-6f524902689f" (UID: "3279b4cf-5e53-46f6-a93c-6f524902689f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:44:49.210405 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:49.210378    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3279b4cf-5e53-46f6-a93c-6f524902689f-kube-api-access-46h6p" (OuterVolumeSpecName: "kube-api-access-46h6p") pod "3279b4cf-5e53-46f6-a93c-6f524902689f" (UID: "3279b4cf-5e53-46f6-a93c-6f524902689f"). InnerVolumeSpecName "kube-api-access-46h6p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:44:49.309387 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:49.309327    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-46h6p\" (UniqueName: \"kubernetes.io/projected/3279b4cf-5e53-46f6-a93c-6f524902689f-kube-api-access-46h6p\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:44:49.309387 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:49.309381    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3279b4cf-5e53-46f6-a93c-6f524902689f-plugins-config-volume\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:44:50.047295 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:50.047264    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-4bc0fb-68cfb59b4b-wftkw"
Sep 16 01:44:50.047692 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:50.047301    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w1-4bc0fb-68cfb59b4b-wftkw" event={"ID":"3279b4cf-5e53-46f6-a93c-6f524902689f","Type":"ContainerDied","Data":"f870c87025f8af7cd11c8e1e0369ee9a66fb44a728d2bef03a4f67d2eaca2b27"}
Sep 16 01:44:50.047692 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:50.047386    2565 scope.go:117] "RemoveContainer" containerID="7f15446bfd2157799d6f310750665039917d10a7189759827263a379354ba452"
Sep 16 01:44:50.071450 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:50.071424    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w1-4bc0fb-68cfb59b4b-wftkw"]
Sep 16 01:44:50.079117 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:50.079091    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w1-4bc0fb-68cfb59b4b-wftkw"]
Sep 16 01:44:50.927676 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:50.927637    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-f73a36-vk269"]
Sep 16 01:44:50.929677 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:50.929640    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3279b4cf-5e53-46f6-a93c-6f524902689f" containerName="payload-pre-processing"
Sep 16 01:44:50.929677 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:50.929676    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3279b4cf-5e53-46f6-a93c-6f524902689f" containerName="payload-pre-processing"
Sep 16 01:44:50.929895 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:50.929700    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e130352a-563a-4732-b1b3-b0ff71ee2a90" containerName="revoke-keys"
Sep 16 01:44:50.929895 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:50.929710    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e130352a-563a-4732-b1b3-b0ff71ee2a90" containerName="revoke-keys"
Sep 16 01:44:50.929895 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:50.929822    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e130352a-563a-4732-b1b3-b0ff71ee2a90" containerName="revoke-keys"
Sep 16 01:44:50.929895 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:50.929838    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3279b4cf-5e53-46f6-a93c-6f524902689f" containerName="payload-pre-processing"
Sep 16 01:44:50.943935 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:50.943896    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-f73a36-vk269"
Sep 16 01:44:50.946407 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:50.946194    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-f73a36-vk269"]
Sep 16 01:44:50.946823 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:50.946653    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4ljjd\""
Sep 16 01:44:50.946823 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:50.946657    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 01:44:51.028431 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:51.028390    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/657a80d4-a4ef-4529-a354-6fb22aaa774c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-f73a36-vk269\" (UID: \"657a80d4-a4ef-4529-a354-6fb22aaa774c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-f73a36-vk269"
Sep 16 01:44:51.129804 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:51.129767    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/657a80d4-a4ef-4529-a354-6fb22aaa774c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-f73a36-vk269\" (UID: \"657a80d4-a4ef-4529-a354-6fb22aaa774c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-f73a36-vk269"
Sep 16 01:44:51.132057 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:51.132040    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 01:44:51.141445 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:51.141422    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/657a80d4-a4ef-4529-a354-6fb22aaa774c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-f73a36-vk269\" (UID: \"657a80d4-a4ef-4529-a354-6fb22aaa774c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-f73a36-vk269"
Sep 16 01:44:51.173163 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:51.173130    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3279b4cf-5e53-46f6-a93c-6f524902689f" path="/var/lib/kubelet/pods/3279b4cf-5e53-46f6-a93c-6f524902689f/volumes"
Sep 16 01:44:51.259355 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:51.259242    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4ljjd\""
Sep 16 01:44:51.267113 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:51.267085    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-f73a36-vk269"
Sep 16 01:44:51.511547 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:51.511460    2565 scope.go:117] "RemoveContainer" containerID="73d2440179ce5f4685207af63fc08763984e0261386e33f6f37e146d5ed41206"
Sep 16 01:44:51.519931 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:51.519905    2565 scope.go:117] "RemoveContainer" containerID="c3de36d105260aff3a558c499ec12757490f2dc5b8a9678c389d1f43b599f5ce"
Sep 16 01:44:51.537391 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:51.537326    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-f73a36-vk269"]
Sep 16 01:44:51.539581 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:44:51.539561    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod657a80d4_a4ef_4529_a354_6fb22aaa774c.slice/crio-1ccb2354d3e1ec4faf2dd99e11bce83438533c689307ad7691e1bae4b93de733 WatchSource:0}: Error finding container 1ccb2354d3e1ec4faf2dd99e11bce83438533c689307ad7691e1bae4b93de733: Status 404 returned error can't find the container with id 1ccb2354d3e1ec4faf2dd99e11bce83438533c689307ad7691e1bae4b93de733
Sep 16 01:44:52.060803 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:52.060709    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-f73a36-vk269" event={"ID":"657a80d4-a4ef-4529-a354-6fb22aaa774c","Type":"ContainerStarted","Data":"6de00630cc3d11a019f962ae8dbc6195a444e0b9cf2508b552ff52c570eeda76"}
Sep 16 01:44:52.060803 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:52.060776    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-f73a36-vk269" event={"ID":"657a80d4-a4ef-4529-a354-6fb22aaa774c","Type":"ContainerStarted","Data":"1ccb2354d3e1ec4faf2dd99e11bce83438533c689307ad7691e1bae4b93de733"}
Sep 16 01:44:52.074782 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:52.074732    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-f73a36-vk269" podStartSLOduration=2.074715721 podStartE2EDuration="2.074715721s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:44:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:44:52.073148291 +0000 UTC m=+1741.396616869" watchObservedRunningTime="2026-09-16 01:44:52.074715721 +0000 UTC m=+1741.398184298"
Sep 16 01:44:53.068423 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:53.068389    2565 generic.go:356] "Generic (PLEG): container finished" podID="657a80d4-a4ef-4529-a354-6fb22aaa774c" containerID="6de00630cc3d11a019f962ae8dbc6195a444e0b9cf2508b552ff52c570eeda76" exitCode=0
Sep 16 01:44:53.068898 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:53.068470    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-f73a36-vk269" event={"ID":"657a80d4-a4ef-4529-a354-6fb22aaa774c","Type":"ContainerDied","Data":"6de00630cc3d11a019f962ae8dbc6195a444e0b9cf2508b552ff52c570eeda76"}
Sep 16 01:44:54.218951 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:54.218924    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-f73a36-vk269"
Sep 16 01:44:54.257381 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:54.257325    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/657a80d4-a4ef-4529-a354-6fb22aaa774c-maas-api-service-ca\") pod \"657a80d4-a4ef-4529-a354-6fb22aaa774c\" (UID: \"657a80d4-a4ef-4529-a354-6fb22aaa774c\") "
Sep 16 01:44:54.257695 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:54.257671    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/657a80d4-a4ef-4529-a354-6fb22aaa774c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "657a80d4-a4ef-4529-a354-6fb22aaa774c" (UID: "657a80d4-a4ef-4529-a354-6fb22aaa774c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:44:54.359164 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:54.359082    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/657a80d4-a4ef-4529-a354-6fb22aaa774c-maas-api-service-ca\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:44:55.086964 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:55.086932    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-f73a36-vk269"
Sep 16 01:44:55.087141 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:55.086965    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-f73a36-vk269" event={"ID":"657a80d4-a4ef-4529-a354-6fb22aaa774c","Type":"ContainerDied","Data":"1ccb2354d3e1ec4faf2dd99e11bce83438533c689307ad7691e1bae4b93de733"}
Sep 16 01:44:55.087141 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:55.087035    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1ccb2354d3e1ec4faf2dd99e11bce83438533c689307ad7691e1bae4b93de733"
Sep 16 01:44:56.154624 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:56.154588    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb"]
Sep 16 01:44:56.155012 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:56.154839    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb" podUID="59023c4f-45b1-480e-a110-50c6fe86586a" containerName="istio-proxy" containerID="cri-o://fe7627e57f95022e696a4c6331932f85b83101e0b86a56e0990b0165f8e3a4d7" gracePeriod=30
Sep 16 01:44:56.518637 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:56.518548    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-0d2655-7g5rj"]
Sep 16 01:44:56.518990 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:56.518977    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="657a80d4-a4ef-4529-a354-6fb22aaa774c" containerName="revoke-keys"
Sep 16 01:44:56.519045 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:56.518991    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="657a80d4-a4ef-4529-a354-6fb22aaa774c" containerName="revoke-keys"
Sep 16 01:44:56.519078 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:56.519057    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="657a80d4-a4ef-4529-a354-6fb22aaa774c" containerName="revoke-keys"
Sep 16 01:44:56.522228 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:56.522208    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-0d2655-7g5rj"
Sep 16 01:44:56.524468 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:56.524449    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 01:44:56.524605 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:56.524583    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4ljjd\""
Sep 16 01:44:56.528477 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:56.528450    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-0d2655-7g5rj"]
Sep 16 01:44:56.582238 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:56.582198    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bda8289d-a9db-422d-8b2a-e2c1f5322bf6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w1-0d2655-7g5rj\" (UID: \"bda8289d-a9db-422d-8b2a-e2c1f5322bf6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-0d2655-7g5rj"
Sep 16 01:44:56.683040 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:56.682997    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bda8289d-a9db-422d-8b2a-e2c1f5322bf6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w1-0d2655-7g5rj\" (UID: \"bda8289d-a9db-422d-8b2a-e2c1f5322bf6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-0d2655-7g5rj"
Sep 16 01:44:56.683634 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:56.683615    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bda8289d-a9db-422d-8b2a-e2c1f5322bf6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w1-0d2655-7g5rj\" (UID: \"bda8289d-a9db-422d-8b2a-e2c1f5322bf6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-0d2655-7g5rj"
Sep 16 01:44:56.835548 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:56.835441    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-0d2655-7g5rj"
Sep 16 01:44:57.105151 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:57.105127    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-0d2655-7g5rj"]
Sep 16 01:44:57.107069 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:44:57.107039    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbda8289d_a9db_422d_8b2a_e2c1f5322bf6.slice/crio-887dd6b127da6832062592318809c5290f336e93fb29945e56cd2dc19e5827b5 WatchSource:0}: Error finding container 887dd6b127da6832062592318809c5290f336e93fb29945e56cd2dc19e5827b5: Status 404 returned error can't find the container with id 887dd6b127da6832062592318809c5290f336e93fb29945e56cd2dc19e5827b5
Sep 16 01:44:58.105283 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:58.105186    2565 generic.go:356] "Generic (PLEG): container finished" podID="bda8289d-a9db-422d-8b2a-e2c1f5322bf6" containerID="924409d4639669103a5bc6d7c40424ce9613fcac5fae75351d3717cbc7ec310e" exitCode=0
Sep 16 01:44:58.105640 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:58.105276    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-0d2655-7g5rj" event={"ID":"bda8289d-a9db-422d-8b2a-e2c1f5322bf6","Type":"ContainerDied","Data":"924409d4639669103a5bc6d7c40424ce9613fcac5fae75351d3717cbc7ec310e"}
Sep 16 01:44:58.105640 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:58.105331    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-0d2655-7g5rj" event={"ID":"bda8289d-a9db-422d-8b2a-e2c1f5322bf6","Type":"ContainerStarted","Data":"887dd6b127da6832062592318809c5290f336e93fb29945e56cd2dc19e5827b5"}
Sep 16 01:44:59.252223 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:59.252196    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-0d2655-7g5rj"
Sep 16 01:44:59.308805 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:59.308764    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bda8289d-a9db-422d-8b2a-e2c1f5322bf6-maas-api-service-ca\") pod \"bda8289d-a9db-422d-8b2a-e2c1f5322bf6\" (UID: \"bda8289d-a9db-422d-8b2a-e2c1f5322bf6\") "
Sep 16 01:44:59.309118 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:59.309094    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bda8289d-a9db-422d-8b2a-e2c1f5322bf6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bda8289d-a9db-422d-8b2a-e2c1f5322bf6" (UID: "bda8289d-a9db-422d-8b2a-e2c1f5322bf6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:44:59.409775 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:44:59.409744    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bda8289d-a9db-422d-8b2a-e2c1f5322bf6-maas-api-service-ca\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:45:00.119500 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:00.119460    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-0d2655-7g5rj"
Sep 16 01:45:00.119684 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:00.119502    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-0d2655-7g5rj" event={"ID":"bda8289d-a9db-422d-8b2a-e2c1f5322bf6","Type":"ContainerDied","Data":"887dd6b127da6832062592318809c5290f336e93fb29945e56cd2dc19e5827b5"}
Sep 16 01:45:00.119684 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:00.119549    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="887dd6b127da6832062592318809c5290f336e93fb29945e56cd2dc19e5827b5"
Sep 16 01:45:00.128692 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:00.128664    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-cleanup-f73a36-29825385-999v6"]
Sep 16 01:45:00.129265 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:00.129245    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bda8289d-a9db-422d-8b2a-e2c1f5322bf6" containerName="revoke-keys"
Sep 16 01:45:00.129325 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:00.129267    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bda8289d-a9db-422d-8b2a-e2c1f5322bf6" containerName="revoke-keys"
Sep 16 01:45:00.129389 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:00.129377    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="bda8289d-a9db-422d-8b2a-e2c1f5322bf6" containerName="revoke-keys"
Sep 16 01:45:00.132560 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:00.132541    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-cleanup-f73a36-29825385-999v6"
Sep 16 01:45:00.136562 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:00.136535    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4ljjd\""
Sep 16 01:45:00.136760 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:00.136743    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-0d2655-29825385-t998b"]
Sep 16 01:45:00.140903 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:00.140794    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-cleanup-f73a36-29825385-999v6"]
Sep 16 01:45:00.140975 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:00.140901    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-0d2655-29825385-t998b"
Sep 16 01:45:00.147258 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:00.147232    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-cleanup-f73a36-29825385-999v6"
Sep 16 01:45:00.148352 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:00.148297    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-0d2655-29825385-t998b"]
Sep 16 01:45:00.153922 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:00.153653    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-a42101-29825385-724dx"]
Sep 16 01:45:00.159930 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:00.159908    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-0d2655-29825385-t998b"
Sep 16 01:45:00.160215 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:00.160197    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-8d230b-29825385-9vf9m"]
Sep 16 01:45:00.160539 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:00.160520    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-a42101-29825385-724dx"
Sep 16 01:45:00.169614 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:00.169587    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-a42101-29825385-724dx"]
Sep 16 01:45:00.170898 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:00.170804    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-8d230b-29825385-9vf9m"
Sep 16 01:45:00.173082 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:00.172387    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-8d230b-29825385-9vf9m"]
Sep 16 01:45:00.206803 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:00.206560    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-a42101-29825385-724dx"
Sep 16 01:45:00.214256 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:00.214231    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-8d230b-29825385-9vf9m"
Sep 16 01:45:00.441068 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:00.441036    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-cleanup-f73a36-29825385-999v6"]
Sep 16 01:45:00.443308 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:45:00.443279    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf357a1a2_93f8_4d37_a19a_d790ee6bec64.slice/crio-e9ad094cecda8759b3f7130f7e561f05d458a8e8b1f83662e14180ba4695e559 WatchSource:0}: Error finding container e9ad094cecda8759b3f7130f7e561f05d458a8e8b1f83662e14180ba4695e559: Status 404 returned error can't find the container with id e9ad094cecda8759b3f7130f7e561f05d458a8e8b1f83662e14180ba4695e559
Sep 16 01:45:00.454044 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:00.454020    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-0d2655-29825385-t998b"]
Sep 16 01:45:00.457876 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:45:00.457843    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf73953a6_1fc6_475b_ac14_7f045e3c1c00.slice/crio-43aa72ea074a4cfaa4669455f318b5979588fc1a3274a62f391af4a5bfaaa80d WatchSource:0}: Error finding container 43aa72ea074a4cfaa4669455f318b5979588fc1a3274a62f391af4a5bfaaa80d: Status 404 returned error can't find the container with id 43aa72ea074a4cfaa4669455f318b5979588fc1a3274a62f391af4a5bfaaa80d
Sep 16 01:45:00.506555 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:00.506527    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-a42101-29825385-724dx"]
Sep 16 01:45:00.510011 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:45:00.509972    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82ba12b0_5cb7_4da7_b385_ee908f06fe56.slice/crio-74b459455c670b50b576b234226f8325a11f9a2d8d60e5c1abb331e400e09e2a WatchSource:0}: Error finding container 74b459455c670b50b576b234226f8325a11f9a2d8d60e5c1abb331e400e09e2a: Status 404 returned error can't find the container with id 74b459455c670b50b576b234226f8325a11f9a2d8d60e5c1abb331e400e09e2a
Sep 16 01:45:00.512456 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:00.512381    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-8d230b-29825385-9vf9m"]
Sep 16 01:45:00.513962 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:45:00.513943    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b7b1a03_3ace_4b02_8d5a_876d252e9ec1.slice/crio-0fea68ed6709409b91cd9a945fe5011237879aabb055749f78bd162839b7a745 WatchSource:0}: Error finding container 0fea68ed6709409b91cd9a945fe5011237879aabb055749f78bd162839b7a745: Status 404 returned error can't find the container with id 0fea68ed6709409b91cd9a945fe5011237879aabb055749f78bd162839b7a745
Sep 16 01:45:01.127736 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:01.127637    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-a42101-29825385-724dx" event={"ID":"82ba12b0-5cb7-4da7-b385-ee908f06fe56","Type":"ContainerStarted","Data":"8d74a36e307c91a9893d96354500b3e423b495adb133e660100af2d59a36a6df"}
Sep 16 01:45:01.127736 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:01.127707    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-a42101-29825385-724dx" event={"ID":"82ba12b0-5cb7-4da7-b385-ee908f06fe56","Type":"ContainerStarted","Data":"74b459455c670b50b576b234226f8325a11f9a2d8d60e5c1abb331e400e09e2a"}
Sep 16 01:45:01.129372 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:01.129316    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-8d230b-29825385-9vf9m" event={"ID":"1b7b1a03-3ace-4b02-8d5a-876d252e9ec1","Type":"ContainerStarted","Data":"89ebf111fae17d47497395de0d6a5eeebba5c9c309622518cbdcbd305b07a65b"}
Sep 16 01:45:01.129510 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:01.129391    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-8d230b-29825385-9vf9m" event={"ID":"1b7b1a03-3ace-4b02-8d5a-876d252e9ec1","Type":"ContainerStarted","Data":"0fea68ed6709409b91cd9a945fe5011237879aabb055749f78bd162839b7a745"}
Sep 16 01:45:01.130920 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:01.130896    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-0d2655-29825385-t998b" event={"ID":"f73953a6-1fc6-475b-ac14-7f045e3c1c00","Type":"ContainerStarted","Data":"2c60c28fd8a0a7abd34b9372955044065478b27846418d030d7669a2f6850c9c"}
Sep 16 01:45:01.131039 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:01.130939    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-0d2655-29825385-t998b" event={"ID":"f73953a6-1fc6-475b-ac14-7f045e3c1c00","Type":"ContainerStarted","Data":"43aa72ea074a4cfaa4669455f318b5979588fc1a3274a62f391af4a5bfaaa80d"}
Sep 16 01:45:01.139000 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:01.138974    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-cleanup-f73a36-29825385-999v6" event={"ID":"f357a1a2-93f8-4d37-a19a-d790ee6bec64","Type":"ContainerStarted","Data":"c1a700bd05d8a57f42592ab07dd2701c4cb904729a162a1cb5dad358c41a8b4c"}
Sep 16 01:45:01.139111 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:01.139043    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-cleanup-f73a36-29825385-999v6" event={"ID":"f357a1a2-93f8-4d37-a19a-d790ee6bec64","Type":"ContainerStarted","Data":"e9ad094cecda8759b3f7130f7e561f05d458a8e8b1f83662e14180ba4695e559"}
Sep 16 01:45:01.141232 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:01.141179    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-a42101-29825385-724dx" podStartSLOduration=1.141162367 podStartE2EDuration="1.141162367s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:45:01.140415082 +0000 UTC m=+1750.463883659" watchObservedRunningTime="2026-09-16 01:45:01.141162367 +0000 UTC m=+1750.464630945"
Sep 16 01:45:01.154105 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:01.154069    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-8d230b-29825385-9vf9m" podStartSLOduration=1.154031105 podStartE2EDuration="1.154031105s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:45:01.153384564 +0000 UTC m=+1750.476853141" watchObservedRunningTime="2026-09-16 01:45:01.154031105 +0000 UTC m=+1750.477499678"
Sep 16 01:45:01.167814 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:01.167755    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-0d2655-29825385-t998b" podStartSLOduration=1.167733925 podStartE2EDuration="1.167733925s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:45:01.165488343 +0000 UTC m=+1750.488956920" watchObservedRunningTime="2026-09-16 01:45:01.167733925 +0000 UTC m=+1750.491202502"
Sep 16 01:45:01.180954 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:01.180897    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-cleanup-f73a36-29825385-999v6" podStartSLOduration=1.180878965 podStartE2EDuration="1.180878965s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:45:01.177321495 +0000 UTC m=+1750.500790083" watchObservedRunningTime="2026-09-16 01:45:01.180878965 +0000 UTC m=+1750.504347543"
Sep 16 01:45:01.418455 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:01.418425    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb"
Sep 16 01:45:01.533072 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:01.533040    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59023c4f-45b1-480e-a110-50c6fe86586a-workload-certs\") pod \"59023c4f-45b1-480e-a110-50c6fe86586a\" (UID: \"59023c4f-45b1-480e-a110-50c6fe86586a\") "
Sep 16 01:45:01.533550 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:01.533087    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59023c4f-45b1-480e-a110-50c6fe86586a-istio-podinfo\") pod \"59023c4f-45b1-480e-a110-50c6fe86586a\" (UID: \"59023c4f-45b1-480e-a110-50c6fe86586a\") "
Sep 16 01:45:01.533550 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:01.533109    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59023c4f-45b1-480e-a110-50c6fe86586a-istio-envoy\") pod \"59023c4f-45b1-480e-a110-50c6fe86586a\" (UID: \"59023c4f-45b1-480e-a110-50c6fe86586a\") "
Sep 16 01:45:01.533550 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:01.533142    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59023c4f-45b1-480e-a110-50c6fe86586a-istio-token\") pod \"59023c4f-45b1-480e-a110-50c6fe86586a\" (UID: \"59023c4f-45b1-480e-a110-50c6fe86586a\") "
Sep 16 01:45:01.533550 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:01.533181    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59023c4f-45b1-480e-a110-50c6fe86586a-workload-socket\") pod \"59023c4f-45b1-480e-a110-50c6fe86586a\" (UID: \"59023c4f-45b1-480e-a110-50c6fe86586a\") "
Sep 16 01:45:01.533550 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:01.533243    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59023c4f-45b1-480e-a110-50c6fe86586a-istio-data\") pod \"59023c4f-45b1-480e-a110-50c6fe86586a\" (UID: \"59023c4f-45b1-480e-a110-50c6fe86586a\") "
Sep 16 01:45:01.533550 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:01.533308    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59023c4f-45b1-480e-a110-50c6fe86586a-credential-socket\") pod \"59023c4f-45b1-480e-a110-50c6fe86586a\" (UID: \"59023c4f-45b1-480e-a110-50c6fe86586a\") "
Sep 16 01:45:01.533550 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:01.533416    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59023c4f-45b1-480e-a110-50c6fe86586a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "59023c4f-45b1-480e-a110-50c6fe86586a" (UID: "59023c4f-45b1-480e-a110-50c6fe86586a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:45:01.533550 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:01.533427    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59023c4f-45b1-480e-a110-50c6fe86586a-istiod-ca-cert\") pod \"59023c4f-45b1-480e-a110-50c6fe86586a\" (UID: \"59023c4f-45b1-480e-a110-50c6fe86586a\") "
Sep 16 01:45:01.533550 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:01.533520    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59023c4f-45b1-480e-a110-50c6fe86586a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "59023c4f-45b1-480e-a110-50c6fe86586a" (UID: "59023c4f-45b1-480e-a110-50c6fe86586a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:45:01.534011 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:01.533621    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59023c4f-45b1-480e-a110-50c6fe86586a-istio-data" (OuterVolumeSpecName: "istio-data") pod "59023c4f-45b1-480e-a110-50c6fe86586a" (UID: "59023c4f-45b1-480e-a110-50c6fe86586a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:45:01.534011 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:01.533639    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59023c4f-45b1-480e-a110-50c6fe86586a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "59023c4f-45b1-480e-a110-50c6fe86586a" (UID: "59023c4f-45b1-480e-a110-50c6fe86586a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:45:01.534011 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:01.533745    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4szgl\" (UniqueName: \"kubernetes.io/projected/59023c4f-45b1-480e-a110-50c6fe86586a-kube-api-access-4szgl\") pod \"59023c4f-45b1-480e-a110-50c6fe86586a\" (UID: \"59023c4f-45b1-480e-a110-50c6fe86586a\") "
Sep 16 01:45:01.534011 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:01.533806    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59023c4f-45b1-480e-a110-50c6fe86586a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "59023c4f-45b1-480e-a110-50c6fe86586a" (UID: "59023c4f-45b1-480e-a110-50c6fe86586a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:45:01.534209 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:01.534103    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59023c4f-45b1-480e-a110-50c6fe86586a-workload-certs\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:45:01.534209 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:01.534121    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59023c4f-45b1-480e-a110-50c6fe86586a-workload-socket\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:45:01.534209 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:01.534135    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59023c4f-45b1-480e-a110-50c6fe86586a-istio-data\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:45:01.534209 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:01.534175    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59023c4f-45b1-480e-a110-50c6fe86586a-credential-socket\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:45:01.534209 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:01.534190    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59023c4f-45b1-480e-a110-50c6fe86586a-istiod-ca-cert\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:45:01.535401 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:01.535375    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59023c4f-45b1-480e-a110-50c6fe86586a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "59023c4f-45b1-480e-a110-50c6fe86586a" (UID: "59023c4f-45b1-480e-a110-50c6fe86586a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:45:01.535514 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:01.535502    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59023c4f-45b1-480e-a110-50c6fe86586a-istio-token" (OuterVolumeSpecName: "istio-token") pod "59023c4f-45b1-480e-a110-50c6fe86586a" (UID: "59023c4f-45b1-480e-a110-50c6fe86586a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:45:01.535661 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:01.535640    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/59023c4f-45b1-480e-a110-50c6fe86586a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "59023c4f-45b1-480e-a110-50c6fe86586a" (UID: "59023c4f-45b1-480e-a110-50c6fe86586a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 01:45:01.536088 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:01.536065    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59023c4f-45b1-480e-a110-50c6fe86586a-kube-api-access-4szgl" (OuterVolumeSpecName: "kube-api-access-4szgl") pod "59023c4f-45b1-480e-a110-50c6fe86586a" (UID: "59023c4f-45b1-480e-a110-50c6fe86586a"). InnerVolumeSpecName "kube-api-access-4szgl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:45:01.634704 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:01.634670    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4szgl\" (UniqueName: \"kubernetes.io/projected/59023c4f-45b1-480e-a110-50c6fe86586a-kube-api-access-4szgl\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:45:01.634704 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:01.634699    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59023c4f-45b1-480e-a110-50c6fe86586a-istio-podinfo\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:45:01.634704 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:01.634709    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59023c4f-45b1-480e-a110-50c6fe86586a-istio-envoy\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:45:01.635009 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:01.634717    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59023c4f-45b1-480e-a110-50c6fe86586a-istio-token\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:45:02.146963 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:02.146865    2565 generic.go:356] "Generic (PLEG): container finished" podID="1b7b1a03-3ace-4b02-8d5a-876d252e9ec1" containerID="89ebf111fae17d47497395de0d6a5eeebba5c9c309622518cbdcbd305b07a65b" exitCode=0
Sep 16 01:45:02.147136 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:02.146955    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-8d230b-29825385-9vf9m" event={"ID":"1b7b1a03-3ace-4b02-8d5a-876d252e9ec1","Type":"ContainerDied","Data":"89ebf111fae17d47497395de0d6a5eeebba5c9c309622518cbdcbd305b07a65b"}
Sep 16 01:45:02.148583 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:02.148558    2565 generic.go:356] "Generic (PLEG): container finished" podID="f73953a6-1fc6-475b-ac14-7f045e3c1c00" containerID="2c60c28fd8a0a7abd34b9372955044065478b27846418d030d7669a2f6850c9c" exitCode=0
Sep 16 01:45:02.148711 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:02.148641    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-0d2655-29825385-t998b" event={"ID":"f73953a6-1fc6-475b-ac14-7f045e3c1c00","Type":"ContainerDied","Data":"2c60c28fd8a0a7abd34b9372955044065478b27846418d030d7669a2f6850c9c"}
Sep 16 01:45:02.150224 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:02.150200    2565 generic.go:356] "Generic (PLEG): container finished" podID="f357a1a2-93f8-4d37-a19a-d790ee6bec64" containerID="c1a700bd05d8a57f42592ab07dd2701c4cb904729a162a1cb5dad358c41a8b4c" exitCode=0
Sep 16 01:45:02.150373 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:02.150289    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-cleanup-f73a36-29825385-999v6" event={"ID":"f357a1a2-93f8-4d37-a19a-d790ee6bec64","Type":"ContainerDied","Data":"c1a700bd05d8a57f42592ab07dd2701c4cb904729a162a1cb5dad358c41a8b4c"}
Sep 16 01:45:02.151989 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:02.151971    2565 generic.go:356] "Generic (PLEG): container finished" podID="59023c4f-45b1-480e-a110-50c6fe86586a" containerID="fe7627e57f95022e696a4c6331932f85b83101e0b86a56e0990b0165f8e3a4d7" exitCode=0
Sep 16 01:45:02.152084 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:02.152020    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb"
Sep 16 01:45:02.152084 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:02.152050    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb" event={"ID":"59023c4f-45b1-480e-a110-50c6fe86586a","Type":"ContainerDied","Data":"fe7627e57f95022e696a4c6331932f85b83101e0b86a56e0990b0165f8e3a4d7"}
Sep 16 01:45:02.152196 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:02.152098    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb" event={"ID":"59023c4f-45b1-480e-a110-50c6fe86586a","Type":"ContainerDied","Data":"5fc07a3690099424fc384ca06d70a2da62e07bd65932011b5294f296a1c3a38c"}
Sep 16 01:45:02.152196 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:02.152134    2565 scope.go:117] "RemoveContainer" containerID="fe7627e57f95022e696a4c6331932f85b83101e0b86a56e0990b0165f8e3a4d7"
Sep 16 01:45:02.153693 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:02.153658    2565 generic.go:356] "Generic (PLEG): container finished" podID="82ba12b0-5cb7-4da7-b385-ee908f06fe56" containerID="8d74a36e307c91a9893d96354500b3e423b495adb133e660100af2d59a36a6df" exitCode=0
Sep 16 01:45:02.153693 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:02.153692    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-a42101-29825385-724dx" event={"ID":"82ba12b0-5cb7-4da7-b385-ee908f06fe56","Type":"ContainerDied","Data":"8d74a36e307c91a9893d96354500b3e423b495adb133e660100af2d59a36a6df"}
Sep 16 01:45:02.162156 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:02.162136    2565 scope.go:117] "RemoveContainer" containerID="fc49086c4becc28eac0ef825429214d9b3f1582bda25ae1be779b281aa71f663"
Sep 16 01:45:02.171106 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:02.171089    2565 scope.go:117] "RemoveContainer" containerID="fe7627e57f95022e696a4c6331932f85b83101e0b86a56e0990b0165f8e3a4d7"
Sep 16 01:45:02.171396 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:45:02.171372    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe7627e57f95022e696a4c6331932f85b83101e0b86a56e0990b0165f8e3a4d7\": container with ID starting with fe7627e57f95022e696a4c6331932f85b83101e0b86a56e0990b0165f8e3a4d7 not found: ID does not exist" containerID="fe7627e57f95022e696a4c6331932f85b83101e0b86a56e0990b0165f8e3a4d7"
Sep 16 01:45:02.171474 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:02.171404    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe7627e57f95022e696a4c6331932f85b83101e0b86a56e0990b0165f8e3a4d7"} err="failed to get container status \"fe7627e57f95022e696a4c6331932f85b83101e0b86a56e0990b0165f8e3a4d7\": rpc error: code = NotFound desc = could not find container \"fe7627e57f95022e696a4c6331932f85b83101e0b86a56e0990b0165f8e3a4d7\": container with ID starting with fe7627e57f95022e696a4c6331932f85b83101e0b86a56e0990b0165f8e3a4d7 not found: ID does not exist"
Sep 16 01:45:02.171474 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:02.171434    2565 scope.go:117] "RemoveContainer" containerID="fc49086c4becc28eac0ef825429214d9b3f1582bda25ae1be779b281aa71f663"
Sep 16 01:45:02.171714 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:45:02.171698    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc49086c4becc28eac0ef825429214d9b3f1582bda25ae1be779b281aa71f663\": container with ID starting with fc49086c4becc28eac0ef825429214d9b3f1582bda25ae1be779b281aa71f663 not found: ID does not exist" containerID="fc49086c4becc28eac0ef825429214d9b3f1582bda25ae1be779b281aa71f663"
Sep 16 01:45:02.171756 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:02.171719    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc49086c4becc28eac0ef825429214d9b3f1582bda25ae1be779b281aa71f663"} err="failed to get container status \"fc49086c4becc28eac0ef825429214d9b3f1582bda25ae1be779b281aa71f663\": rpc error: code = NotFound desc = could not find container \"fc49086c4becc28eac0ef825429214d9b3f1582bda25ae1be779b281aa71f663\": container with ID starting with fc49086c4becc28eac0ef825429214d9b3f1582bda25ae1be779b281aa71f663 not found: ID does not exist"
Sep 16 01:45:02.217735 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:02.217705    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb"]
Sep 16 01:45:02.221678 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:02.221653    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb"]
Sep 16 01:45:02.491868 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:02.491832    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-cleanup-f73a36-29825385-999v6"]
Sep 16 01:45:02.519278 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:02.519244    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-f73a36-64c867f7f-5r4jq"]
Sep 16 01:45:02.519757 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:02.519494    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f73a36-64c867f7f-5r4jq" podUID="624281d6-9174-4107-80a7-320782f096ff" containerName="payload-processing" containerID="cri-o://f7d8d1640312212695df279a7be16f9e3ed9026eb4d1e8530dd67debe942f60d" gracePeriod=30
Sep 16 01:45:02.525028 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:02.525001    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f73a36-58c64c5bcd-p5vws"]
Sep 16 01:45:02.525293 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:02.525254    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f73a36-58c64c5bcd-p5vws" podUID="24808b82-6a76-4697-a33c-a6d48deb960a" containerName="payload-pre-processing" containerID="cri-o://ae3ad61c03b2c0a53891daee267464fd516409e6cf2b1884f16818e7229b50f8" gracePeriod=30
Sep 16 01:45:02.689993 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:02.689927    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-f73a36-vk269"]
Sep 16 01:45:02.695485 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:02.693141    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-f73a36-vk269"]
Sep 16 01:45:02.808148 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:02.808117    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f73a36-64c867f7f-5r4jq"
Sep 16 01:45:02.810701 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:02.810678    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f73a36-58c64c5bcd-p5vws"
Sep 16 01:45:02.948411 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:02.948377    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24808b82-6a76-4697-a33c-a6d48deb960a-plugins-config-volume\") pod \"24808b82-6a76-4697-a33c-a6d48deb960a\" (UID: \"24808b82-6a76-4697-a33c-a6d48deb960a\") "
Sep 16 01:45:02.948612 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:02.948438    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zgjf4\" (UniqueName: \"kubernetes.io/projected/24808b82-6a76-4697-a33c-a6d48deb960a-kube-api-access-zgjf4\") pod \"24808b82-6a76-4697-a33c-a6d48deb960a\" (UID: \"24808b82-6a76-4697-a33c-a6d48deb960a\") "
Sep 16 01:45:02.948612 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:02.948468    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/624281d6-9174-4107-80a7-320782f096ff-plugins-config-volume\") pod \"624281d6-9174-4107-80a7-320782f096ff\" (UID: \"624281d6-9174-4107-80a7-320782f096ff\") "
Sep 16 01:45:02.948612 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:02.948562    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7jrs\" (UniqueName: \"kubernetes.io/projected/624281d6-9174-4107-80a7-320782f096ff-kube-api-access-q7jrs\") pod \"624281d6-9174-4107-80a7-320782f096ff\" (UID: \"624281d6-9174-4107-80a7-320782f096ff\") "
Sep 16 01:45:02.948854 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:02.948827    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24808b82-6a76-4697-a33c-a6d48deb960a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "24808b82-6a76-4697-a33c-a6d48deb960a" (UID: "24808b82-6a76-4697-a33c-a6d48deb960a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:45:02.948933 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:02.948897    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/624281d6-9174-4107-80a7-320782f096ff-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "624281d6-9174-4107-80a7-320782f096ff" (UID: "624281d6-9174-4107-80a7-320782f096ff"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:45:02.950691 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:02.950670    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24808b82-6a76-4697-a33c-a6d48deb960a-kube-api-access-zgjf4" (OuterVolumeSpecName: "kube-api-access-zgjf4") pod "24808b82-6a76-4697-a33c-a6d48deb960a" (UID: "24808b82-6a76-4697-a33c-a6d48deb960a"). InnerVolumeSpecName "kube-api-access-zgjf4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:45:02.950758 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:02.950731    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/624281d6-9174-4107-80a7-320782f096ff-kube-api-access-q7jrs" (OuterVolumeSpecName: "kube-api-access-q7jrs") pod "624281d6-9174-4107-80a7-320782f096ff" (UID: "624281d6-9174-4107-80a7-320782f096ff"). InnerVolumeSpecName "kube-api-access-q7jrs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:45:03.050145 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:03.050074    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24808b82-6a76-4697-a33c-a6d48deb960a-plugins-config-volume\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:45:03.050145 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:03.050098    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zgjf4\" (UniqueName: \"kubernetes.io/projected/24808b82-6a76-4697-a33c-a6d48deb960a-kube-api-access-zgjf4\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:45:03.050145 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:03.050108    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/624281d6-9174-4107-80a7-320782f096ff-plugins-config-volume\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:45:03.050145 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:03.050117    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7jrs\" (UniqueName: \"kubernetes.io/projected/624281d6-9174-4107-80a7-320782f096ff-kube-api-access-q7jrs\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:45:03.161885 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:03.161848    2565 generic.go:356] "Generic (PLEG): container finished" podID="24808b82-6a76-4697-a33c-a6d48deb960a" containerID="ae3ad61c03b2c0a53891daee267464fd516409e6cf2b1884f16818e7229b50f8" exitCode=0
Sep 16 01:45:03.162042 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:03.161898    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f73a36-58c64c5bcd-p5vws"
Sep 16 01:45:03.162042 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:03.161932    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f73a36-58c64c5bcd-p5vws" event={"ID":"24808b82-6a76-4697-a33c-a6d48deb960a","Type":"ContainerDied","Data":"ae3ad61c03b2c0a53891daee267464fd516409e6cf2b1884f16818e7229b50f8"}
Sep 16 01:45:03.162042 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:03.161986    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f73a36-58c64c5bcd-p5vws" event={"ID":"24808b82-6a76-4697-a33c-a6d48deb960a","Type":"ContainerDied","Data":"e0bd5607d2ec5dcca5a7f31e2fb277db8908b7336bd2785c856de61284f70d32"}
Sep 16 01:45:03.162042 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:03.162010    2565 scope.go:117] "RemoveContainer" containerID="ae3ad61c03b2c0a53891daee267464fd516409e6cf2b1884f16818e7229b50f8"
Sep 16 01:45:03.163607 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:03.163581    2565 generic.go:356] "Generic (PLEG): container finished" podID="624281d6-9174-4107-80a7-320782f096ff" containerID="f7d8d1640312212695df279a7be16f9e3ed9026eb4d1e8530dd67debe942f60d" exitCode=0
Sep 16 01:45:03.163730 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:03.163641    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f73a36-64c867f7f-5r4jq"
Sep 16 01:45:03.179593 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:03.179559    2565 scope.go:117] "RemoveContainer" containerID="ae3ad61c03b2c0a53891daee267464fd516409e6cf2b1884f16818e7229b50f8"
Sep 16 01:45:03.183280 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:45:03.183239    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae3ad61c03b2c0a53891daee267464fd516409e6cf2b1884f16818e7229b50f8\": container with ID starting with ae3ad61c03b2c0a53891daee267464fd516409e6cf2b1884f16818e7229b50f8 not found: ID does not exist" containerID="ae3ad61c03b2c0a53891daee267464fd516409e6cf2b1884f16818e7229b50f8"
Sep 16 01:45:03.183442 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:03.183291    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae3ad61c03b2c0a53891daee267464fd516409e6cf2b1884f16818e7229b50f8"} err="failed to get container status \"ae3ad61c03b2c0a53891daee267464fd516409e6cf2b1884f16818e7229b50f8\": rpc error: code = NotFound desc = could not find container \"ae3ad61c03b2c0a53891daee267464fd516409e6cf2b1884f16818e7229b50f8\": container with ID starting with ae3ad61c03b2c0a53891daee267464fd516409e6cf2b1884f16818e7229b50f8 not found: ID does not exist"
Sep 16 01:45:03.184356 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:03.183650    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59023c4f-45b1-480e-a110-50c6fe86586a" path="/var/lib/kubelet/pods/59023c4f-45b1-480e-a110-50c6fe86586a/volumes"
Sep 16 01:45:03.184356 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:03.184257    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="657a80d4-a4ef-4529-a354-6fb22aaa774c" path="/var/lib/kubelet/pods/657a80d4-a4ef-4529-a354-6fb22aaa774c/volumes"
Sep 16 01:45:03.197071 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:03.196832    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f73a36-64c867f7f-5r4jq" event={"ID":"624281d6-9174-4107-80a7-320782f096ff","Type":"ContainerDied","Data":"f7d8d1640312212695df279a7be16f9e3ed9026eb4d1e8530dd67debe942f60d"}
Sep 16 01:45:03.197071 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:03.196882    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f73a36-64c867f7f-5r4jq" event={"ID":"624281d6-9174-4107-80a7-320782f096ff","Type":"ContainerDied","Data":"1931996ef6f638323c867c08c9c6835e3d8b8754220534feef0667e86fd64b7d"}
Sep 16 01:45:03.197071 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:03.196936    2565 scope.go:117] "RemoveContainer" containerID="f7d8d1640312212695df279a7be16f9e3ed9026eb4d1e8530dd67debe942f60d"
Sep 16 01:45:03.215446 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:03.215389    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-f73a36-64c867f7f-5r4jq"]
Sep 16 01:45:03.215866 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:03.215838    2565 scope.go:117] "RemoveContainer" containerID="f7d8d1640312212695df279a7be16f9e3ed9026eb4d1e8530dd67debe942f60d"
Sep 16 01:45:03.216393 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:45:03.216331    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7d8d1640312212695df279a7be16f9e3ed9026eb4d1e8530dd67debe942f60d\": container with ID starting with f7d8d1640312212695df279a7be16f9e3ed9026eb4d1e8530dd67debe942f60d not found: ID does not exist" containerID="f7d8d1640312212695df279a7be16f9e3ed9026eb4d1e8530dd67debe942f60d"
Sep 16 01:45:03.216522 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:03.216398    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7d8d1640312212695df279a7be16f9e3ed9026eb4d1e8530dd67debe942f60d"} err="failed to get container status \"f7d8d1640312212695df279a7be16f9e3ed9026eb4d1e8530dd67debe942f60d\": rpc error: code = NotFound desc = could not find container \"f7d8d1640312212695df279a7be16f9e3ed9026eb4d1e8530dd67debe942f60d\": container with ID starting with f7d8d1640312212695df279a7be16f9e3ed9026eb4d1e8530dd67debe942f60d not found: ID does not exist"
Sep 16 01:45:03.218534 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:03.218510    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-f73a36-64c867f7f-5r4jq"]
Sep 16 01:45:03.227105 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:03.226573    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f73a36-58c64c5bcd-p5vws"]
Sep 16 01:45:03.232761 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:03.232735    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f73a36-58c64c5bcd-p5vws"]
Sep 16 01:45:03.357854 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:03.357822    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-8d230b-29825385-9vf9m"
Sep 16 01:45:03.360968 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:03.360935    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-cleanup-f73a36-29825385-999v6"
Sep 16 01:45:03.411560 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:03.411534    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-0d2655-29825385-t998b"
Sep 16 01:45:03.417470 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:03.417438    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-a42101-29825385-724dx"
Sep 16 01:45:04.172322 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:04.172293    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-a42101-29825385-724dx"
Sep 16 01:45:04.172322 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:04.172293    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-a42101-29825385-724dx" event={"ID":"82ba12b0-5cb7-4da7-b385-ee908f06fe56","Type":"ContainerDied","Data":"74b459455c670b50b576b234226f8325a11f9a2d8d60e5c1abb331e400e09e2a"}
Sep 16 01:45:04.172843 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:04.172381    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="74b459455c670b50b576b234226f8325a11f9a2d8d60e5c1abb331e400e09e2a"
Sep 16 01:45:04.173757 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:04.173731    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-8d230b-29825385-9vf9m"
Sep 16 01:45:04.173757 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:04.173748    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-8d230b-29825385-9vf9m" event={"ID":"1b7b1a03-3ace-4b02-8d5a-876d252e9ec1","Type":"ContainerDied","Data":"0fea68ed6709409b91cd9a945fe5011237879aabb055749f78bd162839b7a745"}
Sep 16 01:45:04.173962 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:04.173792    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0fea68ed6709409b91cd9a945fe5011237879aabb055749f78bd162839b7a745"
Sep 16 01:45:04.175136 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:04.175120    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-0d2655-29825385-t998b"
Sep 16 01:45:04.175234 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:04.175169    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-0d2655-29825385-t998b" event={"ID":"f73953a6-1fc6-475b-ac14-7f045e3c1c00","Type":"ContainerDied","Data":"43aa72ea074a4cfaa4669455f318b5979588fc1a3274a62f391af4a5bfaaa80d"}
Sep 16 01:45:04.175234 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:04.175206    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="43aa72ea074a4cfaa4669455f318b5979588fc1a3274a62f391af4a5bfaaa80d"
Sep 16 01:45:04.176636 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:04.176614    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-cleanup-f73a36-29825385-999v6"
Sep 16 01:45:04.176709 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:04.176616    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-cleanup-f73a36-29825385-999v6" event={"ID":"f357a1a2-93f8-4d37-a19a-d790ee6bec64","Type":"ContainerDied","Data":"e9ad094cecda8759b3f7130f7e561f05d458a8e8b1f83662e14180ba4695e559"}
Sep 16 01:45:04.176750 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:04.176738    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e9ad094cecda8759b3f7130f7e561f05d458a8e8b1f83662e14180ba4695e559"
Sep 16 01:45:04.216262 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:04.216230    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-cleanup-f73a36-29825385-999v6"]
Sep 16 01:45:04.218064 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:04.218045    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-cleanup-f73a36-29825385-999v6"]
Sep 16 01:45:05.170227 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:05.170194    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24808b82-6a76-4697-a33c-a6d48deb960a" path="/var/lib/kubelet/pods/24808b82-6a76-4697-a33c-a6d48deb960a/volumes"
Sep 16 01:45:05.170637 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:05.170622    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="624281d6-9174-4107-80a7-320782f096ff" path="/var/lib/kubelet/pods/624281d6-9174-4107-80a7-320782f096ff/volumes"
Sep 16 01:45:05.170867 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:05.170856    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f357a1a2-93f8-4d37-a19a-d790ee6bec64" path="/var/lib/kubelet/pods/f357a1a2-93f8-4d37-a19a-d790ee6bec64/volumes"
Sep 16 01:45:06.806106 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:06.806054    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-0d2655-29825385-t998b"]
Sep 16 01:45:06.808710 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:06.808684    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-0d2655-29825385-t998b"]
Sep 16 01:45:06.835835 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:06.835802    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w1-0d2655-575888b5b9-7t6dn"]
Sep 16 01:45:06.836133 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:06.836105    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-0d2655-575888b5b9-7t6dn" podUID="365650a0-930f-4ea1-8e5d-a3588fa1891e" containerName="payload-processing" containerID="cri-o://fff4651193f1eaa577ff983a3608592cb465494b47f48c51905e884570e26599" gracePeriod=30
Sep 16 01:45:06.841792 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:06.841765    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w1-0d2655-76cd8f4d9d-htct8"]
Sep 16 01:45:06.842162 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:06.842132    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-0d2655-76cd8f4d9d-htct8" podUID="073574ba-86a1-466b-8a0a-2b6fb97b6c68" containerName="payload-pre-processing" containerID="cri-o://d5b3f296174b057f8ec80c71c39631f3fe556ea1ab1426552e109e15bd12103d" gracePeriod=30
Sep 16 01:45:06.981355 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:06.981303    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-0d2655-7g5rj"]
Sep 16 01:45:06.983306 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:06.983282    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-0d2655-7g5rj"]
Sep 16 01:45:07.089709 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:07.089680    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-0d2655-575888b5b9-7t6dn"
Sep 16 01:45:07.126634 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:07.126608    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-0d2655-76cd8f4d9d-htct8"
Sep 16 01:45:07.175379 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:07.175016    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bda8289d-a9db-422d-8b2a-e2c1f5322bf6" path="/var/lib/kubelet/pods/bda8289d-a9db-422d-8b2a-e2c1f5322bf6/volumes"
Sep 16 01:45:07.176032 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:07.175793    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f73953a6-1fc6-475b-ac14-7f045e3c1c00" path="/var/lib/kubelet/pods/f73953a6-1fc6-475b-ac14-7f045e3c1c00/volumes"
Sep 16 01:45:07.191171 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:07.191132    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/365650a0-930f-4ea1-8e5d-a3588fa1891e-plugins-config-volume\") pod \"365650a0-930f-4ea1-8e5d-a3588fa1891e\" (UID: \"365650a0-930f-4ea1-8e5d-a3588fa1891e\") "
Sep 16 01:45:07.191403 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:07.191217    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zzm4n\" (UniqueName: \"kubernetes.io/projected/365650a0-930f-4ea1-8e5d-a3588fa1891e-kube-api-access-zzm4n\") pod \"365650a0-930f-4ea1-8e5d-a3588fa1891e\" (UID: \"365650a0-930f-4ea1-8e5d-a3588fa1891e\") "
Sep 16 01:45:07.191527 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:07.191502    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/365650a0-930f-4ea1-8e5d-a3588fa1891e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "365650a0-930f-4ea1-8e5d-a3588fa1891e" (UID: "365650a0-930f-4ea1-8e5d-a3588fa1891e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:45:07.194022 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:07.193987    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/365650a0-930f-4ea1-8e5d-a3588fa1891e-kube-api-access-zzm4n" (OuterVolumeSpecName: "kube-api-access-zzm4n") pod "365650a0-930f-4ea1-8e5d-a3588fa1891e" (UID: "365650a0-930f-4ea1-8e5d-a3588fa1891e"). InnerVolumeSpecName "kube-api-access-zzm4n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:45:07.197073 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:07.197041    2565 generic.go:356] "Generic (PLEG): container finished" podID="073574ba-86a1-466b-8a0a-2b6fb97b6c68" containerID="d5b3f296174b057f8ec80c71c39631f3fe556ea1ab1426552e109e15bd12103d" exitCode=0
Sep 16 01:45:07.197196 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:07.197089    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-0d2655-76cd8f4d9d-htct8"
Sep 16 01:45:07.197196 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:07.197123    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-0d2655-76cd8f4d9d-htct8" event={"ID":"073574ba-86a1-466b-8a0a-2b6fb97b6c68","Type":"ContainerDied","Data":"d5b3f296174b057f8ec80c71c39631f3fe556ea1ab1426552e109e15bd12103d"}
Sep 16 01:45:07.197196 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:07.197189    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-0d2655-76cd8f4d9d-htct8" event={"ID":"073574ba-86a1-466b-8a0a-2b6fb97b6c68","Type":"ContainerDied","Data":"258fc251f0516903a9c6b1a7275814c60ed018c90cee956cb153b00bb995c556"}
Sep 16 01:45:07.197383 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:07.197221    2565 scope.go:117] "RemoveContainer" containerID="d5b3f296174b057f8ec80c71c39631f3fe556ea1ab1426552e109e15bd12103d"
Sep 16 01:45:07.198654 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:07.198632    2565 generic.go:356] "Generic (PLEG): container finished" podID="365650a0-930f-4ea1-8e5d-a3588fa1891e" containerID="fff4651193f1eaa577ff983a3608592cb465494b47f48c51905e884570e26599" exitCode=0
Sep 16 01:45:07.198791 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:07.198661    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-0d2655-575888b5b9-7t6dn" event={"ID":"365650a0-930f-4ea1-8e5d-a3588fa1891e","Type":"ContainerDied","Data":"fff4651193f1eaa577ff983a3608592cb465494b47f48c51905e884570e26599"}
Sep 16 01:45:07.198791 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:07.198676    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-0d2655-575888b5b9-7t6dn"
Sep 16 01:45:07.198791 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:07.198714    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w1-0d2655-575888b5b9-7t6dn" event={"ID":"365650a0-930f-4ea1-8e5d-a3588fa1891e","Type":"ContainerDied","Data":"4e638f21ece9efe9884d24b0a4aeb66eb7223911aae822f01f795210da0378ed"}
Sep 16 01:45:07.207647 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:07.207627    2565 scope.go:117] "RemoveContainer" containerID="d5b3f296174b057f8ec80c71c39631f3fe556ea1ab1426552e109e15bd12103d"
Sep 16 01:45:07.207968 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:45:07.207945    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5b3f296174b057f8ec80c71c39631f3fe556ea1ab1426552e109e15bd12103d\": container with ID starting with d5b3f296174b057f8ec80c71c39631f3fe556ea1ab1426552e109e15bd12103d not found: ID does not exist" containerID="d5b3f296174b057f8ec80c71c39631f3fe556ea1ab1426552e109e15bd12103d"
Sep 16 01:45:07.208035 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:07.207981    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5b3f296174b057f8ec80c71c39631f3fe556ea1ab1426552e109e15bd12103d"} err="failed to get container status \"d5b3f296174b057f8ec80c71c39631f3fe556ea1ab1426552e109e15bd12103d\": rpc error: code = NotFound desc = could not find container \"d5b3f296174b057f8ec80c71c39631f3fe556ea1ab1426552e109e15bd12103d\": container with ID starting with d5b3f296174b057f8ec80c71c39631f3fe556ea1ab1426552e109e15bd12103d not found: ID does not exist"
Sep 16 01:45:07.208035 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:07.208004    2565 scope.go:117] "RemoveContainer" containerID="fff4651193f1eaa577ff983a3608592cb465494b47f48c51905e884570e26599"
Sep 16 01:45:07.216820 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:07.216802    2565 scope.go:117] "RemoveContainer" containerID="fff4651193f1eaa577ff983a3608592cb465494b47f48c51905e884570e26599"
Sep 16 01:45:07.217098 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:45:07.217074    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fff4651193f1eaa577ff983a3608592cb465494b47f48c51905e884570e26599\": container with ID starting with fff4651193f1eaa577ff983a3608592cb465494b47f48c51905e884570e26599 not found: ID does not exist" containerID="fff4651193f1eaa577ff983a3608592cb465494b47f48c51905e884570e26599"
Sep 16 01:45:07.217187 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:07.217104    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fff4651193f1eaa577ff983a3608592cb465494b47f48c51905e884570e26599"} err="failed to get container status \"fff4651193f1eaa577ff983a3608592cb465494b47f48c51905e884570e26599\": rpc error: code = NotFound desc = could not find container \"fff4651193f1eaa577ff983a3608592cb465494b47f48c51905e884570e26599\": container with ID starting with fff4651193f1eaa577ff983a3608592cb465494b47f48c51905e884570e26599 not found: ID does not exist"
Sep 16 01:45:07.220639 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:07.220616    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w1-0d2655-575888b5b9-7t6dn"]
Sep 16 01:45:07.224517 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:07.224495    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w1-0d2655-575888b5b9-7t6dn"]
Sep 16 01:45:07.292297 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:07.292258    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/073574ba-86a1-466b-8a0a-2b6fb97b6c68-plugins-config-volume\") pod \"073574ba-86a1-466b-8a0a-2b6fb97b6c68\" (UID: \"073574ba-86a1-466b-8a0a-2b6fb97b6c68\") "
Sep 16 01:45:07.292561 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:07.292323    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-92ftq\" (UniqueName: \"kubernetes.io/projected/073574ba-86a1-466b-8a0a-2b6fb97b6c68-kube-api-access-92ftq\") pod \"073574ba-86a1-466b-8a0a-2b6fb97b6c68\" (UID: \"073574ba-86a1-466b-8a0a-2b6fb97b6c68\") "
Sep 16 01:45:07.292712 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:07.292692    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zzm4n\" (UniqueName: \"kubernetes.io/projected/365650a0-930f-4ea1-8e5d-a3588fa1891e-kube-api-access-zzm4n\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:45:07.292802 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:07.292716    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/365650a0-930f-4ea1-8e5d-a3588fa1891e-plugins-config-volume\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:45:07.292802 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:07.292746    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/073574ba-86a1-466b-8a0a-2b6fb97b6c68-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "073574ba-86a1-466b-8a0a-2b6fb97b6c68" (UID: "073574ba-86a1-466b-8a0a-2b6fb97b6c68"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:45:07.295580 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:07.295529    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/073574ba-86a1-466b-8a0a-2b6fb97b6c68-kube-api-access-92ftq" (OuterVolumeSpecName: "kube-api-access-92ftq") pod "073574ba-86a1-466b-8a0a-2b6fb97b6c68" (UID: "073574ba-86a1-466b-8a0a-2b6fb97b6c68"). InnerVolumeSpecName "kube-api-access-92ftq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:45:07.393993 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:07.393906    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/073574ba-86a1-466b-8a0a-2b6fb97b6c68-plugins-config-volume\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:45:07.393993 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:07.393937    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-92ftq\" (UniqueName: \"kubernetes.io/projected/073574ba-86a1-466b-8a0a-2b6fb97b6c68-kube-api-access-92ftq\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:45:07.518000 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:07.517960    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w1-0d2655-76cd8f4d9d-htct8"]
Sep 16 01:45:07.521392 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:07.521366    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w1-0d2655-76cd8f4d9d-htct8"]
Sep 16 01:45:09.169660 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:09.169628    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="073574ba-86a1-466b-8a0a-2b6fb97b6c68" path="/var/lib/kubelet/pods/073574ba-86a1-466b-8a0a-2b6fb97b6c68/volumes"
Sep 16 01:45:09.170039 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:09.169977    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="365650a0-930f-4ea1-8e5d-a3588fa1891e" path="/var/lib/kubelet/pods/365650a0-930f-4ea1-8e5d-a3588fa1891e/volumes"
Sep 16 01:45:13.203155 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:13.203117    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj"]
Sep 16 01:45:13.203676 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:13.203439    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj" podUID="1074617b-d56c-4638-8f7d-c9b5db5f6c68" containerName="istio-proxy" containerID="cri-o://f6957c5bde994dc8aa960193c553d8a8cf1eff3ca6917882dd3e3b247b02e9b7" gracePeriod=30
Sep 16 01:45:13.360797 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:13.360751    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-8d230b-l78c4"]
Sep 16 01:45:13.361243 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:13.361224    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24808b82-6a76-4697-a33c-a6d48deb960a" containerName="payload-pre-processing"
Sep 16 01:45:13.361351 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:13.361246    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="24808b82-6a76-4697-a33c-a6d48deb960a" containerName="payload-pre-processing"
Sep 16 01:45:13.361351 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:13.361264    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59023c4f-45b1-480e-a110-50c6fe86586a" containerName="istio-proxy"
Sep 16 01:45:13.361351 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:13.361271    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="59023c4f-45b1-480e-a110-50c6fe86586a" containerName="istio-proxy"
Sep 16 01:45:13.361351 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:13.361283    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="624281d6-9174-4107-80a7-320782f096ff" containerName="payload-processing"
Sep 16 01:45:13.361351 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:13.361291    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="624281d6-9174-4107-80a7-320782f096ff" containerName="payload-processing"
Sep 16 01:45:13.361351 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:13.361300    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f73953a6-1fc6-475b-ac14-7f045e3c1c00" containerName="cleanup"
Sep 16 01:45:13.361351 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:13.361309    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f73953a6-1fc6-475b-ac14-7f045e3c1c00" containerName="cleanup"
Sep 16 01:45:13.361351 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:13.361319    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b7b1a03-3ace-4b02-8d5a-876d252e9ec1" containerName="cleanup"
Sep 16 01:45:13.361351 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:13.361328    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b7b1a03-3ace-4b02-8d5a-876d252e9ec1" containerName="cleanup"
Sep 16 01:45:13.361803 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:13.361361    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82ba12b0-5cb7-4da7-b385-ee908f06fe56" containerName="cleanup"
Sep 16 01:45:13.361803 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:13.361370    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="82ba12b0-5cb7-4da7-b385-ee908f06fe56" containerName="cleanup"
Sep 16 01:45:13.361803 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:13.361387    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59023c4f-45b1-480e-a110-50c6fe86586a" containerName="istio-proxy"
Sep 16 01:45:13.361803 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:13.361395    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="59023c4f-45b1-480e-a110-50c6fe86586a" containerName="istio-proxy"
Sep 16 01:45:13.361803 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:13.361411    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f357a1a2-93f8-4d37-a19a-d790ee6bec64" containerName="cleanup"
Sep 16 01:45:13.361803 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:13.361420    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f357a1a2-93f8-4d37-a19a-d790ee6bec64" containerName="cleanup"
Sep 16 01:45:13.361803 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:13.361430    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="073574ba-86a1-466b-8a0a-2b6fb97b6c68" containerName="payload-pre-processing"
Sep 16 01:45:13.361803 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:13.361437    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="073574ba-86a1-466b-8a0a-2b6fb97b6c68" containerName="payload-pre-processing"
Sep 16 01:45:13.361803 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:13.361451    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="365650a0-930f-4ea1-8e5d-a3588fa1891e" containerName="payload-processing"
Sep 16 01:45:13.361803 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:13.361460    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="365650a0-930f-4ea1-8e5d-a3588fa1891e" containerName="payload-processing"
Sep 16 01:45:13.361803 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:13.361569    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="624281d6-9174-4107-80a7-320782f096ff" containerName="payload-processing"
Sep 16 01:45:13.361803 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:13.361582    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f357a1a2-93f8-4d37-a19a-d790ee6bec64" containerName="cleanup"
Sep 16 01:45:13.361803 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:13.361591    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f73953a6-1fc6-475b-ac14-7f045e3c1c00" containerName="cleanup"
Sep 16 01:45:13.361803 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:13.361602    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="82ba12b0-5cb7-4da7-b385-ee908f06fe56" containerName="cleanup"
Sep 16 01:45:13.361803 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:13.361611    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b7b1a03-3ace-4b02-8d5a-876d252e9ec1" containerName="cleanup"
Sep 16 01:45:13.361803 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:13.361621    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="24808b82-6a76-4697-a33c-a6d48deb960a" containerName="payload-pre-processing"
Sep 16 01:45:13.361803 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:13.361632    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="365650a0-930f-4ea1-8e5d-a3588fa1891e" containerName="payload-processing"
Sep 16 01:45:13.361803 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:13.361640    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="59023c4f-45b1-480e-a110-50c6fe86586a" containerName="istio-proxy"
Sep 16 01:45:13.361803 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:13.361649    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="073574ba-86a1-466b-8a0a-2b6fb97b6c68" containerName="payload-pre-processing"
Sep 16 01:45:13.361803 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:13.361657    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="59023c4f-45b1-480e-a110-50c6fe86586a" containerName="istio-proxy"
Sep 16 01:45:13.366542 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:13.366521    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-8d230b-l78c4"
Sep 16 01:45:13.369002 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:13.368981    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4ljjd\""
Sep 16 01:45:13.369002 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:13.368992    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 01:45:13.371289 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:13.371268    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-8d230b-l78c4"]
Sep 16 01:45:13.453318 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:13.453225    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/25d29526-eab9-41ac-ac77-a1411e748f50-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-8d230b-l78c4\" (UID: \"25d29526-eab9-41ac-ac77-a1411e748f50\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-8d230b-l78c4"
Sep 16 01:45:13.553859 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:13.553822    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/25d29526-eab9-41ac-ac77-a1411e748f50-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-8d230b-l78c4\" (UID: \"25d29526-eab9-41ac-ac77-a1411e748f50\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-8d230b-l78c4"
Sep 16 01:45:13.554480 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:13.554459    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/25d29526-eab9-41ac-ac77-a1411e748f50-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-8d230b-l78c4\" (UID: \"25d29526-eab9-41ac-ac77-a1411e748f50\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-8d230b-l78c4"
Sep 16 01:45:13.678635 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:13.678600    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-8d230b-l78c4"
Sep 16 01:45:13.954963 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:13.954937    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-8d230b-l78c4"]
Sep 16 01:45:13.957125 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:45:13.957090    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25d29526_eab9_41ac_ac77_a1411e748f50.slice/crio-3bdbb6288ddbc5674dfa5dc7c741ea35619e1627ede955c1ff1b7cb81eefc9c6 WatchSource:0}: Error finding container 3bdbb6288ddbc5674dfa5dc7c741ea35619e1627ede955c1ff1b7cb81eefc9c6: Status 404 returned error can't find the container with id 3bdbb6288ddbc5674dfa5dc7c741ea35619e1627ede955c1ff1b7cb81eefc9c6
Sep 16 01:45:14.163328 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:14.163302    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-processing-5d7dbbd56b-4455c" secret="" err="secret \"payload-processing-dockercfg-kkbcm\" not found"
Sep 16 01:45:14.239660 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:14.239574    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-8d230b-l78c4" event={"ID":"25d29526-eab9-41ac-ac77-a1411e748f50","Type":"ContainerStarted","Data":"3bdbb6288ddbc5674dfa5dc7c741ea35619e1627ede955c1ff1b7cb81eefc9c6"}
Sep 16 01:45:15.246995 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:15.246961    2565 generic.go:356] "Generic (PLEG): container finished" podID="25d29526-eab9-41ac-ac77-a1411e748f50" containerID="e8b465b0ed3b351ec444d2ead8f60ac118c1ca7e1485b3020eba0214ec4c9696" exitCode=0
Sep 16 01:45:15.247390 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:15.247054    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-8d230b-l78c4" event={"ID":"25d29526-eab9-41ac-ac77-a1411e748f50","Type":"ContainerDied","Data":"e8b465b0ed3b351ec444d2ead8f60ac118c1ca7e1485b3020eba0214ec4c9696"}
Sep 16 01:45:16.388112 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:16.388047    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-8d230b-l78c4"
Sep 16 01:45:16.480130 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:16.480095    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/25d29526-eab9-41ac-ac77-a1411e748f50-maas-api-service-ca\") pod \"25d29526-eab9-41ac-ac77-a1411e748f50\" (UID: \"25d29526-eab9-41ac-ac77-a1411e748f50\") "
Sep 16 01:45:16.480545 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:16.480519    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25d29526-eab9-41ac-ac77-a1411e748f50-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "25d29526-eab9-41ac-ac77-a1411e748f50" (UID: "25d29526-eab9-41ac-ac77-a1411e748f50"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:45:16.581322 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:16.581235    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/25d29526-eab9-41ac-ac77-a1411e748f50-maas-api-service-ca\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:45:17.259616 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:17.259581    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-8d230b-l78c4"
Sep 16 01:45:17.259765 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:17.259617    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-8d230b-l78c4" event={"ID":"25d29526-eab9-41ac-ac77-a1411e748f50","Type":"ContainerDied","Data":"3bdbb6288ddbc5674dfa5dc7c741ea35619e1627ede955c1ff1b7cb81eefc9c6"}
Sep 16 01:45:17.259765 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:17.259666    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3bdbb6288ddbc5674dfa5dc7c741ea35619e1627ede955c1ff1b7cb81eefc9c6"
Sep 16 01:45:18.449516 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:18.449489    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj"
Sep 16 01:45:18.598387 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:18.598250    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1074617b-d56c-4638-8f7d-c9b5db5f6c68-istio-token\") pod \"1074617b-d56c-4638-8f7d-c9b5db5f6c68\" (UID: \"1074617b-d56c-4638-8f7d-c9b5db5f6c68\") "
Sep 16 01:45:18.598387 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:18.598310    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1074617b-d56c-4638-8f7d-c9b5db5f6c68-workload-socket\") pod \"1074617b-d56c-4638-8f7d-c9b5db5f6c68\" (UID: \"1074617b-d56c-4638-8f7d-c9b5db5f6c68\") "
Sep 16 01:45:18.598387 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:18.598387    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1074617b-d56c-4638-8f7d-c9b5db5f6c68-istio-envoy\") pod \"1074617b-d56c-4638-8f7d-c9b5db5f6c68\" (UID: \"1074617b-d56c-4638-8f7d-c9b5db5f6c68\") "
Sep 16 01:45:18.598668 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:18.598432    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1074617b-d56c-4638-8f7d-c9b5db5f6c68-istio-podinfo\") pod \"1074617b-d56c-4638-8f7d-c9b5db5f6c68\" (UID: \"1074617b-d56c-4638-8f7d-c9b5db5f6c68\") "
Sep 16 01:45:18.598668 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:18.598487    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1074617b-d56c-4638-8f7d-c9b5db5f6c68-istiod-ca-cert\") pod \"1074617b-d56c-4638-8f7d-c9b5db5f6c68\" (UID: \"1074617b-d56c-4638-8f7d-c9b5db5f6c68\") "
Sep 16 01:45:18.598668 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:18.598532    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1074617b-d56c-4638-8f7d-c9b5db5f6c68-credential-socket\") pod \"1074617b-d56c-4638-8f7d-c9b5db5f6c68\" (UID: \"1074617b-d56c-4638-8f7d-c9b5db5f6c68\") "
Sep 16 01:45:18.598668 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:18.598567    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1074617b-d56c-4638-8f7d-c9b5db5f6c68-istio-data\") pod \"1074617b-d56c-4638-8f7d-c9b5db5f6c68\" (UID: \"1074617b-d56c-4638-8f7d-c9b5db5f6c68\") "
Sep 16 01:45:18.598668 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:18.598598    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bt2kr\" (UniqueName: \"kubernetes.io/projected/1074617b-d56c-4638-8f7d-c9b5db5f6c68-kube-api-access-bt2kr\") pod \"1074617b-d56c-4638-8f7d-c9b5db5f6c68\" (UID: \"1074617b-d56c-4638-8f7d-c9b5db5f6c68\") "
Sep 16 01:45:18.598668 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:18.598615    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1074617b-d56c-4638-8f7d-c9b5db5f6c68-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1074617b-d56c-4638-8f7d-c9b5db5f6c68" (UID: "1074617b-d56c-4638-8f7d-c9b5db5f6c68"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:45:18.598668 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:18.598632    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1074617b-d56c-4638-8f7d-c9b5db5f6c68-workload-certs\") pod \"1074617b-d56c-4638-8f7d-c9b5db5f6c68\" (UID: \"1074617b-d56c-4638-8f7d-c9b5db5f6c68\") "
Sep 16 01:45:18.599108 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:18.598816    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1074617b-d56c-4638-8f7d-c9b5db5f6c68-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1074617b-d56c-4638-8f7d-c9b5db5f6c68" (UID: "1074617b-d56c-4638-8f7d-c9b5db5f6c68"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:45:18.599108 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:18.598848    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1074617b-d56c-4638-8f7d-c9b5db5f6c68-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1074617b-d56c-4638-8f7d-c9b5db5f6c68" (UID: "1074617b-d56c-4638-8f7d-c9b5db5f6c68"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:45:18.599108 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:18.599010    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1074617b-d56c-4638-8f7d-c9b5db5f6c68-workload-socket\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:45:18.599108 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:18.599031    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1074617b-d56c-4638-8f7d-c9b5db5f6c68-credential-socket\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:45:18.599108 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:18.599045    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1074617b-d56c-4638-8f7d-c9b5db5f6c68-workload-certs\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:45:18.599108 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:18.599009    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1074617b-d56c-4638-8f7d-c9b5db5f6c68-istio-data" (OuterVolumeSpecName: "istio-data") pod "1074617b-d56c-4638-8f7d-c9b5db5f6c68" (UID: "1074617b-d56c-4638-8f7d-c9b5db5f6c68"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:45:18.599108 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:18.598928    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1074617b-d56c-4638-8f7d-c9b5db5f6c68-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1074617b-d56c-4638-8f7d-c9b5db5f6c68" (UID: "1074617b-d56c-4638-8f7d-c9b5db5f6c68"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:45:18.600647 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:18.600623    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1074617b-d56c-4638-8f7d-c9b5db5f6c68-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1074617b-d56c-4638-8f7d-c9b5db5f6c68" (UID: "1074617b-d56c-4638-8f7d-c9b5db5f6c68"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 01:45:18.600765 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:18.600649    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1074617b-d56c-4638-8f7d-c9b5db5f6c68-istio-token" (OuterVolumeSpecName: "istio-token") pod "1074617b-d56c-4638-8f7d-c9b5db5f6c68" (UID: "1074617b-d56c-4638-8f7d-c9b5db5f6c68"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:45:18.600929 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:18.600911    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1074617b-d56c-4638-8f7d-c9b5db5f6c68-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1074617b-d56c-4638-8f7d-c9b5db5f6c68" (UID: "1074617b-d56c-4638-8f7d-c9b5db5f6c68"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:45:18.601015 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:18.601000    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1074617b-d56c-4638-8f7d-c9b5db5f6c68-kube-api-access-bt2kr" (OuterVolumeSpecName: "kube-api-access-bt2kr") pod "1074617b-d56c-4638-8f7d-c9b5db5f6c68" (UID: "1074617b-d56c-4638-8f7d-c9b5db5f6c68"). InnerVolumeSpecName "kube-api-access-bt2kr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:45:18.699553 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:18.699510    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1074617b-d56c-4638-8f7d-c9b5db5f6c68-istio-envoy\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:45:18.699553 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:18.699544    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1074617b-d56c-4638-8f7d-c9b5db5f6c68-istio-podinfo\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:45:18.699553 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:18.699555    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1074617b-d56c-4638-8f7d-c9b5db5f6c68-istiod-ca-cert\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:45:18.699810 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:18.699565    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1074617b-d56c-4638-8f7d-c9b5db5f6c68-istio-data\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:45:18.699810 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:18.699575    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bt2kr\" (UniqueName: \"kubernetes.io/projected/1074617b-d56c-4638-8f7d-c9b5db5f6c68-kube-api-access-bt2kr\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:45:18.699810 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:18.699584    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1074617b-d56c-4638-8f7d-c9b5db5f6c68-istio-token\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:45:19.272044 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:19.272010    2565 generic.go:356] "Generic (PLEG): container finished" podID="1074617b-d56c-4638-8f7d-c9b5db5f6c68" containerID="f6957c5bde994dc8aa960193c553d8a8cf1eff3ca6917882dd3e3b247b02e9b7" exitCode=0
Sep 16 01:45:19.272187 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:19.272059    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj"
Sep 16 01:45:19.272187 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:19.272090    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj" event={"ID":"1074617b-d56c-4638-8f7d-c9b5db5f6c68","Type":"ContainerDied","Data":"f6957c5bde994dc8aa960193c553d8a8cf1eff3ca6917882dd3e3b247b02e9b7"}
Sep 16 01:45:19.272187 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:19.272143    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj" event={"ID":"1074617b-d56c-4638-8f7d-c9b5db5f6c68","Type":"ContainerDied","Data":"5a8ea3f14ca8704bbc56b5eedd4d7b52b3c5375684d202f0bfeda71e81f30095"}
Sep 16 01:45:19.272187 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:19.272166    2565 scope.go:117] "RemoveContainer" containerID="f6957c5bde994dc8aa960193c553d8a8cf1eff3ca6917882dd3e3b247b02e9b7"
Sep 16 01:45:19.281461 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:19.281442    2565 scope.go:117] "RemoveContainer" containerID="eb7adc38712b66dd2ac0e19df83bb197eaf67756d1e47af20c3a909b913294e3"
Sep 16 01:45:19.292982 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:19.292952    2565 scope.go:117] "RemoveContainer" containerID="f6957c5bde994dc8aa960193c553d8a8cf1eff3ca6917882dd3e3b247b02e9b7"
Sep 16 01:45:19.293401 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:45:19.293376    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6957c5bde994dc8aa960193c553d8a8cf1eff3ca6917882dd3e3b247b02e9b7\": container with ID starting with f6957c5bde994dc8aa960193c553d8a8cf1eff3ca6917882dd3e3b247b02e9b7 not found: ID does not exist" containerID="f6957c5bde994dc8aa960193c553d8a8cf1eff3ca6917882dd3e3b247b02e9b7"
Sep 16 01:45:19.293485 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:19.293410    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6957c5bde994dc8aa960193c553d8a8cf1eff3ca6917882dd3e3b247b02e9b7"} err="failed to get container status \"f6957c5bde994dc8aa960193c553d8a8cf1eff3ca6917882dd3e3b247b02e9b7\": rpc error: code = NotFound desc = could not find container \"f6957c5bde994dc8aa960193c553d8a8cf1eff3ca6917882dd3e3b247b02e9b7\": container with ID starting with f6957c5bde994dc8aa960193c553d8a8cf1eff3ca6917882dd3e3b247b02e9b7 not found: ID does not exist"
Sep 16 01:45:19.293485 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:19.293431    2565 scope.go:117] "RemoveContainer" containerID="eb7adc38712b66dd2ac0e19df83bb197eaf67756d1e47af20c3a909b913294e3"
Sep 16 01:45:19.293712 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:45:19.293695    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb7adc38712b66dd2ac0e19df83bb197eaf67756d1e47af20c3a909b913294e3\": container with ID starting with eb7adc38712b66dd2ac0e19df83bb197eaf67756d1e47af20c3a909b913294e3 not found: ID does not exist" containerID="eb7adc38712b66dd2ac0e19df83bb197eaf67756d1e47af20c3a909b913294e3"
Sep 16 01:45:19.293754 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:19.293718    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb7adc38712b66dd2ac0e19df83bb197eaf67756d1e47af20c3a909b913294e3"} err="failed to get container status \"eb7adc38712b66dd2ac0e19df83bb197eaf67756d1e47af20c3a909b913294e3\": rpc error: code = NotFound desc = could not find container \"eb7adc38712b66dd2ac0e19df83bb197eaf67756d1e47af20c3a909b913294e3\": container with ID starting with eb7adc38712b66dd2ac0e19df83bb197eaf67756d1e47af20c3a909b913294e3 not found: ID does not exist"
Sep 16 01:45:19.294576 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:19.294563    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj"]
Sep 16 01:45:19.296412 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:19.296392    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj"]
Sep 16 01:45:21.170721 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:21.170687    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1074617b-d56c-4638-8f7d-c9b5db5f6c68" path="/var/lib/kubelet/pods/1074617b-d56c-4638-8f7d-c9b5db5f6c68/volumes"
Sep 16 01:45:24.164031 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:24.163995    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-6cd864bc95-st4pq" secret="" err="secret \"payload-processing-dockercfg-kkbcm\" not found"
Sep 16 01:45:28.824749 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:28.824709    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-8d230b-29825385-9vf9m"]
Sep 16 01:45:28.826622 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:28.826596    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-8d230b-29825385-9vf9m"]
Sep 16 01:45:28.849120 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:28.849087    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-8d230b-5c8bf9cb4c-ctjr5"]
Sep 16 01:45:28.849455 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:28.849395    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-8d230b-5c8bf9cb4c-ctjr5" podUID="def1a514-7c74-4788-a673-6c523d029b57" containerName="payload-processing" containerID="cri-o://167e02a5da5ec2cb73b0c13fc09dac7ae7b4d833464f7df4ffdd476cd3e17722" gracePeriod=30
Sep 16 01:45:28.997958 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:28.997921    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-8d230b-l78c4"]
Sep 16 01:45:28.999776 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:28.999746    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-8d230b-l78c4"]
Sep 16 01:45:29.098082 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:29.098055    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-8d230b-5c8bf9cb4c-ctjr5"
Sep 16 01:45:29.170961 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:29.170928    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b7b1a03-3ace-4b02-8d5a-876d252e9ec1" path="/var/lib/kubelet/pods/1b7b1a03-3ace-4b02-8d5a-876d252e9ec1/volumes"
Sep 16 01:45:29.171742 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:29.171717    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25d29526-eab9-41ac-ac77-a1411e748f50" path="/var/lib/kubelet/pods/25d29526-eab9-41ac-ac77-a1411e748f50/volumes"
Sep 16 01:45:29.196477 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:29.196444    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/def1a514-7c74-4788-a673-6c523d029b57-plugins-config-volume\") pod \"def1a514-7c74-4788-a673-6c523d029b57\" (UID: \"def1a514-7c74-4788-a673-6c523d029b57\") "
Sep 16 01:45:29.196650 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:29.196541    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54hl7\" (UniqueName: \"kubernetes.io/projected/def1a514-7c74-4788-a673-6c523d029b57-kube-api-access-54hl7\") pod \"def1a514-7c74-4788-a673-6c523d029b57\" (UID: \"def1a514-7c74-4788-a673-6c523d029b57\") "
Sep 16 01:45:29.196829 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:29.196803    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/def1a514-7c74-4788-a673-6c523d029b57-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "def1a514-7c74-4788-a673-6c523d029b57" (UID: "def1a514-7c74-4788-a673-6c523d029b57"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:45:29.198733 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:29.198699    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/def1a514-7c74-4788-a673-6c523d029b57-kube-api-access-54hl7" (OuterVolumeSpecName: "kube-api-access-54hl7") pod "def1a514-7c74-4788-a673-6c523d029b57" (UID: "def1a514-7c74-4788-a673-6c523d029b57"). InnerVolumeSpecName "kube-api-access-54hl7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:45:29.297845 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:29.297814    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54hl7\" (UniqueName: \"kubernetes.io/projected/def1a514-7c74-4788-a673-6c523d029b57-kube-api-access-54hl7\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:45:29.297845 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:29.297840    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/def1a514-7c74-4788-a673-6c523d029b57-plugins-config-volume\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:45:29.332089 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:29.332001    2565 generic.go:356] "Generic (PLEG): container finished" podID="def1a514-7c74-4788-a673-6c523d029b57" containerID="167e02a5da5ec2cb73b0c13fc09dac7ae7b4d833464f7df4ffdd476cd3e17722" exitCode=0
Sep 16 01:45:29.332089 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:29.332051    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-8d230b-5c8bf9cb4c-ctjr5"
Sep 16 01:45:29.332089 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:29.332062    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-8d230b-5c8bf9cb4c-ctjr5" event={"ID":"def1a514-7c74-4788-a673-6c523d029b57","Type":"ContainerDied","Data":"167e02a5da5ec2cb73b0c13fc09dac7ae7b4d833464f7df4ffdd476cd3e17722"}
Sep 16 01:45:29.332264 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:29.332115    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-8d230b-5c8bf9cb4c-ctjr5" event={"ID":"def1a514-7c74-4788-a673-6c523d029b57","Type":"ContainerDied","Data":"ac7af51b6c17aac52d9b6ed7a68107a76c63874d5af2961f2a34d05266c4fec1"}
Sep 16 01:45:29.332264 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:29.332147    2565 scope.go:117] "RemoveContainer" containerID="167e02a5da5ec2cb73b0c13fc09dac7ae7b4d833464f7df4ffdd476cd3e17722"
Sep 16 01:45:29.341384 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:29.341350    2565 scope.go:117] "RemoveContainer" containerID="167e02a5da5ec2cb73b0c13fc09dac7ae7b4d833464f7df4ffdd476cd3e17722"
Sep 16 01:45:29.341644 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:45:29.341625    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"167e02a5da5ec2cb73b0c13fc09dac7ae7b4d833464f7df4ffdd476cd3e17722\": container with ID starting with 167e02a5da5ec2cb73b0c13fc09dac7ae7b4d833464f7df4ffdd476cd3e17722 not found: ID does not exist" containerID="167e02a5da5ec2cb73b0c13fc09dac7ae7b4d833464f7df4ffdd476cd3e17722"
Sep 16 01:45:29.341694 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:29.341651    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"167e02a5da5ec2cb73b0c13fc09dac7ae7b4d833464f7df4ffdd476cd3e17722"} err="failed to get container status \"167e02a5da5ec2cb73b0c13fc09dac7ae7b4d833464f7df4ffdd476cd3e17722\": rpc error: code = NotFound desc = could not find container \"167e02a5da5ec2cb73b0c13fc09dac7ae7b4d833464f7df4ffdd476cd3e17722\": container with ID starting with 167e02a5da5ec2cb73b0c13fc09dac7ae7b4d833464f7df4ffdd476cd3e17722 not found: ID does not exist"
Sep 16 01:45:29.352218 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:29.352194    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-8d230b-5c8bf9cb4c-ctjr5"]
Sep 16 01:45:29.358378 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:29.358353    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-8d230b-5c8bf9cb4c-ctjr5"]
Sep 16 01:45:31.169226 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:45:31.169192    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="def1a514-7c74-4788-a673-6c523d029b57" path="/var/lib/kubelet/pods/def1a514-7c74-4788-a673-6c523d029b57/volumes"
Sep 16 01:46:17.143892 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:17.143848    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h"]
Sep 16 01:46:17.144439 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:17.144077    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h" podUID="ec30d4ef-5d57-47da-b2a4-ae1e43795f22" containerName="istio-proxy" containerID="cri-o://db6fdb63d6b52ff05b598a77aa467a9e583293f355b7ce7bbdc5f672ed8104ea" gracePeriod=30
Sep 16 01:46:17.546786 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:17.546744    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a42101-vpjxz"]
Sep 16 01:46:17.547153 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:17.547139    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1074617b-d56c-4638-8f7d-c9b5db5f6c68" containerName="istio-proxy"
Sep 16 01:46:17.547205 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:17.547155    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1074617b-d56c-4638-8f7d-c9b5db5f6c68" containerName="istio-proxy"
Sep 16 01:46:17.547205 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:17.547173    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="def1a514-7c74-4788-a673-6c523d029b57" containerName="payload-processing"
Sep 16 01:46:17.547205 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:17.547178    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="def1a514-7c74-4788-a673-6c523d029b57" containerName="payload-processing"
Sep 16 01:46:17.547205 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:17.547187    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25d29526-eab9-41ac-ac77-a1411e748f50" containerName="revoke-keys"
Sep 16 01:46:17.547205 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:17.547193    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="25d29526-eab9-41ac-ac77-a1411e748f50" containerName="revoke-keys"
Sep 16 01:46:17.547420 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:17.547257    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1074617b-d56c-4638-8f7d-c9b5db5f6c68" containerName="istio-proxy"
Sep 16 01:46:17.547420 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:17.547265    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="def1a514-7c74-4788-a673-6c523d029b57" containerName="payload-processing"
Sep 16 01:46:17.547420 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:17.547272    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="25d29526-eab9-41ac-ac77-a1411e748f50" containerName="revoke-keys"
Sep 16 01:46:17.547420 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:17.547279    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1074617b-d56c-4638-8f7d-c9b5db5f6c68" containerName="istio-proxy"
Sep 16 01:46:17.550595 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:17.550569    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a42101-vpjxz"
Sep 16 01:46:17.552812 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:17.552792    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4ljjd\""
Sep 16 01:46:17.552939 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:17.552900    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 01:46:17.557399 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:17.557368    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a42101-vpjxz"]
Sep 16 01:46:17.634517 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:17.634476    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d94a8f10-4be1-4fb5-a2f0-30c4ec78626a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-a42101-vpjxz\" (UID: \"d94a8f10-4be1-4fb5-a2f0-30c4ec78626a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a42101-vpjxz"
Sep 16 01:46:17.735562 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:17.735512    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d94a8f10-4be1-4fb5-a2f0-30c4ec78626a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-a42101-vpjxz\" (UID: \"d94a8f10-4be1-4fb5-a2f0-30c4ec78626a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a42101-vpjxz"
Sep 16 01:46:17.736170 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:17.736149    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d94a8f10-4be1-4fb5-a2f0-30c4ec78626a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-a42101-vpjxz\" (UID: \"d94a8f10-4be1-4fb5-a2f0-30c4ec78626a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a42101-vpjxz"
Sep 16 01:46:17.863152 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:17.863039    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a42101-vpjxz"
Sep 16 01:46:18.138751 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:18.138720    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a42101-vpjxz"]
Sep 16 01:46:18.140774 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:46:18.140739    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd94a8f10_4be1_4fb5_a2f0_30c4ec78626a.slice/crio-dd8a6abed6a5ae7aa79d72a3fa498553b54c09c5f280e08d5bc9cf5d2d7ac852 WatchSource:0}: Error finding container dd8a6abed6a5ae7aa79d72a3fa498553b54c09c5f280e08d5bc9cf5d2d7ac852: Status 404 returned error can't find the container with id dd8a6abed6a5ae7aa79d72a3fa498553b54c09c5f280e08d5bc9cf5d2d7ac852
Sep 16 01:46:18.596747 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:18.596705    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a42101-vpjxz" event={"ID":"d94a8f10-4be1-4fb5-a2f0-30c4ec78626a","Type":"ContainerStarted","Data":"e895bf0a45b59e82f846cd549a20249283931dd8a1434f3bbfb5328a6013b8be"}
Sep 16 01:46:18.597154 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:18.596761    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a42101-vpjxz" event={"ID":"d94a8f10-4be1-4fb5-a2f0-30c4ec78626a","Type":"ContainerStarted","Data":"dd8a6abed6a5ae7aa79d72a3fa498553b54c09c5f280e08d5bc9cf5d2d7ac852"}
Sep 16 01:46:18.612566 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:18.612512    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a42101-vpjxz" podStartSLOduration=1.6124956080000001 podStartE2EDuration="1.612495608s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:46:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:46:18.609709307 +0000 UTC m=+1827.933177886" watchObservedRunningTime="2026-09-16 01:46:18.612495608 +0000 UTC m=+1827.935964184"
Sep 16 01:46:19.603485 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:19.603448    2565 generic.go:356] "Generic (PLEG): container finished" podID="d94a8f10-4be1-4fb5-a2f0-30c4ec78626a" containerID="e895bf0a45b59e82f846cd549a20249283931dd8a1434f3bbfb5328a6013b8be" exitCode=0
Sep 16 01:46:19.603951 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:19.603499    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a42101-vpjxz" event={"ID":"d94a8f10-4be1-4fb5-a2f0-30c4ec78626a","Type":"ContainerDied","Data":"e895bf0a45b59e82f846cd549a20249283931dd8a1434f3bbfb5328a6013b8be"}
Sep 16 01:46:20.742053 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:20.742028    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a42101-vpjxz"
Sep 16 01:46:20.763781 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:20.763753    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d94a8f10-4be1-4fb5-a2f0-30c4ec78626a-maas-api-service-ca\") pod \"d94a8f10-4be1-4fb5-a2f0-30c4ec78626a\" (UID: \"d94a8f10-4be1-4fb5-a2f0-30c4ec78626a\") "
Sep 16 01:46:20.764168 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:20.764142    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d94a8f10-4be1-4fb5-a2f0-30c4ec78626a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d94a8f10-4be1-4fb5-a2f0-30c4ec78626a" (UID: "d94a8f10-4be1-4fb5-a2f0-30c4ec78626a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:46:20.864729 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:20.864639    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d94a8f10-4be1-4fb5-a2f0-30c4ec78626a-maas-api-service-ca\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:46:21.614920 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:21.614822    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a42101-vpjxz"
Sep 16 01:46:21.614920 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:21.614865    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a42101-vpjxz" event={"ID":"d94a8f10-4be1-4fb5-a2f0-30c4ec78626a","Type":"ContainerDied","Data":"dd8a6abed6a5ae7aa79d72a3fa498553b54c09c5f280e08d5bc9cf5d2d7ac852"}
Sep 16 01:46:21.614920 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:21.614911    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dd8a6abed6a5ae7aa79d72a3fa498553b54c09c5f280e08d5bc9cf5d2d7ac852"
Sep 16 01:46:22.396961 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:22.396932    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h"
Sep 16 01:46:22.479439 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:22.479404    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec30d4ef-5d57-47da-b2a4-ae1e43795f22-istio-data\") pod \"ec30d4ef-5d57-47da-b2a4-ae1e43795f22\" (UID: \"ec30d4ef-5d57-47da-b2a4-ae1e43795f22\") "
Sep 16 01:46:22.479439 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:22.479438    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec30d4ef-5d57-47da-b2a4-ae1e43795f22-istio-envoy\") pod \"ec30d4ef-5d57-47da-b2a4-ae1e43795f22\" (UID: \"ec30d4ef-5d57-47da-b2a4-ae1e43795f22\") "
Sep 16 01:46:22.479710 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:22.479469    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec30d4ef-5d57-47da-b2a4-ae1e43795f22-workload-certs\") pod \"ec30d4ef-5d57-47da-b2a4-ae1e43795f22\" (UID: \"ec30d4ef-5d57-47da-b2a4-ae1e43795f22\") "
Sep 16 01:46:22.479710 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:22.479528    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec30d4ef-5d57-47da-b2a4-ae1e43795f22-istiod-ca-cert\") pod \"ec30d4ef-5d57-47da-b2a4-ae1e43795f22\" (UID: \"ec30d4ef-5d57-47da-b2a4-ae1e43795f22\") "
Sep 16 01:46:22.479710 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:22.479553    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec30d4ef-5d57-47da-b2a4-ae1e43795f22-istio-podinfo\") pod \"ec30d4ef-5d57-47da-b2a4-ae1e43795f22\" (UID: \"ec30d4ef-5d57-47da-b2a4-ae1e43795f22\") "
Sep 16 01:46:22.479710 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:22.479585    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec30d4ef-5d57-47da-b2a4-ae1e43795f22-credential-socket\") pod \"ec30d4ef-5d57-47da-b2a4-ae1e43795f22\" (UID: \"ec30d4ef-5d57-47da-b2a4-ae1e43795f22\") "
Sep 16 01:46:22.479918 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:22.479772    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec30d4ef-5d57-47da-b2a4-ae1e43795f22-istio-data" (OuterVolumeSpecName: "istio-data") pod "ec30d4ef-5d57-47da-b2a4-ae1e43795f22" (UID: "ec30d4ef-5d57-47da-b2a4-ae1e43795f22"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:46:22.479918 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:22.479856    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec30d4ef-5d57-47da-b2a4-ae1e43795f22-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ec30d4ef-5d57-47da-b2a4-ae1e43795f22" (UID: "ec30d4ef-5d57-47da-b2a4-ae1e43795f22"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:46:22.479918 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:22.479869    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec30d4ef-5d57-47da-b2a4-ae1e43795f22-workload-socket\") pod \"ec30d4ef-5d57-47da-b2a4-ae1e43795f22\" (UID: \"ec30d4ef-5d57-47da-b2a4-ae1e43795f22\") "
Sep 16 01:46:22.479918 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:22.479877    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec30d4ef-5d57-47da-b2a4-ae1e43795f22-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ec30d4ef-5d57-47da-b2a4-ae1e43795f22" (UID: "ec30d4ef-5d57-47da-b2a4-ae1e43795f22"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:46:22.480130 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:22.479942    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec30d4ef-5d57-47da-b2a4-ae1e43795f22-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ec30d4ef-5d57-47da-b2a4-ae1e43795f22" (UID: "ec30d4ef-5d57-47da-b2a4-ae1e43795f22"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:46:22.480130 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:22.479955    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7528p\" (UniqueName: \"kubernetes.io/projected/ec30d4ef-5d57-47da-b2a4-ae1e43795f22-kube-api-access-7528p\") pod \"ec30d4ef-5d57-47da-b2a4-ae1e43795f22\" (UID: \"ec30d4ef-5d57-47da-b2a4-ae1e43795f22\") "
Sep 16 01:46:22.480130 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:22.479987    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec30d4ef-5d57-47da-b2a4-ae1e43795f22-istio-token\") pod \"ec30d4ef-5d57-47da-b2a4-ae1e43795f22\" (UID: \"ec30d4ef-5d57-47da-b2a4-ae1e43795f22\") "
Sep 16 01:46:22.480130 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:22.480098    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec30d4ef-5d57-47da-b2a4-ae1e43795f22-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ec30d4ef-5d57-47da-b2a4-ae1e43795f22" (UID: "ec30d4ef-5d57-47da-b2a4-ae1e43795f22"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:46:22.480329 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:22.480314    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec30d4ef-5d57-47da-b2a4-ae1e43795f22-istio-data\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:46:22.480421 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:22.480356    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec30d4ef-5d57-47da-b2a4-ae1e43795f22-workload-certs\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:46:22.480421 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:22.480371    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec30d4ef-5d57-47da-b2a4-ae1e43795f22-istiod-ca-cert\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:46:22.480421 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:22.480385    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec30d4ef-5d57-47da-b2a4-ae1e43795f22-credential-socket\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:46:22.480421 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:22.480399    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec30d4ef-5d57-47da-b2a4-ae1e43795f22-workload-socket\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:46:22.481852 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:22.481826    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ec30d4ef-5d57-47da-b2a4-ae1e43795f22-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ec30d4ef-5d57-47da-b2a4-ae1e43795f22" (UID: "ec30d4ef-5d57-47da-b2a4-ae1e43795f22"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 01:46:22.482053 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:22.482031    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec30d4ef-5d57-47da-b2a4-ae1e43795f22-istio-token" (OuterVolumeSpecName: "istio-token") pod "ec30d4ef-5d57-47da-b2a4-ae1e43795f22" (UID: "ec30d4ef-5d57-47da-b2a4-ae1e43795f22"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:46:22.482170 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:22.482148    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec30d4ef-5d57-47da-b2a4-ae1e43795f22-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ec30d4ef-5d57-47da-b2a4-ae1e43795f22" (UID: "ec30d4ef-5d57-47da-b2a4-ae1e43795f22"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:46:22.482284 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:22.482262    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec30d4ef-5d57-47da-b2a4-ae1e43795f22-kube-api-access-7528p" (OuterVolumeSpecName: "kube-api-access-7528p") pod "ec30d4ef-5d57-47da-b2a4-ae1e43795f22" (UID: "ec30d4ef-5d57-47da-b2a4-ae1e43795f22"). InnerVolumeSpecName "kube-api-access-7528p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:46:22.581102 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:22.581072    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7528p\" (UniqueName: \"kubernetes.io/projected/ec30d4ef-5d57-47da-b2a4-ae1e43795f22-kube-api-access-7528p\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:46:22.581102 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:22.581099    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec30d4ef-5d57-47da-b2a4-ae1e43795f22-istio-token\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:46:22.581102 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:22.581110    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec30d4ef-5d57-47da-b2a4-ae1e43795f22-istio-envoy\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:46:22.581346 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:22.581119    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec30d4ef-5d57-47da-b2a4-ae1e43795f22-istio-podinfo\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:46:22.628245 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:22.628206    2565 generic.go:356] "Generic (PLEG): container finished" podID="ec30d4ef-5d57-47da-b2a4-ae1e43795f22" containerID="db6fdb63d6b52ff05b598a77aa467a9e583293f355b7ce7bbdc5f672ed8104ea" exitCode=0
Sep 16 01:46:22.628446 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:22.628266    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h"
Sep 16 01:46:22.628446 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:22.628290    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h" event={"ID":"ec30d4ef-5d57-47da-b2a4-ae1e43795f22","Type":"ContainerDied","Data":"db6fdb63d6b52ff05b598a77aa467a9e583293f355b7ce7bbdc5f672ed8104ea"}
Sep 16 01:46:22.628446 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:22.628384    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h" event={"ID":"ec30d4ef-5d57-47da-b2a4-ae1e43795f22","Type":"ContainerDied","Data":"3ab70ffe8ce4126a10303059111f2966be913171677cc6b134058c90d2adbbe2"}
Sep 16 01:46:22.628446 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:22.628407    2565 scope.go:117] "RemoveContainer" containerID="db6fdb63d6b52ff05b598a77aa467a9e583293f355b7ce7bbdc5f672ed8104ea"
Sep 16 01:46:22.637719 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:22.637704    2565 scope.go:117] "RemoveContainer" containerID="821271b970fdffbed54bef6e9853db915eddbf246dd13d8f8e85b1d50c2b161e"
Sep 16 01:46:22.646425 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:22.646374    2565 scope.go:117] "RemoveContainer" containerID="db6fdb63d6b52ff05b598a77aa467a9e583293f355b7ce7bbdc5f672ed8104ea"
Sep 16 01:46:22.646837 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:46:22.646807    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db6fdb63d6b52ff05b598a77aa467a9e583293f355b7ce7bbdc5f672ed8104ea\": container with ID starting with db6fdb63d6b52ff05b598a77aa467a9e583293f355b7ce7bbdc5f672ed8104ea not found: ID does not exist" containerID="db6fdb63d6b52ff05b598a77aa467a9e583293f355b7ce7bbdc5f672ed8104ea"
Sep 16 01:46:22.646937 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:22.646848    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db6fdb63d6b52ff05b598a77aa467a9e583293f355b7ce7bbdc5f672ed8104ea"} err="failed to get container status \"db6fdb63d6b52ff05b598a77aa467a9e583293f355b7ce7bbdc5f672ed8104ea\": rpc error: code = NotFound desc = could not find container \"db6fdb63d6b52ff05b598a77aa467a9e583293f355b7ce7bbdc5f672ed8104ea\": container with ID starting with db6fdb63d6b52ff05b598a77aa467a9e583293f355b7ce7bbdc5f672ed8104ea not found: ID does not exist"
Sep 16 01:46:22.646937 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:22.646872    2565 scope.go:117] "RemoveContainer" containerID="821271b970fdffbed54bef6e9853db915eddbf246dd13d8f8e85b1d50c2b161e"
Sep 16 01:46:22.647161 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:46:22.647138    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"821271b970fdffbed54bef6e9853db915eddbf246dd13d8f8e85b1d50c2b161e\": container with ID starting with 821271b970fdffbed54bef6e9853db915eddbf246dd13d8f8e85b1d50c2b161e not found: ID does not exist" containerID="821271b970fdffbed54bef6e9853db915eddbf246dd13d8f8e85b1d50c2b161e"
Sep 16 01:46:22.647210 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:22.647168    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"821271b970fdffbed54bef6e9853db915eddbf246dd13d8f8e85b1d50c2b161e"} err="failed to get container status \"821271b970fdffbed54bef6e9853db915eddbf246dd13d8f8e85b1d50c2b161e\": rpc error: code = NotFound desc = could not find container \"821271b970fdffbed54bef6e9853db915eddbf246dd13d8f8e85b1d50c2b161e\": container with ID starting with 821271b970fdffbed54bef6e9853db915eddbf246dd13d8f8e85b1d50c2b161e not found: ID does not exist"
Sep 16 01:46:22.648830 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:22.648812    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h"]
Sep 16 01:46:22.653636 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:22.653615    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h"]
Sep 16 01:46:23.169780 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:23.169745    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec30d4ef-5d57-47da-b2a4-ae1e43795f22" path="/var/lib/kubelet/pods/ec30d4ef-5d57-47da-b2a4-ae1e43795f22/volumes"
Sep 16 01:46:28.067145 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:28.067111    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-a42101-29825385-724dx"]
Sep 16 01:46:28.069899 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:28.069875    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-a42101-29825385-724dx"]
Sep 16 01:46:28.096782 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:28.096751    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-a42101-7ffd868b8b-tgdbf"]
Sep 16 01:46:28.096995 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:28.096970    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a42101-7ffd868b8b-tgdbf" podUID="63b15286-47cd-49dd-a1e2-cc5e4f9eae9a" containerName="payload-pre-processing" containerID="cri-o://79db34be21f0a89af5fd1fc86cac5150f5c68d8961f39df9bf37189ec5c0dfbe" gracePeriod=30
Sep 16 01:46:28.240230 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:28.240188    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a42101-vpjxz"]
Sep 16 01:46:28.242405 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:28.242373    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a42101-vpjxz"]
Sep 16 01:46:28.367783 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:28.367758    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a42101-7ffd868b8b-tgdbf"
Sep 16 01:46:28.434561 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:28.434526    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63b15286-47cd-49dd-a1e2-cc5e4f9eae9a-plugins-config-volume\") pod \"63b15286-47cd-49dd-a1e2-cc5e4f9eae9a\" (UID: \"63b15286-47cd-49dd-a1e2-cc5e4f9eae9a\") "
Sep 16 01:46:28.434759 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:28.434611    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nvr44\" (UniqueName: \"kubernetes.io/projected/63b15286-47cd-49dd-a1e2-cc5e4f9eae9a-kube-api-access-nvr44\") pod \"63b15286-47cd-49dd-a1e2-cc5e4f9eae9a\" (UID: \"63b15286-47cd-49dd-a1e2-cc5e4f9eae9a\") "
Sep 16 01:46:28.434904 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:28.434882    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63b15286-47cd-49dd-a1e2-cc5e4f9eae9a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "63b15286-47cd-49dd-a1e2-cc5e4f9eae9a" (UID: "63b15286-47cd-49dd-a1e2-cc5e4f9eae9a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:46:28.436831 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:28.436808    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63b15286-47cd-49dd-a1e2-cc5e4f9eae9a-kube-api-access-nvr44" (OuterVolumeSpecName: "kube-api-access-nvr44") pod "63b15286-47cd-49dd-a1e2-cc5e4f9eae9a" (UID: "63b15286-47cd-49dd-a1e2-cc5e4f9eae9a"). InnerVolumeSpecName "kube-api-access-nvr44". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:46:28.535492 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:28.535450    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nvr44\" (UniqueName: \"kubernetes.io/projected/63b15286-47cd-49dd-a1e2-cc5e4f9eae9a-kube-api-access-nvr44\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:46:28.535492 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:28.535483    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63b15286-47cd-49dd-a1e2-cc5e4f9eae9a-plugins-config-volume\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:46:28.663436 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:28.663401    2565 generic.go:356] "Generic (PLEG): container finished" podID="63b15286-47cd-49dd-a1e2-cc5e4f9eae9a" containerID="79db34be21f0a89af5fd1fc86cac5150f5c68d8961f39df9bf37189ec5c0dfbe" exitCode=0
Sep 16 01:46:28.663613 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:28.663451    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a42101-7ffd868b8b-tgdbf"
Sep 16 01:46:28.663613 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:28.663485    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a42101-7ffd868b8b-tgdbf" event={"ID":"63b15286-47cd-49dd-a1e2-cc5e4f9eae9a","Type":"ContainerDied","Data":"79db34be21f0a89af5fd1fc86cac5150f5c68d8961f39df9bf37189ec5c0dfbe"}
Sep 16 01:46:28.663613 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:28.663545    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a42101-7ffd868b8b-tgdbf" event={"ID":"63b15286-47cd-49dd-a1e2-cc5e4f9eae9a","Type":"ContainerDied","Data":"9f2fa9f92d0eb363f8af6fc4033e207d5500d99febf83b68728f9a2f486e8995"}
Sep 16 01:46:28.663613 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:28.663569    2565 scope.go:117] "RemoveContainer" containerID="79db34be21f0a89af5fd1fc86cac5150f5c68d8961f39df9bf37189ec5c0dfbe"
Sep 16 01:46:28.672805 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:28.672784    2565 scope.go:117] "RemoveContainer" containerID="79db34be21f0a89af5fd1fc86cac5150f5c68d8961f39df9bf37189ec5c0dfbe"
Sep 16 01:46:28.673123 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:46:28.673102    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79db34be21f0a89af5fd1fc86cac5150f5c68d8961f39df9bf37189ec5c0dfbe\": container with ID starting with 79db34be21f0a89af5fd1fc86cac5150f5c68d8961f39df9bf37189ec5c0dfbe not found: ID does not exist" containerID="79db34be21f0a89af5fd1fc86cac5150f5c68d8961f39df9bf37189ec5c0dfbe"
Sep 16 01:46:28.673197 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:28.673133    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79db34be21f0a89af5fd1fc86cac5150f5c68d8961f39df9bf37189ec5c0dfbe"} err="failed to get container status \"79db34be21f0a89af5fd1fc86cac5150f5c68d8961f39df9bf37189ec5c0dfbe\": rpc error: code = NotFound desc = could not find container \"79db34be21f0a89af5fd1fc86cac5150f5c68d8961f39df9bf37189ec5c0dfbe\": container with ID starting with 79db34be21f0a89af5fd1fc86cac5150f5c68d8961f39df9bf37189ec5c0dfbe not found: ID does not exist"
Sep 16 01:46:28.683649 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:28.683621    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-a42101-7ffd868b8b-tgdbf"]
Sep 16 01:46:28.687120 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:28.687098    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-a42101-7ffd868b8b-tgdbf"]
Sep 16 01:46:29.168980 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:29.168944    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63b15286-47cd-49dd-a1e2-cc5e4f9eae9a" path="/var/lib/kubelet/pods/63b15286-47cd-49dd-a1e2-cc5e4f9eae9a/volumes"
Sep 16 01:46:29.169428 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:29.169411    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82ba12b0-5cb7-4da7-b385-ee908f06fe56" path="/var/lib/kubelet/pods/82ba12b0-5cb7-4da7-b385-ee908f06fe56/volumes"
Sep 16 01:46:29.169819 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:29.169805    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d94a8f10-4be1-4fb5-a2f0-30c4ec78626a" path="/var/lib/kubelet/pods/d94a8f10-4be1-4fb5-a2f0-30c4ec78626a/volumes"
Sep 16 01:46:34.897886 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:34.897852    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-cbb499-drsnp"]
Sep 16 01:46:34.898329 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:34.898202    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec30d4ef-5d57-47da-b2a4-ae1e43795f22" containerName="istio-proxy"
Sep 16 01:46:34.898329 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:34.898213    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec30d4ef-5d57-47da-b2a4-ae1e43795f22" containerName="istio-proxy"
Sep 16 01:46:34.898329 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:34.898221    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d94a8f10-4be1-4fb5-a2f0-30c4ec78626a" containerName="revoke-keys"
Sep 16 01:46:34.898329 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:34.898227    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d94a8f10-4be1-4fb5-a2f0-30c4ec78626a" containerName="revoke-keys"
Sep 16 01:46:34.898329 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:34.898241    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1074617b-d56c-4638-8f7d-c9b5db5f6c68" containerName="istio-proxy"
Sep 16 01:46:34.898329 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:34.898247    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1074617b-d56c-4638-8f7d-c9b5db5f6c68" containerName="istio-proxy"
Sep 16 01:46:34.898329 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:34.898256    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec30d4ef-5d57-47da-b2a4-ae1e43795f22" containerName="istio-proxy"
Sep 16 01:46:34.898329 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:34.898263    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec30d4ef-5d57-47da-b2a4-ae1e43795f22" containerName="istio-proxy"
Sep 16 01:46:34.898329 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:34.898269    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63b15286-47cd-49dd-a1e2-cc5e4f9eae9a" containerName="payload-pre-processing"
Sep 16 01:46:34.898329 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:34.898275    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="63b15286-47cd-49dd-a1e2-cc5e4f9eae9a" containerName="payload-pre-processing"
Sep 16 01:46:34.898702 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:34.898330    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="63b15286-47cd-49dd-a1e2-cc5e4f9eae9a" containerName="payload-pre-processing"
Sep 16 01:46:34.898702 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:34.898362    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d94a8f10-4be1-4fb5-a2f0-30c4ec78626a" containerName="revoke-keys"
Sep 16 01:46:34.898702 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:34.898373    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec30d4ef-5d57-47da-b2a4-ae1e43795f22" containerName="istio-proxy"
Sep 16 01:46:34.898702 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:34.898379    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec30d4ef-5d57-47da-b2a4-ae1e43795f22" containerName="istio-proxy"
Sep 16 01:46:34.902979 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:34.902961    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-cbb499-drsnp"
Sep 16 01:46:34.905978 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:34.905948    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 01:46:34.906590 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:34.906316    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4ljjd\""
Sep 16 01:46:34.907684 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:34.907659    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-cbb499-drsnp"]
Sep 16 01:46:34.991439 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:34.991407    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca94fe38-c27a-4eb6-98dd-ab425624e9c3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-cbb499-drsnp\" (UID: \"ca94fe38-c27a-4eb6-98dd-ab425624e9c3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-cbb499-drsnp"
Sep 16 01:46:35.092631 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:35.092593    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca94fe38-c27a-4eb6-98dd-ab425624e9c3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-cbb499-drsnp\" (UID: \"ca94fe38-c27a-4eb6-98dd-ab425624e9c3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-cbb499-drsnp"
Sep 16 01:46:35.093234 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:35.093215    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca94fe38-c27a-4eb6-98dd-ab425624e9c3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-cbb499-drsnp\" (UID: \"ca94fe38-c27a-4eb6-98dd-ab425624e9c3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-cbb499-drsnp"
Sep 16 01:46:35.214933 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:35.214904    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-cbb499-drsnp"
Sep 16 01:46:35.483895 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:35.483871    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-cbb499-drsnp"]
Sep 16 01:46:35.486708 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:46:35.486670    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca94fe38_c27a_4eb6_98dd_ab425624e9c3.slice/crio-f10c40da0f598449e3c62282a9d6932e3febb4b6b7cd8a23bc106a720c43d559 WatchSource:0}: Error finding container f10c40da0f598449e3c62282a9d6932e3febb4b6b7cd8a23bc106a720c43d559: Status 404 returned error can't find the container with id f10c40da0f598449e3c62282a9d6932e3febb4b6b7cd8a23bc106a720c43d559
Sep 16 01:46:35.702325 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:35.702290    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-cbb499-drsnp" event={"ID":"ca94fe38-c27a-4eb6-98dd-ab425624e9c3","Type":"ContainerStarted","Data":"3a89071097a9213382190e9af4134dc604de3d7d17eb8fb2948352b1c1b439a1"}
Sep 16 01:46:35.702457 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:35.702369    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-cbb499-drsnp" event={"ID":"ca94fe38-c27a-4eb6-98dd-ab425624e9c3","Type":"ContainerStarted","Data":"f10c40da0f598449e3c62282a9d6932e3febb4b6b7cd8a23bc106a720c43d559"}
Sep 16 01:46:35.716536 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:35.716492    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-cbb499-drsnp" podStartSLOduration=1.716477571 podStartE2EDuration="1.716477571s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:46:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:46:35.715022196 +0000 UTC m=+1845.038490772" watchObservedRunningTime="2026-09-16 01:46:35.716477571 +0000 UTC m=+1845.039946147"
Sep 16 01:46:36.708856 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:36.708809    2565 generic.go:356] "Generic (PLEG): container finished" podID="ca94fe38-c27a-4eb6-98dd-ab425624e9c3" containerID="3a89071097a9213382190e9af4134dc604de3d7d17eb8fb2948352b1c1b439a1" exitCode=0
Sep 16 01:46:36.709265 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:36.708890    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-cbb499-drsnp" event={"ID":"ca94fe38-c27a-4eb6-98dd-ab425624e9c3","Type":"ContainerDied","Data":"3a89071097a9213382190e9af4134dc604de3d7d17eb8fb2948352b1c1b439a1"}
Sep 16 01:46:37.846306 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:37.846281    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-cbb499-drsnp"
Sep 16 01:46:37.916588 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:37.916551    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca94fe38-c27a-4eb6-98dd-ab425624e9c3-maas-api-service-ca\") pod \"ca94fe38-c27a-4eb6-98dd-ab425624e9c3\" (UID: \"ca94fe38-c27a-4eb6-98dd-ab425624e9c3\") "
Sep 16 01:46:37.916929 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:37.916905    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca94fe38-c27a-4eb6-98dd-ab425624e9c3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ca94fe38-c27a-4eb6-98dd-ab425624e9c3" (UID: "ca94fe38-c27a-4eb6-98dd-ab425624e9c3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:46:38.017392 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:38.017280    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca94fe38-c27a-4eb6-98dd-ab425624e9c3-maas-api-service-ca\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:46:38.720867 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:38.720820    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-cbb499-drsnp" event={"ID":"ca94fe38-c27a-4eb6-98dd-ab425624e9c3","Type":"ContainerDied","Data":"f10c40da0f598449e3c62282a9d6932e3febb4b6b7cd8a23bc106a720c43d559"}
Sep 16 01:46:38.720867 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:38.720857    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-cbb499-drsnp"
Sep 16 01:46:38.721106 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:38.720880    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f10c40da0f598449e3c62282a9d6932e3febb4b6b7cd8a23bc106a720c43d559"
Sep 16 01:46:39.163808 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:39.163776    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-processing-5d7dbbd56b-4455c" secret="" err="secret \"payload-processing-dockercfg-kkbcm\" not found"
Sep 16 01:46:45.508931 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:45.508892    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-cbb499-drsnp"]
Sep 16 01:46:45.513455 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:45.513421    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-cbb499-drsnp"]
Sep 16 01:46:47.169420 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:47.169375    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca94fe38-c27a-4eb6-98dd-ab425624e9c3" path="/var/lib/kubelet/pods/ca94fe38-c27a-4eb6-98dd-ab425624e9c3/volumes"
Sep 16 01:46:51.166864 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:51.166816    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-6cd864bc95-st4pq" secret="" err="secret \"payload-processing-dockercfg-kkbcm\" not found"
Sep 16 01:46:51.607554 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:51.607465    2565 scope.go:117] "RemoveContainer" containerID="155b8888432277ccad9169651a5ab3c92b801492c9434f60238c55fbbb6c532c"
Sep 16 01:46:52.502780 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:52.502745    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-c0ec73-r9t65"]
Sep 16 01:46:52.503180 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:52.503126    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca94fe38-c27a-4eb6-98dd-ab425624e9c3" containerName="revoke-keys"
Sep 16 01:46:52.503180 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:52.503138    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca94fe38-c27a-4eb6-98dd-ab425624e9c3" containerName="revoke-keys"
Sep 16 01:46:52.503254 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:52.503203    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca94fe38-c27a-4eb6-98dd-ab425624e9c3" containerName="revoke-keys"
Sep 16 01:46:52.507748 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:52.507728    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-c0ec73-r9t65"
Sep 16 01:46:52.510215 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:52.510188    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 01:46:52.510387 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:52.510208    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4ljjd\""
Sep 16 01:46:52.513505 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:52.513482    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-c0ec73-r9t65"]
Sep 16 01:46:52.647234 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:52.647186    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fa3776c-fe86-46cf-b61d-7f63021502af-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-c0ec73-r9t65\" (UID: \"5fa3776c-fe86-46cf-b61d-7f63021502af\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-c0ec73-r9t65"
Sep 16 01:46:52.748558 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:52.748522    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fa3776c-fe86-46cf-b61d-7f63021502af-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-c0ec73-r9t65\" (UID: \"5fa3776c-fe86-46cf-b61d-7f63021502af\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-c0ec73-r9t65"
Sep 16 01:46:52.749235 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:52.749209    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fa3776c-fe86-46cf-b61d-7f63021502af-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-c0ec73-r9t65\" (UID: \"5fa3776c-fe86-46cf-b61d-7f63021502af\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-c0ec73-r9t65"
Sep 16 01:46:52.819524 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:52.819429    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-c0ec73-r9t65"
Sep 16 01:46:53.090106 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:53.090067    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-c0ec73-r9t65"]
Sep 16 01:46:53.095273 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:46:53.095243    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fa3776c_fe86_46cf_b61d_7f63021502af.slice/crio-8b59fda6eeddd251092b53b452521ea481c7375a99388c2efd49172b63ee02b6 WatchSource:0}: Error finding container 8b59fda6eeddd251092b53b452521ea481c7375a99388c2efd49172b63ee02b6: Status 404 returned error can't find the container with id 8b59fda6eeddd251092b53b452521ea481c7375a99388c2efd49172b63ee02b6
Sep 16 01:46:53.807554 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:53.807519    2565 generic.go:356] "Generic (PLEG): container finished" podID="5fa3776c-fe86-46cf-b61d-7f63021502af" containerID="fb91fdb36bdb3ca25abcb5fb2f0e33c8e8976396b0718fd15241920cdd33615d" exitCode=0
Sep 16 01:46:53.807935 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:53.807604    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-c0ec73-r9t65" event={"ID":"5fa3776c-fe86-46cf-b61d-7f63021502af","Type":"ContainerDied","Data":"fb91fdb36bdb3ca25abcb5fb2f0e33c8e8976396b0718fd15241920cdd33615d"}
Sep 16 01:46:53.807935 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:53.807659    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-c0ec73-r9t65" event={"ID":"5fa3776c-fe86-46cf-b61d-7f63021502af","Type":"ContainerStarted","Data":"8b59fda6eeddd251092b53b452521ea481c7375a99388c2efd49172b63ee02b6"}
Sep 16 01:46:54.945279 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:54.945253    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-c0ec73-r9t65"
Sep 16 01:46:55.068740 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:55.068650    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fa3776c-fe86-46cf-b61d-7f63021502af-maas-api-service-ca\") pod \"5fa3776c-fe86-46cf-b61d-7f63021502af\" (UID: \"5fa3776c-fe86-46cf-b61d-7f63021502af\") "
Sep 16 01:46:55.069030 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:55.069005    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fa3776c-fe86-46cf-b61d-7f63021502af-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5fa3776c-fe86-46cf-b61d-7f63021502af" (UID: "5fa3776c-fe86-46cf-b61d-7f63021502af"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:46:55.169373 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:55.169325    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fa3776c-fe86-46cf-b61d-7f63021502af-maas-api-service-ca\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:46:55.819707 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:55.819670    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-c0ec73-r9t65" event={"ID":"5fa3776c-fe86-46cf-b61d-7f63021502af","Type":"ContainerDied","Data":"8b59fda6eeddd251092b53b452521ea481c7375a99388c2efd49172b63ee02b6"}
Sep 16 01:46:55.819950 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:55.819737    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8b59fda6eeddd251092b53b452521ea481c7375a99388c2efd49172b63ee02b6"
Sep 16 01:46:55.819950 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:46:55.819683    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-c0ec73-r9t65"
Sep 16 01:47:03.108647 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:03.108609    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c0ec73-7788cdf566-vqjrj"]
Sep 16 01:47:03.109137 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:03.108904    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c0ec73-7788cdf566-vqjrj" podUID="1122f057-4180-4b44-9e4f-0b2e15eed8ac" containerName="payload-pre-processing" containerID="cri-o://70671c62e9bb50cdce28245ffdedad1864ee9395c362ace252f6757918d68464" gracePeriod=30
Sep 16 01:47:03.349678 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:03.349640    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-c0ec73-r9t65"]
Sep 16 01:47:03.357422 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:03.357393    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-c0ec73-r9t65"]
Sep 16 01:47:03.363537 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:03.363483    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c0ec73-7788cdf566-vqjrj"
Sep 16 01:47:03.448743 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:03.448711    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dxfdr\" (UniqueName: \"kubernetes.io/projected/1122f057-4180-4b44-9e4f-0b2e15eed8ac-kube-api-access-dxfdr\") pod \"1122f057-4180-4b44-9e4f-0b2e15eed8ac\" (UID: \"1122f057-4180-4b44-9e4f-0b2e15eed8ac\") "
Sep 16 01:47:03.448923 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:03.448758    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1122f057-4180-4b44-9e4f-0b2e15eed8ac-plugins-config-volume\") pod \"1122f057-4180-4b44-9e4f-0b2e15eed8ac\" (UID: \"1122f057-4180-4b44-9e4f-0b2e15eed8ac\") "
Sep 16 01:47:03.449196 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:03.449159    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1122f057-4180-4b44-9e4f-0b2e15eed8ac-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1122f057-4180-4b44-9e4f-0b2e15eed8ac" (UID: "1122f057-4180-4b44-9e4f-0b2e15eed8ac"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:47:03.450873 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:03.450852    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1122f057-4180-4b44-9e4f-0b2e15eed8ac-kube-api-access-dxfdr" (OuterVolumeSpecName: "kube-api-access-dxfdr") pod "1122f057-4180-4b44-9e4f-0b2e15eed8ac" (UID: "1122f057-4180-4b44-9e4f-0b2e15eed8ac"). InnerVolumeSpecName "kube-api-access-dxfdr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:47:03.549901 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:03.549861    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dxfdr\" (UniqueName: \"kubernetes.io/projected/1122f057-4180-4b44-9e4f-0b2e15eed8ac-kube-api-access-dxfdr\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:47:03.549901 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:03.549892    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1122f057-4180-4b44-9e4f-0b2e15eed8ac-plugins-config-volume\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:47:03.864649 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:03.864613    2565 generic.go:356] "Generic (PLEG): container finished" podID="1122f057-4180-4b44-9e4f-0b2e15eed8ac" containerID="70671c62e9bb50cdce28245ffdedad1864ee9395c362ace252f6757918d68464" exitCode=0
Sep 16 01:47:03.864859 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:03.864663    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c0ec73-7788cdf566-vqjrj"
Sep 16 01:47:03.864859 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:03.864696    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c0ec73-7788cdf566-vqjrj" event={"ID":"1122f057-4180-4b44-9e4f-0b2e15eed8ac","Type":"ContainerDied","Data":"70671c62e9bb50cdce28245ffdedad1864ee9395c362ace252f6757918d68464"}
Sep 16 01:47:03.864859 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:03.864748    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c0ec73-7788cdf566-vqjrj" event={"ID":"1122f057-4180-4b44-9e4f-0b2e15eed8ac","Type":"ContainerDied","Data":"900b1d710dd4e2fc9728339162909294c17faf98aaa710401bac332dc4d22028"}
Sep 16 01:47:03.864859 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:03.864771    2565 scope.go:117] "RemoveContainer" containerID="70671c62e9bb50cdce28245ffdedad1864ee9395c362ace252f6757918d68464"
Sep 16 01:47:03.874402 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:03.874374    2565 scope.go:117] "RemoveContainer" containerID="70671c62e9bb50cdce28245ffdedad1864ee9395c362ace252f6757918d68464"
Sep 16 01:47:03.874689 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:47:03.874669    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70671c62e9bb50cdce28245ffdedad1864ee9395c362ace252f6757918d68464\": container with ID starting with 70671c62e9bb50cdce28245ffdedad1864ee9395c362ace252f6757918d68464 not found: ID does not exist" containerID="70671c62e9bb50cdce28245ffdedad1864ee9395c362ace252f6757918d68464"
Sep 16 01:47:03.874757 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:03.874698    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70671c62e9bb50cdce28245ffdedad1864ee9395c362ace252f6757918d68464"} err="failed to get container status \"70671c62e9bb50cdce28245ffdedad1864ee9395c362ace252f6757918d68464\": rpc error: code = NotFound desc = could not find container \"70671c62e9bb50cdce28245ffdedad1864ee9395c362ace252f6757918d68464\": container with ID starting with 70671c62e9bb50cdce28245ffdedad1864ee9395c362ace252f6757918d68464 not found: ID does not exist"
Sep 16 01:47:03.885930 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:03.885903    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c0ec73-7788cdf566-vqjrj"]
Sep 16 01:47:03.889347 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:03.889309    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c0ec73-7788cdf566-vqjrj"]
Sep 16 01:47:05.168888 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:05.168847    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1122f057-4180-4b44-9e4f-0b2e15eed8ac" path="/var/lib/kubelet/pods/1122f057-4180-4b44-9e4f-0b2e15eed8ac/volumes"
Sep 16 01:47:05.169269 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:05.169194    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fa3776c-fe86-46cf-b61d-7f63021502af" path="/var/lib/kubelet/pods/5fa3776c-fe86-46cf-b61d-7f63021502af/volumes"
Sep 16 01:47:09.671925 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:09.671888    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q"]
Sep 16 01:47:09.672370 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:09.672131    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q" podUID="fc8ba9c0-9e0f-4550-9c19-265da23baf55" containerName="istio-proxy" containerID="cri-o://6f7597da3b6acb2c1ad12dd7f2c09c7c46fd8a9b89a9cda168f3569cbb529614" gracePeriod=30
Sep 16 01:47:14.923053 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:14.923018    2565 generic.go:356] "Generic (PLEG): container finished" podID="fc8ba9c0-9e0f-4550-9c19-265da23baf55" containerID="6f7597da3b6acb2c1ad12dd7f2c09c7c46fd8a9b89a9cda168f3569cbb529614" exitCode=0
Sep 16 01:47:14.923491 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:14.923091    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q" event={"ID":"fc8ba9c0-9e0f-4550-9c19-265da23baf55","Type":"ContainerDied","Data":"6f7597da3b6acb2c1ad12dd7f2c09c7c46fd8a9b89a9cda168f3569cbb529614"}
Sep 16 01:47:14.923491 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:14.923173    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q" event={"ID":"fc8ba9c0-9e0f-4550-9c19-265da23baf55","Type":"ContainerDied","Data":"dbbbe2147a1ed85f23260dead39535f73568a13d77139eb4c71030ec72cd6afa"}
Sep 16 01:47:14.923491 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:14.923202    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dbbbe2147a1ed85f23260dead39535f73568a13d77139eb4c71030ec72cd6afa"
Sep 16 01:47:14.923491 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:14.923222    2565 scope.go:117] "RemoveContainer" containerID="5aa88c2c161fffdf6004ad2b204989b5dcadcdab5c758ac2e724e7de21c18ec4"
Sep 16 01:47:14.926376 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:14.926356    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q"
Sep 16 01:47:14.956283 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:14.956211    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc8ba9c0-9e0f-4550-9c19-265da23baf55-istio-podinfo\") pod \"fc8ba9c0-9e0f-4550-9c19-265da23baf55\" (UID: \"fc8ba9c0-9e0f-4550-9c19-265da23baf55\") "
Sep 16 01:47:14.956283 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:14.956266    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lqx82\" (UniqueName: \"kubernetes.io/projected/fc8ba9c0-9e0f-4550-9c19-265da23baf55-kube-api-access-lqx82\") pod \"fc8ba9c0-9e0f-4550-9c19-265da23baf55\" (UID: \"fc8ba9c0-9e0f-4550-9c19-265da23baf55\") "
Sep 16 01:47:14.956483 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:14.956301    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc8ba9c0-9e0f-4550-9c19-265da23baf55-credential-socket\") pod \"fc8ba9c0-9e0f-4550-9c19-265da23baf55\" (UID: \"fc8ba9c0-9e0f-4550-9c19-265da23baf55\") "
Sep 16 01:47:14.956483 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:14.956351    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc8ba9c0-9e0f-4550-9c19-265da23baf55-istio-token\") pod \"fc8ba9c0-9e0f-4550-9c19-265da23baf55\" (UID: \"fc8ba9c0-9e0f-4550-9c19-265da23baf55\") "
Sep 16 01:47:14.956483 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:14.956445    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc8ba9c0-9e0f-4550-9c19-265da23baf55-istio-envoy\") pod \"fc8ba9c0-9e0f-4550-9c19-265da23baf55\" (UID: \"fc8ba9c0-9e0f-4550-9c19-265da23baf55\") "
Sep 16 01:47:14.956483 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:14.956474    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc8ba9c0-9e0f-4550-9c19-265da23baf55-istiod-ca-cert\") pod \"fc8ba9c0-9e0f-4550-9c19-265da23baf55\" (UID: \"fc8ba9c0-9e0f-4550-9c19-265da23baf55\") "
Sep 16 01:47:14.956699 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:14.956497    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc8ba9c0-9e0f-4550-9c19-265da23baf55-istio-data\") pod \"fc8ba9c0-9e0f-4550-9c19-265da23baf55\" (UID: \"fc8ba9c0-9e0f-4550-9c19-265da23baf55\") "
Sep 16 01:47:14.956699 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:14.956523    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc8ba9c0-9e0f-4550-9c19-265da23baf55-workload-certs\") pod \"fc8ba9c0-9e0f-4550-9c19-265da23baf55\" (UID: \"fc8ba9c0-9e0f-4550-9c19-265da23baf55\") "
Sep 16 01:47:14.956699 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:14.956546    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc8ba9c0-9e0f-4550-9c19-265da23baf55-workload-socket\") pod \"fc8ba9c0-9e0f-4550-9c19-265da23baf55\" (UID: \"fc8ba9c0-9e0f-4550-9c19-265da23baf55\") "
Sep 16 01:47:14.956699 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:14.956667    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc8ba9c0-9e0f-4550-9c19-265da23baf55-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fc8ba9c0-9e0f-4550-9c19-265da23baf55" (UID: "fc8ba9c0-9e0f-4550-9c19-265da23baf55"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:47:14.956846 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:14.956807    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc8ba9c0-9e0f-4550-9c19-265da23baf55-istio-data" (OuterVolumeSpecName: "istio-data") pod "fc8ba9c0-9e0f-4550-9c19-265da23baf55" (UID: "fc8ba9c0-9e0f-4550-9c19-265da23baf55"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:47:14.956913 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:14.956853    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc8ba9c0-9e0f-4550-9c19-265da23baf55-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fc8ba9c0-9e0f-4550-9c19-265da23baf55" (UID: "fc8ba9c0-9e0f-4550-9c19-265da23baf55"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 01:47:14.956973 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:14.956942    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc8ba9c0-9e0f-4550-9c19-265da23baf55-istiod-ca-cert\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:47:14.956973 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:14.956961    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc8ba9c0-9e0f-4550-9c19-265da23baf55-istio-data\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:47:14.957075 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:14.957002    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc8ba9c0-9e0f-4550-9c19-265da23baf55-credential-socket\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:47:14.957075 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:14.957061    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc8ba9c0-9e0f-4550-9c19-265da23baf55-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fc8ba9c0-9e0f-4550-9c19-265da23baf55" (UID: "fc8ba9c0-9e0f-4550-9c19-265da23baf55"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:47:14.957190 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:14.957084    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc8ba9c0-9e0f-4550-9c19-265da23baf55-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fc8ba9c0-9e0f-4550-9c19-265da23baf55" (UID: "fc8ba9c0-9e0f-4550-9c19-265da23baf55"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:47:14.958896 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:14.958863    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc8ba9c0-9e0f-4550-9c19-265da23baf55-istio-token" (OuterVolumeSpecName: "istio-token") pod "fc8ba9c0-9e0f-4550-9c19-265da23baf55" (UID: "fc8ba9c0-9e0f-4550-9c19-265da23baf55"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:47:14.959000 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:14.958940    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fc8ba9c0-9e0f-4550-9c19-265da23baf55-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fc8ba9c0-9e0f-4550-9c19-265da23baf55" (UID: "fc8ba9c0-9e0f-4550-9c19-265da23baf55"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 01:47:14.959000 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:14.958947    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc8ba9c0-9e0f-4550-9c19-265da23baf55-kube-api-access-lqx82" (OuterVolumeSpecName: "kube-api-access-lqx82") pod "fc8ba9c0-9e0f-4550-9c19-265da23baf55" (UID: "fc8ba9c0-9e0f-4550-9c19-265da23baf55"). InnerVolumeSpecName "kube-api-access-lqx82". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:47:14.959121 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:14.959010    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc8ba9c0-9e0f-4550-9c19-265da23baf55-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fc8ba9c0-9e0f-4550-9c19-265da23baf55" (UID: "fc8ba9c0-9e0f-4550-9c19-265da23baf55"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:47:15.058050 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:15.057993    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc8ba9c0-9e0f-4550-9c19-265da23baf55-istio-envoy\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:47:15.058050 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:15.058038    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc8ba9c0-9e0f-4550-9c19-265da23baf55-workload-certs\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:47:15.058050 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:15.058049    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc8ba9c0-9e0f-4550-9c19-265da23baf55-workload-socket\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:47:15.058050 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:15.058057    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc8ba9c0-9e0f-4550-9c19-265da23baf55-istio-podinfo\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:47:15.058050 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:15.058067    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lqx82\" (UniqueName: \"kubernetes.io/projected/fc8ba9c0-9e0f-4550-9c19-265da23baf55-kube-api-access-lqx82\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:47:15.058050 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:15.058076    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc8ba9c0-9e0f-4550-9c19-265da23baf55-istio-token\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:47:15.929599 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:15.929562    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q"
Sep 16 01:47:15.959140 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:15.959104    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q"]
Sep 16 01:47:15.962551 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:15.962521    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q"]
Sep 16 01:47:17.169992 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:17.169954    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc8ba9c0-9e0f-4550-9c19-265da23baf55" path="/var/lib/kubelet/pods/fc8ba9c0-9e0f-4550-9c19-265da23baf55/volumes"
Sep 16 01:47:51.639637 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:51.639598    2565 scope.go:117] "RemoveContainer" containerID="6f7597da3b6acb2c1ad12dd7f2c09c7c46fd8a9b89a9cda168f3569cbb529614"
Sep 16 01:47:53.163804 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:53.163766    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-processing-5d7dbbd56b-4455c" secret="" err="secret \"payload-processing-dockercfg-kkbcm\" not found"
Sep 16 01:47:57.164297 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:47:57.164263    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-6cd864bc95-st4pq" secret="" err="secret \"payload-processing-dockercfg-kkbcm\" not found"
Sep 16 01:48:57.164206 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:48:57.164159    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-processing-5d7dbbd56b-4455c" secret="" err="secret \"payload-processing-dockercfg-kkbcm\" not found"
Sep 16 01:49:24.163800 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:49:24.163768    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-6cd864bc95-st4pq" secret="" err="secret \"payload-processing-dockercfg-kkbcm\" not found"
Sep 16 01:50:26.163590 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:50:26.163505    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-processing-5d7dbbd56b-4455c" secret="" err="secret \"payload-processing-dockercfg-kkbcm\" not found"
Sep 16 01:50:31.165900 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:50:31.165859    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-6cd864bc95-st4pq" secret="" err="secret \"payload-processing-dockercfg-kkbcm\" not found"
Sep 16 01:50:51.686917 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:50:51.686877    2565 scope.go:117] "RemoveContainer" containerID="6de00630cc3d11a019f962ae8dbc6195a444e0b9cf2508b552ff52c570eeda76"
Sep 16 01:50:51.697746 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:50:51.697691    2565 scope.go:117] "RemoveContainer" containerID="6c1accfea06f582b933ba39ef8bc8894fe5df2a3d66e57b5a0d2f07419159793"
Sep 16 01:50:51.705976 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:50:51.705956    2565 scope.go:117] "RemoveContainer" containerID="e6da476d95c32b9a1c4d9ffb052301f56c32e8f908764893e63180f34e4585a1"
Sep 16 01:50:51.713409 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:50:51.713371    2565 scope.go:117] "RemoveContainer" containerID="93d478b0fc9fb02fb10c8e801de5d12a6dc2dcc94b4a4f291ed46aa31a308b12"
Sep 16 01:51:34.164052 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:51:34.164015    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-processing-5d7dbbd56b-4455c" secret="" err="secret \"payload-processing-dockercfg-kkbcm\" not found"
Sep 16 01:51:38.313608 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:51:38.313563    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f"]
Sep 16 01:51:38.314184 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:51:38.314081    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1122f057-4180-4b44-9e4f-0b2e15eed8ac" containerName="payload-pre-processing"
Sep 16 01:51:38.314184 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:51:38.314103    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1122f057-4180-4b44-9e4f-0b2e15eed8ac" containerName="payload-pre-processing"
Sep 16 01:51:38.314184 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:51:38.314122    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc8ba9c0-9e0f-4550-9c19-265da23baf55" containerName="istio-proxy"
Sep 16 01:51:38.314184 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:51:38.314131    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc8ba9c0-9e0f-4550-9c19-265da23baf55" containerName="istio-proxy"
Sep 16 01:51:38.314184 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:51:38.314147    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fa3776c-fe86-46cf-b61d-7f63021502af" containerName="revoke-keys"
Sep 16 01:51:38.314184 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:51:38.314157    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fa3776c-fe86-46cf-b61d-7f63021502af" containerName="revoke-keys"
Sep 16 01:51:38.314184 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:51:38.314167    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc8ba9c0-9e0f-4550-9c19-265da23baf55" containerName="istio-proxy"
Sep 16 01:51:38.314184 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:51:38.314175    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc8ba9c0-9e0f-4550-9c19-265da23baf55" containerName="istio-proxy"
Sep 16 01:51:38.314626 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:51:38.314272    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fa3776c-fe86-46cf-b61d-7f63021502af" containerName="revoke-keys"
Sep 16 01:51:38.314626 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:51:38.314287    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1122f057-4180-4b44-9e4f-0b2e15eed8ac" containerName="payload-pre-processing"
Sep 16 01:51:38.314626 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:51:38.314297    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc8ba9c0-9e0f-4550-9c19-265da23baf55" containerName="istio-proxy"
Sep 16 01:51:38.314626 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:51:38.314305    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc8ba9c0-9e0f-4550-9c19-265da23baf55" containerName="istio-proxy"
Sep 16 01:51:38.317610 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:51:38.317583    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f"
Sep 16 01:51:38.319878 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:51:38.319851    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-a084e1f3-kserve-self-signed-certs\""
Sep 16 01:51:38.326778 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:51:38.326748    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f"]
Sep 16 01:51:38.396434 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:51:38.396381    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f817952-8bb4-4398-a47c-14978c596515-tls-certs\") pod \"e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f\" (UID: \"4f817952-8bb4-4398-a47c-14978c596515\") " pod="llm/e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f"
Sep 16 01:51:38.396434 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:51:38.396445    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f817952-8bb4-4398-a47c-14978c596515-tmp-dir\") pod \"e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f\" (UID: \"4f817952-8bb4-4398-a47c-14978c596515\") " pod="llm/e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f"
Sep 16 01:51:38.396670 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:51:38.396490    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f817952-8bb4-4398-a47c-14978c596515-model-cache\") pod \"e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f\" (UID: \"4f817952-8bb4-4398-a47c-14978c596515\") " pod="llm/e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f"
Sep 16 01:51:38.396670 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:51:38.396539    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v59ql\" (UniqueName: \"kubernetes.io/projected/4f817952-8bb4-4398-a47c-14978c596515-kube-api-access-v59ql\") pod \"e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f\" (UID: \"4f817952-8bb4-4398-a47c-14978c596515\") " pod="llm/e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f"
Sep 16 01:51:38.396670 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:51:38.396588    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f817952-8bb4-4398-a47c-14978c596515-dshm\") pod \"e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f\" (UID: \"4f817952-8bb4-4398-a47c-14978c596515\") " pod="llm/e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f"
Sep 16 01:51:38.396670 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:51:38.396611    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f817952-8bb4-4398-a47c-14978c596515-home\") pod \"e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f\" (UID: \"4f817952-8bb4-4398-a47c-14978c596515\") " pod="llm/e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f"
Sep 16 01:51:38.497771 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:51:38.497723    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f817952-8bb4-4398-a47c-14978c596515-tls-certs\") pod \"e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f\" (UID: \"4f817952-8bb4-4398-a47c-14978c596515\") " pod="llm/e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f"
Sep 16 01:51:38.497771 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:51:38.497774    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f817952-8bb4-4398-a47c-14978c596515-tmp-dir\") pod \"e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f\" (UID: \"4f817952-8bb4-4398-a47c-14978c596515\") " pod="llm/e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f"
Sep 16 01:51:38.498043 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:51:38.497800    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f817952-8bb4-4398-a47c-14978c596515-model-cache\") pod \"e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f\" (UID: \"4f817952-8bb4-4398-a47c-14978c596515\") " pod="llm/e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f"
Sep 16 01:51:38.498043 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:51:38.497831    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v59ql\" (UniqueName: \"kubernetes.io/projected/4f817952-8bb4-4398-a47c-14978c596515-kube-api-access-v59ql\") pod \"e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f\" (UID: \"4f817952-8bb4-4398-a47c-14978c596515\") " pod="llm/e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f"
Sep 16 01:51:38.498043 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:51:38.497865    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f817952-8bb4-4398-a47c-14978c596515-dshm\") pod \"e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f\" (UID: \"4f817952-8bb4-4398-a47c-14978c596515\") " pod="llm/e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f"
Sep 16 01:51:38.498043 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:51:38.497894    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f817952-8bb4-4398-a47c-14978c596515-home\") pod \"e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f\" (UID: \"4f817952-8bb4-4398-a47c-14978c596515\") " pod="llm/e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f"
Sep 16 01:51:38.498265 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:51:38.498214    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f817952-8bb4-4398-a47c-14978c596515-tmp-dir\") pod \"e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f\" (UID: \"4f817952-8bb4-4398-a47c-14978c596515\") " pod="llm/e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f"
Sep 16 01:51:38.498327 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:51:38.498298    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f817952-8bb4-4398-a47c-14978c596515-model-cache\") pod \"e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f\" (UID: \"4f817952-8bb4-4398-a47c-14978c596515\") " pod="llm/e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f"
Sep 16 01:51:38.498327 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:51:38.498312    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f817952-8bb4-4398-a47c-14978c596515-home\") pod \"e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f\" (UID: \"4f817952-8bb4-4398-a47c-14978c596515\") " pod="llm/e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f"
Sep 16 01:51:38.500279 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:51:38.500256    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f817952-8bb4-4398-a47c-14978c596515-dshm\") pod \"e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f\" (UID: \"4f817952-8bb4-4398-a47c-14978c596515\") " pod="llm/e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f"
Sep 16 01:51:38.500446 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:51:38.500428    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f817952-8bb4-4398-a47c-14978c596515-tls-certs\") pod \"e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f\" (UID: \"4f817952-8bb4-4398-a47c-14978c596515\") " pod="llm/e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f"
Sep 16 01:51:38.505741 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:51:38.505717    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v59ql\" (UniqueName: \"kubernetes.io/projected/4f817952-8bb4-4398-a47c-14978c596515-kube-api-access-v59ql\") pod \"e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f\" (UID: \"4f817952-8bb4-4398-a47c-14978c596515\") " pod="llm/e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f"
Sep 16 01:51:38.627561 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:51:38.627460    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f"
Sep 16 01:51:38.898862 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:51:38.898706    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f"]
Sep 16 01:51:38.901539 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:51:38.901513    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4f817952_8bb4_4398_a47c_14978c596515.slice/crio-69b1e09d9f3eda9e71510f00de3ab342db9d1ef053961f0aec5c4d678bd8ea72 WatchSource:0}: Error finding container 69b1e09d9f3eda9e71510f00de3ab342db9d1ef053961f0aec5c4d678bd8ea72: Status 404 returned error can't find the container with id 69b1e09d9f3eda9e71510f00de3ab342db9d1ef053961f0aec5c4d678bd8ea72
Sep 16 01:51:39.279947 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:51:39.279908    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f" event={"ID":"4f817952-8bb4-4398-a47c-14978c596515","Type":"ContainerStarted","Data":"989694e87fabd87f86e032090af6dbd3bdf16320b28db70e6652dbaaf1d37290"}
Sep 16 01:51:39.280117 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:51:39.279957    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f" event={"ID":"4f817952-8bb4-4398-a47c-14978c596515","Type":"ContainerStarted","Data":"69b1e09d9f3eda9e71510f00de3ab342db9d1ef053961f0aec5c4d678bd8ea72"}
Sep 16 01:51:39.299664 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:51:39.299608    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f" podStartSLOduration=1.299574956 podStartE2EDuration="1.299574956s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 01:51:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:51:39.296795639 +0000 UTC m=+2148.620264218" watchObservedRunningTime="2026-09-16 01:51:39.299574956 +0000 UTC m=+2148.623043535"
Sep 16 01:51:48.627683 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:51:48.627636    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f"
Sep 16 01:51:48.627683 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:51:48.627698    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f"
Sep 16 01:51:48.640699 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:51:48.640661    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f"
Sep 16 01:51:49.343617 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:51:49.343584    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f"
Sep 16 01:51:51.744660 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:51:51.744621    2565 scope.go:117] "RemoveContainer" containerID="8d74a36e307c91a9893d96354500b3e423b495adb133e660100af2d59a36a6df"
Sep 16 01:51:51.754511 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:51:51.754486    2565 scope.go:117] "RemoveContainer" containerID="2c60c28fd8a0a7abd34b9372955044065478b27846418d030d7669a2f6850c9c"
Sep 16 01:51:51.762855 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:51:51.762829    2565 scope.go:117] "RemoveContainer" containerID="c1a700bd05d8a57f42592ab07dd2701c4cb904729a162a1cb5dad358c41a8b4c"
Sep 16 01:51:51.770897 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:51:51.770875    2565 scope.go:117] "RemoveContainer" containerID="924409d4639669103a5bc6d7c40424ce9613fcac5fae75351d3717cbc7ec310e"
Sep 16 01:51:51.779415 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:51:51.779393    2565 scope.go:117] "RemoveContainer" containerID="e8b465b0ed3b351ec444d2ead8f60ac118c1ca7e1485b3020eba0214ec4c9696"
Sep 16 01:51:51.787428 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:51:51.787406    2565 scope.go:117] "RemoveContainer" containerID="89ebf111fae17d47497395de0d6a5eeebba5c9c309622518cbdcbd305b07a65b"
Sep 16 01:51:54.507532 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:51:54.507462    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f"]
Sep 16 01:51:56.164180 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:51:56.164125    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-6cd864bc95-st4pq" secret="" err="secret \"payload-processing-dockercfg-kkbcm\" not found"
Sep 16 01:52:09.530204 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:52:09.530152    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f" podUID="4f817952-8bb4-4398-a47c-14978c596515" containerName="main" containerID="cri-o://989694e87fabd87f86e032090af6dbd3bdf16320b28db70e6652dbaaf1d37290" gracePeriod=45
Sep 16 01:52:09.776602 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:52:09.776571    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f"
Sep 16 01:52:09.887542 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:52:09.887462    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v59ql\" (UniqueName: \"kubernetes.io/projected/4f817952-8bb4-4398-a47c-14978c596515-kube-api-access-v59ql\") pod \"4f817952-8bb4-4398-a47c-14978c596515\" (UID: \"4f817952-8bb4-4398-a47c-14978c596515\") "
Sep 16 01:52:09.887542 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:52:09.887505    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f817952-8bb4-4398-a47c-14978c596515-model-cache\") pod \"4f817952-8bb4-4398-a47c-14978c596515\" (UID: \"4f817952-8bb4-4398-a47c-14978c596515\") "
Sep 16 01:52:09.887759 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:52:09.887545    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f817952-8bb4-4398-a47c-14978c596515-dshm\") pod \"4f817952-8bb4-4398-a47c-14978c596515\" (UID: \"4f817952-8bb4-4398-a47c-14978c596515\") "
Sep 16 01:52:09.887759 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:52:09.887585    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f817952-8bb4-4398-a47c-14978c596515-home\") pod \"4f817952-8bb4-4398-a47c-14978c596515\" (UID: \"4f817952-8bb4-4398-a47c-14978c596515\") "
Sep 16 01:52:09.887759 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:52:09.887628    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f817952-8bb4-4398-a47c-14978c596515-tmp-dir\") pod \"4f817952-8bb4-4398-a47c-14978c596515\" (UID: \"4f817952-8bb4-4398-a47c-14978c596515\") "
Sep 16 01:52:09.887759 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:52:09.887659    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f817952-8bb4-4398-a47c-14978c596515-tls-certs\") pod \"4f817952-8bb4-4398-a47c-14978c596515\" (UID: \"4f817952-8bb4-4398-a47c-14978c596515\") "
Sep 16 01:52:09.887985 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:52:09.887795    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f817952-8bb4-4398-a47c-14978c596515-model-cache" (OuterVolumeSpecName: "model-cache") pod "4f817952-8bb4-4398-a47c-14978c596515" (UID: "4f817952-8bb4-4398-a47c-14978c596515"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:52:09.887985 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:52:09.887903    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f817952-8bb4-4398-a47c-14978c596515-home" (OuterVolumeSpecName: "home") pod "4f817952-8bb4-4398-a47c-14978c596515" (UID: "4f817952-8bb4-4398-a47c-14978c596515"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:52:09.888070 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:52:09.887976    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f817952-8bb4-4398-a47c-14978c596515-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4f817952-8bb4-4398-a47c-14978c596515" (UID: "4f817952-8bb4-4398-a47c-14978c596515"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:52:09.888070 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:52:09.888028    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f817952-8bb4-4398-a47c-14978c596515-model-cache\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:52:09.888070 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:52:09.888049    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f817952-8bb4-4398-a47c-14978c596515-home\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:52:09.889907 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:52:09.889886    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f817952-8bb4-4398-a47c-14978c596515-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4f817952-8bb4-4398-a47c-14978c596515" (UID: "4f817952-8bb4-4398-a47c-14978c596515"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 01:52:09.890086 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:52:09.890064    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f817952-8bb4-4398-a47c-14978c596515-kube-api-access-v59ql" (OuterVolumeSpecName: "kube-api-access-v59ql") pod "4f817952-8bb4-4398-a47c-14978c596515" (UID: "4f817952-8bb4-4398-a47c-14978c596515"). InnerVolumeSpecName "kube-api-access-v59ql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 01:52:09.890194 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:52:09.890066    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f817952-8bb4-4398-a47c-14978c596515-dshm" (OuterVolumeSpecName: "dshm") pod "4f817952-8bb4-4398-a47c-14978c596515" (UID: "4f817952-8bb4-4398-a47c-14978c596515"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 01:52:09.989103 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:52:09.989072    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f817952-8bb4-4398-a47c-14978c596515-dshm\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:52:09.989103 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:52:09.989101    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f817952-8bb4-4398-a47c-14978c596515-tmp-dir\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:52:09.989307 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:52:09.989116    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f817952-8bb4-4398-a47c-14978c596515-tls-certs\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:52:09.989307 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:52:09.989129    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v59ql\" (UniqueName: \"kubernetes.io/projected/4f817952-8bb4-4398-a47c-14978c596515-kube-api-access-v59ql\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\""
Sep 16 01:52:10.441161 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:52:10.441122    2565 generic.go:356] "Generic (PLEG): container finished" podID="4f817952-8bb4-4398-a47c-14978c596515" containerID="989694e87fabd87f86e032090af6dbd3bdf16320b28db70e6652dbaaf1d37290" exitCode=0
Sep 16 01:52:10.441391 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:52:10.441182    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f"
Sep 16 01:52:10.441391 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:52:10.441207    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f" event={"ID":"4f817952-8bb4-4398-a47c-14978c596515","Type":"ContainerDied","Data":"989694e87fabd87f86e032090af6dbd3bdf16320b28db70e6652dbaaf1d37290"}
Sep 16 01:52:10.441391 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:52:10.441255    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f" event={"ID":"4f817952-8bb4-4398-a47c-14978c596515","Type":"ContainerDied","Data":"69b1e09d9f3eda9e71510f00de3ab342db9d1ef053961f0aec5c4d678bd8ea72"}
Sep 16 01:52:10.441391 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:52:10.441277    2565 scope.go:117] "RemoveContainer" containerID="989694e87fabd87f86e032090af6dbd3bdf16320b28db70e6652dbaaf1d37290"
Sep 16 01:52:10.450723 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:52:10.450704    2565 scope.go:117] "RemoveContainer" containerID="989694e87fabd87f86e032090af6dbd3bdf16320b28db70e6652dbaaf1d37290"
Sep 16 01:52:10.450989 ip-10-0-135-225 kubenswrapper[2565]: E0916 01:52:10.450972    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"989694e87fabd87f86e032090af6dbd3bdf16320b28db70e6652dbaaf1d37290\": container with ID starting with 989694e87fabd87f86e032090af6dbd3bdf16320b28db70e6652dbaaf1d37290 not found: ID does not exist" containerID="989694e87fabd87f86e032090af6dbd3bdf16320b28db70e6652dbaaf1d37290"
Sep 16 01:52:10.451034 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:52:10.450996    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"989694e87fabd87f86e032090af6dbd3bdf16320b28db70e6652dbaaf1d37290"} err="failed to get container status \"989694e87fabd87f86e032090af6dbd3bdf16320b28db70e6652dbaaf1d37290\": rpc error: code = NotFound desc = could not find container \"989694e87fabd87f86e032090af6dbd3bdf16320b28db70e6652dbaaf1d37290\": container with ID starting with 989694e87fabd87f86e032090af6dbd3bdf16320b28db70e6652dbaaf1d37290 not found: ID does not exist"
Sep 16 01:52:10.461713 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:52:10.461688    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f"]
Sep 16 01:52:10.464679 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:52:10.464661    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-a084e1f3-kserve-7c465779bc-mf75f"]
Sep 16 01:52:11.169935 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:52:11.169901    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f817952-8bb4-4398-a47c-14978c596515" path="/var/lib/kubelet/pods/4f817952-8bb4-4398-a47c-14978c596515/volumes"
Sep 16 01:52:38.163544 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:52:38.163509    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-processing-5d7dbbd56b-4455c" secret="" err="secret \"payload-processing-dockercfg-kkbcm\" not found"
Sep 16 01:52:51.833594 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:52:51.833559    2565 scope.go:117] "RemoveContainer" containerID="3a89071097a9213382190e9af4134dc604de3d7d17eb8fb2948352b1c1b439a1"
Sep 16 01:52:51.841899 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:52:51.841878    2565 scope.go:117] "RemoveContainer" containerID="e895bf0a45b59e82f846cd549a20249283931dd8a1434f3bbfb5328a6013b8be"
Sep 16 01:53:14.164301 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:53:14.164212    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-6cd864bc95-st4pq" secret="" err="secret \"payload-processing-dockercfg-kkbcm\" not found"
Sep 16 01:53:51.867086 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:53:51.867052    2565 scope.go:117] "RemoveContainer" containerID="fb91fdb36bdb3ca25abcb5fb2f0e33c8e8976396b0718fd15241920cdd33615d"
Sep 16 01:53:59.164127 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:53:59.164094    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-processing-5d7dbbd56b-4455c" secret="" err="secret \"payload-processing-dockercfg-kkbcm\" not found"
Sep 16 01:54:19.163816 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:54:19.163774    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-6cd864bc95-st4pq" secret="" err="secret \"payload-processing-dockercfg-kkbcm\" not found"
Sep 16 01:55:09.164088 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:09.164050    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-processing-5d7dbbd56b-4455c" secret="" err="secret \"payload-processing-dockercfg-kkbcm\" not found"
Sep 16 01:55:36.164265 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:36.164226    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-6cd864bc95-st4pq" secret="" err="secret \"payload-processing-dockercfg-kkbcm\" not found"
Sep 16 01:55:43.249326 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:43.249295    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vzwdx_f7c423cc-710d-49fa-835f-518fc794dfb0/global-pull-secret-syncer/0.log"
Sep 16 01:55:43.356303 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:43.356277    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-t9knx_d5fdc95b-8eaa-401f-a9a9-50bea6a5ffc8/konnectivity-agent/0.log"
Sep 16 01:55:43.372774 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:43.372750    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-225.ec2.internal_dc733c4b3ec8f9e22d85736adcd9ed91/haproxy/0.log"
Sep 16 01:55:47.836142 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:47.836065    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-pj5rs_307c2f46-e70c-4ca5-b46d-2e93e5ce1eca/manager/0.log"
Sep 16 01:55:48.018398 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:48.018362    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-gkn5p_1fada03f-2b80-4113-90a9-91890464ce69/manager/0.log"
Sep 16 01:55:49.953283 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:49.953230    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-wtnmz_c4fa7f68-6b61-47c6-bb6a-e24e9e240d24/monitoring-plugin/0.log"
Sep 16 01:55:50.128953 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:50.128924    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x6chc_c7263ca2-ea08-4e19-986f-23cea0e8d3ab/node-exporter/0.log"
Sep 16 01:55:50.147950 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:50.147920    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x6chc_c7263ca2-ea08-4e19-986f-23cea0e8d3ab/kube-rbac-proxy/0.log"
Sep 16 01:55:50.169821 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:50.169796    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x6chc_c7263ca2-ea08-4e19-986f-23cea0e8d3ab/init-textfile/0.log"
Sep 16 01:55:52.199258 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:52.199223    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-dkwxh_b9dc9cce-c642-4259-83f4-dc9eaac7bbb8/networking-console-plugin/0.log"
Sep 16 01:55:54.011186 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:54.011154    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hcspv/perf-node-gather-daemonset-8b48j"]
Sep 16 01:55:54.011560 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:54.011526    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f817952-8bb4-4398-a47c-14978c596515" containerName="main"
Sep 16 01:55:54.011560 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:54.011540    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f817952-8bb4-4398-a47c-14978c596515" containerName="main"
Sep 16 01:55:54.011634 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:54.011600    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f817952-8bb4-4398-a47c-14978c596515" containerName="main"
Sep 16 01:55:54.014442 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:54.014427    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hcspv/perf-node-gather-daemonset-8b48j"
Sep 16 01:55:54.016620 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:54.016601    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hcspv\"/\"default-dockercfg-dfgwp\""
Sep 16 01:55:54.016762 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:54.016601    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hcspv\"/\"openshift-service-ca.crt\""
Sep 16 01:55:54.017667 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:54.017651    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hcspv\"/\"kube-root-ca.crt\""
Sep 16 01:55:54.023107 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:54.023088    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hcspv/perf-node-gather-daemonset-8b48j"]
Sep 16 01:55:54.129494 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:54.129460    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/282e7d44-3c65-4db3-90e7-cace006be192-lib-modules\") pod \"perf-node-gather-daemonset-8b48j\" (UID: \"282e7d44-3c65-4db3-90e7-cace006be192\") " pod="openshift-must-gather-hcspv/perf-node-gather-daemonset-8b48j"
Sep 16 01:55:54.129494 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:54.129494    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4db7\" (UniqueName: \"kubernetes.io/projected/282e7d44-3c65-4db3-90e7-cace006be192-kube-api-access-j4db7\") pod \"perf-node-gather-daemonset-8b48j\" (UID: \"282e7d44-3c65-4db3-90e7-cace006be192\") " pod="openshift-must-gather-hcspv/perf-node-gather-daemonset-8b48j"
Sep 16 01:55:54.129728 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:54.129587    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/282e7d44-3c65-4db3-90e7-cace006be192-proc\") pod \"perf-node-gather-daemonset-8b48j\" (UID: \"282e7d44-3c65-4db3-90e7-cace006be192\") " pod="openshift-must-gather-hcspv/perf-node-gather-daemonset-8b48j"
Sep 16 01:55:54.129728 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:54.129662    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/282e7d44-3c65-4db3-90e7-cace006be192-podres\") pod \"perf-node-gather-daemonset-8b48j\" (UID: \"282e7d44-3c65-4db3-90e7-cace006be192\") " pod="openshift-must-gather-hcspv/perf-node-gather-daemonset-8b48j"
Sep 16 01:55:54.129812 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:54.129768    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/282e7d44-3c65-4db3-90e7-cace006be192-sys\") pod \"perf-node-gather-daemonset-8b48j\" (UID: \"282e7d44-3c65-4db3-90e7-cace006be192\") " pod="openshift-must-gather-hcspv/perf-node-gather-daemonset-8b48j"
Sep 16 01:55:54.146550 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:54.146522    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-lltbx_baf175e9-9ba3-46e6-926b-d5005b869801/volume-data-source-validator/0.log"
Sep 16 01:55:54.230423 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:54.230399    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/282e7d44-3c65-4db3-90e7-cace006be192-lib-modules\") pod \"perf-node-gather-daemonset-8b48j\" (UID: \"282e7d44-3c65-4db3-90e7-cace006be192\") " pod="openshift-must-gather-hcspv/perf-node-gather-daemonset-8b48j"
Sep 16 01:55:54.230585 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:54.230432    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4db7\" (UniqueName: \"kubernetes.io/projected/282e7d44-3c65-4db3-90e7-cace006be192-kube-api-access-j4db7\") pod \"perf-node-gather-daemonset-8b48j\" (UID: \"282e7d44-3c65-4db3-90e7-cace006be192\") " pod="openshift-must-gather-hcspv/perf-node-gather-daemonset-8b48j"
Sep 16 01:55:54.230656 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:54.230590    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/282e7d44-3c65-4db3-90e7-cace006be192-lib-modules\") pod \"perf-node-gather-daemonset-8b48j\" (UID: \"282e7d44-3c65-4db3-90e7-cace006be192\") " pod="openshift-must-gather-hcspv/perf-node-gather-daemonset-8b48j"
Sep 16 01:55:54.230656 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:54.230594    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/282e7d44-3c65-4db3-90e7-cace006be192-proc\") pod \"perf-node-gather-daemonset-8b48j\" (UID: \"282e7d44-3c65-4db3-90e7-cace006be192\") " pod="openshift-must-gather-hcspv/perf-node-gather-daemonset-8b48j"
Sep 16 01:55:54.230656 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:54.230646    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/282e7d44-3c65-4db3-90e7-cace006be192-proc\") pod \"perf-node-gather-daemonset-8b48j\" (UID: \"282e7d44-3c65-4db3-90e7-cace006be192\") " pod="openshift-must-gather-hcspv/perf-node-gather-daemonset-8b48j"
Sep 16 01:55:54.230831 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:54.230702    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/282e7d44-3c65-4db3-90e7-cace006be192-podres\") pod \"perf-node-gather-daemonset-8b48j\" (UID: \"282e7d44-3c65-4db3-90e7-cace006be192\") " pod="openshift-must-gather-hcspv/perf-node-gather-daemonset-8b48j"
Sep 16 01:55:54.230831 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:54.230748    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/282e7d44-3c65-4db3-90e7-cace006be192-sys\") pod \"perf-node-gather-daemonset-8b48j\" (UID: \"282e7d44-3c65-4db3-90e7-cace006be192\") " pod="openshift-must-gather-hcspv/perf-node-gather-daemonset-8b48j"
Sep 16 01:55:54.230831 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:54.230815    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/282e7d44-3c65-4db3-90e7-cace006be192-sys\") pod \"perf-node-gather-daemonset-8b48j\" (UID: \"282e7d44-3c65-4db3-90e7-cace006be192\") " pod="openshift-must-gather-hcspv/perf-node-gather-daemonset-8b48j"
Sep 16 01:55:54.230831 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:54.230822    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/282e7d44-3c65-4db3-90e7-cace006be192-podres\") pod \"perf-node-gather-daemonset-8b48j\" (UID: \"282e7d44-3c65-4db3-90e7-cace006be192\") " pod="openshift-must-gather-hcspv/perf-node-gather-daemonset-8b48j"
Sep 16 01:55:54.238435 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:54.238412    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4db7\" (UniqueName: \"kubernetes.io/projected/282e7d44-3c65-4db3-90e7-cace006be192-kube-api-access-j4db7\") pod \"perf-node-gather-daemonset-8b48j\" (UID: \"282e7d44-3c65-4db3-90e7-cace006be192\") " pod="openshift-must-gather-hcspv/perf-node-gather-daemonset-8b48j"
Sep 16 01:55:54.324737 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:54.324666    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hcspv/perf-node-gather-daemonset-8b48j"
Sep 16 01:55:54.591841 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:54.591818    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hcspv/perf-node-gather-daemonset-8b48j"]
Sep 16 01:55:54.594740 ip-10-0-135-225 kubenswrapper[2565]: W0916 01:55:54.594713    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod282e7d44_3c65_4db3_90e7_cace006be192.slice/crio-90d865b64690a9512b68b1518067da4d69780e967917f681bd61034363e62eff WatchSource:0}: Error finding container 90d865b64690a9512b68b1518067da4d69780e967917f681bd61034363e62eff: Status 404 returned error can't find the container with id 90d865b64690a9512b68b1518067da4d69780e967917f681bd61034363e62eff
Sep 16 01:55:55.326453 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:55.326423    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pz7gn_064dea27-f1a9-4eb9-990b-92d5b4ed0a2c/dns/0.log"
Sep 16 01:55:55.345504 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:55.345478    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pz7gn_064dea27-f1a9-4eb9-990b-92d5b4ed0a2c/kube-rbac-proxy/0.log"
Sep 16 01:55:55.413130 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:55.413109    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dksqw_cec37c8f-d1ef-47fc-9e34-58c4f9c4e26d/dns-node-resolver/0.log"
Sep 16 01:55:55.502083 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:55.502060    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hcspv/perf-node-gather-daemonset-8b48j" event={"ID":"282e7d44-3c65-4db3-90e7-cace006be192","Type":"ContainerStarted","Data":"5622a0ddd7dc2eebc6547305507823ce05121f21aec8bcc05749160aee1299b5"}
Sep 16 01:55:55.502190 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:55.502102    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hcspv/perf-node-gather-daemonset-8b48j" event={"ID":"282e7d44-3c65-4db3-90e7-cace006be192","Type":"ContainerStarted","Data":"90d865b64690a9512b68b1518067da4d69780e967917f681bd61034363e62eff"}
Sep 16 01:55:55.502241 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:55.502184    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hcspv/perf-node-gather-daemonset-8b48j"
Sep 16 01:55:55.516692 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:55.516653    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hcspv/perf-node-gather-daemonset-8b48j" podStartSLOduration=2.516637961 podStartE2EDuration="2.516637961s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 01:55:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 01:55:55.515681615 +0000 UTC m=+2404.839150192" watchObservedRunningTime="2026-09-16 01:55:55.516637961 +0000 UTC m=+2404.840106538"
Sep 16 01:55:55.963520 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:55.963495    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-h9vzm_9b5e1f55-e4cc-46aa-919c-c50324c38ce0/node-ca/0.log"
Sep 16 01:55:56.851323 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:56.851291    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6_53eb79db-7856-4ca3-b8e7-95e015332b55/istio-proxy/0.log"
Sep 16 01:55:57.181567 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:57.181538    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-fdh4p_1e085087-790e-45c7-aa5e-5b97b122e15f/discovery/0.log"
Sep 16 01:55:57.210614 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:57.210584    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-569b779d49-bsbr8_501d163c-b2ec-4565-9318-3446994673e8/kube-auth-proxy/0.log"
Sep 16 01:55:57.287596 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:57.287571    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-6cd864bc95-st4pq_14a698e1-acae-4027-bca5-6cf067112033/payload-pre-processing/0.log"
Sep 16 01:55:57.307504 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:57.307490    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5d7dbbd56b-4455c_6c67aa80-4f89-4425-8726-a2a63b6a3121/payload-processing/0.log"
Sep 16 01:55:57.332444 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:57.332423    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-ff46cf8-5t75c_62e020bc-deda-4f89-93a8-e737340375d7/router/0.log"
Sep 16 01:55:58.142709 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:58.142677    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tcx6s_1bc088f7-5296-4cd4-b845-f56577d3a938/serve-healthcheck-canary/0.log"
Sep 16 01:55:58.657344 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:58.657318    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bqmz7_57b44225-8ae5-410c-8f44-812c00c972b8/kube-rbac-proxy/0.log"
Sep 16 01:55:58.674637 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:58.674612    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bqmz7_57b44225-8ae5-410c-8f44-812c00c972b8/exporter/0.log"
Sep 16 01:55:58.695710 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:55:58.695690    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bqmz7_57b44225-8ae5-410c-8f44-812c00c972b8/extractor/0.log"
Sep 16 01:56:00.830377 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:56:00.830323    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-5d945fb875-d7cbl_e6bb7a83-bb5d-4334-9307-ea7e85e5200e/manager/0.log"
Sep 16 01:56:01.517871 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:56:01.517838    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hcspv/perf-node-gather-daemonset-8b48j"
Sep 16 01:56:01.628259 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:56:01.628235    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f84c66984-v2sgb_553974ef-47d8-4734-9673-2634bcf4839d/manager/0.log"
Sep 16 01:56:01.642192 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:56:01.642168    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f84c66984-v2sgb_553974ef-47d8-4734-9673-2634bcf4839d/copy-manifests/0.log"
Sep 16 01:56:04.037254 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:56:04.037228    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6_53eb79db-7856-4ca3-b8e7-95e015332b55/istio-proxy/0.log"
Sep 16 01:56:04.379742 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:56:04.379671    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-fdh4p_1e085087-790e-45c7-aa5e-5b97b122e15f/discovery/0.log"
Sep 16 01:56:04.389362 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:56:04.389320    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-569b779d49-bsbr8_501d163c-b2ec-4565-9318-3446994673e8/kube-auth-proxy/0.log"
Sep 16 01:56:04.434107 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:56:04.434087    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-6cd864bc95-st4pq_14a698e1-acae-4027-bca5-6cf067112033/payload-pre-processing/0.log"
Sep 16 01:56:04.451269 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:56:04.451248    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5d7dbbd56b-4455c_6c67aa80-4f89-4425-8726-a2a63b6a3121/payload-processing/0.log"
Sep 16 01:56:04.467301 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:56:04.467277    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-ff46cf8-5t75c_62e020bc-deda-4f89-93a8-e737340375d7/router/0.log"
Sep 16 01:56:06.005493 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:56:06.005463    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6_53eb79db-7856-4ca3-b8e7-95e015332b55/istio-proxy/0.log"
Sep 16 01:56:06.332427 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:56:06.332315    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-fdh4p_1e085087-790e-45c7-aa5e-5b97b122e15f/discovery/0.log"
Sep 16 01:56:06.346982 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:56:06.346959    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-569b779d49-bsbr8_501d163c-b2ec-4565-9318-3446994673e8/kube-auth-proxy/0.log"
Sep 16 01:56:06.398956 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:56:06.398937    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-6cd864bc95-st4pq_14a698e1-acae-4027-bca5-6cf067112033/payload-pre-processing/0.log"
Sep 16 01:56:06.410257 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:56:06.410240    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5d7dbbd56b-4455c_6c67aa80-4f89-4425-8726-a2a63b6a3121/payload-processing/0.log"
Sep 16 01:56:06.426016 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:56:06.426000    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-ff46cf8-5t75c_62e020bc-deda-4f89-93a8-e737340375d7/router/0.log"
Sep 16 01:56:08.440508 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:56:08.440476    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-dnsvb_653d2ad6-c615-4dde-a7fb-980f70eb4de7/kube-storage-version-migrator-operator/1.log"
Sep 16 01:56:08.441424 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:56:08.441407    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-dnsvb_653d2ad6-c615-4dde-a7fb-980f70eb4de7/kube-storage-version-migrator-operator/0.log"
Sep 16 01:56:09.608100 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:56:09.608071    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z24pg_7c405cb2-c373-496e-84e5-055abf68c46c/kube-multus-additional-cni-plugins/0.log"
Sep 16 01:56:09.625369 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:56:09.625329    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z24pg_7c405cb2-c373-496e-84e5-055abf68c46c/egress-router-binary-copy/0.log"
Sep 16 01:56:09.643046 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:56:09.643024    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z24pg_7c405cb2-c373-496e-84e5-055abf68c46c/cni-plugins/0.log"
Sep 16 01:56:09.659877 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:56:09.659857    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z24pg_7c405cb2-c373-496e-84e5-055abf68c46c/bond-cni-plugin/0.log"
Sep 16 01:56:09.676179 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:56:09.676161    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z24pg_7c405cb2-c373-496e-84e5-055abf68c46c/routeoverride-cni/0.log"
Sep 16 01:56:09.695225 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:56:09.695206    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z24pg_7c405cb2-c373-496e-84e5-055abf68c46c/whereabouts-cni-bincopy/0.log"
Sep 16 01:56:09.714277 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:56:09.714257    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z24pg_7c405cb2-c373-496e-84e5-055abf68c46c/whereabouts-cni/0.log"
Sep 16 01:56:09.759271 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:56:09.759247    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-bxmkv_63a0c126-4c73-480d-aa3c-6de4e96c4b69/kube-multus/0.log"
Sep 16 01:56:09.943224 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:56:09.943198    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lxzjg_4112bee2-636b-4e14-a5ba-fd2bb43fffaf/network-metrics-daemon/0.log"
Sep 16 01:56:09.957860 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:56:09.957837    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lxzjg_4112bee2-636b-4e14-a5ba-fd2bb43fffaf/kube-rbac-proxy/0.log"
Sep 16 01:56:10.993467 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:56:10.993436    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fqnhz_47481dec-b718-4041-827a-aa8dd51a98d0/ovn-controller/0.log"
Sep 16 01:56:11.006879 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:56:11.006858    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fqnhz_47481dec-b718-4041-827a-aa8dd51a98d0/ovn-acl-logging/0.log"
Sep 16 01:56:11.026494 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:56:11.026471    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fqnhz_47481dec-b718-4041-827a-aa8dd51a98d0/kube-rbac-proxy-node/0.log"
Sep 16 01:56:11.044192 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:56:11.044171    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fqnhz_47481dec-b718-4041-827a-aa8dd51a98d0/kube-rbac-proxy-ovn-metrics/0.log"
Sep 16 01:56:11.058623 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:56:11.058605    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fqnhz_47481dec-b718-4041-827a-aa8dd51a98d0/northd/0.log"
Sep 16 01:56:11.075306 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:56:11.075288    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fqnhz_47481dec-b718-4041-827a-aa8dd51a98d0/nbdb/0.log"
Sep 16 01:56:11.091547 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:56:11.091527    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fqnhz_47481dec-b718-4041-827a-aa8dd51a98d0/sbdb/0.log"
Sep 16 01:56:11.148224 ip-10-0-135-225 kubenswrapper[2565]: I0916 01:56:11.148200    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fqnhz_47481dec-b718-4041-827a-aa8dd51a98d0/ovnkube-controller/0.log"