Sep 15 10:17:45.396994 ip-10-0-135-231 systemd[1]: Starting Kubernetes Kubelet...
Sep 15 10:17:45.803678 ip-10-0-135-231 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 10:17:45.803678 ip-10-0-135-231 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 15 10:17:45.803678 ip-10-0-135-231 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 10:17:45.803678 ip-10-0-135-231 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 15 10:17:45.803678 ip-10-0-135-231 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 10:17:45.805523 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.805435    2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 15 10:17:45.812519 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.812496    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 10:17:45.812519 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.812518    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 10:17:45.812519 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.812521    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 10:17:45.812630 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.812528    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 10:17:45.812630 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.812532    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 10:17:45.813219 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813209    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 10:17:45.813249 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813219    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 10:17:45.813249 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813225    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 10:17:45.813249 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813230    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 10:17:45.813249 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813233    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 10:17:45.813249 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813243    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 10:17:45.813249 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813246    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 10:17:45.813249 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813249    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 10:17:45.813249 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813252    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 10:17:45.813454 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813255    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 10:17:45.813454 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813258    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 10:17:45.813454 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813261    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 10:17:45.813454 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813264    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 10:17:45.813454 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813266    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 10:17:45.813454 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813269    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 10:17:45.813454 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813272    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 10:17:45.813454 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813275    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 10:17:45.813454 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813278    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 10:17:45.813454 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813280    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 10:17:45.813454 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813283    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 10:17:45.813454 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813285    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 10:17:45.813454 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813288    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 10:17:45.813454 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813291    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 10:17:45.813454 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813293    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 10:17:45.813454 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813296    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 10:17:45.813454 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813300    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 10:17:45.813454 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813304    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 10:17:45.813454 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813306    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 10:17:45.813925 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813310    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 10:17:45.813925 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813313    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 10:17:45.813925 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813316    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 10:17:45.813925 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813318    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 10:17:45.813925 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813321    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 10:17:45.813925 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813324    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 10:17:45.813925 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813326    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 10:17:45.813925 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813329    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 10:17:45.813925 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813332    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 10:17:45.813925 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813336    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 10:17:45.813925 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813338    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 10:17:45.813925 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813341    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 10:17:45.813925 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813343    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 10:17:45.813925 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813346    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 10:17:45.813925 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813350    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 10:17:45.813925 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813352    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 10:17:45.813925 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813355    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 10:17:45.813925 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813358    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 10:17:45.813925 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813368    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 10:17:45.813925 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813372    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 10:17:45.814456 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813374    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 10:17:45.814456 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813377    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 10:17:45.814456 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813380    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 10:17:45.814456 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813382    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 10:17:45.814456 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813385    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 10:17:45.814456 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813387    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 10:17:45.814456 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813390    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 10:17:45.814456 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813393    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 10:17:45.814456 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813396    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 10:17:45.814456 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813399    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 10:17:45.814456 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813401    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 10:17:45.814456 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813404    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 10:17:45.814456 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813406    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 10:17:45.814456 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813409    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 10:17:45.814456 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813412    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 10:17:45.814456 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813415    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 10:17:45.814456 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813417    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 10:17:45.814456 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813419    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 10:17:45.814456 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813422    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 10:17:45.814456 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813425    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 10:17:45.814965 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813428    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 10:17:45.814965 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813430    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 10:17:45.814965 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813433    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 10:17:45.814965 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813436    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 10:17:45.814965 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813439    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 10:17:45.814965 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813441    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 10:17:45.814965 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813445    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 10:17:45.814965 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813447    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 10:17:45.814965 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813451    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 10:17:45.814965 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813454    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 10:17:45.814965 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813456    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 10:17:45.814965 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813459    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 10:17:45.814965 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813461    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 10:17:45.814965 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813464    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 10:17:45.814965 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813467    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 10:17:45.814965 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813470    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 10:17:45.814965 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813472    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 10:17:45.814965 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813475    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 10:17:45.814965 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813478    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 10:17:45.815420 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813481    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 10:17:45.815420 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813484    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 10:17:45.815420 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813486    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 10:17:45.815420 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813489    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 10:17:45.815420 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813492    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 10:17:45.815420 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813495    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 10:17:45.815420 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.813498    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 10:17:45.815420 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814248    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 10:17:45.815420 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814256    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 10:17:45.815420 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814258    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 10:17:45.815420 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814264    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 10:17:45.815420 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814267    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 10:17:45.815420 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814271    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 10:17:45.815420 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814274    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 10:17:45.815420 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814277    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 10:17:45.815420 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814279    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 10:17:45.815420 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814283    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 10:17:45.815420 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814286    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 10:17:45.815420 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814288    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 10:17:45.815890 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814292    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 10:17:45.815890 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814294    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 10:17:45.815890 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814297    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 10:17:45.815890 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814300    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 10:17:45.815890 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814303    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 10:17:45.815890 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814307    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 10:17:45.815890 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814311    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 10:17:45.815890 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814314    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 10:17:45.815890 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814317    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 10:17:45.815890 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814319    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 10:17:45.815890 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814322    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 10:17:45.815890 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814324    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 10:17:45.815890 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814328    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 10:17:45.815890 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814331    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 10:17:45.815890 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814333    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 10:17:45.815890 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814336    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 10:17:45.815890 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814338    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 10:17:45.815890 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814342    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 10:17:45.815890 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814345    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 10:17:45.816371 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814347    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 10:17:45.816371 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814351    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 10:17:45.816371 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814355    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 10:17:45.816371 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814358    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 10:17:45.816371 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814361    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 10:17:45.816371 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814364    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 10:17:45.816371 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814367    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 10:17:45.816371 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814369    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 10:17:45.816371 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814372    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 10:17:45.816371 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814375    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 10:17:45.816371 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814377    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 10:17:45.816371 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814381    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 10:17:45.816371 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814384    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 10:17:45.816371 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814387    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 10:17:45.816371 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814390    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 10:17:45.816371 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814392    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 10:17:45.816371 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814395    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 10:17:45.816371 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814397    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 10:17:45.816371 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814400    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 10:17:45.816371 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814403    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 10:17:45.816913 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814405    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 10:17:45.816913 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814408    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 10:17:45.816913 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814410    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 10:17:45.816913 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814413    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 10:17:45.816913 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814415    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 10:17:45.816913 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814418    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 10:17:45.816913 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814421    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 10:17:45.816913 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814423    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 10:17:45.816913 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814426    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 10:17:45.816913 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814428    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 10:17:45.816913 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814431    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 10:17:45.816913 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814436    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 10:17:45.816913 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814439    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 10:17:45.816913 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814442    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 10:17:45.816913 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814445    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 10:17:45.816913 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814447    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 10:17:45.816913 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814450    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 10:17:45.816913 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814453    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 10:17:45.816913 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814456    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 10:17:45.816913 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814459    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 10:17:45.817404 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814461    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 10:17:45.817404 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814464    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 10:17:45.817404 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814467    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 10:17:45.817404 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814469    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 10:17:45.817404 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814472    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 10:17:45.817404 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814475    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 10:17:45.817404 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814478    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 10:17:45.817404 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814481    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 10:17:45.817404 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814484    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 10:17:45.817404 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814486    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 10:17:45.817404 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814489    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 10:17:45.817404 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814491    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 10:17:45.817404 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814494    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 10:17:45.817404 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814496    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 10:17:45.817404 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814499    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 10:17:45.817404 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814501    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 10:17:45.817404 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814505    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 10:17:45.817404 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814508    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 10:17:45.817404 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814510    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 10:17:45.817404 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814513    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 10:17:45.817913 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814515    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 10:17:45.817913 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814518    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 10:17:45.817913 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814521    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 10:17:45.817913 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814526    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 10:17:45.817913 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814528    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 10:17:45.817913 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814531    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 10:17:45.817913 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814534    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 10:17:45.817913 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814536    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 10:17:45.817913 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814945    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 10:17:45.817913 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814950    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 10:17:45.817913 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814953    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 10:17:45.817913 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814956    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 10:17:45.817913 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814959    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 10:17:45.817913 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814961    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 10:17:45.817913 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814964    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 10:17:45.817913 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814967    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 10:17:45.817913 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814971    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 10:17:45.817913 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814976    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 10:17:45.817913 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814979    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 10:17:45.818376 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814982    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 10:17:45.818376 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814985    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 10:17:45.818376 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814989    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 10:17:45.818376 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814993    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 10:17:45.818376 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814996    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 10:17:45.818376 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.814999    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 10:17:45.818376 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815002    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 10:17:45.818376 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815005    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 10:17:45.818376 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815008    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 10:17:45.818376 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815011    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 10:17:45.818376 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815013    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 10:17:45.818376 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815016    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 10:17:45.818376 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815019    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 10:17:45.818376 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815022    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 10:17:45.818376 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815024    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 10:17:45.818376 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815027    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 10:17:45.818376 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815031    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 10:17:45.818376 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815034    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 10:17:45.818376 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815036    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 10:17:45.818865 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815039    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 10:17:45.818865 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815042    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 10:17:45.818865 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815044    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 10:17:45.818865 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815047    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 10:17:45.818865 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815049    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 10:17:45.818865 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815052    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 10:17:45.818865 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815055    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 10:17:45.818865 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815057    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 10:17:45.818865 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815060    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 10:17:45.818865 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815062    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 10:17:45.818865 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815065    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 10:17:45.818865 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815068    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 10:17:45.818865 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815070    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 10:17:45.818865 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815073    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 10:17:45.818865 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815075    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 10:17:45.818865 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815078    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 10:17:45.818865 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815080    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 10:17:45.818865 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815083    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 10:17:45.818865 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815085    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 10:17:45.818865 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815088    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 10:17:45.819358 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815090    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 10:17:45.819358 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815093    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 10:17:45.819358 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815095    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 10:17:45.819358 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815098    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 10:17:45.819358 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815100    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 10:17:45.819358 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815102    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 10:17:45.819358 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815105    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 10:17:45.819358 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815107    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 10:17:45.819358 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815110    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 10:17:45.819358 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815114    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 10:17:45.819358 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815116    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 10:17:45.819358 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815119    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 10:17:45.819358 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815122    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 10:17:45.819358 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815125    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 10:17:45.819358 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815127    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 10:17:45.819358 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815130    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 10:17:45.819358 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815132    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 10:17:45.819358 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815135    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 10:17:45.819358 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815137    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 10:17:45.819827 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815140    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 10:17:45.819827 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815142    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 10:17:45.819827 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815145    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 10:17:45.819827 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815148    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 10:17:45.819827 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815150    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 10:17:45.819827 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815153    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 10:17:45.819827 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815156    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 10:17:45.819827 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815159    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 10:17:45.819827 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815161    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 10:17:45.819827 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815164    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 10:17:45.819827 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815168    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 10:17:45.819827 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815171    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 10:17:45.819827 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815174    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 10:17:45.819827 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815177    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 10:17:45.819827 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815180    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 10:17:45.819827 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815183    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 10:17:45.819827 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815185    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 10:17:45.819827 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815188    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 10:17:45.819827 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815191    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 10:17:45.820281 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815194    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 10:17:45.820281 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815196    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 10:17:45.820281 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815199    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 10:17:45.820281 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815202    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 10:17:45.820281 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815205    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 10:17:45.820281 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815208    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 10:17:45.820281 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815210    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 10:17:45.820281 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815213    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 10:17:45.820281 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815215    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 10:17:45.820281 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815218    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 10:17:45.820281 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815221    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 10:17:45.820281 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815307    2579 flags.go:64] FLAG: --address="0.0.0.0"
Sep 15 10:17:45.820281 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815350    2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 15 10:17:45.820281 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815357    2579 flags.go:64] FLAG: --anonymous-auth="true"
Sep 15 10:17:45.820281 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815362    2579 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 15 10:17:45.820281 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815367    2579 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 15 10:17:45.820281 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815370    2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 15 10:17:45.820281 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815374    2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 15 10:17:45.820281 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815378    2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 15 10:17:45.820281 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815383    2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 15 10:17:45.820281 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815386    2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 15 10:17:45.820883 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815390    2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 15 10:17:45.820883 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815393    2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 15 10:17:45.820883 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815396    2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 15 10:17:45.820883 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815399    2579 flags.go:64] FLAG: --cgroup-root=""
Sep 15 10:17:45.820883 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815402    2579 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 15 10:17:45.820883 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815405    2579 flags.go:64] FLAG: --client-ca-file=""
Sep 15 10:17:45.820883 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815408    2579 flags.go:64] FLAG: --cloud-provider="external"
Sep 15 10:17:45.820883 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815411    2579 flags.go:64] FLAG: --cluster-dns="[]"
Sep 15 10:17:45.820883 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815415    2579 flags.go:64] FLAG: --cluster-domain=""
Sep 15 10:17:45.820883 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815420    2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 15 10:17:45.820883 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815423    2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 15 10:17:45.820883 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815426    2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 15 10:17:45.820883 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815430    2579 flags.go:64] FLAG: --container-log-max-files="5"
Sep 15 10:17:45.820883 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815433    2579 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 15 10:17:45.820883 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815437    2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 15 10:17:45.820883 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815441    2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 15 10:17:45.820883 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815444    2579 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 15 10:17:45.820883 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815448    2579 flags.go:64] FLAG: --contention-profiling="false"
Sep 15 10:17:45.820883 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815451    2579 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 15 10:17:45.820883 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815454    2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 15 10:17:45.820883 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815457    2579 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 15 10:17:45.820883 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815460    2579 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 15 10:17:45.820883 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815464    2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 15 10:17:45.820883 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815466    2579 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 15 10:17:45.821463 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815469    2579 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 15 10:17:45.821463 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815473    2579 flags.go:64] FLAG: --enable-load-reader="false"
Sep 15 10:17:45.821463 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815475    2579 flags.go:64] FLAG: --enable-server="true"
Sep 15 10:17:45.821463 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815479    2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 15 10:17:45.821463 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815483    2579 flags.go:64] FLAG: --event-burst="100"
Sep 15 10:17:45.821463 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815486    2579 flags.go:64] FLAG: --event-qps="50"
Sep 15 10:17:45.821463 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815489    2579 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 15 10:17:45.821463 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815493    2579 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 15 10:17:45.821463 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815496    2579 flags.go:64] FLAG: --eviction-hard=""
Sep 15 10:17:45.821463 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815499    2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 15 10:17:45.821463 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815502    2579 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 15 10:17:45.821463 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815505    2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 15 10:17:45.821463 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815508    2579 flags.go:64] FLAG: --eviction-soft=""
Sep 15 10:17:45.821463 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815511    2579 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 15 10:17:45.821463 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815514    2579 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 15 10:17:45.821463 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815517    2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 15 10:17:45.821463 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815520    2579 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 15 10:17:45.821463 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815525    2579 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 15 10:17:45.821463 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815528    2579 flags.go:64] FLAG: --fail-swap-on="true"
Sep 15 10:17:45.821463 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815531    2579 flags.go:64] FLAG: --feature-gates=""
Sep 15 10:17:45.821463 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815535    2579 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 15 10:17:45.821463 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815539    2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 15 10:17:45.821463 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815542    2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 15 10:17:45.821463 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815545    2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 15 10:17:45.821463 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815548    2579 flags.go:64] FLAG: --healthz-port="10248"
Sep 15 10:17:45.821463 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815551    2579 flags.go:64] FLAG: --help="false"
Sep 15 10:17:45.822137 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815554    2579 flags.go:64] FLAG: --hostname-override="ip-10-0-135-231.ec2.internal"
Sep 15 10:17:45.822137 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815557    2579 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 15 10:17:45.822137 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815560    2579 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 15 10:17:45.822137 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815563    2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 15 10:17:45.822137 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815566    2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 15 10:17:45.822137 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815570    2579 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 15 10:17:45.822137 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815573    2579 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 15 10:17:45.822137 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815576    2579 flags.go:64] FLAG: --image-service-endpoint=""
Sep 15 10:17:45.822137 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815579    2579 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 15 10:17:45.822137 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815582    2579 flags.go:64] FLAG: --kube-api-burst="100"
Sep 15 10:17:45.822137 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815585    2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 15 10:17:45.822137 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815588    2579 flags.go:64] FLAG: --kube-api-qps="50"
Sep 15 10:17:45.822137 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815591    2579 flags.go:64] FLAG: --kube-reserved=""
Sep 15 10:17:45.822137 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815594    2579 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 15 10:17:45.822137 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815597    2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 15 10:17:45.822137 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815600    2579 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 15 10:17:45.822137 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815603    2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 15 10:17:45.822137 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815606    2579 flags.go:64] FLAG: --lock-file=""
Sep 15 10:17:45.822137 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815609    2579 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 15 10:17:45.822137 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815612    2579 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 15 10:17:45.822137 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815615    2579 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 15 10:17:45.822137 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815621    2579 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 15 10:17:45.822137 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815624    2579 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 15 10:17:45.822730 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815629    2579 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 15 10:17:45.822730 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815632    2579 flags.go:64] FLAG: --logging-format="text"
Sep 15 10:17:45.822730 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815648    2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 15 10:17:45.822730 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815652    2579 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 15 10:17:45.822730 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815655    2579 flags.go:64] FLAG: --manifest-url=""
Sep 15 10:17:45.822730 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815658    2579 flags.go:64] FLAG: --manifest-url-header=""
Sep 15 10:17:45.822730 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815668    2579 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 15 10:17:45.822730 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815671    2579 flags.go:64] FLAG: --max-open-files="1000000"
Sep 15 10:17:45.822730 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815675    2579 flags.go:64] FLAG: --max-pods="110"
Sep 15 10:17:45.822730 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815678    2579 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 15 10:17:45.822730 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815682    2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 15 10:17:45.822730 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815685    2579 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 15 10:17:45.822730 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815688    2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 15 10:17:45.822730 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815691    2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 15 10:17:45.822730 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815694    2579 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 15 10:17:45.822730 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815697    2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 15 10:17:45.822730 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815704    2579 flags.go:64] FLAG: --node-status-max-images="50"
Sep 15 10:17:45.822730 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815707    2579 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 15 10:17:45.822730 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815710    2579 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 15 10:17:45.822730 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815713    2579 flags.go:64] FLAG: --pod-cidr=""
Sep 15 10:17:45.822730 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815716    2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 15 10:17:45.822730 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815722    2579 flags.go:64] FLAG: --pod-manifest-path=""
Sep 15 10:17:45.822730 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815725    2579 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 15 10:17:45.822730 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815728    2579 flags.go:64] FLAG: --pods-per-core="0"
Sep 15 10:17:45.823314 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815732    2579 flags.go:64] FLAG: --port="10250"
Sep 15 10:17:45.823314 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815735    2579 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 15 10:17:45.823314 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815738    2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0aa9be997765477b0"
Sep 15 10:17:45.823314 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815741    2579 flags.go:64] FLAG: --qos-reserved=""
Sep 15 10:17:45.823314 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815744    2579 flags.go:64] FLAG: --read-only-port="10255"
Sep 15 10:17:45.823314 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815747    2579 flags.go:64] FLAG: --register-node="true"
Sep 15 10:17:45.823314 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815750    2579 flags.go:64] FLAG: --register-with-taints=""
Sep 15 10:17:45.823314 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815754    2579 flags.go:64] FLAG: --registry-burst="10"
Sep 15 10:17:45.823314 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815758    2579 flags.go:64] FLAG: --registry-qps="5"
Sep 15 10:17:45.823314 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815761    2579 flags.go:64] FLAG: --reserved-cpus=""
Sep 15 10:17:45.823314 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815764    2579 flags.go:64] FLAG: --reserved-memory=""
Sep 15 10:17:45.823314 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815768    2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 15 10:17:45.823314 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815771    2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 15 10:17:45.823314 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815774    2579 flags.go:64] FLAG: --rotate-certificates="false"
Sep 15 10:17:45.823314 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815776    2579 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 15 10:17:45.823314 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815779    2579 flags.go:64] FLAG: --runonce="false"
Sep 15 10:17:45.823314 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815783    2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 15 10:17:45.823314 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815786    2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 15 10:17:45.823314 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815789    2579 flags.go:64] FLAG: --seccomp-default="false"
Sep 15 10:17:45.823314 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815792    2579 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 15 10:17:45.823314 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815794    2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 15 10:17:45.823314 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815798    2579 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 15 10:17:45.823314 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815801    2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 15 10:17:45.823314 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815804    2579 flags.go:64] FLAG: --storage-driver-password="root"
Sep 15 10:17:45.823314 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815807    2579 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 15 10:17:45.823314 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815810    2579 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 15 10:17:45.824245 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815813    2579 flags.go:64] FLAG: --storage-driver-user="root"
Sep 15 10:17:45.824245 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815815    2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 15 10:17:45.824245 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815818    2579 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 15 10:17:45.824245 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815821    2579 flags.go:64] FLAG: --system-cgroups=""
Sep 15 10:17:45.824245 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815824    2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 15 10:17:45.824245 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815834    2579 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 15 10:17:45.824245 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815838    2579 flags.go:64] FLAG: --tls-cert-file=""
Sep 15 10:17:45.824245 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815842    2579 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 15 10:17:45.824245 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815846    2579 flags.go:64] FLAG: --tls-min-version=""
Sep 15 10:17:45.824245 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815849    2579 flags.go:64] FLAG: --tls-private-key-file=""
Sep 15 10:17:45.824245 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815852    2579 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 15 10:17:45.824245 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815855    2579 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 15 10:17:45.824245 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815858    2579 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 15 10:17:45.824245 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815861    2579 flags.go:64] FLAG: --v="2"
Sep 15 10:17:45.824245 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815866    2579 flags.go:64] FLAG: --version="false"
Sep 15 10:17:45.824245 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815870    2579 flags.go:64] FLAG: --vmodule=""
Sep 15 10:17:45.824245 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815874    2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 15 10:17:45.824245 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.815878    2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 15 10:17:45.824245 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815996    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 10:17:45.824245 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.815999    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 10:17:45.824245 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816003    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 10:17:45.824245 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816006    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 10:17:45.824245 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816009    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 10:17:45.824245 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816012    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 10:17:45.825361 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816014    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 10:17:45.825361 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816017    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 10:17:45.825361 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816020    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 10:17:45.825361 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816022    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 10:17:45.825361 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816025    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 10:17:45.825361 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816028    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 10:17:45.825361 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816030    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 10:17:45.825361 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816033    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 10:17:45.825361 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816036    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 10:17:45.825361 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816038    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 10:17:45.825361 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816041    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 10:17:45.825361 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816043    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 10:17:45.825361 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816046    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 10:17:45.825361 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816048    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 10:17:45.825361 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816052    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 10:17:45.825361 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816055    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 10:17:45.825361 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816058    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 10:17:45.825361 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816061    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 10:17:45.825361 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816064    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 10:17:45.825861 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816066    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 10:17:45.825861 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816069    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 10:17:45.825861 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816071    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 10:17:45.825861 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816075    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 10:17:45.825861 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816077    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 10:17:45.825861 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816080    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 10:17:45.825861 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816083    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 10:17:45.825861 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816085    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 10:17:45.825861 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816087    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 10:17:45.825861 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816090    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 10:17:45.825861 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816093    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 10:17:45.825861 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816095    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 10:17:45.825861 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816098    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 10:17:45.825861 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816100    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 10:17:45.825861 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816103    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 10:17:45.825861 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816106    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 10:17:45.825861 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816108    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 10:17:45.825861 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816111    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 10:17:45.825861 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816113    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 10:17:45.825861 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816116    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 10:17:45.826343 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816118    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 10:17:45.826343 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816121    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 10:17:45.826343 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816123    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 10:17:45.826343 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816126    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 10:17:45.826343 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816128    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 10:17:45.826343 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816131    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 10:17:45.826343 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816134    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 10:17:45.826343 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816138    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 10:17:45.826343 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816141    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 10:17:45.826343 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816143    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 10:17:45.826343 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816146    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 10:17:45.826343 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816149    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 10:17:45.826343 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816151    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 10:17:45.826343 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816154    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 10:17:45.826343 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816156    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 10:17:45.826343 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816161    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 10:17:45.826343 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816163    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 10:17:45.826343 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816166    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 10:17:45.826343 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816168    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 10:17:45.826343 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816172    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 10:17:45.826902 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816176    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 10:17:45.826902 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816179    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 10:17:45.826902 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816181    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 10:17:45.826902 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816184    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 10:17:45.826902 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816186    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 10:17:45.826902 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816189    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 10:17:45.826902 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816192    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 10:17:45.826902 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816194    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 10:17:45.826902 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816197    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 10:17:45.826902 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816199    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 10:17:45.826902 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816202    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 10:17:45.826902 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816205    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 10:17:45.826902 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816207    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 10:17:45.826902 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816210    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 10:17:45.826902 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816213    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 10:17:45.826902 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816217    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 10:17:45.826902 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816220    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 10:17:45.826902 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816223    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 10:17:45.826902 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816226    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 10:17:45.827381 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816230    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 10:17:45.827381 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816233    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 10:17:45.827381 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816236    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 10:17:45.827381 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816238    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 10:17:45.827381 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816241    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 10:17:45.827381 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816244    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 10:17:45.827381 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816246    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 10:17:45.827381 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816249    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 10:17:45.827381 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816253    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 10:17:45.827381 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816256    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 10:17:45.827381 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816258    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 10:17:45.827381 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816261    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 10:17:45.827381 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816264    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 10:17:45.827381 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816266    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 10:17:45.827381 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.816270    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 10:17:45.827766 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.816963    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 10:17:45.827766 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.826496    2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 15 10:17:45.827766 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.826515    2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 15 10:17:45.827766 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.826536    2579 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 15 10:17:45.827766 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.826546    2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 15 10:17:45.827766 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826604    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 10:17:45.827766 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826609    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 10:17:45.827766 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826613    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 10:17:45.827766 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826616    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 10:17:45.827766 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826619    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 10:17:45.827766 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826622    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 10:17:45.827766 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826625    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 10:17:45.827766 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826629    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 10:17:45.827766 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826632    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 10:17:45.827766 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826651    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 10:17:45.828150 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826656    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 10:17:45.828150 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826659    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 10:17:45.828150 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826662    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 10:17:45.828150 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826665    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 10:17:45.828150 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826668    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 10:17:45.828150 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826670    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 10:17:45.828150 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826673    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 10:17:45.828150 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826676    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 10:17:45.828150 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826687    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 10:17:45.828150 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826690    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 10:17:45.828150 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826693    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 10:17:45.828150 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826695    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 10:17:45.828150 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826698    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 10:17:45.828150 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826701    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 10:17:45.828150 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826704    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 10:17:45.828150 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826708    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 10:17:45.828150 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826711    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 10:17:45.828150 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826714    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 10:17:45.828150 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826716    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 10:17:45.828150 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826720    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 10:17:45.828661 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826722    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 10:17:45.828661 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826725    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 10:17:45.828661 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826728    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 10:17:45.828661 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826731    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 10:17:45.828661 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826734    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 10:17:45.828661 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826736    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 10:17:45.828661 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826739    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 10:17:45.828661 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826742    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 10:17:45.828661 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826744    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 10:17:45.828661 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826747    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 10:17:45.828661 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826750    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 10:17:45.828661 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826753    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 10:17:45.828661 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826757    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 10:17:45.828661 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826761    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 10:17:45.828661 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826764    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 10:17:45.828661 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826767    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 10:17:45.828661 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826771    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 10:17:45.828661 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826774    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 10:17:45.828661 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826777    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 10:17:45.829134 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826780    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 10:17:45.829134 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826783    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 10:17:45.829134 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826786    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 10:17:45.829134 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826789    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 10:17:45.829134 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826792    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 10:17:45.829134 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826794    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 10:17:45.829134 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826797    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 10:17:45.829134 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826800    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 10:17:45.829134 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826802    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 10:17:45.829134 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826805    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 10:17:45.829134 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826808    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 10:17:45.829134 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826810    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 10:17:45.829134 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826814    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 10:17:45.829134 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826817    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 10:17:45.829134 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826820    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 10:17:45.829134 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826822    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 10:17:45.829134 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826825    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 10:17:45.829134 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826828    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 10:17:45.829134 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826830    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 10:17:45.829134 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826833    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 10:17:45.829611 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826835    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 10:17:45.829611 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826838    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 10:17:45.829611 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826841    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 10:17:45.829611 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826845    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 10:17:45.829611 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826849    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 10:17:45.829611 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826852    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 10:17:45.829611 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826854    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 10:17:45.829611 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826857    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 10:17:45.829611 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826860    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 10:17:45.829611 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826863    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 10:17:45.829611 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826866    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 10:17:45.829611 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826869    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 10:17:45.829611 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826872    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 10:17:45.829611 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826874    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 10:17:45.829611 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826877    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 10:17:45.829611 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826879    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 10:17:45.829611 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826882    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 10:17:45.829611 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826884    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 10:17:45.829611 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826887    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 10:17:45.829611 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826890    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 10:17:45.830150 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826893    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 10:17:45.830150 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826895    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 10:17:45.830150 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826898    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 10:17:45.830150 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826901    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 10:17:45.830150 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826904    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 10:17:45.830150 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826907    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 10:17:45.830150 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826911    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 10:17:45.830150 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826915    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 10:17:45.830150 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826919    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 10:17:45.830150 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.826921    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 10:17:45.830150 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.826927    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 10:17:45.830150 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827041    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 10:17:45.830150 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827046    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 10:17:45.830150 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827049    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 10:17:45.830150 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827052    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 10:17:45.830523 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827055    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 10:17:45.830523 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827058    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 10:17:45.830523 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827062    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 10:17:45.830523 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827065    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 10:17:45.830523 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827067    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 10:17:45.830523 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827070    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 10:17:45.830523 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827072    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 10:17:45.830523 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827075    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 10:17:45.830523 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827079    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 10:17:45.830523 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827081    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 10:17:45.830523 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827084    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 10:17:45.830523 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827087    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 10:17:45.830523 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827089    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 10:17:45.830523 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827092    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 10:17:45.830523 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827094    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 10:17:45.830523 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827097    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 10:17:45.830523 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827099    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 10:17:45.830523 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827102    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 10:17:45.830523 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827105    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 10:17:45.830523 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827108    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 10:17:45.831035 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827110    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 10:17:45.831035 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827114    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 10:17:45.831035 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827118    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 10:17:45.831035 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827121    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 10:17:45.831035 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827125    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 10:17:45.831035 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827127    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 10:17:45.831035 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827130    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 10:17:45.831035 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827133    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 10:17:45.831035 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827135    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 10:17:45.831035 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827138    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 10:17:45.831035 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827141    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 10:17:45.831035 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827143    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 10:17:45.831035 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827146    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 10:17:45.831035 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827149    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 10:17:45.831035 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827151    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 10:17:45.831035 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827154    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 10:17:45.831035 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827157    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 10:17:45.831035 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827159    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 10:17:45.831035 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827162    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 10:17:45.831035 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827164    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 10:17:45.831521 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827167    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 10:17:45.831521 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827170    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 10:17:45.831521 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827173    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 10:17:45.831521 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827175    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 10:17:45.831521 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827178    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 10:17:45.831521 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827180    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 10:17:45.831521 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827183    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 10:17:45.831521 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827186    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 10:17:45.831521 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827188    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 10:17:45.831521 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827191    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 10:17:45.831521 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827194    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 10:17:45.831521 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827197    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 10:17:45.831521 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827199    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 10:17:45.831521 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827202    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 10:17:45.831521 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827205    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 10:17:45.831521 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827208    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 10:17:45.831521 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827210    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 10:17:45.831521 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827213    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 10:17:45.831521 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827215    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 10:17:45.832000 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827219    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 10:17:45.832000 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827223    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 10:17:45.832000 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827225    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 10:17:45.832000 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827228    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 10:17:45.832000 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827231    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 10:17:45.832000 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827234    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 10:17:45.832000 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827237    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 10:17:45.832000 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827239    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 10:17:45.832000 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827242    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 10:17:45.832000 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827244    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 10:17:45.832000 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827247    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 10:17:45.832000 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827249    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 10:17:45.832000 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827252    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 10:17:45.832000 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827254    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 10:17:45.832000 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827257    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 10:17:45.832000 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827260    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 10:17:45.832000 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827266    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 10:17:45.832000 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827269    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 10:17:45.832000 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827272    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 10:17:45.832000 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827274    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 10:17:45.832495 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827277    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 10:17:45.832495 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827280    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 10:17:45.832495 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827283    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 10:17:45.832495 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827285    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 10:17:45.832495 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827288    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 10:17:45.832495 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827290    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 10:17:45.832495 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827293    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 10:17:45.832495 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827296    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 10:17:45.832495 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827299    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 10:17:45.832495 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827303    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 10:17:45.832495 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827306    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 10:17:45.832495 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827308    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 10:17:45.832495 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827311    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 10:17:45.832495 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827314    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 10:17:45.832495 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827316    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 10:17:45.832495 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:45.827319    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 10:17:45.832910 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.827324    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 10:17:45.832910 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.827445    2579 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 15 10:17:45.832910 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.831803    2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 15 10:17:45.832992 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.832924    2579 server.go:1019] "Starting client certificate rotation"
Sep 15 10:17:45.833056 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.833036    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 15 10:17:45.833089 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.833071    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 15 10:17:45.836576 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.836561    2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 15 10:17:45.837767 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.837745    2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 15 10:17:45.849049 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.849030    2579 log.go:25] "Validated CRI v1 runtime API"
Sep 15 10:17:45.853422 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.853402    2579 log.go:25] "Validated CRI v1 image API"
Sep 15 10:17:45.855214 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.855143    2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 15 10:17:45.860889 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.860865    2579 fs.go:135] Filesystem UUIDs: map[35f7917d-c2c2-421a-97ac-66f5448c9caa:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 ba7d65a8-0aba-47fd-a165-8a4ae4027062:/dev/nvme0n1p4]
Sep 15 10:17:45.860993 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.860888    2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 15 10:17:45.863258 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.863236    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 15 10:17:45.865231 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.865118    2579 manager.go:216] Machine: {Timestamp:2026-09-15 10:17:45.864649307 +0000 UTC m=+0.368826227 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3091500 MemoryCapacity:33164468224 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29805f2d8aea346ee19c0af38e3eb3 SystemUUID:ec29805f-2d8a-ea34-6ee1-9c0af38e3eb3 BootID:71a4bb1d-c8a8-4efc-97d9-21ed2a891cd0 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582234112 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582234112 Type:vfs Inodes:4048397 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:e3:5d:7e:51 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:e3:5d:7e:51 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:16:bf:97:42:80:08 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164468224 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 15 10:17:45.865231 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.865223    2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 15 10:17:45.865383 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.865329    2579 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 15 10:17:45.866550 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.866522    2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 15 10:17:45.866717 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.866553    2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-231.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 15 10:17:45.867506 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.867496    2579 topology_manager.go:138] "Creating topology manager with none policy"
Sep 15 10:17:45.867536 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.867509    2579 container_manager_linux.go:309] "Creating device plugin manager"
Sep 15 10:17:45.867536 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.867517    2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 15 10:17:45.868478 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.868467    2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 15 10:17:45.869752 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.869742    2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 15 10:17:45.875220 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.875206    2579 state_mem.go:36] "Initialized new in-memory state store"
Sep 15 10:17:45.875350 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.875340    2579 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 15 10:17:45.875382 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.875371    2579 kubelet.go:486] "Attempting to sync node with API server"
Sep 15 10:17:45.875420 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.875389    2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 15 10:17:45.875420 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.875407    2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 15 10:17:45.875420 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.875417    2579 kubelet.go:398] "Adding apiserver pod source"
Sep 15 10:17:45.875529 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.875427    2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 15 10:17:45.875812 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.875799    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 15 10:17:45.875859 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.875820    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 15 10:17:45.878422 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.878406    2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 15 10:17:45.880921 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.880905    2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 15 10:17:45.881009 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.880944    2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 15 10:17:45.883776 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.883762    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 15 10:17:45.883852 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.883788    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 15 10:17:45.883852 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.883797    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 15 10:17:45.883852 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.883805    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 15 10:17:45.883852 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.883817    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 15 10:17:45.883852 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.883826    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 15 10:17:45.883852 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.883847    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 15 10:17:45.884050 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.883855    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 15 10:17:45.884050 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.883867    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 15 10:17:45.884050 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.883877    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 15 10:17:45.884050 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.883900    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 15 10:17:45.884050 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.883909    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 15 10:17:45.884652 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.884630    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 15 10:17:45.884699 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.884655    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 15 10:17:45.885271 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:45.885252    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-231.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 15 10:17:45.885305 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:45.885270    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 15 10:17:45.888326 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.888311    2579 server.go:1268] "Started kubelet"
Sep 15 10:17:45.888401 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.888379    2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 15 10:17:45.888467 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.888444    2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 15 10:17:45.888501 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.888486    2579 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 15 10:17:45.890687 ip-10-0-135-231 systemd[1]: Started Kubernetes Kubelet.
Sep 15 10:17:45.891317 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.891304    2579 server.go:310] "Adding debug handlers to kubelet server"
Sep 15 10:17:45.891970 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.891949    2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 15 10:17:45.893829 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:45.893813    2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 15 10:17:45.897688 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.897671    2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 15 10:17:45.897775 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.897700    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 15 10:17:45.897850 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:45.897800    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-231.ec2.internal\" not found"
Sep 15 10:17:45.898705 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.898675    2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 15 10:17:45.898913 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.898896    2579 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 15 10:17:45.898980 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.898918    2579 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 15 10:17:45.899149 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.899132    2579 reconstruct.go:97] "Volume reconstruction finished"
Sep 15 10:17:45.899149 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.899149    2579 reconciler.go:29] "Reconciler: start to sync state"
Sep 15 10:17:45.902516 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.900386    2579 factory.go:55] Registering systemd factory
Sep 15 10:17:45.902516 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.900405    2579 factory.go:223] Registration of the systemd container factory successfully
Sep 15 10:17:45.902516 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.900685    2579 factory.go:153] Registering CRI-O factory
Sep 15 10:17:45.902516 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.900710    2579 factory.go:223] Registration of the crio container factory successfully
Sep 15 10:17:45.902516 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.900780    2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 15 10:17:45.902516 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:45.900815    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 15 10:17:45.902516 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.902366    2579 factory.go:103] Registering Raw factory
Sep 15 10:17:45.902516 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.902429    2579 manager.go:1196] Started watching for new ooms in manager
Sep 15 10:17:45.903334 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.903317    2579 manager.go:349] Starting recovery of all containers
Sep 15 10:17:45.908510 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.908489    2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-231.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 15 10:17:45.908665 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:45.908502    2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-231.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 15 10:17:45.911620 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:45.908511    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-231.ec2.internal.18d5772de163b2fb  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-231.ec2.internal,UID:ip-10-0-135-231.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-231.ec2.internal,},FirstTimestamp:2026-09-15 10:17:45.888281339 +0000 UTC m=+0.392458256,LastTimestamp:2026-09-15 10:17:45.888281339 +0000 UTC m=+0.392458256,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-231.ec2.internal,}"
Sep 15 10:17:45.913732 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.913715    2579 manager.go:354] Recovery completed
Sep 15 10:17:45.913996 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.913966    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2zlg4"
Sep 15 10:17:45.918105 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.917990    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 10:17:45.921123 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.920730    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-231.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 10:17:45.921123 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.920756    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-231.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 10:17:45.921123 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.920767    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-231.ec2.internal" event="NodeHasSufficientPID"
Sep 15 10:17:45.921421 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.921412    2579 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 15 10:17:45.921472 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.921422    2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 15 10:17:45.921472 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.921429    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 10:17:45.921472 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.921437    2579 state_mem.go:36] "Initialized new in-memory state store"
Sep 15 10:17:45.922099 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.922082    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2zlg4"
Sep 15 10:17:45.922357 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.922340    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-231.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 10:17:45.922421 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.922375    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-231.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 10:17:45.922421 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.922391    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-231.ec2.internal" event="NodeHasSufficientPID"
Sep 15 10:17:45.922868 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:45.922795    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-231.ec2.internal.18d5772de35312e4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-231.ec2.internal,UID:ip-10-0-135-231.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-231.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-231.ec2.internal,},FirstTimestamp:2026-09-15 10:17:45.920746212 +0000 UTC m=+0.424923133,LastTimestamp:2026-09-15 10:17:45.920746212 +0000 UTC m=+0.424923133,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-231.ec2.internal,}"
Sep 15 10:17:45.923716 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.923703    2579 policy_none.go:49] "None policy: Start"
Sep 15 10:17:45.923772 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.923722    2579 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 15 10:17:45.923772 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.923737    2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 15 10:17:45.925806 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.925790    2579 policy_none.go:47] "Start"
Sep 15 10:17:45.954301 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.954284    2579 manager.go:337] "Starting Device Plugin manager"
Sep 15 10:17:45.978556 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:45.954321    2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 15 10:17:45.978556 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.954331    2579 server.go:87] "Starting device plugin registration server"
Sep 15 10:17:45.978556 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.954701    2579 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 15 10:17:45.978556 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.954714    2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 15 10:17:45.978556 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.954857    2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 15 10:17:45.978556 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.954935    2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 15 10:17:45.978556 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:45.954944    2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 15 10:17:45.978556 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:45.956149    2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 15 10:17:45.978556 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:45.956203    2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-231.ec2.internal\" not found"
Sep 15 10:17:46.032652 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:46.032603    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 15 10:17:46.033751 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:46.033736    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 15 10:17:46.033815 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:46.033798    2579 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 15 10:17:46.033859 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:46.033823    2579 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 15 10:17:46.033935 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:46.033920    2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 15 10:17:46.036117 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:46.036090    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 10:17:46.055039 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:46.054948    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 10:17:46.055972 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:46.055956    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-231.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 10:17:46.056054 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:46.055987    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-231.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 10:17:46.056054 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:46.056003    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-231.ec2.internal" event="NodeHasSufficientPID"
Sep 15 10:17:46.056054 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:46.056027    2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-231.ec2.internal"
Sep 15 10:17:46.064404 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:46.064387    2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-231.ec2.internal"
Sep 15 10:17:46.064488 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:46.064413    2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-231.ec2.internal\": node \"ip-10-0-135-231.ec2.internal\" not found"
Sep 15 10:17:46.103102 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:46.103074    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-231.ec2.internal\" not found"
Sep 15 10:17:46.134019 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:46.133978    2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-135-231.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-231.ec2.internal"]
Sep 15 10:17:46.134086 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:46.134063    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 10:17:46.135041 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:46.135024    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-231.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 10:17:46.135142 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:46.135054    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-231.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 10:17:46.135142 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:46.135063    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-231.ec2.internal" event="NodeHasSufficientPID"
Sep 15 10:17:46.137425 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:46.137411    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 10:17:46.137553 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:46.137536    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-231.ec2.internal"
Sep 15 10:17:46.137610 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:46.137575    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 10:17:46.139816 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:46.139796    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-231.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 10:17:46.139816 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:46.139801    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-231.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 10:17:46.139939 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:46.139823    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-231.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 10:17:46.139939 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:46.139832    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-231.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 10:17:46.139939 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:46.139837    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-231.ec2.internal" event="NodeHasSufficientPID"
Sep 15 10:17:46.139939 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:46.139846    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-231.ec2.internal" event="NodeHasSufficientPID"
Sep 15 10:17:46.142087 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:46.142074    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-231.ec2.internal"
Sep 15 10:17:46.142132 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:46.142102    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 10:17:46.142890 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:46.142874    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-231.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 10:17:46.142964 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:46.142900    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-231.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 10:17:46.142964 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:46.142913    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-231.ec2.internal" event="NodeHasSufficientPID"
Sep 15 10:17:46.156263 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:46.156241    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-231.ec2.internal\" not found" node="ip-10-0-135-231.ec2.internal"
Sep 15 10:17:46.160363 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:46.160348    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-231.ec2.internal\" not found" node="ip-10-0-135-231.ec2.internal"
Sep 15 10:17:46.199894 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:46.199865    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d7516d9a8a3fc6042bb1e0dad3631678-config\") pod \"kube-apiserver-proxy-ip-10-0-135-231.ec2.internal\" (UID: \"d7516d9a8a3fc6042bb1e0dad3631678\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-231.ec2.internal"
Sep 15 10:17:46.200035 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:46.199899    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/00cc55289c9a2631420bef053cfac41d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-231.ec2.internal\" (UID: \"00cc55289c9a2631420bef053cfac41d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-231.ec2.internal"
Sep 15 10:17:46.200035 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:46.199925    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/00cc55289c9a2631420bef053cfac41d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-231.ec2.internal\" (UID: \"00cc55289c9a2631420bef053cfac41d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-231.ec2.internal"
Sep 15 10:17:46.204140 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:46.204120    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-231.ec2.internal\" not found"
Sep 15 10:17:46.300371 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:46.300335    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d7516d9a8a3fc6042bb1e0dad3631678-config\") pod \"kube-apiserver-proxy-ip-10-0-135-231.ec2.internal\" (UID: \"d7516d9a8a3fc6042bb1e0dad3631678\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-231.ec2.internal"
Sep 15 10:17:46.300371 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:46.300374    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/00cc55289c9a2631420bef053cfac41d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-231.ec2.internal\" (UID: \"00cc55289c9a2631420bef053cfac41d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-231.ec2.internal"
Sep 15 10:17:46.300587 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:46.300400    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/00cc55289c9a2631420bef053cfac41d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-231.ec2.internal\" (UID: \"00cc55289c9a2631420bef053cfac41d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-231.ec2.internal"
Sep 15 10:17:46.300587 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:46.300458    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d7516d9a8a3fc6042bb1e0dad3631678-config\") pod \"kube-apiserver-proxy-ip-10-0-135-231.ec2.internal\" (UID: \"d7516d9a8a3fc6042bb1e0dad3631678\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-231.ec2.internal"
Sep 15 10:17:46.300587 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:46.300488    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/00cc55289c9a2631420bef053cfac41d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-231.ec2.internal\" (UID: \"00cc55289c9a2631420bef053cfac41d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-231.ec2.internal"
Sep 15 10:17:46.300587 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:46.300460    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/00cc55289c9a2631420bef053cfac41d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-231.ec2.internal\" (UID: \"00cc55289c9a2631420bef053cfac41d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-231.ec2.internal"
Sep 15 10:17:46.304451 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:46.304432    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-231.ec2.internal\" not found"
Sep 15 10:17:47.513433 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:47.513401    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-231.ec2.internal\" not found"
Sep 15 10:17:47.566632 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:47.566588    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-231.ec2.internal"
Sep 15 10:17:47.571845 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:47.571714    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-231.ec2.internal"
Sep 15 10:17:47.613960 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:47.613930    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-231.ec2.internal\" not found"
Sep 15 10:17:47.714558 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:47.714481    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-231.ec2.internal\" not found"
Sep 15 10:17:47.815057 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:47.815034    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-231.ec2.internal\" not found"
Sep 15 10:17:47.915777 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:47.915746    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-231.ec2.internal\" not found"
Sep 15 10:17:47.940939 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:47.940907    2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 15 10:17:47.941095 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:47.941058    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 15 10:17:48.016840 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:48.016763    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-231.ec2.internal\" not found"
Sep 15 10:17:48.036019 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:48.035972    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-14 10:12:47 +0000 UTC" deadline="2028-03-29 21:25:03.972072913 +0000 UTC"
Sep 15 10:17:48.036019 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:48.036006    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13475h7m15.936070114s"
Sep 15 10:17:48.087135 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:48.087106    2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 10:17:48.117299 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:48.117271    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-231.ec2.internal\" not found"
Sep 15 10:17:48.167931 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:48.167904    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00cc55289c9a2631420bef053cfac41d.slice/crio-05b448604cdf5bb3e33c81c341cf2ef7c7d064a8e9256b6af4543d3b4c5c9a2b WatchSource:0}: Error finding container 05b448604cdf5bb3e33c81c341cf2ef7c7d064a8e9256b6af4543d3b4c5c9a2b: Status 404 returned error can't find the container with id 05b448604cdf5bb3e33c81c341cf2ef7c7d064a8e9256b6af4543d3b4c5c9a2b
Sep 15 10:17:48.174612 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:48.174597    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 10:17:48.218244 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:48.218203    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-231.ec2.internal\" not found"
Sep 15 10:17:48.318510 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:48.318448    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-231.ec2.internal\" not found"
Sep 15 10:17:48.318510 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:48.318484    2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 10:17:48.384455 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:48.384425    2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 10:17:48.406377 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:48.406342    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-231.ec2.internal"
Sep 15 10:17:48.418362 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:48.418341    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 15 10:17:48.419267 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:48.419253    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-231.ec2.internal"
Sep 15 10:17:48.426925 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:48.426907    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 15 10:17:48.716358 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:48.716325    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7516d9a8a3fc6042bb1e0dad3631678.slice/crio-f646d0219fccc529082ee33c1055d51260de4f1d1c41a0d3a26e51842fb10fee WatchSource:0}: Error finding container f646d0219fccc529082ee33c1055d51260de4f1d1c41a0d3a26e51842fb10fee: Status 404 returned error can't find the container with id f646d0219fccc529082ee33c1055d51260de4f1d1c41a0d3a26e51842fb10fee
Sep 15 10:17:48.816140 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:48.816111    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 10:17:48.984436 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:48.984348    2579 apiserver.go:52] "Watching apiserver"
Sep 15 10:17:48.993495 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:48.993465    2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 15 10:17:48.993857 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:48.993830    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgqtw","openshift-cluster-node-tuning-operator/tuned-v8nd4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-231.ec2.internal","openshift-network-diagnostics/network-check-target-fqms7","openshift-network-operator/iptables-alerter-gd25b","openshift-ovn-kubernetes/ovnkube-node-xbkjk","kube-system/kube-apiserver-proxy-ip-10-0-135-231.ec2.internal","openshift-dns/node-resolver-t5gjf","openshift-image-registry/node-ca-pbf8k","openshift-multus/multus-additional-cni-plugins-vl7m7","openshift-multus/multus-jlrbr","openshift-multus/network-metrics-daemon-hh4zk","kube-system/global-pull-secret-syncer-d48mp","kube-system/konnectivity-agent-h4d8p"]
Sep 15 10:17:48.996453 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:48.996425    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vl7m7"
Sep 15 10:17:48.998673 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:48.998625    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d48mp"
Sep 15 10:17:48.998824 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:48.998700    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d48mp" podUID="ecad1164-c9d0-4df5-a0b8-382e33ac5629"
Sep 15 10:17:48.998824 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:48.998709    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 15 10:17:48.998824 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:48.998806    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 15 10:17:48.999315 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:48.999141    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 15 10:17:48.999315 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:48.999160    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 15 10:17:48.999315 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:48.999181    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9c9rd\""
Sep 15 10:17:48.999315 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:48.999248    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 15 10:17:49.000885 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.000822    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h4d8p"
Sep 15 10:17:49.003030 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.003011    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fb6pf\""
Sep 15 10:17:49.003130 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.003073    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 15 10:17:49.003221 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.003206    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 15 10:17:49.003337 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.003325    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqms7"
Sep 15 10:17:49.003401 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:49.003382    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqms7" podUID="4015e313-4380-437f-81e5-ba8622486e13"
Sep 15 10:17:49.005393 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.005371    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gd25b"
Sep 15 10:17:49.006813 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.006792    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 15 10:17:49.007760 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.007676    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.007852 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.007762    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-ncv85\""
Sep 15 10:17:49.007906 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.007853    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 15 10:17:49.008127 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.008017    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 15 10:17:49.008278 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.008263    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 15 10:17:49.010426 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.010072    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pbf8k"
Sep 15 10:17:49.010426 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.010126    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 15 10:17:49.010426 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.010157    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 15 10:17:49.010426 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.010227    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 15 10:17:49.010426 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.010230    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 15 10:17:49.010426 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.010334    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 15 10:17:49.010816 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.010647    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pccfn\""
Sep 15 10:17:49.010816 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.010650    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 15 10:17:49.012562 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.012378    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t5gjf"
Sep 15 10:17:49.012673 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.012610    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nvkmf\""
Sep 15 10:17:49.012673 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.012617    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 15 10:17:49.012805 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.012784    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 15 10:17:49.012862 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.012824    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 15 10:17:49.014704 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.014681    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 15 10:17:49.015021 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.015000    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 15 10:17:49.015199 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.015181    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-k8jwj\""
Sep 15 10:17:49.015278 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.015250    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-v8nd4"
Sep 15 10:17:49.017270 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.017250    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgqtw"
Sep 15 10:17:49.017791 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.017769    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-c7bqh\""
Sep 15 10:17:49.018164 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.018144    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 15 10:17:49.018972 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.018617    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8821682e-804a-4bc8-9b87-f190576d59f4-cnibin\") pod \"multus-additional-cni-plugins-vl7m7\" (UID: \"8821682e-804a-4bc8-9b87-f190576d59f4\") " pod="openshift-multus/multus-additional-cni-plugins-vl7m7"
Sep 15 10:17:49.018972 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.018664    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8821682e-804a-4bc8-9b87-f190576d59f4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vl7m7\" (UID: \"8821682e-804a-4bc8-9b87-f190576d59f4\") " pod="openshift-multus/multus-additional-cni-plugins-vl7m7"
Sep 15 10:17:49.018972 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.018697    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/573b2808-2371-4c1a-8da8-b2a3b04efed3-host-slash\") pod \"iptables-alerter-gd25b\" (UID: \"573b2808-2371-4c1a-8da8-b2a3b04efed3\") " pod="openshift-network-operator/iptables-alerter-gd25b"
Sep 15 10:17:49.018972 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.018824    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crtzg\" (UniqueName: \"kubernetes.io/projected/573b2808-2371-4c1a-8da8-b2a3b04efed3-kube-api-access-crtzg\") pod \"iptables-alerter-gd25b\" (UID: \"573b2808-2371-4c1a-8da8-b2a3b04efed3\") " pod="openshift-network-operator/iptables-alerter-gd25b"
Sep 15 10:17:49.019198 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.018981    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8db10bdb-f668-43df-8b2d-3530e0befef7-systemd-units\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.019198 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.019007    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8db10bdb-f668-43df-8b2d-3530e0befef7-host-run-netns\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.019198 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.019101    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8821682e-804a-4bc8-9b87-f190576d59f4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vl7m7\" (UID: \"8821682e-804a-4bc8-9b87-f190576d59f4\") " pod="openshift-multus/multus-additional-cni-plugins-vl7m7"
Sep 15 10:17:49.019198 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.019116    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 15 10:17:49.019198 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.019139    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v79f\" (UniqueName: \"kubernetes.io/projected/8821682e-804a-4bc8-9b87-f190576d59f4-kube-api-access-4v79f\") pod \"multus-additional-cni-plugins-vl7m7\" (UID: \"8821682e-804a-4bc8-9b87-f190576d59f4\") " pod="openshift-multus/multus-additional-cni-plugins-vl7m7"
Sep 15 10:17:49.019198 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.019177    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ecad1164-c9d0-4df5-a0b8-382e33ac5629-kubelet-config\") pod \"global-pull-secret-syncer-d48mp\" (UID: \"ecad1164-c9d0-4df5-a0b8-382e33ac5629\") " pod="kube-system/global-pull-secret-syncer-d48mp"
Sep 15 10:17:49.021186 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.019207    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8db10bdb-f668-43df-8b2d-3530e0befef7-host-kubelet\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.021186 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.019287    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ecad1164-c9d0-4df5-a0b8-382e33ac5629-original-pull-secret\") pod \"global-pull-secret-syncer-d48mp\" (UID: \"ecad1164-c9d0-4df5-a0b8-382e33ac5629\") " pod="kube-system/global-pull-secret-syncer-d48mp"
Sep 15 10:17:49.021186 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.019317    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8db10bdb-f668-43df-8b2d-3530e0befef7-log-socket\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.021186 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.019346    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8db10bdb-f668-43df-8b2d-3530e0befef7-host-cni-netd\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.021186 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.019399    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8821682e-804a-4bc8-9b87-f190576d59f4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vl7m7\" (UID: \"8821682e-804a-4bc8-9b87-f190576d59f4\") " pod="openshift-multus/multus-additional-cni-plugins-vl7m7"
Sep 15 10:17:49.021186 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.019431    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8db10bdb-f668-43df-8b2d-3530e0befef7-run-systemd\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.021186 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.019479    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8db10bdb-f668-43df-8b2d-3530e0befef7-host-slash\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.021186 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.019561    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8db10bdb-f668-43df-8b2d-3530e0befef7-etc-openvswitch\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.021186 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.019588    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8db10bdb-f668-43df-8b2d-3530e0befef7-run-ovn\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.021186 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.019620    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8db10bdb-f668-43df-8b2d-3530e0befef7-host-run-ovn-kubernetes\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.021186 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.019652    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8db10bdb-f668-43df-8b2d-3530e0befef7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.021186 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.019685    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crlml\" (UniqueName: \"kubernetes.io/projected/8db10bdb-f668-43df-8b2d-3530e0befef7-kube-api-access-crlml\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.021186 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.019798    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ecad1164-c9d0-4df5-a0b8-382e33ac5629-dbus\") pod \"global-pull-secret-syncer-d48mp\" (UID: \"ecad1164-c9d0-4df5-a0b8-382e33ac5629\") " pod="kube-system/global-pull-secret-syncer-d48mp"
Sep 15 10:17:49.021186 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.019827    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1a9137a7-9b75-4af5-8b82-10102bd76707-konnectivity-ca\") pod \"konnectivity-agent-h4d8p\" (UID: \"1a9137a7-9b75-4af5-8b82-10102bd76707\") " pod="kube-system/konnectivity-agent-h4d8p"
Sep 15 10:17:49.021186 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.019881    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8db10bdb-f668-43df-8b2d-3530e0befef7-run-openvswitch\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.021186 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.019893    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 15 10:17:49.021186 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.019921    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8db10bdb-f668-43df-8b2d-3530e0befef7-node-log\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.022131 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.019951    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8db10bdb-f668-43df-8b2d-3530e0befef7-host-cni-bin\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.022131 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.020002    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8821682e-804a-4bc8-9b87-f190576d59f4-system-cni-dir\") pod \"multus-additional-cni-plugins-vl7m7\" (UID: \"8821682e-804a-4bc8-9b87-f190576d59f4\") " pod="openshift-multus/multus-additional-cni-plugins-vl7m7"
Sep 15 10:17:49.022131 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.020067    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8821682e-804a-4bc8-9b87-f190576d59f4-cni-binary-copy\") pod \"multus-additional-cni-plugins-vl7m7\" (UID: \"8821682e-804a-4bc8-9b87-f190576d59f4\") " pod="openshift-multus/multus-additional-cni-plugins-vl7m7"
Sep 15 10:17:49.022131 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.020101    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1a9137a7-9b75-4af5-8b82-10102bd76707-agent-certs\") pod \"konnectivity-agent-h4d8p\" (UID: \"1a9137a7-9b75-4af5-8b82-10102bd76707\") " pod="kube-system/konnectivity-agent-h4d8p"
Sep 15 10:17:49.022131 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.020131    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6fcn\" (UniqueName: \"kubernetes.io/projected/4015e313-4380-437f-81e5-ba8622486e13-kube-api-access-p6fcn\") pod \"network-check-target-fqms7\" (UID: \"4015e313-4380-437f-81e5-ba8622486e13\") " pod="openshift-network-diagnostics/network-check-target-fqms7"
Sep 15 10:17:49.022131 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.020168    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8db10bdb-f668-43df-8b2d-3530e0befef7-var-lib-openvswitch\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.022131 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.020208    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8db10bdb-f668-43df-8b2d-3530e0befef7-ovnkube-config\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.022131 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.020237    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8db10bdb-f668-43df-8b2d-3530e0befef7-env-overrides\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.022131 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.020265    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8db10bdb-f668-43df-8b2d-3530e0befef7-ovn-node-metrics-cert\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.022131 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.020317    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 15 10:17:49.022131 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.020334    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 15 10:17:49.022131 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.020317    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/573b2808-2371-4c1a-8da8-b2a3b04efed3-iptables-alerter-script\") pod \"iptables-alerter-gd25b\" (UID: \"573b2808-2371-4c1a-8da8-b2a3b04efed3\") " pod="openshift-network-operator/iptables-alerter-gd25b"
Sep 15 10:17:49.022131 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.020383    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 15 10:17:49.022131 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.020395    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8db10bdb-f668-43df-8b2d-3530e0befef7-ovnkube-script-lib\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.022131 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.021243    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jlrbr"
Sep 15 10:17:49.022131 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.021766    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5tv4m\""
Sep 15 10:17:49.023700 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.023680    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 15 10:17:49.023811 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.023748    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ngz5l\""
Sep 15 10:17:49.024554 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.024527    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hh4zk"
Sep 15 10:17:49.024649 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:49.024628    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hh4zk" podUID="c101b9f1-4c96-416c-b899-fc7eee86e4ea"
Sep 15 10:17:49.042905 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.042882    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bg9j7"
Sep 15 10:17:49.048072 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.048052    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bg9j7"
Sep 15 10:17:49.108083 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.108055    2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 15 10:17:49.121134 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.121086    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c164659a-3b71-4518-b8ae-46b7163282d8-etc-kubernetes\") pod \"tuned-v8nd4\" (UID: \"c164659a-3b71-4518-b8ae-46b7163282d8\") " pod="openshift-cluster-node-tuning-operator/tuned-v8nd4"
Sep 15 10:17:49.121312 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.121152    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9f425ab3-69a3-4fa3-81a0-2bccfb818349-host-run-k8s-cni-cncf-io\") pod \"multus-jlrbr\" (UID: \"9f425ab3-69a3-4fa3-81a0-2bccfb818349\") " pod="openshift-multus/multus-jlrbr"
Sep 15 10:17:49.121312 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.121182    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8db10bdb-f668-43df-8b2d-3530e0befef7-host-slash\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.121312 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.121203    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8db10bdb-f668-43df-8b2d-3530e0befef7-host-run-ovn-kubernetes\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.121312 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.121225    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55bjc\" (UniqueName: \"kubernetes.io/projected/764a519b-87a8-4759-b03a-585cc4731146-kube-api-access-55bjc\") pod \"node-resolver-t5gjf\" (UID: \"764a519b-87a8-4759-b03a-585cc4731146\") " pod="openshift-dns/node-resolver-t5gjf"
Sep 15 10:17:49.121312 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.121231    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8db10bdb-f668-43df-8b2d-3530e0befef7-host-slash\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.121312 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.121246    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c164659a-3b71-4518-b8ae-46b7163282d8-etc-modprobe-d\") pod \"tuned-v8nd4\" (UID: \"c164659a-3b71-4518-b8ae-46b7163282d8\") " pod="openshift-cluster-node-tuning-operator/tuned-v8nd4"
Sep 15 10:17:49.121312 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.121280    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ecad1164-c9d0-4df5-a0b8-382e33ac5629-dbus\") pod \"global-pull-secret-syncer-d48mp\" (UID: \"ecad1164-c9d0-4df5-a0b8-382e33ac5629\") " pod="kube-system/global-pull-secret-syncer-d48mp"
Sep 15 10:17:49.121312 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.121303    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1a9137a7-9b75-4af5-8b82-10102bd76707-konnectivity-ca\") pod \"konnectivity-agent-h4d8p\" (UID: \"1a9137a7-9b75-4af5-8b82-10102bd76707\") " pod="kube-system/konnectivity-agent-h4d8p"
Sep 15 10:17:49.121312 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.121307    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8db10bdb-f668-43df-8b2d-3530e0befef7-host-run-ovn-kubernetes\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.121716 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.121323    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8db10bdb-f668-43df-8b2d-3530e0befef7-host-cni-bin\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.121716 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.121347    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c101b9f1-4c96-416c-b899-fc7eee86e4ea-metrics-certs\") pod \"network-metrics-daemon-hh4zk\" (UID: \"c101b9f1-4c96-416c-b899-fc7eee86e4ea\") " pod="openshift-multus/network-metrics-daemon-hh4zk"
Sep 15 10:17:49.121716 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.121359    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ecad1164-c9d0-4df5-a0b8-382e33ac5629-dbus\") pod \"global-pull-secret-syncer-d48mp\" (UID: \"ecad1164-c9d0-4df5-a0b8-382e33ac5629\") " pod="kube-system/global-pull-secret-syncer-d48mp"
Sep 15 10:17:49.121716 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.121363    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/764a519b-87a8-4759-b03a-585cc4731146-hosts-file\") pod \"node-resolver-t5gjf\" (UID: \"764a519b-87a8-4759-b03a-585cc4731146\") " pod="openshift-dns/node-resolver-t5gjf"
Sep 15 10:17:49.121716 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.121400    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8db10bdb-f668-43df-8b2d-3530e0befef7-host-cni-bin\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.121716 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.121412    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1a9137a7-9b75-4af5-8b82-10102bd76707-agent-certs\") pod \"konnectivity-agent-h4d8p\" (UID: \"1a9137a7-9b75-4af5-8b82-10102bd76707\") " pod="kube-system/konnectivity-agent-h4d8p"
Sep 15 10:17:49.121716 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.121455    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6fcn\" (UniqueName: \"kubernetes.io/projected/4015e313-4380-437f-81e5-ba8622486e13-kube-api-access-p6fcn\") pod \"network-check-target-fqms7\" (UID: \"4015e313-4380-437f-81e5-ba8622486e13\") " pod="openshift-network-diagnostics/network-check-target-fqms7"
Sep 15 10:17:49.121716 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.121526    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8db10bdb-f668-43df-8b2d-3530e0befef7-var-lib-openvswitch\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.121716 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.121550    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8db10bdb-f668-43df-8b2d-3530e0befef7-ovnkube-config\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.121716 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.121567    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8db10bdb-f668-43df-8b2d-3530e0befef7-env-overrides\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.121716 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.121587    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8db10bdb-f668-43df-8b2d-3530e0befef7-ovn-node-metrics-cert\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.121716 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.121609    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c164659a-3b71-4518-b8ae-46b7163282d8-etc-sysctl-d\") pod \"tuned-v8nd4\" (UID: \"c164659a-3b71-4518-b8ae-46b7163282d8\") " pod="openshift-cluster-node-tuning-operator/tuned-v8nd4"
Sep 15 10:17:49.121716 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.121635    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzjbm\" (UniqueName: \"kubernetes.io/projected/b552b1f6-e2a2-4c0c-a53d-2023233c6c43-kube-api-access-gzjbm\") pod \"aws-ebs-csi-driver-node-pgqtw\" (UID: \"b552b1f6-e2a2-4c0c-a53d-2023233c6c43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgqtw"
Sep 15 10:17:49.121716 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.121659    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aaa39564-bf93-4ed2-b834-bdb0dba37aea-host\") pod \"node-ca-pbf8k\" (UID: \"aaa39564-bf93-4ed2-b834-bdb0dba37aea\") " pod="openshift-image-registry/node-ca-pbf8k"
Sep 15 10:17:49.121716 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.121665    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8db10bdb-f668-43df-8b2d-3530e0befef7-var-lib-openvswitch\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.121716 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.121680    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9f425ab3-69a3-4fa3-81a0-2bccfb818349-multus-socket-dir-parent\") pod \"multus-jlrbr\" (UID: \"9f425ab3-69a3-4fa3-81a0-2bccfb818349\") " pod="openshift-multus/multus-jlrbr"
Sep 15 10:17:49.121716 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.121707    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8821682e-804a-4bc8-9b87-f190576d59f4-cnibin\") pod \"multus-additional-cni-plugins-vl7m7\" (UID: \"8821682e-804a-4bc8-9b87-f190576d59f4\") " pod="openshift-multus/multus-additional-cni-plugins-vl7m7"
Sep 15 10:17:49.122580 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.121745    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8821682e-804a-4bc8-9b87-f190576d59f4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vl7m7\" (UID: \"8821682e-804a-4bc8-9b87-f190576d59f4\") " pod="openshift-multus/multus-additional-cni-plugins-vl7m7"
Sep 15 10:17:49.122580 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.121772    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/573b2808-2371-4c1a-8da8-b2a3b04efed3-host-slash\") pod \"iptables-alerter-gd25b\" (UID: \"573b2808-2371-4c1a-8da8-b2a3b04efed3\") " pod="openshift-network-operator/iptables-alerter-gd25b"
Sep 15 10:17:49.122580 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.121794    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crtzg\" (UniqueName: \"kubernetes.io/projected/573b2808-2371-4c1a-8da8-b2a3b04efed3-kube-api-access-crtzg\") pod \"iptables-alerter-gd25b\" (UID: \"573b2808-2371-4c1a-8da8-b2a3b04efed3\") " pod="openshift-network-operator/iptables-alerter-gd25b"
Sep 15 10:17:49.122580 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.121833    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5wr5\" (UniqueName: \"kubernetes.io/projected/aaa39564-bf93-4ed2-b834-bdb0dba37aea-kube-api-access-v5wr5\") pod \"node-ca-pbf8k\" (UID: \"aaa39564-bf93-4ed2-b834-bdb0dba37aea\") " pod="openshift-image-registry/node-ca-pbf8k"
Sep 15 10:17:49.122580 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.121864    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8821682e-804a-4bc8-9b87-f190576d59f4-cnibin\") pod \"multus-additional-cni-plugins-vl7m7\" (UID: \"8821682e-804a-4bc8-9b87-f190576d59f4\") " pod="openshift-multus/multus-additional-cni-plugins-vl7m7"
Sep 15 10:17:49.122580 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.121869    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/764a519b-87a8-4759-b03a-585cc4731146-tmp-dir\") pod \"node-resolver-t5gjf\" (UID: \"764a519b-87a8-4759-b03a-585cc4731146\") " pod="openshift-dns/node-resolver-t5gjf"
Sep 15 10:17:49.122580 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.121899    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c164659a-3b71-4518-b8ae-46b7163282d8-var-lib-kubelet\") pod \"tuned-v8nd4\" (UID: \"c164659a-3b71-4518-b8ae-46b7163282d8\") " pod="openshift-cluster-node-tuning-operator/tuned-v8nd4"
Sep 15 10:17:49.122580 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.121918    2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 15 10:17:49.122580 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.121962    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/573b2808-2371-4c1a-8da8-b2a3b04efed3-host-slash\") pod \"iptables-alerter-gd25b\" (UID: \"573b2808-2371-4c1a-8da8-b2a3b04efed3\") " pod="openshift-network-operator/iptables-alerter-gd25b"
Sep 15 10:17:49.122580 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.121973    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1a9137a7-9b75-4af5-8b82-10102bd76707-konnectivity-ca\") pod \"konnectivity-agent-h4d8p\" (UID: \"1a9137a7-9b75-4af5-8b82-10102bd76707\") " pod="kube-system/konnectivity-agent-h4d8p"
Sep 15 10:17:49.122580 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.122011    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4v79f\" (UniqueName: \"kubernetes.io/projected/8821682e-804a-4bc8-9b87-f190576d59f4-kube-api-access-4v79f\") pod \"multus-additional-cni-plugins-vl7m7\" (UID: \"8821682e-804a-4bc8-9b87-f190576d59f4\") " pod="openshift-multus/multus-additional-cni-plugins-vl7m7"
Sep 15 10:17:49.122580 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.122172    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8db10bdb-f668-43df-8b2d-3530e0befef7-env-overrides\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.122580 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.122200    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8db10bdb-f668-43df-8b2d-3530e0befef7-host-kubelet\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.122580 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.122245    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8db10bdb-f668-43df-8b2d-3530e0befef7-host-kubelet\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.122580 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.122251    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgrz6\" (UniqueName: \"kubernetes.io/projected/c101b9f1-4c96-416c-b899-fc7eee86e4ea-kube-api-access-xgrz6\") pod \"network-metrics-daemon-hh4zk\" (UID: \"c101b9f1-4c96-416c-b899-fc7eee86e4ea\") " pod="openshift-multus/network-metrics-daemon-hh4zk"
Sep 15 10:17:49.122580 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.122291    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c164659a-3b71-4518-b8ae-46b7163282d8-etc-sysctl-conf\") pod \"tuned-v8nd4\" (UID: \"c164659a-3b71-4518-b8ae-46b7163282d8\") " pod="openshift-cluster-node-tuning-operator/tuned-v8nd4"
Sep 15 10:17:49.122580 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.122317    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c164659a-3b71-4518-b8ae-46b7163282d8-run\") pod \"tuned-v8nd4\" (UID: \"c164659a-3b71-4518-b8ae-46b7163282d8\") " pod="openshift-cluster-node-tuning-operator/tuned-v8nd4"
Sep 15 10:17:49.123364 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.122335    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8db10bdb-f668-43df-8b2d-3530e0befef7-ovnkube-config\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.123364 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.122345    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c164659a-3b71-4518-b8ae-46b7163282d8-host\") pod \"tuned-v8nd4\" (UID: \"c164659a-3b71-4518-b8ae-46b7163282d8\") " pod="openshift-cluster-node-tuning-operator/tuned-v8nd4"
Sep 15 10:17:49.123364 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.122369    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmwvn\" (UniqueName: \"kubernetes.io/projected/c164659a-3b71-4518-b8ae-46b7163282d8-kube-api-access-pmwvn\") pod \"tuned-v8nd4\" (UID: \"c164659a-3b71-4518-b8ae-46b7163282d8\") " pod="openshift-cluster-node-tuning-operator/tuned-v8nd4"
Sep 15 10:17:49.123364 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.122396    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ecad1164-c9d0-4df5-a0b8-382e33ac5629-original-pull-secret\") pod \"global-pull-secret-syncer-d48mp\" (UID: \"ecad1164-c9d0-4df5-a0b8-382e33ac5629\") " pod="kube-system/global-pull-secret-syncer-d48mp"
Sep 15 10:17:49.123364 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.122411    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8821682e-804a-4bc8-9b87-f190576d59f4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vl7m7\" (UID: \"8821682e-804a-4bc8-9b87-f190576d59f4\") " pod="openshift-multus/multus-additional-cni-plugins-vl7m7"
Sep 15 10:17:49.123364 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.122420    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8db10bdb-f668-43df-8b2d-3530e0befef7-log-socket\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.123364 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.122445    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c164659a-3b71-4518-b8ae-46b7163282d8-etc-sysconfig\") pod \"tuned-v8nd4\" (UID: \"c164659a-3b71-4518-b8ae-46b7163282d8\") " pod="openshift-cluster-node-tuning-operator/tuned-v8nd4"
Sep 15 10:17:49.123364 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:49.122520    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 10:17:49.123364 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.122543    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b552b1f6-e2a2-4c0c-a53d-2023233c6c43-socket-dir\") pod \"aws-ebs-csi-driver-node-pgqtw\" (UID: \"b552b1f6-e2a2-4c0c-a53d-2023233c6c43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgqtw"
Sep 15 10:17:49.123364 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.122545    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8db10bdb-f668-43df-8b2d-3530e0befef7-log-socket\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.123364 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:49.122620    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecad1164-c9d0-4df5-a0b8-382e33ac5629-original-pull-secret podName:ecad1164-c9d0-4df5-a0b8-382e33ac5629 nodeName:}" failed. No retries permitted until 2026-09-15 10:17:49.622577052 +0000 UTC m=+3.018669130 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ecad1164-c9d0-4df5-a0b8-382e33ac5629-original-pull-secret") pod "global-pull-secret-syncer-d48mp" (UID: "ecad1164-c9d0-4df5-a0b8-382e33ac5629") : object "kube-system"/"original-pull-secret" not registered
Sep 15 10:17:49.123364 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.122641    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9f425ab3-69a3-4fa3-81a0-2bccfb818349-cnibin\") pod \"multus-jlrbr\" (UID: \"9f425ab3-69a3-4fa3-81a0-2bccfb818349\") " pod="openshift-multus/multus-jlrbr"
Sep 15 10:17:49.123364 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.122668    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9f425ab3-69a3-4fa3-81a0-2bccfb818349-cni-binary-copy\") pod \"multus-jlrbr\" (UID: \"9f425ab3-69a3-4fa3-81a0-2bccfb818349\") " pod="openshift-multus/multus-jlrbr"
Sep 15 10:17:49.123364 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.122695    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8821682e-804a-4bc8-9b87-f190576d59f4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vl7m7\" (UID: \"8821682e-804a-4bc8-9b87-f190576d59f4\") " pod="openshift-multus/multus-additional-cni-plugins-vl7m7"
Sep 15 10:17:49.123364 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.122734    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8db10bdb-f668-43df-8b2d-3530e0befef7-run-systemd\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.123364 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.122769    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b552b1f6-e2a2-4c0c-a53d-2023233c6c43-registration-dir\") pod \"aws-ebs-csi-driver-node-pgqtw\" (UID: \"b552b1f6-e2a2-4c0c-a53d-2023233c6c43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgqtw"
Sep 15 10:17:49.124039 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.122794    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9f425ab3-69a3-4fa3-81a0-2bccfb818349-host-run-netns\") pod \"multus-jlrbr\" (UID: \"9f425ab3-69a3-4fa3-81a0-2bccfb818349\") " pod="openshift-multus/multus-jlrbr"
Sep 15 10:17:49.124039 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.122795    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8db10bdb-f668-43df-8b2d-3530e0befef7-run-systemd\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.124039 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.122818    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f425ab3-69a3-4fa3-81a0-2bccfb818349-host-var-lib-kubelet\") pod \"multus-jlrbr\" (UID: \"9f425ab3-69a3-4fa3-81a0-2bccfb818349\") " pod="openshift-multus/multus-jlrbr"
Sep 15 10:17:49.124039 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.122844    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9f425ab3-69a3-4fa3-81a0-2bccfb818349-multus-conf-dir\") pod \"multus-jlrbr\" (UID: \"9f425ab3-69a3-4fa3-81a0-2bccfb818349\") " pod="openshift-multus/multus-jlrbr"
Sep 15 10:17:49.124039 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.122871    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9f425ab3-69a3-4fa3-81a0-2bccfb818349-host-run-multus-certs\") pod \"multus-jlrbr\" (UID: \"9f425ab3-69a3-4fa3-81a0-2bccfb818349\") " pod="openshift-multus/multus-jlrbr"
Sep 15 10:17:49.124039 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.122887    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8821682e-804a-4bc8-9b87-f190576d59f4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vl7m7\" (UID: \"8821682e-804a-4bc8-9b87-f190576d59f4\") " pod="openshift-multus/multus-additional-cni-plugins-vl7m7"
Sep 15 10:17:49.124039 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.122897    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8db10bdb-f668-43df-8b2d-3530e0befef7-etc-openvswitch\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.124039 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.122921    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8db10bdb-f668-43df-8b2d-3530e0befef7-run-ovn\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.124039 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.122950    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8db10bdb-f668-43df-8b2d-3530e0befef7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.124039 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.122957    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8db10bdb-f668-43df-8b2d-3530e0befef7-etc-openvswitch\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.124039 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.122976    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crlml\" (UniqueName: \"kubernetes.io/projected/8db10bdb-f668-43df-8b2d-3530e0befef7-kube-api-access-crlml\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.124039 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.122999    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c164659a-3b71-4518-b8ae-46b7163282d8-sys\") pod \"tuned-v8nd4\" (UID: \"c164659a-3b71-4518-b8ae-46b7163282d8\") " pod="openshift-cluster-node-tuning-operator/tuned-v8nd4"
Sep 15 10:17:49.124039 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.123001    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8db10bdb-f668-43df-8b2d-3530e0befef7-run-ovn\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.124039 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.123027    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8db10bdb-f668-43df-8b2d-3530e0befef7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.124039 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.123031    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c164659a-3b71-4518-b8ae-46b7163282d8-lib-modules\") pod \"tuned-v8nd4\" (UID: \"c164659a-3b71-4518-b8ae-46b7163282d8\") " pod="openshift-cluster-node-tuning-operator/tuned-v8nd4"
Sep 15 10:17:49.124039 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.123069    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f425ab3-69a3-4fa3-81a0-2bccfb818349-etc-kubernetes\") pod \"multus-jlrbr\" (UID: \"9f425ab3-69a3-4fa3-81a0-2bccfb818349\") " pod="openshift-multus/multus-jlrbr"
Sep 15 10:17:49.124039 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.123094    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8db10bdb-f668-43df-8b2d-3530e0befef7-run-openvswitch\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.124716 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.123117    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8db10bdb-f668-43df-8b2d-3530e0befef7-node-log\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.124716 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.123140    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c164659a-3b71-4518-b8ae-46b7163282d8-etc-systemd\") pod \"tuned-v8nd4\" (UID: \"c164659a-3b71-4518-b8ae-46b7163282d8\") " pod="openshift-cluster-node-tuning-operator/tuned-v8nd4"
Sep 15 10:17:49.124716 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.123163    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b552b1f6-e2a2-4c0c-a53d-2023233c6c43-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pgqtw\" (UID: \"b552b1f6-e2a2-4c0c-a53d-2023233c6c43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgqtw"
Sep 15 10:17:49.124716 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.123175    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8db10bdb-f668-43df-8b2d-3530e0befef7-run-openvswitch\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.124716 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.123186    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b552b1f6-e2a2-4c0c-a53d-2023233c6c43-etc-selinux\") pod \"aws-ebs-csi-driver-node-pgqtw\" (UID: \"b552b1f6-e2a2-4c0c-a53d-2023233c6c43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgqtw"
Sep 15 10:17:49.124716 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.123215    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b552b1f6-e2a2-4c0c-a53d-2023233c6c43-sys-fs\") pod \"aws-ebs-csi-driver-node-pgqtw\" (UID: \"b552b1f6-e2a2-4c0c-a53d-2023233c6c43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgqtw"
Sep 15 10:17:49.124716 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.123238    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9f425ab3-69a3-4fa3-81a0-2bccfb818349-system-cni-dir\") pod \"multus-jlrbr\" (UID: \"9f425ab3-69a3-4fa3-81a0-2bccfb818349\") " pod="openshift-multus/multus-jlrbr"
Sep 15 10:17:49.124716 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.123245    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8db10bdb-f668-43df-8b2d-3530e0befef7-node-log\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.124716 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.123297    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9f425ab3-69a3-4fa3-81a0-2bccfb818349-host-var-lib-cni-multus\") pod \"multus-jlrbr\" (UID: \"9f425ab3-69a3-4fa3-81a0-2bccfb818349\") " pod="openshift-multus/multus-jlrbr"
Sep 15 10:17:49.124716 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.123326    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8821682e-804a-4bc8-9b87-f190576d59f4-system-cni-dir\") pod \"multus-additional-cni-plugins-vl7m7\" (UID: \"8821682e-804a-4bc8-9b87-f190576d59f4\") " pod="openshift-multus/multus-additional-cni-plugins-vl7m7"
Sep 15 10:17:49.124716 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.123352    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8821682e-804a-4bc8-9b87-f190576d59f4-cni-binary-copy\") pod \"multus-additional-cni-plugins-vl7m7\" (UID: \"8821682e-804a-4bc8-9b87-f190576d59f4\") " pod="openshift-multus/multus-additional-cni-plugins-vl7m7"
Sep 15 10:17:49.124716 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.123410    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8821682e-804a-4bc8-9b87-f190576d59f4-system-cni-dir\") pod \"multus-additional-cni-plugins-vl7m7\" (UID: \"8821682e-804a-4bc8-9b87-f190576d59f4\") " pod="openshift-multus/multus-additional-cni-plugins-vl7m7"
Sep 15 10:17:49.124716 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.123443    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c164659a-3b71-4518-b8ae-46b7163282d8-tmp\") pod \"tuned-v8nd4\" (UID: \"c164659a-3b71-4518-b8ae-46b7163282d8\") " pod="openshift-cluster-node-tuning-operator/tuned-v8nd4"
Sep 15 10:17:49.124716 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.123468    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b552b1f6-e2a2-4c0c-a53d-2023233c6c43-device-dir\") pod \"aws-ebs-csi-driver-node-pgqtw\" (UID: \"b552b1f6-e2a2-4c0c-a53d-2023233c6c43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgqtw"
Sep 15 10:17:49.124716 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.123489    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9f425ab3-69a3-4fa3-81a0-2bccfb818349-multus-cni-dir\") pod \"multus-jlrbr\" (UID: \"9f425ab3-69a3-4fa3-81a0-2bccfb818349\") " pod="openshift-multus/multus-jlrbr"
Sep 15 10:17:49.124716 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.123522    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9f425ab3-69a3-4fa3-81a0-2bccfb818349-host-var-lib-cni-bin\") pod \"multus-jlrbr\" (UID: \"9f425ab3-69a3-4fa3-81a0-2bccfb818349\") " pod="openshift-multus/multus-jlrbr"
Sep 15 10:17:49.124716 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.123554    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/573b2808-2371-4c1a-8da8-b2a3b04efed3-iptables-alerter-script\") pod \"iptables-alerter-gd25b\" (UID: \"573b2808-2371-4c1a-8da8-b2a3b04efed3\") " pod="openshift-network-operator/iptables-alerter-gd25b"
Sep 15 10:17:49.125355 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.123580    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8db10bdb-f668-43df-8b2d-3530e0befef7-ovnkube-script-lib\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.125355 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.123605    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgjb4\" (UniqueName: \"kubernetes.io/projected/9f425ab3-69a3-4fa3-81a0-2bccfb818349-kube-api-access-jgjb4\") pod \"multus-jlrbr\" (UID: \"9f425ab3-69a3-4fa3-81a0-2bccfb818349\") " pod="openshift-multus/multus-jlrbr"
Sep 15 10:17:49.125355 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.123628    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8db10bdb-f668-43df-8b2d-3530e0befef7-systemd-units\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.125355 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.123653    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8db10bdb-f668-43df-8b2d-3530e0befef7-host-run-netns\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.125355 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.123679    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8821682e-804a-4bc8-9b87-f190576d59f4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vl7m7\" (UID: \"8821682e-804a-4bc8-9b87-f190576d59f4\") " pod="openshift-multus/multus-additional-cni-plugins-vl7m7"
Sep 15 10:17:49.125355 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.123705    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ecad1164-c9d0-4df5-a0b8-382e33ac5629-kubelet-config\") pod \"global-pull-secret-syncer-d48mp\" (UID: \"ecad1164-c9d0-4df5-a0b8-382e33ac5629\") " pod="kube-system/global-pull-secret-syncer-d48mp"
Sep 15 10:17:49.125355 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.123745    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/aaa39564-bf93-4ed2-b834-bdb0dba37aea-serviceca\") pod \"node-ca-pbf8k\" (UID: \"aaa39564-bf93-4ed2-b834-bdb0dba37aea\") " pod="openshift-image-registry/node-ca-pbf8k"
Sep 15 10:17:49.125355 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.123768    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9f425ab3-69a3-4fa3-81a0-2bccfb818349-hostroot\") pod \"multus-jlrbr\" (UID: \"9f425ab3-69a3-4fa3-81a0-2bccfb818349\") " pod="openshift-multus/multus-jlrbr"
Sep 15 10:17:49.125355 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.123797    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9f425ab3-69a3-4fa3-81a0-2bccfb818349-multus-daemon-config\") pod \"multus-jlrbr\" (UID: \"9f425ab3-69a3-4fa3-81a0-2bccfb818349\") " pod="openshift-multus/multus-jlrbr"
Sep 15 10:17:49.125355 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.123820    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8db10bdb-f668-43df-8b2d-3530e0befef7-host-cni-netd\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.125355 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.123838    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8821682e-804a-4bc8-9b87-f190576d59f4-cni-binary-copy\") pod \"multus-additional-cni-plugins-vl7m7\" (UID: \"8821682e-804a-4bc8-9b87-f190576d59f4\") " pod="openshift-multus/multus-additional-cni-plugins-vl7m7"
Sep 15 10:17:49.125355 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.123844    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c164659a-3b71-4518-b8ae-46b7163282d8-etc-tuned\") pod \"tuned-v8nd4\" (UID: \"c164659a-3b71-4518-b8ae-46b7163282d8\") " pod="openshift-cluster-node-tuning-operator/tuned-v8nd4"
Sep 15 10:17:49.125355 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.123941    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ecad1164-c9d0-4df5-a0b8-382e33ac5629-kubelet-config\") pod \"global-pull-secret-syncer-d48mp\" (UID: \"ecad1164-c9d0-4df5-a0b8-382e33ac5629\") " pod="kube-system/global-pull-secret-syncer-d48mp"
Sep 15 10:17:49.125355 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.123984    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8db10bdb-f668-43df-8b2d-3530e0befef7-host-cni-netd\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.125355 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.124018    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8db10bdb-f668-43df-8b2d-3530e0befef7-host-run-netns\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.125355 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.124051    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8db10bdb-f668-43df-8b2d-3530e0befef7-systemd-units\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.125355 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.124116    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8db10bdb-f668-43df-8b2d-3530e0befef7-ovnkube-script-lib\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.126008 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.124145    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/573b2808-2371-4c1a-8da8-b2a3b04efed3-iptables-alerter-script\") pod \"iptables-alerter-gd25b\" (UID: \"573b2808-2371-4c1a-8da8-b2a3b04efed3\") " pod="openshift-network-operator/iptables-alerter-gd25b"
Sep 15 10:17:49.126008 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.124330    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8821682e-804a-4bc8-9b87-f190576d59f4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vl7m7\" (UID: \"8821682e-804a-4bc8-9b87-f190576d59f4\") " pod="openshift-multus/multus-additional-cni-plugins-vl7m7"
Sep 15 10:17:49.126008 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.125820    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8db10bdb-f668-43df-8b2d-3530e0befef7-ovn-node-metrics-cert\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.126008 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.125922    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1a9137a7-9b75-4af5-8b82-10102bd76707-agent-certs\") pod \"konnectivity-agent-h4d8p\" (UID: \"1a9137a7-9b75-4af5-8b82-10102bd76707\") " pod="kube-system/konnectivity-agent-h4d8p"
Sep 15 10:17:49.130880 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:49.130859    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 10:17:49.130880 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:49.130883    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 10:17:49.131085 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:49.130898    2579 projected.go:196] Error preparing data for projected volume kube-api-access-p6fcn for pod openshift-network-diagnostics/network-check-target-fqms7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 10:17:49.131085 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:49.130958    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4015e313-4380-437f-81e5-ba8622486e13-kube-api-access-p6fcn podName:4015e313-4380-437f-81e5-ba8622486e13 nodeName:}" failed. No retries permitted until 2026-09-15 10:17:49.630941824 +0000 UTC m=+3.027033895 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-p6fcn" (UniqueName: "kubernetes.io/projected/4015e313-4380-437f-81e5-ba8622486e13-kube-api-access-p6fcn") pod "network-check-target-fqms7" (UID: "4015e313-4380-437f-81e5-ba8622486e13") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 10:17:49.133287 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.133263    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crtzg\" (UniqueName: \"kubernetes.io/projected/573b2808-2371-4c1a-8da8-b2a3b04efed3-kube-api-access-crtzg\") pod \"iptables-alerter-gd25b\" (UID: \"573b2808-2371-4c1a-8da8-b2a3b04efed3\") " pod="openshift-network-operator/iptables-alerter-gd25b"
Sep 15 10:17:49.134346 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.134324    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v79f\" (UniqueName: \"kubernetes.io/projected/8821682e-804a-4bc8-9b87-f190576d59f4-kube-api-access-4v79f\") pod \"multus-additional-cni-plugins-vl7m7\" (UID: \"8821682e-804a-4bc8-9b87-f190576d59f4\") " pod="openshift-multus/multus-additional-cni-plugins-vl7m7"
Sep 15 10:17:49.134591 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.134572    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crlml\" (UniqueName: \"kubernetes.io/projected/8db10bdb-f668-43df-8b2d-3530e0befef7-kube-api-access-crlml\") pod \"ovnkube-node-xbkjk\" (UID: \"8db10bdb-f668-43df-8b2d-3530e0befef7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.146796 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.146739    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-231.ec2.internal" event={"ID":"d7516d9a8a3fc6042bb1e0dad3631678","Type":"ContainerStarted","Data":"f646d0219fccc529082ee33c1055d51260de4f1d1c41a0d3a26e51842fb10fee"}
Sep 15 10:17:49.151369 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.148485    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-231.ec2.internal" event={"ID":"00cc55289c9a2631420bef053cfac41d","Type":"ContainerStarted","Data":"05b448604cdf5bb3e33c81c341cf2ef7c7d064a8e9256b6af4543d3b4c5c9a2b"}
Sep 15 10:17:49.224947 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.224910    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b552b1f6-e2a2-4c0c-a53d-2023233c6c43-etc-selinux\") pod \"aws-ebs-csi-driver-node-pgqtw\" (UID: \"b552b1f6-e2a2-4c0c-a53d-2023233c6c43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgqtw"
Sep 15 10:17:49.224947 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.224945    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b552b1f6-e2a2-4c0c-a53d-2023233c6c43-sys-fs\") pod \"aws-ebs-csi-driver-node-pgqtw\" (UID: \"b552b1f6-e2a2-4c0c-a53d-2023233c6c43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgqtw"
Sep 15 10:17:49.225186 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.224961    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9f425ab3-69a3-4fa3-81a0-2bccfb818349-system-cni-dir\") pod \"multus-jlrbr\" (UID: \"9f425ab3-69a3-4fa3-81a0-2bccfb818349\") " pod="openshift-multus/multus-jlrbr"
Sep 15 10:17:49.225186 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.224980    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9f425ab3-69a3-4fa3-81a0-2bccfb818349-host-var-lib-cni-multus\") pod \"multus-jlrbr\" (UID: \"9f425ab3-69a3-4fa3-81a0-2bccfb818349\") " pod="openshift-multus/multus-jlrbr"
Sep 15 10:17:49.225186 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.225008    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c164659a-3b71-4518-b8ae-46b7163282d8-tmp\") pod \"tuned-v8nd4\" (UID: \"c164659a-3b71-4518-b8ae-46b7163282d8\") " pod="openshift-cluster-node-tuning-operator/tuned-v8nd4"
Sep 15 10:17:49.225186 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.225032    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b552b1f6-e2a2-4c0c-a53d-2023233c6c43-device-dir\") pod \"aws-ebs-csi-driver-node-pgqtw\" (UID: \"b552b1f6-e2a2-4c0c-a53d-2023233c6c43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgqtw"
Sep 15 10:17:49.225186 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.225054    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9f425ab3-69a3-4fa3-81a0-2bccfb818349-multus-cni-dir\") pod \"multus-jlrbr\" (UID: \"9f425ab3-69a3-4fa3-81a0-2bccfb818349\") " pod="openshift-multus/multus-jlrbr"
Sep 15 10:17:49.225186 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.225056    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b552b1f6-e2a2-4c0c-a53d-2023233c6c43-sys-fs\") pod \"aws-ebs-csi-driver-node-pgqtw\" (UID: \"b552b1f6-e2a2-4c0c-a53d-2023233c6c43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgqtw"
Sep 15 10:17:49.225186 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.225080    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9f425ab3-69a3-4fa3-81a0-2bccfb818349-host-var-lib-cni-bin\") pod \"multus-jlrbr\" (UID: \"9f425ab3-69a3-4fa3-81a0-2bccfb818349\") " pod="openshift-multus/multus-jlrbr"
Sep 15 10:17:49.225186 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.225058    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9f425ab3-69a3-4fa3-81a0-2bccfb818349-system-cni-dir\") pod \"multus-jlrbr\" (UID: \"9f425ab3-69a3-4fa3-81a0-2bccfb818349\") " pod="openshift-multus/multus-jlrbr"
Sep 15 10:17:49.225186 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.225080    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9f425ab3-69a3-4fa3-81a0-2bccfb818349-host-var-lib-cni-multus\") pod \"multus-jlrbr\" (UID: \"9f425ab3-69a3-4fa3-81a0-2bccfb818349\") " pod="openshift-multus/multus-jlrbr"
Sep 15 10:17:49.225186 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.225106    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgjb4\" (UniqueName: \"kubernetes.io/projected/9f425ab3-69a3-4fa3-81a0-2bccfb818349-kube-api-access-jgjb4\") pod \"multus-jlrbr\" (UID: \"9f425ab3-69a3-4fa3-81a0-2bccfb818349\") " pod="openshift-multus/multus-jlrbr"
Sep 15 10:17:49.225186 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.225115    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b552b1f6-e2a2-4c0c-a53d-2023233c6c43-device-dir\") pod \"aws-ebs-csi-driver-node-pgqtw\" (UID: \"b552b1f6-e2a2-4c0c-a53d-2023233c6c43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgqtw"
Sep 15 10:17:49.225186 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.225131    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/aaa39564-bf93-4ed2-b834-bdb0dba37aea-serviceca\") pod \"node-ca-pbf8k\" (UID: \"aaa39564-bf93-4ed2-b834-bdb0dba37aea\") " pod="openshift-image-registry/node-ca-pbf8k"
Sep 15 10:17:49.225186 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.225049    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b552b1f6-e2a2-4c0c-a53d-2023233c6c43-etc-selinux\") pod \"aws-ebs-csi-driver-node-pgqtw\" (UID: \"b552b1f6-e2a2-4c0c-a53d-2023233c6c43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgqtw"
Sep 15 10:17:49.225186 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.225120    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9f425ab3-69a3-4fa3-81a0-2bccfb818349-multus-cni-dir\") pod \"multus-jlrbr\" (UID: \"9f425ab3-69a3-4fa3-81a0-2bccfb818349\") " pod="openshift-multus/multus-jlrbr"
Sep 15 10:17:49.225186 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.225141    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9f425ab3-69a3-4fa3-81a0-2bccfb818349-host-var-lib-cni-bin\") pod \"multus-jlrbr\" (UID: \"9f425ab3-69a3-4fa3-81a0-2bccfb818349\") " pod="openshift-multus/multus-jlrbr"
Sep 15 10:17:49.225186 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.225158    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9f425ab3-69a3-4fa3-81a0-2bccfb818349-hostroot\") pod \"multus-jlrbr\" (UID: \"9f425ab3-69a3-4fa3-81a0-2bccfb818349\") " pod="openshift-multus/multus-jlrbr"
Sep 15 10:17:49.225186 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.225179    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9f425ab3-69a3-4fa3-81a0-2bccfb818349-multus-daemon-config\") pod \"multus-jlrbr\" (UID: \"9f425ab3-69a3-4fa3-81a0-2bccfb818349\") " pod="openshift-multus/multus-jlrbr"
Sep 15 10:17:49.225989 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.225203    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c164659a-3b71-4518-b8ae-46b7163282d8-etc-tuned\") pod \"tuned-v8nd4\" (UID: \"c164659a-3b71-4518-b8ae-46b7163282d8\") " pod="openshift-cluster-node-tuning-operator/tuned-v8nd4"
Sep 15 10:17:49.225989 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.225214    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9f425ab3-69a3-4fa3-81a0-2bccfb818349-hostroot\") pod \"multus-jlrbr\" (UID: \"9f425ab3-69a3-4fa3-81a0-2bccfb818349\") " pod="openshift-multus/multus-jlrbr"
Sep 15 10:17:49.225989 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.225226    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c164659a-3b71-4518-b8ae-46b7163282d8-etc-kubernetes\") pod \"tuned-v8nd4\" (UID: \"c164659a-3b71-4518-b8ae-46b7163282d8\") " pod="openshift-cluster-node-tuning-operator/tuned-v8nd4"
Sep 15 10:17:49.225989 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.225248    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9f425ab3-69a3-4fa3-81a0-2bccfb818349-host-run-k8s-cni-cncf-io\") pod \"multus-jlrbr\" (UID: \"9f425ab3-69a3-4fa3-81a0-2bccfb818349\") " pod="openshift-multus/multus-jlrbr"
Sep 15 10:17:49.225989 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.225269    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55bjc\" (UniqueName: \"kubernetes.io/projected/764a519b-87a8-4759-b03a-585cc4731146-kube-api-access-55bjc\") pod \"node-resolver-t5gjf\" (UID: \"764a519b-87a8-4759-b03a-585cc4731146\") " pod="openshift-dns/node-resolver-t5gjf"
Sep 15 10:17:49.225989 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.225283    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c164659a-3b71-4518-b8ae-46b7163282d8-etc-modprobe-d\") pod \"tuned-v8nd4\" (UID: \"c164659a-3b71-4518-b8ae-46b7163282d8\") " pod="openshift-cluster-node-tuning-operator/tuned-v8nd4"
Sep 15 10:17:49.225989 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.225307    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c101b9f1-4c96-416c-b899-fc7eee86e4ea-metrics-certs\") pod \"network-metrics-daemon-hh4zk\" (UID: \"c101b9f1-4c96-416c-b899-fc7eee86e4ea\") " pod="openshift-multus/network-metrics-daemon-hh4zk"
Sep 15 10:17:49.225989 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.225332    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/764a519b-87a8-4759-b03a-585cc4731146-hosts-file\") pod \"node-resolver-t5gjf\" (UID: \"764a519b-87a8-4759-b03a-585cc4731146\") " pod="openshift-dns/node-resolver-t5gjf"
Sep 15 10:17:49.225989 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.225339    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c164659a-3b71-4518-b8ae-46b7163282d8-etc-kubernetes\") pod \"tuned-v8nd4\" (UID: \"c164659a-3b71-4518-b8ae-46b7163282d8\") " pod="openshift-cluster-node-tuning-operator/tuned-v8nd4"
Sep 15 10:17:49.225989 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.225374    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c164659a-3b71-4518-b8ae-46b7163282d8-etc-sysctl-d\") pod \"tuned-v8nd4\" (UID: \"c164659a-3b71-4518-b8ae-46b7163282d8\") " pod="openshift-cluster-node-tuning-operator/tuned-v8nd4"
Sep 15 10:17:49.225989 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.225398    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzjbm\" (UniqueName: \"kubernetes.io/projected/b552b1f6-e2a2-4c0c-a53d-2023233c6c43-kube-api-access-gzjbm\") pod \"aws-ebs-csi-driver-node-pgqtw\" (UID: \"b552b1f6-e2a2-4c0c-a53d-2023233c6c43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgqtw"
Sep 15 10:17:49.225989 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.225420    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aaa39564-bf93-4ed2-b834-bdb0dba37aea-host\") pod \"node-ca-pbf8k\" (UID: \"aaa39564-bf93-4ed2-b834-bdb0dba37aea\") " pod="openshift-image-registry/node-ca-pbf8k"
Sep 15 10:17:49.225989 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.225441    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9f425ab3-69a3-4fa3-81a0-2bccfb818349-multus-socket-dir-parent\") pod \"multus-jlrbr\" (UID: \"9f425ab3-69a3-4fa3-81a0-2bccfb818349\") " pod="openshift-multus/multus-jlrbr"
Sep 15 10:17:49.225989 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.225470    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5wr5\" (UniqueName: \"kubernetes.io/projected/aaa39564-bf93-4ed2-b834-bdb0dba37aea-kube-api-access-v5wr5\") pod \"node-ca-pbf8k\" (UID: \"aaa39564-bf93-4ed2-b834-bdb0dba37aea\") " pod="openshift-image-registry/node-ca-pbf8k"
Sep 15 10:17:49.225989 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.225492    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/764a519b-87a8-4759-b03a-585cc4731146-tmp-dir\") pod \"node-resolver-t5gjf\" (UID: \"764a519b-87a8-4759-b03a-585cc4731146\") " pod="openshift-dns/node-resolver-t5gjf"
Sep 15 10:17:49.225989 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.225514    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c164659a-3b71-4518-b8ae-46b7163282d8-var-lib-kubelet\") pod \"tuned-v8nd4\" (UID: \"c164659a-3b71-4518-b8ae-46b7163282d8\") " pod="openshift-cluster-node-tuning-operator/tuned-v8nd4"
Sep 15 10:17:49.225989 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.225540    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgrz6\" (UniqueName: \"kubernetes.io/projected/c101b9f1-4c96-416c-b899-fc7eee86e4ea-kube-api-access-xgrz6\") pod \"network-metrics-daemon-hh4zk\" (UID: \"c101b9f1-4c96-416c-b899-fc7eee86e4ea\") " pod="openshift-multus/network-metrics-daemon-hh4zk"
Sep 15 10:17:49.225989 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.225549    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aaa39564-bf93-4ed2-b834-bdb0dba37aea-host\") pod \"node-ca-pbf8k\" (UID: \"aaa39564-bf93-4ed2-b834-bdb0dba37aea\") " pod="openshift-image-registry/node-ca-pbf8k"
Sep 15 10:17:49.226632 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.225562    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c164659a-3b71-4518-b8ae-46b7163282d8-etc-sysctl-conf\") pod \"tuned-v8nd4\" (UID: \"c164659a-3b71-4518-b8ae-46b7163282d8\") " pod="openshift-cluster-node-tuning-operator/tuned-v8nd4"
Sep 15 10:17:49.226632 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.225588    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c164659a-3b71-4518-b8ae-46b7163282d8-run\") pod \"tuned-v8nd4\" (UID: \"c164659a-3b71-4518-b8ae-46b7163282d8\") " pod="openshift-cluster-node-tuning-operator/tuned-v8nd4"
Sep 15 10:17:49.226632 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.225608    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9f425ab3-69a3-4fa3-81a0-2bccfb818349-host-run-k8s-cni-cncf-io\") pod \"multus-jlrbr\" (UID: \"9f425ab3-69a3-4fa3-81a0-2bccfb818349\") " pod="openshift-multus/multus-jlrbr"
Sep 15 10:17:49.226632 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.225611    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c164659a-3b71-4518-b8ae-46b7163282d8-etc-sysctl-d\") pod \"tuned-v8nd4\" (UID: \"c164659a-3b71-4518-b8ae-46b7163282d8\") " pod="openshift-cluster-node-tuning-operator/tuned-v8nd4"
Sep 15 10:17:49.226632 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.225610    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/aaa39564-bf93-4ed2-b834-bdb0dba37aea-serviceca\") pod \"node-ca-pbf8k\" (UID: \"aaa39564-bf93-4ed2-b834-bdb0dba37aea\") " pod="openshift-image-registry/node-ca-pbf8k"
Sep 15 10:17:49.226632 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.225612    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c164659a-3b71-4518-b8ae-46b7163282d8-host\") pod \"tuned-v8nd4\" (UID: \"c164659a-3b71-4518-b8ae-46b7163282d8\") " pod="openshift-cluster-node-tuning-operator/tuned-v8nd4"
Sep 15 10:17:49.226632 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.225668    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c164659a-3b71-4518-b8ae-46b7163282d8-host\") pod \"tuned-v8nd4\" (UID: \"c164659a-3b71-4518-b8ae-46b7163282d8\") " pod="openshift-cluster-node-tuning-operator/tuned-v8nd4"
Sep 15 10:17:49.226632 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.225677    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmwvn\" (UniqueName: \"kubernetes.io/projected/c164659a-3b71-4518-b8ae-46b7163282d8-kube-api-access-pmwvn\") pod \"tuned-v8nd4\" (UID: \"c164659a-3b71-4518-b8ae-46b7163282d8\") " pod="openshift-cluster-node-tuning-operator/tuned-v8nd4"
Sep 15 10:17:49.226632 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.225686    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9f425ab3-69a3-4fa3-81a0-2bccfb818349-multus-socket-dir-parent\") pod \"multus-jlrbr\" (UID: \"9f425ab3-69a3-4fa3-81a0-2bccfb818349\") " pod="openshift-multus/multus-jlrbr"
Sep 15 10:17:49.226632 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:49.225760    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 10:17:49.226632 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.225797    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9f425ab3-69a3-4fa3-81a0-2bccfb818349-multus-daemon-config\") pod \"multus-jlrbr\" (UID: \"9f425ab3-69a3-4fa3-81a0-2bccfb818349\") " pod="openshift-multus/multus-jlrbr"
Sep 15 10:17:49.226632 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.225801    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c164659a-3b71-4518-b8ae-46b7163282d8-etc-sysconfig\") pod \"tuned-v8nd4\" (UID: \"c164659a-3b71-4518-b8ae-46b7163282d8\") " pod="openshift-cluster-node-tuning-operator/tuned-v8nd4"
Sep 15 10:17:49.226632 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:49.225844    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c101b9f1-4c96-416c-b899-fc7eee86e4ea-metrics-certs podName:c101b9f1-4c96-416c-b899-fc7eee86e4ea nodeName:}" failed. No retries permitted until 2026-09-15 10:17:49.725827541 +0000 UTC m=+3.121919621 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c101b9f1-4c96-416c-b899-fc7eee86e4ea-metrics-certs") pod "network-metrics-daemon-hh4zk" (UID: "c101b9f1-4c96-416c-b899-fc7eee86e4ea") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 10:17:49.226632 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.225762    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c164659a-3b71-4518-b8ae-46b7163282d8-etc-sysconfig\") pod \"tuned-v8nd4\" (UID: \"c164659a-3b71-4518-b8ae-46b7163282d8\") " pod="openshift-cluster-node-tuning-operator/tuned-v8nd4"
Sep 15 10:17:49.226632 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.225890    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/764a519b-87a8-4759-b03a-585cc4731146-hosts-file\") pod \"node-resolver-t5gjf\" (UID: \"764a519b-87a8-4759-b03a-585cc4731146\") " pod="openshift-dns/node-resolver-t5gjf"
Sep 15 10:17:49.226632 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.225899    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b552b1f6-e2a2-4c0c-a53d-2023233c6c43-socket-dir\") pod \"aws-ebs-csi-driver-node-pgqtw\" (UID: \"b552b1f6-e2a2-4c0c-a53d-2023233c6c43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgqtw"
Sep 15 10:17:49.226632 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.225909    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c164659a-3b71-4518-b8ae-46b7163282d8-etc-modprobe-d\") pod \"tuned-v8nd4\" (UID: \"c164659a-3b71-4518-b8ae-46b7163282d8\") " pod="openshift-cluster-node-tuning-operator/tuned-v8nd4"
Sep 15 10:17:49.226632 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.225923    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/764a519b-87a8-4759-b03a-585cc4731146-tmp-dir\") pod \"node-resolver-t5gjf\" (UID: \"764a519b-87a8-4759-b03a-585cc4731146\") " pod="openshift-dns/node-resolver-t5gjf"
Sep 15 10:17:49.227194 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.225953    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c164659a-3b71-4518-b8ae-46b7163282d8-run\") pod \"tuned-v8nd4\" (UID: \"c164659a-3b71-4518-b8ae-46b7163282d8\") " pod="openshift-cluster-node-tuning-operator/tuned-v8nd4"
Sep 15 10:17:49.227194 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.225962    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9f425ab3-69a3-4fa3-81a0-2bccfb818349-cnibin\") pod \"multus-jlrbr\" (UID: \"9f425ab3-69a3-4fa3-81a0-2bccfb818349\") " pod="openshift-multus/multus-jlrbr"
Sep 15 10:17:49.227194 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.225924    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9f425ab3-69a3-4fa3-81a0-2bccfb818349-cnibin\") pod \"multus-jlrbr\" (UID: \"9f425ab3-69a3-4fa3-81a0-2bccfb818349\") " pod="openshift-multus/multus-jlrbr"
Sep 15 10:17:49.227194 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.225963    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c164659a-3b71-4518-b8ae-46b7163282d8-etc-sysctl-conf\") pod \"tuned-v8nd4\" (UID: \"c164659a-3b71-4518-b8ae-46b7163282d8\") " pod="openshift-cluster-node-tuning-operator/tuned-v8nd4"
Sep 15 10:17:49.227194 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.225996    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c164659a-3b71-4518-b8ae-46b7163282d8-var-lib-kubelet\") pod \"tuned-v8nd4\" (UID: \"c164659a-3b71-4518-b8ae-46b7163282d8\") " pod="openshift-cluster-node-tuning-operator/tuned-v8nd4"
Sep 15 10:17:49.227194 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.226001    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9f425ab3-69a3-4fa3-81a0-2bccfb818349-cni-binary-copy\") pod \"multus-jlrbr\" (UID: \"9f425ab3-69a3-4fa3-81a0-2bccfb818349\") " pod="openshift-multus/multus-jlrbr"
Sep 15 10:17:49.227194 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.226028    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b552b1f6-e2a2-4c0c-a53d-2023233c6c43-registration-dir\") pod \"aws-ebs-csi-driver-node-pgqtw\" (UID: \"b552b1f6-e2a2-4c0c-a53d-2023233c6c43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgqtw"
Sep 15 10:17:49.227194 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.226058    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9f425ab3-69a3-4fa3-81a0-2bccfb818349-host-run-netns\") pod \"multus-jlrbr\" (UID: \"9f425ab3-69a3-4fa3-81a0-2bccfb818349\") " pod="openshift-multus/multus-jlrbr"
Sep 15 10:17:49.227194 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.226091    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f425ab3-69a3-4fa3-81a0-2bccfb818349-host-var-lib-kubelet\") pod \"multus-jlrbr\" (UID: \"9f425ab3-69a3-4fa3-81a0-2bccfb818349\") " pod="openshift-multus/multus-jlrbr"
Sep 15 10:17:49.227194 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.226100    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b552b1f6-e2a2-4c0c-a53d-2023233c6c43-socket-dir\") pod \"aws-ebs-csi-driver-node-pgqtw\" (UID: \"b552b1f6-e2a2-4c0c-a53d-2023233c6c43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgqtw"
Sep 15 10:17:49.227194 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.226113    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b552b1f6-e2a2-4c0c-a53d-2023233c6c43-registration-dir\") pod \"aws-ebs-csi-driver-node-pgqtw\" (UID: \"b552b1f6-e2a2-4c0c-a53d-2023233c6c43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgqtw"
Sep 15 10:17:49.227194 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.226122    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9f425ab3-69a3-4fa3-81a0-2bccfb818349-multus-conf-dir\") pod \"multus-jlrbr\" (UID: \"9f425ab3-69a3-4fa3-81a0-2bccfb818349\") " pod="openshift-multus/multus-jlrbr"
Sep 15 10:17:49.227194 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.226148    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9f425ab3-69a3-4fa3-81a0-2bccfb818349-host-run-multus-certs\") pod \"multus-jlrbr\" (UID: \"9f425ab3-69a3-4fa3-81a0-2bccfb818349\") " pod="openshift-multus/multus-jlrbr"
Sep 15 10:17:49.227194 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.226158    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f425ab3-69a3-4fa3-81a0-2bccfb818349-host-var-lib-kubelet\") pod \"multus-jlrbr\" (UID: \"9f425ab3-69a3-4fa3-81a0-2bccfb818349\") " pod="openshift-multus/multus-jlrbr"
Sep 15 10:17:49.227194 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.226162    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9f425ab3-69a3-4fa3-81a0-2bccfb818349-host-run-netns\") pod \"multus-jlrbr\" (UID: \"9f425ab3-69a3-4fa3-81a0-2bccfb818349\") " pod="openshift-multus/multus-jlrbr"
Sep 15 10:17:49.227194 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.226176    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c164659a-3b71-4518-b8ae-46b7163282d8-sys\") pod \"tuned-v8nd4\" (UID: \"c164659a-3b71-4518-b8ae-46b7163282d8\") " pod="openshift-cluster-node-tuning-operator/tuned-v8nd4"
Sep 15 10:17:49.227194 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.226199    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c164659a-3b71-4518-b8ae-46b7163282d8-lib-modules\") pod \"tuned-v8nd4\" (UID: \"c164659a-3b71-4518-b8ae-46b7163282d8\") " pod="openshift-cluster-node-tuning-operator/tuned-v8nd4"
Sep 15 10:17:49.227194 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.226217    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9f425ab3-69a3-4fa3-81a0-2bccfb818349-host-run-multus-certs\") pod \"multus-jlrbr\" (UID: \"9f425ab3-69a3-4fa3-81a0-2bccfb818349\") " pod="openshift-multus/multus-jlrbr"
Sep 15 10:17:49.228041 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.226222    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f425ab3-69a3-4fa3-81a0-2bccfb818349-etc-kubernetes\") pod \"multus-jlrbr\" (UID: \"9f425ab3-69a3-4fa3-81a0-2bccfb818349\") " pod="openshift-multus/multus-jlrbr"
Sep 15 10:17:49.228041 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.226242    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c164659a-3b71-4518-b8ae-46b7163282d8-sys\") pod \"tuned-v8nd4\" (UID: \"c164659a-3b71-4518-b8ae-46b7163282d8\") " pod="openshift-cluster-node-tuning-operator/tuned-v8nd4"
Sep 15 10:17:49.228041 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.226255    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c164659a-3b71-4518-b8ae-46b7163282d8-etc-systemd\") pod \"tuned-v8nd4\" (UID: \"c164659a-3b71-4518-b8ae-46b7163282d8\") " pod="openshift-cluster-node-tuning-operator/tuned-v8nd4"
Sep 15 10:17:49.228041 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.226198    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9f425ab3-69a3-4fa3-81a0-2bccfb818349-multus-conf-dir\") pod \"multus-jlrbr\" (UID: \"9f425ab3-69a3-4fa3-81a0-2bccfb818349\") " pod="openshift-multus/multus-jlrbr"
Sep 15 10:17:49.228041 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.226294    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f425ab3-69a3-4fa3-81a0-2bccfb818349-etc-kubernetes\") pod \"multus-jlrbr\" (UID: \"9f425ab3-69a3-4fa3-81a0-2bccfb818349\") " pod="openshift-multus/multus-jlrbr"
Sep 15 10:17:49.228041 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.226308    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c164659a-3b71-4518-b8ae-46b7163282d8-lib-modules\") pod \"tuned-v8nd4\" (UID: \"c164659a-3b71-4518-b8ae-46b7163282d8\") " pod="openshift-cluster-node-tuning-operator/tuned-v8nd4"
Sep 15 10:17:49.228041 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.226324    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b552b1f6-e2a2-4c0c-a53d-2023233c6c43-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pgqtw\" (UID: \"b552b1f6-e2a2-4c0c-a53d-2023233c6c43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgqtw"
Sep 15 10:17:49.228041 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.226322    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c164659a-3b71-4518-b8ae-46b7163282d8-etc-systemd\") pod \"tuned-v8nd4\" (UID: \"c164659a-3b71-4518-b8ae-46b7163282d8\") " pod="openshift-cluster-node-tuning-operator/tuned-v8nd4"
Sep 15 10:17:49.228041 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.226394    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b552b1f6-e2a2-4c0c-a53d-2023233c6c43-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pgqtw\" (UID: \"b552b1f6-e2a2-4c0c-a53d-2023233c6c43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgqtw"
Sep 15 10:17:49.228041 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.226492    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9f425ab3-69a3-4fa3-81a0-2bccfb818349-cni-binary-copy\") pod \"multus-jlrbr\" (UID: \"9f425ab3-69a3-4fa3-81a0-2bccfb818349\") " pod="openshift-multus/multus-jlrbr"
Sep 15 10:17:49.228041 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.227457    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c164659a-3b71-4518-b8ae-46b7163282d8-tmp\") pod \"tuned-v8nd4\" (UID: \"c164659a-3b71-4518-b8ae-46b7163282d8\") " pod="openshift-cluster-node-tuning-operator/tuned-v8nd4"
Sep 15 10:17:49.228041 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.227891    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c164659a-3b71-4518-b8ae-46b7163282d8-etc-tuned\") pod \"tuned-v8nd4\" (UID: \"c164659a-3b71-4518-b8ae-46b7163282d8\") " pod="openshift-cluster-node-tuning-operator/tuned-v8nd4"
Sep 15 10:17:49.234647 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.234579    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgjb4\" (UniqueName: \"kubernetes.io/projected/9f425ab3-69a3-4fa3-81a0-2bccfb818349-kube-api-access-jgjb4\") pod \"multus-jlrbr\" (UID: \"9f425ab3-69a3-4fa3-81a0-2bccfb818349\") " pod="openshift-multus/multus-jlrbr"
Sep 15 10:17:49.234647 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.234582    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55bjc\" (UniqueName: \"kubernetes.io/projected/764a519b-87a8-4759-b03a-585cc4731146-kube-api-access-55bjc\") pod \"node-resolver-t5gjf\" (UID: \"764a519b-87a8-4759-b03a-585cc4731146\") " pod="openshift-dns/node-resolver-t5gjf"
Sep 15 10:17:49.235504 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.235456    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5wr5\" (UniqueName: \"kubernetes.io/projected/aaa39564-bf93-4ed2-b834-bdb0dba37aea-kube-api-access-v5wr5\") pod \"node-ca-pbf8k\" (UID: \"aaa39564-bf93-4ed2-b834-bdb0dba37aea\") " pod="openshift-image-registry/node-ca-pbf8k"
Sep 15 10:17:49.235669 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.235644    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgrz6\" (UniqueName: \"kubernetes.io/projected/c101b9f1-4c96-416c-b899-fc7eee86e4ea-kube-api-access-xgrz6\") pod \"network-metrics-daemon-hh4zk\" (UID: \"c101b9f1-4c96-416c-b899-fc7eee86e4ea\") " pod="openshift-multus/network-metrics-daemon-hh4zk"
Sep 15 10:17:49.236125 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.236106    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmwvn\" (UniqueName: \"kubernetes.io/projected/c164659a-3b71-4518-b8ae-46b7163282d8-kube-api-access-pmwvn\") pod \"tuned-v8nd4\" (UID: \"c164659a-3b71-4518-b8ae-46b7163282d8\") " pod="openshift-cluster-node-tuning-operator/tuned-v8nd4"
Sep 15 10:17:49.236392 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.236372    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzjbm\" (UniqueName: \"kubernetes.io/projected/b552b1f6-e2a2-4c0c-a53d-2023233c6c43-kube-api-access-gzjbm\") pod \"aws-ebs-csi-driver-node-pgqtw\" (UID: \"b552b1f6-e2a2-4c0c-a53d-2023233c6c43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgqtw"
Sep 15 10:17:49.308290 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.308241    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vl7m7"
Sep 15 10:17:49.315746 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.315707    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h4d8p"
Sep 15 10:17:49.318629 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:49.318608    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8821682e_804a_4bc8_9b87_f190576d59f4.slice/crio-11f958b24f66a7519afeb03a4f871c6fee2a994a4e6fb2c517efac7535815618 WatchSource:0}: Error finding container 11f958b24f66a7519afeb03a4f871c6fee2a994a4e6fb2c517efac7535815618: Status 404 returned error can't find the container with id 11f958b24f66a7519afeb03a4f871c6fee2a994a4e6fb2c517efac7535815618
Sep 15 10:17:49.323998 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:49.323980    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a9137a7_9b75_4af5_8b82_10102bd76707.slice/crio-c788d060825256a0964192832bc5bc6eff3f2692a6ffc5ad9e3dff2c15438f9a WatchSource:0}: Error finding container c788d060825256a0964192832bc5bc6eff3f2692a6ffc5ad9e3dff2c15438f9a: Status 404 returned error can't find the container with id c788d060825256a0964192832bc5bc6eff3f2692a6ffc5ad9e3dff2c15438f9a
Sep 15 10:17:49.327307 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.327239    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gd25b"
Sep 15 10:17:49.333508 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.333346    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:17:49.337898 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:49.337872    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod573b2808_2371_4c1a_8da8_b2a3b04efed3.slice/crio-1a759f6225de7245ab2ff159f41f0bd170e70257ab02bdebd8bd7bb0b60a5696 WatchSource:0}: Error finding container 1a759f6225de7245ab2ff159f41f0bd170e70257ab02bdebd8bd7bb0b60a5696: Status 404 returned error can't find the container with id 1a759f6225de7245ab2ff159f41f0bd170e70257ab02bdebd8bd7bb0b60a5696
Sep 15 10:17:49.340640 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.340613    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pbf8k"
Sep 15 10:17:49.343006 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:49.342982    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8db10bdb_f668_43df_8b2d_3530e0befef7.slice/crio-2270b7615d8760de9465bf5476f584fbb0aaf192329aabd3b961a6eef967fed0 WatchSource:0}: Error finding container 2270b7615d8760de9465bf5476f584fbb0aaf192329aabd3b961a6eef967fed0: Status 404 returned error can't find the container with id 2270b7615d8760de9465bf5476f584fbb0aaf192329aabd3b961a6eef967fed0
Sep 15 10:17:49.347740 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.347702    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t5gjf"
Sep 15 10:17:49.351223 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:49.351200    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaa39564_bf93_4ed2_b834_bdb0dba37aea.slice/crio-01c837f613c99c6e8f5ca14cff04b45da52c906019040fdef17990811db71ab7 WatchSource:0}: Error finding container 01c837f613c99c6e8f5ca14cff04b45da52c906019040fdef17990811db71ab7: Status 404 returned error can't find the container with id 01c837f613c99c6e8f5ca14cff04b45da52c906019040fdef17990811db71ab7
Sep 15 10:17:49.354922 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.354797    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-v8nd4"
Sep 15 10:17:49.357275 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:49.357258    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod764a519b_87a8_4759_b03a_585cc4731146.slice/crio-78c2f3ef031d07d9bc94b6c278aa5bd3e876c639ce47893b46aca5aa34a04e10 WatchSource:0}: Error finding container 78c2f3ef031d07d9bc94b6c278aa5bd3e876c639ce47893b46aca5aa34a04e10: Status 404 returned error can't find the container with id 78c2f3ef031d07d9bc94b6c278aa5bd3e876c639ce47893b46aca5aa34a04e10
Sep 15 10:17:49.361997 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.361967    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgqtw"
Sep 15 10:17:49.365209 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:49.365185    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc164659a_3b71_4518_b8ae_46b7163282d8.slice/crio-ebf8e07540a3e15c9b67dbeccb90869af2b1c4382b72d2a0b0c4339db7b2797f WatchSource:0}: Error finding container ebf8e07540a3e15c9b67dbeccb90869af2b1c4382b72d2a0b0c4339db7b2797f: Status 404 returned error can't find the container with id ebf8e07540a3e15c9b67dbeccb90869af2b1c4382b72d2a0b0c4339db7b2797f
Sep 15 10:17:49.368149 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.368131    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jlrbr"
Sep 15 10:17:49.374681 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:49.374487    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb552b1f6_e2a2_4c0c_a53d_2023233c6c43.slice/crio-88dbaabca22687a184ff4e1fff3a1671648e03efeb6fd30c8a30cb7cd3536a5a WatchSource:0}: Error finding container 88dbaabca22687a184ff4e1fff3a1671648e03efeb6fd30c8a30cb7cd3536a5a: Status 404 returned error can't find the container with id 88dbaabca22687a184ff4e1fff3a1671648e03efeb6fd30c8a30cb7cd3536a5a
Sep 15 10:17:49.379349 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:17:49.379327    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f425ab3_69a3_4fa3_81a0_2bccfb818349.slice/crio-f9d19fc4e6f6382623882f11a9423becb57454bc4deda97b5914aff623ddbba9 WatchSource:0}: Error finding container f9d19fc4e6f6382623882f11a9423becb57454bc4deda97b5914aff623ddbba9: Status 404 returned error can't find the container with id f9d19fc4e6f6382623882f11a9423becb57454bc4deda97b5914aff623ddbba9
Sep 15 10:17:49.630151 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.630053    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ecad1164-c9d0-4df5-a0b8-382e33ac5629-original-pull-secret\") pod \"global-pull-secret-syncer-d48mp\" (UID: \"ecad1164-c9d0-4df5-a0b8-382e33ac5629\") " pod="kube-system/global-pull-secret-syncer-d48mp"
Sep 15 10:17:49.630326 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:49.630257    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 10:17:49.630326 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:49.630322    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecad1164-c9d0-4df5-a0b8-382e33ac5629-original-pull-secret podName:ecad1164-c9d0-4df5-a0b8-382e33ac5629 nodeName:}" failed. No retries permitted until 2026-09-15 10:17:50.630303884 +0000 UTC m=+4.026395952 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ecad1164-c9d0-4df5-a0b8-382e33ac5629-original-pull-secret") pod "global-pull-secret-syncer-d48mp" (UID: "ecad1164-c9d0-4df5-a0b8-382e33ac5629") : object "kube-system"/"original-pull-secret" not registered
Sep 15 10:17:49.731031 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.730878    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c101b9f1-4c96-416c-b899-fc7eee86e4ea-metrics-certs\") pod \"network-metrics-daemon-hh4zk\" (UID: \"c101b9f1-4c96-416c-b899-fc7eee86e4ea\") " pod="openshift-multus/network-metrics-daemon-hh4zk"
Sep 15 10:17:49.731031 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:49.730916    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6fcn\" (UniqueName: \"kubernetes.io/projected/4015e313-4380-437f-81e5-ba8622486e13-kube-api-access-p6fcn\") pod \"network-check-target-fqms7\" (UID: \"4015e313-4380-437f-81e5-ba8622486e13\") " pod="openshift-network-diagnostics/network-check-target-fqms7"
Sep 15 10:17:49.731267 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:49.731067    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 10:17:49.731267 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:49.731087    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 10:17:49.731267 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:49.731098    2579 projected.go:196] Error preparing data for projected volume kube-api-access-p6fcn for pod openshift-network-diagnostics/network-check-target-fqms7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 10:17:49.731267 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:49.731151    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4015e313-4380-437f-81e5-ba8622486e13-kube-api-access-p6fcn podName:4015e313-4380-437f-81e5-ba8622486e13 nodeName:}" failed. No retries permitted until 2026-09-15 10:17:50.731135142 +0000 UTC m=+4.127227207 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-p6fcn" (UniqueName: "kubernetes.io/projected/4015e313-4380-437f-81e5-ba8622486e13-kube-api-access-p6fcn") pod "network-check-target-fqms7" (UID: "4015e313-4380-437f-81e5-ba8622486e13") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 10:17:49.731468 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:49.731306    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 10:17:49.731468 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:49.731373    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c101b9f1-4c96-416c-b899-fc7eee86e4ea-metrics-certs podName:c101b9f1-4c96-416c-b899-fc7eee86e4ea nodeName:}" failed. No retries permitted until 2026-09-15 10:17:50.731355888 +0000 UTC m=+4.127447954 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c101b9f1-4c96-416c-b899-fc7eee86e4ea-metrics-certs") pod "network-metrics-daemon-hh4zk" (UID: "c101b9f1-4c96-416c-b899-fc7eee86e4ea") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 10:17:50.052660 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:50.052576    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 10:12:49 +0000 UTC" deadline="2028-06-16 16:28:41.320272794 +0000 UTC"
Sep 15 10:17:50.052660 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:50.052613    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15366h10m51.267664423s"
Sep 15 10:17:50.171113 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:50.170989    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgqtw" event={"ID":"b552b1f6-e2a2-4c0c-a53d-2023233c6c43","Type":"ContainerStarted","Data":"88dbaabca22687a184ff4e1fff3a1671648e03efeb6fd30c8a30cb7cd3536a5a"}
Sep 15 10:17:50.175894 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:50.175823    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t5gjf" event={"ID":"764a519b-87a8-4759-b03a-585cc4731146","Type":"ContainerStarted","Data":"78c2f3ef031d07d9bc94b6c278aa5bd3e876c639ce47893b46aca5aa34a04e10"}
Sep 15 10:17:50.182156 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:50.182077    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pbf8k" event={"ID":"aaa39564-bf93-4ed2-b834-bdb0dba37aea","Type":"ContainerStarted","Data":"01c837f613c99c6e8f5ca14cff04b45da52c906019040fdef17990811db71ab7"}
Sep 15 10:17:50.186120 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:50.186046    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jlrbr" event={"ID":"9f425ab3-69a3-4fa3-81a0-2bccfb818349","Type":"ContainerStarted","Data":"f9d19fc4e6f6382623882f11a9423becb57454bc4deda97b5914aff623ddbba9"}
Sep 15 10:17:50.190219 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:50.190145    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-v8nd4" event={"ID":"c164659a-3b71-4518-b8ae-46b7163282d8","Type":"ContainerStarted","Data":"ebf8e07540a3e15c9b67dbeccb90869af2b1c4382b72d2a0b0c4339db7b2797f"}
Sep 15 10:17:50.192330 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:50.192177    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk" event={"ID":"8db10bdb-f668-43df-8b2d-3530e0befef7","Type":"ContainerStarted","Data":"2270b7615d8760de9465bf5476f584fbb0aaf192329aabd3b961a6eef967fed0"}
Sep 15 10:17:50.195891 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:50.195863    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gd25b" event={"ID":"573b2808-2371-4c1a-8da8-b2a3b04efed3","Type":"ContainerStarted","Data":"1a759f6225de7245ab2ff159f41f0bd170e70257ab02bdebd8bd7bb0b60a5696"}
Sep 15 10:17:50.201884 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:50.201855    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h4d8p" event={"ID":"1a9137a7-9b75-4af5-8b82-10102bd76707","Type":"ContainerStarted","Data":"c788d060825256a0964192832bc5bc6eff3f2692a6ffc5ad9e3dff2c15438f9a"}
Sep 15 10:17:50.203911 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:50.203852    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vl7m7" event={"ID":"8821682e-804a-4bc8-9b87-f190576d59f4","Type":"ContainerStarted","Data":"11f958b24f66a7519afeb03a4f871c6fee2a994a4e6fb2c517efac7535815618"}
Sep 15 10:17:50.640491 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:50.639830    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ecad1164-c9d0-4df5-a0b8-382e33ac5629-original-pull-secret\") pod \"global-pull-secret-syncer-d48mp\" (UID: \"ecad1164-c9d0-4df5-a0b8-382e33ac5629\") " pod="kube-system/global-pull-secret-syncer-d48mp"
Sep 15 10:17:50.640491 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:50.640003    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 10:17:50.640491 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:50.640070    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecad1164-c9d0-4df5-a0b8-382e33ac5629-original-pull-secret podName:ecad1164-c9d0-4df5-a0b8-382e33ac5629 nodeName:}" failed. No retries permitted until 2026-09-15 10:17:52.640051781 +0000 UTC m=+6.036143846 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ecad1164-c9d0-4df5-a0b8-382e33ac5629-original-pull-secret") pod "global-pull-secret-syncer-d48mp" (UID: "ecad1164-c9d0-4df5-a0b8-382e33ac5629") : object "kube-system"/"original-pull-secret" not registered
Sep 15 10:17:50.740971 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:50.740923    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c101b9f1-4c96-416c-b899-fc7eee86e4ea-metrics-certs\") pod \"network-metrics-daemon-hh4zk\" (UID: \"c101b9f1-4c96-416c-b899-fc7eee86e4ea\") " pod="openshift-multus/network-metrics-daemon-hh4zk"
Sep 15 10:17:50.740971 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:50.740974    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6fcn\" (UniqueName: \"kubernetes.io/projected/4015e313-4380-437f-81e5-ba8622486e13-kube-api-access-p6fcn\") pod \"network-check-target-fqms7\" (UID: \"4015e313-4380-437f-81e5-ba8622486e13\") " pod="openshift-network-diagnostics/network-check-target-fqms7"
Sep 15 10:17:50.741191 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:50.741106    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 10:17:50.741191 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:50.741128    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 10:17:50.741191 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:50.741140    2579 projected.go:196] Error preparing data for projected volume kube-api-access-p6fcn for pod openshift-network-diagnostics/network-check-target-fqms7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 10:17:50.741330 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:50.741198    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4015e313-4380-437f-81e5-ba8622486e13-kube-api-access-p6fcn podName:4015e313-4380-437f-81e5-ba8622486e13 nodeName:}" failed. No retries permitted until 2026-09-15 10:17:52.741179283 +0000 UTC m=+6.137271352 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-p6fcn" (UniqueName: "kubernetes.io/projected/4015e313-4380-437f-81e5-ba8622486e13-kube-api-access-p6fcn") pod "network-check-target-fqms7" (UID: "4015e313-4380-437f-81e5-ba8622486e13") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 10:17:50.741623 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:50.741596    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 10:17:50.741751 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:50.741653    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c101b9f1-4c96-416c-b899-fc7eee86e4ea-metrics-certs podName:c101b9f1-4c96-416c-b899-fc7eee86e4ea nodeName:}" failed. No retries permitted until 2026-09-15 10:17:52.741637573 +0000 UTC m=+6.137729639 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c101b9f1-4c96-416c-b899-fc7eee86e4ea-metrics-certs") pod "network-metrics-daemon-hh4zk" (UID: "c101b9f1-4c96-416c-b899-fc7eee86e4ea") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 10:17:51.052896 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:51.052787    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 10:12:49 +0000 UTC" deadline="2028-02-11 01:02:44.338480277 +0000 UTC"
Sep 15 10:17:51.052896 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:51.052849    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12326h44m53.285635163s"
Sep 15 10:17:51.145455 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:51.145426    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d48mp"
Sep 15 10:17:51.145629 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:51.145551    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d48mp" podUID="ecad1164-c9d0-4df5-a0b8-382e33ac5629"
Sep 15 10:17:51.145995 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:51.145976    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hh4zk"
Sep 15 10:17:51.146108 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:51.146087    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hh4zk" podUID="c101b9f1-4c96-416c-b899-fc7eee86e4ea"
Sep 15 10:17:51.146182 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:51.146153    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqms7"
Sep 15 10:17:51.146234 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:51.146216    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqms7" podUID="4015e313-4380-437f-81e5-ba8622486e13"
Sep 15 10:17:52.659590 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:52.659500    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ecad1164-c9d0-4df5-a0b8-382e33ac5629-original-pull-secret\") pod \"global-pull-secret-syncer-d48mp\" (UID: \"ecad1164-c9d0-4df5-a0b8-382e33ac5629\") " pod="kube-system/global-pull-secret-syncer-d48mp"
Sep 15 10:17:52.660385 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:52.659656    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 10:17:52.660385 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:52.659740    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecad1164-c9d0-4df5-a0b8-382e33ac5629-original-pull-secret podName:ecad1164-c9d0-4df5-a0b8-382e33ac5629 nodeName:}" failed. No retries permitted until 2026-09-15 10:17:56.659707406 +0000 UTC m=+10.055799473 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ecad1164-c9d0-4df5-a0b8-382e33ac5629-original-pull-secret") pod "global-pull-secret-syncer-d48mp" (UID: "ecad1164-c9d0-4df5-a0b8-382e33ac5629") : object "kube-system"/"original-pull-secret" not registered
Sep 15 10:17:52.760497 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:52.760462    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6fcn\" (UniqueName: \"kubernetes.io/projected/4015e313-4380-437f-81e5-ba8622486e13-kube-api-access-p6fcn\") pod \"network-check-target-fqms7\" (UID: \"4015e313-4380-437f-81e5-ba8622486e13\") " pod="openshift-network-diagnostics/network-check-target-fqms7"
Sep 15 10:17:52.760684 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:52.760560    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c101b9f1-4c96-416c-b899-fc7eee86e4ea-metrics-certs\") pod \"network-metrics-daemon-hh4zk\" (UID: \"c101b9f1-4c96-416c-b899-fc7eee86e4ea\") " pod="openshift-multus/network-metrics-daemon-hh4zk"
Sep 15 10:17:52.760684 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:52.760678    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 10:17:52.760832 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:52.760758    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c101b9f1-4c96-416c-b899-fc7eee86e4ea-metrics-certs podName:c101b9f1-4c96-416c-b899-fc7eee86e4ea nodeName:}" failed. No retries permitted until 2026-09-15 10:17:56.760739872 +0000 UTC m=+10.156831952 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c101b9f1-4c96-416c-b899-fc7eee86e4ea-metrics-certs") pod "network-metrics-daemon-hh4zk" (UID: "c101b9f1-4c96-416c-b899-fc7eee86e4ea") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 10:17:52.760832 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:52.760783    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 10:17:52.760832 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:52.760808    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 10:17:52.760832 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:52.760823    2579 projected.go:196] Error preparing data for projected volume kube-api-access-p6fcn for pod openshift-network-diagnostics/network-check-target-fqms7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 10:17:52.761041 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:52.760874    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4015e313-4380-437f-81e5-ba8622486e13-kube-api-access-p6fcn podName:4015e313-4380-437f-81e5-ba8622486e13 nodeName:}" failed. No retries permitted until 2026-09-15 10:17:56.760858323 +0000 UTC m=+10.156950390 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-p6fcn" (UniqueName: "kubernetes.io/projected/4015e313-4380-437f-81e5-ba8622486e13-kube-api-access-p6fcn") pod "network-check-target-fqms7" (UID: "4015e313-4380-437f-81e5-ba8622486e13") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 10:17:53.143469 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:53.142609    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d48mp"
Sep 15 10:17:53.143469 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:53.142769    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d48mp" podUID="ecad1164-c9d0-4df5-a0b8-382e33ac5629"
Sep 15 10:17:53.143469 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:53.143158    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hh4zk"
Sep 15 10:17:53.143469 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:53.143265    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hh4zk" podUID="c101b9f1-4c96-416c-b899-fc7eee86e4ea"
Sep 15 10:17:53.143469 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:53.143315    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqms7"
Sep 15 10:17:53.143469 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:53.143381    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqms7" podUID="4015e313-4380-437f-81e5-ba8622486e13"
Sep 15 10:17:53.224217 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:53.224177    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-231.ec2.internal" event={"ID":"00cc55289c9a2631420bef053cfac41d","Type":"ContainerStarted","Data":"6ccccf61ff35317fef0b72a84250cebad0b6edd8536ecde194dc49cb5281ae3d"}
Sep 15 10:17:55.142495 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:55.142456    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqms7"
Sep 15 10:17:55.142879 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:55.142456    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d48mp"
Sep 15 10:17:55.142879 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:55.142571    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqms7" podUID="4015e313-4380-437f-81e5-ba8622486e13"
Sep 15 10:17:55.142879 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:55.142595    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hh4zk"
Sep 15 10:17:55.142879 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:55.142689    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d48mp" podUID="ecad1164-c9d0-4df5-a0b8-382e33ac5629"
Sep 15 10:17:55.142879 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:55.142792    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hh4zk" podUID="c101b9f1-4c96-416c-b899-fc7eee86e4ea"
Sep 15 10:17:56.235702 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:56.235009    2579 generic.go:356] "Generic (PLEG): container finished" podID="00cc55289c9a2631420bef053cfac41d" containerID="6ccccf61ff35317fef0b72a84250cebad0b6edd8536ecde194dc49cb5281ae3d" exitCode=0
Sep 15 10:17:56.235702 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:56.235070    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-231.ec2.internal" event={"ID":"00cc55289c9a2631420bef053cfac41d","Type":"ContainerDied","Data":"6ccccf61ff35317fef0b72a84250cebad0b6edd8536ecde194dc49cb5281ae3d"}
Sep 15 10:17:56.694253 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:56.694215    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ecad1164-c9d0-4df5-a0b8-382e33ac5629-original-pull-secret\") pod \"global-pull-secret-syncer-d48mp\" (UID: \"ecad1164-c9d0-4df5-a0b8-382e33ac5629\") " pod="kube-system/global-pull-secret-syncer-d48mp"
Sep 15 10:17:56.694457 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:56.694429    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 10:17:56.694580 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:56.694559    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecad1164-c9d0-4df5-a0b8-382e33ac5629-original-pull-secret podName:ecad1164-c9d0-4df5-a0b8-382e33ac5629 nodeName:}" failed. No retries permitted until 2026-09-15 10:18:04.694538531 +0000 UTC m=+18.090630596 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ecad1164-c9d0-4df5-a0b8-382e33ac5629-original-pull-secret") pod "global-pull-secret-syncer-d48mp" (UID: "ecad1164-c9d0-4df5-a0b8-382e33ac5629") : object "kube-system"/"original-pull-secret" not registered
Sep 15 10:17:56.795361 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:56.795325    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c101b9f1-4c96-416c-b899-fc7eee86e4ea-metrics-certs\") pod \"network-metrics-daemon-hh4zk\" (UID: \"c101b9f1-4c96-416c-b899-fc7eee86e4ea\") " pod="openshift-multus/network-metrics-daemon-hh4zk"
Sep 15 10:17:56.795537 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:56.795377    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6fcn\" (UniqueName: \"kubernetes.io/projected/4015e313-4380-437f-81e5-ba8622486e13-kube-api-access-p6fcn\") pod \"network-check-target-fqms7\" (UID: \"4015e313-4380-437f-81e5-ba8622486e13\") " pod="openshift-network-diagnostics/network-check-target-fqms7"
Sep 15 10:17:56.795601 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:56.795538    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 10:17:56.795601 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:56.795553    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 10:17:56.795601 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:56.795568    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 10:17:56.795601 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:56.795581    2579 projected.go:196] Error preparing data for projected volume kube-api-access-p6fcn for pod openshift-network-diagnostics/network-check-target-fqms7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 10:17:56.795810 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:56.795612    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c101b9f1-4c96-416c-b899-fc7eee86e4ea-metrics-certs podName:c101b9f1-4c96-416c-b899-fc7eee86e4ea nodeName:}" failed. No retries permitted until 2026-09-15 10:18:04.795592111 +0000 UTC m=+18.191684196 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c101b9f1-4c96-416c-b899-fc7eee86e4ea-metrics-certs") pod "network-metrics-daemon-hh4zk" (UID: "c101b9f1-4c96-416c-b899-fc7eee86e4ea") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 10:17:56.795810 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:56.795630    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4015e313-4380-437f-81e5-ba8622486e13-kube-api-access-p6fcn podName:4015e313-4380-437f-81e5-ba8622486e13 nodeName:}" failed. No retries permitted until 2026-09-15 10:18:04.795620862 +0000 UTC m=+18.191712945 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-p6fcn" (UniqueName: "kubernetes.io/projected/4015e313-4380-437f-81e5-ba8622486e13-kube-api-access-p6fcn") pod "network-check-target-fqms7" (UID: "4015e313-4380-437f-81e5-ba8622486e13") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 10:17:57.147347 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:57.146441    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqms7"
Sep 15 10:17:57.147347 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:57.146631    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqms7" podUID="4015e313-4380-437f-81e5-ba8622486e13"
Sep 15 10:17:57.147347 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:57.147131    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d48mp"
Sep 15 10:17:57.147347 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:57.147250    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d48mp" podUID="ecad1164-c9d0-4df5-a0b8-382e33ac5629"
Sep 15 10:17:57.150380 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:57.147812    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hh4zk"
Sep 15 10:17:57.150380 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:57.147975    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hh4zk" podUID="c101b9f1-4c96-416c-b899-fc7eee86e4ea"
Sep 15 10:17:59.142837 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:59.142804    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqms7"
Sep 15 10:17:59.143361 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:59.142820    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d48mp"
Sep 15 10:17:59.143361 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:17:59.142940    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hh4zk"
Sep 15 10:17:59.143361 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:59.142943    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqms7" podUID="4015e313-4380-437f-81e5-ba8622486e13"
Sep 15 10:17:59.143361 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:59.143057    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d48mp" podUID="ecad1164-c9d0-4df5-a0b8-382e33ac5629"
Sep 15 10:17:59.143361 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:17:59.143184    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hh4zk" podUID="c101b9f1-4c96-416c-b899-fc7eee86e4ea"
Sep 15 10:18:01.143028 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:01.142990    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d48mp"
Sep 15 10:18:01.143502 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:01.142990    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqms7"
Sep 15 10:18:01.143502 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:01.143130    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hh4zk"
Sep 15 10:18:01.143502 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:01.143126    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d48mp" podUID="ecad1164-c9d0-4df5-a0b8-382e33ac5629"
Sep 15 10:18:01.143502 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:01.143237    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqms7" podUID="4015e313-4380-437f-81e5-ba8622486e13"
Sep 15 10:18:01.143502 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:01.143343    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hh4zk" podUID="c101b9f1-4c96-416c-b899-fc7eee86e4ea"
Sep 15 10:18:03.142970 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:03.142925    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d48mp"
Sep 15 10:18:03.143472 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:03.142929    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqms7"
Sep 15 10:18:03.143472 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:03.143061    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d48mp" podUID="ecad1164-c9d0-4df5-a0b8-382e33ac5629"
Sep 15 10:18:03.143472 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:03.142929    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hh4zk"
Sep 15 10:18:03.143472 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:03.143156    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqms7" podUID="4015e313-4380-437f-81e5-ba8622486e13"
Sep 15 10:18:03.143472 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:03.143262    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hh4zk" podUID="c101b9f1-4c96-416c-b899-fc7eee86e4ea"
Sep 15 10:18:04.754778 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:04.754713    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ecad1164-c9d0-4df5-a0b8-382e33ac5629-original-pull-secret\") pod \"global-pull-secret-syncer-d48mp\" (UID: \"ecad1164-c9d0-4df5-a0b8-382e33ac5629\") " pod="kube-system/global-pull-secret-syncer-d48mp"
Sep 15 10:18:04.755225 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:04.754840    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 10:18:04.755225 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:04.754906    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecad1164-c9d0-4df5-a0b8-382e33ac5629-original-pull-secret podName:ecad1164-c9d0-4df5-a0b8-382e33ac5629 nodeName:}" failed. No retries permitted until 2026-09-15 10:18:20.754890728 +0000 UTC m=+34.150982797 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ecad1164-c9d0-4df5-a0b8-382e33ac5629-original-pull-secret") pod "global-pull-secret-syncer-d48mp" (UID: "ecad1164-c9d0-4df5-a0b8-382e33ac5629") : object "kube-system"/"original-pull-secret" not registered
Sep 15 10:18:04.855303 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:04.855260    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c101b9f1-4c96-416c-b899-fc7eee86e4ea-metrics-certs\") pod \"network-metrics-daemon-hh4zk\" (UID: \"c101b9f1-4c96-416c-b899-fc7eee86e4ea\") " pod="openshift-multus/network-metrics-daemon-hh4zk"
Sep 15 10:18:04.855303 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:04.855313    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6fcn\" (UniqueName: \"kubernetes.io/projected/4015e313-4380-437f-81e5-ba8622486e13-kube-api-access-p6fcn\") pod \"network-check-target-fqms7\" (UID: \"4015e313-4380-437f-81e5-ba8622486e13\") " pod="openshift-network-diagnostics/network-check-target-fqms7"
Sep 15 10:18:04.855520 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:04.855433    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 10:18:04.855520 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:04.855479    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 10:18:04.855520 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:04.855495    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 10:18:04.855520 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:04.855508    2579 projected.go:196] Error preparing data for projected volume kube-api-access-p6fcn for pod openshift-network-diagnostics/network-check-target-fqms7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 10:18:04.855691 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:04.855538    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c101b9f1-4c96-416c-b899-fc7eee86e4ea-metrics-certs podName:c101b9f1-4c96-416c-b899-fc7eee86e4ea nodeName:}" failed. No retries permitted until 2026-09-15 10:18:20.855517775 +0000 UTC m=+34.251609849 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c101b9f1-4c96-416c-b899-fc7eee86e4ea-metrics-certs") pod "network-metrics-daemon-hh4zk" (UID: "c101b9f1-4c96-416c-b899-fc7eee86e4ea") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 10:18:04.855691 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:04.855555    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4015e313-4380-437f-81e5-ba8622486e13-kube-api-access-p6fcn podName:4015e313-4380-437f-81e5-ba8622486e13 nodeName:}" failed. No retries permitted until 2026-09-15 10:18:20.855547737 +0000 UTC m=+34.251639802 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-p6fcn" (UniqueName: "kubernetes.io/projected/4015e313-4380-437f-81e5-ba8622486e13-kube-api-access-p6fcn") pod "network-check-target-fqms7" (UID: "4015e313-4380-437f-81e5-ba8622486e13") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 10:18:05.142361 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:05.142326    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d48mp"
Sep 15 10:18:05.142361 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:05.142351    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hh4zk"
Sep 15 10:18:05.142602 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:05.142325    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqms7"
Sep 15 10:18:05.142602 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:05.142476    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d48mp" podUID="ecad1164-c9d0-4df5-a0b8-382e33ac5629"
Sep 15 10:18:05.142713 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:05.142639    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hh4zk" podUID="c101b9f1-4c96-416c-b899-fc7eee86e4ea"
Sep 15 10:18:05.142812 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:05.142743    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqms7" podUID="4015e313-4380-437f-81e5-ba8622486e13"
Sep 15 10:18:07.145546 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:07.145515    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hh4zk"
Sep 15 10:18:07.145997 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:07.145632    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqms7"
Sep 15 10:18:07.145997 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:07.145650    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hh4zk" podUID="c101b9f1-4c96-416c-b899-fc7eee86e4ea"
Sep 15 10:18:07.145997 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:07.145663    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d48mp"
Sep 15 10:18:07.145997 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:07.145733    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqms7" podUID="4015e313-4380-437f-81e5-ba8622486e13"
Sep 15 10:18:07.145997 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:07.145817    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d48mp" podUID="ecad1164-c9d0-4df5-a0b8-382e33ac5629"
Sep 15 10:18:08.264599 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:08.264180    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-231.ec2.internal" event={"ID":"d7516d9a8a3fc6042bb1e0dad3631678","Type":"ContainerStarted","Data":"d2bd8e2a3149c5902f55aa2eeab24bc51c9cd4adf221c6fa26db0356a05c36fa"}
Sep 15 10:18:08.266008 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:08.265982    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-231.ec2.internal" event={"ID":"00cc55289c9a2631420bef053cfac41d","Type":"ContainerStarted","Data":"08640c3a72856d94fc143d026c97ece54a3e890fa2a57bd4a71aa9fee0b55bff"}
Sep 15 10:18:08.267493 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:08.267473    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgqtw" event={"ID":"b552b1f6-e2a2-4c0c-a53d-2023233c6c43","Type":"ContainerStarted","Data":"2642ec6424572d092ca654ca795a946c5cd8ce24b15a35168e549a2cff5928a2"}
Sep 15 10:18:08.268806 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:08.268786    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t5gjf" event={"ID":"764a519b-87a8-4759-b03a-585cc4731146","Type":"ContainerStarted","Data":"c1dd31f7ed4956af1b6296065698cf6bc6f256e3a09a03e7571fd8e697557867"}
Sep 15 10:18:08.270266 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:08.270245    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pbf8k" event={"ID":"aaa39564-bf93-4ed2-b834-bdb0dba37aea","Type":"ContainerStarted","Data":"5de63f5da74a798442aee086d827edc8deefa0dec481aec4273e1ce2611787b2"}
Sep 15 10:18:08.271665 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:08.271645    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jlrbr" event={"ID":"9f425ab3-69a3-4fa3-81a0-2bccfb818349","Type":"ContainerStarted","Data":"631f14de3f487e06078d525cf3bfe6b0c42fe1b3e705ff82650424f6c8c8a8ab"}
Sep 15 10:18:08.273045 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:08.273028    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-v8nd4" event={"ID":"c164659a-3b71-4518-b8ae-46b7163282d8","Type":"ContainerStarted","Data":"7381d5b7ee7437234011c011dcffeed9c563f75e5631fb5174eabeba53956b66"}
Sep 15 10:18:08.275763 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:08.275740    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk" event={"ID":"8db10bdb-f668-43df-8b2d-3530e0befef7","Type":"ContainerStarted","Data":"94c223e741ababcc4dc5646a56c75f0a798a948b5b6aa67fccbb0df6986c4a81"}
Sep 15 10:18:08.275857 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:08.275805    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk" event={"ID":"8db10bdb-f668-43df-8b2d-3530e0befef7","Type":"ContainerStarted","Data":"84a85b1bfe0440af8399894874401609e892df0cf3aae8f536665a9dbf1b92c1"}
Sep 15 10:18:08.275857 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:08.275844    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk" event={"ID":"8db10bdb-f668-43df-8b2d-3530e0befef7","Type":"ContainerStarted","Data":"8932429780b24c174e898ad4725567bd617096e7a4dbb7145505ea8304ea9b3c"}
Sep 15 10:18:08.275944 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:08.275874    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk" event={"ID":"8db10bdb-f668-43df-8b2d-3530e0befef7","Type":"ContainerStarted","Data":"9e7cd94f00b5db9f91bdbe31a956435d025ecbbf54fe6dc37dd3897214eb732e"}
Sep 15 10:18:08.275944 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:08.275907    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk" event={"ID":"8db10bdb-f668-43df-8b2d-3530e0befef7","Type":"ContainerStarted","Data":"a272ff48790380f9c5f6fb589b06f2e2f63d726c1886992dc890d9130f190b5e"}
Sep 15 10:18:08.275944 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:08.275940    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk" event={"ID":"8db10bdb-f668-43df-8b2d-3530e0befef7","Type":"ContainerStarted","Data":"f2190c12be5fc679f1e621b149a4a911f3f9867c4bd2a0e9747b25f1f0ff5036"}
Sep 15 10:18:08.277017 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:08.277001    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h4d8p" event={"ID":"1a9137a7-9b75-4af5-8b82-10102bd76707","Type":"ContainerStarted","Data":"eb480a315e344566df1fbc1868e61caad78e2d14fd668aaa4886288b73e05b3d"}
Sep 15 10:18:08.280345 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:08.280320    2579 generic.go:356] "Generic (PLEG): container finished" podID="8821682e-804a-4bc8-9b87-f190576d59f4" containerID="25d214695f13b704fbdc6e8007324c5ac496a32517aae7f6cada6cde164785a7" exitCode=0
Sep 15 10:18:08.280426 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:08.280346    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vl7m7" event={"ID":"8821682e-804a-4bc8-9b87-f190576d59f4","Type":"ContainerDied","Data":"25d214695f13b704fbdc6e8007324c5ac496a32517aae7f6cada6cde164785a7"}
Sep 15 10:18:08.282699 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:08.282664    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-231.ec2.internal" podStartSLOduration=20.28265221 podStartE2EDuration="20.28265221s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 10:17:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:18:08.282239004 +0000 UTC m=+21.678331091" watchObservedRunningTime="2026-09-15 10:18:08.28265221 +0000 UTC m=+21.678744296"
Sep 15 10:18:08.295044 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:08.295007    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-t5gjf" podStartSLOduration=3.078903415 podStartE2EDuration="21.294993582s" totalImagesPullingTime="18.216090167s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 10:17:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:18:08.294673897 +0000 UTC m=+21.690765983" watchObservedRunningTime="2026-09-15 10:18:08.294993582 +0000 UTC m=+21.691085668"
Sep 15 10:18:08.309112 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:08.309070    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-v8nd4" podStartSLOduration=3.102288567 podStartE2EDuration="21.309056083s" totalImagesPullingTime="18.206767516s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 10:17:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:18:08.308769397 +0000 UTC m=+21.704861483" watchObservedRunningTime="2026-09-15 10:18:08.309056083 +0000 UTC m=+21.705148169"
Sep 15 10:18:08.321109 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:08.321074    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-231.ec2.internal" podStartSLOduration=20.321062094 podStartE2EDuration="20.321062094s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 10:17:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:18:08.321022045 +0000 UTC m=+21.717114131" watchObservedRunningTime="2026-09-15 10:18:08.321062094 +0000 UTC m=+21.717154181"
Sep 15 10:18:08.367899 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:08.367858    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-h4d8p" podStartSLOduration=10.593009613 podStartE2EDuration="21.367844047s" totalImagesPullingTime="10.774834434s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:17:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:18:08.347895197 +0000 UTC m=+21.743987284" watchObservedRunningTime="2026-09-15 10:18:08.367844047 +0000 UTC m=+21.763936133"
Sep 15 10:18:08.368264 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:08.368244    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-pbf8k" podStartSLOduration=3.145483443 podStartE2EDuration="21.368238067s" totalImagesPullingTime="18.222754624s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 10:17:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:18:08.367833896 +0000 UTC m=+21.763925982" watchObservedRunningTime="2026-09-15 10:18:08.368238067 +0000 UTC m=+21.764330175"
Sep 15 10:18:08.384887 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:08.384844    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jlrbr" podStartSLOduration=3.164998078 podStartE2EDuration="21.384829184s" totalImagesPullingTime="18.219831106s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 10:17:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:18:08.384566934 +0000 UTC m=+21.780659020" watchObservedRunningTime="2026-09-15 10:18:08.384829184 +0000 UTC m=+21.780921270"
Sep 15 10:18:09.143050 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:09.142963    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d48mp"
Sep 15 10:18:09.143050 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:09.143005    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hh4zk"
Sep 15 10:18:09.143289 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:09.143098    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d48mp" podUID="ecad1164-c9d0-4df5-a0b8-382e33ac5629"
Sep 15 10:18:09.143289 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:09.143163    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqms7"
Sep 15 10:18:09.143289 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:09.143244    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqms7" podUID="4015e313-4380-437f-81e5-ba8622486e13"
Sep 15 10:18:09.143434 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:09.143335    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hh4zk" podUID="c101b9f1-4c96-416c-b899-fc7eee86e4ea"
Sep 15 10:18:09.252889 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:09.252868    2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 15 10:18:09.284061 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:09.284028    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gd25b" event={"ID":"573b2808-2371-4c1a-8da8-b2a3b04efed3","Type":"ContainerStarted","Data":"87b8db34f407f32f0a5d2cf1cc16044f62ad57e0066d6240d09a8db5a5d1d495"}
Sep 15 10:18:09.286253 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:09.286229    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgqtw" event={"ID":"b552b1f6-e2a2-4c0c-a53d-2023233c6c43","Type":"ContainerStarted","Data":"7ad342aa2a816ccea1bca1594a6dbe2de1f067f226510d1f64d0beb7fcd9afcb"}
Sep 15 10:18:10.075714 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:10.075555    2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-15T10:18:09.252885391Z","UUID":"fcc80d62-feae-4632-aaf8-68fb7b616dd0","Handler":null,"Name":"","Endpoint":""}
Sep 15 10:18:10.077543 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:10.077521    2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 15 10:18:10.077658 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:10.077561    2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 15 10:18:10.294766 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:10.294498    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk" event={"ID":"8db10bdb-f668-43df-8b2d-3530e0befef7","Type":"ContainerStarted","Data":"7251967c20e9ce95f5ac2a2b08b0a528a11260b1e0180286174b370a1e29468d"}
Sep 15 10:18:11.071487 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:11.071454    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-h4d8p"
Sep 15 10:18:11.142622 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:11.142589    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hh4zk"
Sep 15 10:18:11.142813 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:11.142589    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqms7"
Sep 15 10:18:11.142813 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:11.142739    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hh4zk" podUID="c101b9f1-4c96-416c-b899-fc7eee86e4ea"
Sep 15 10:18:11.142813 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:11.142756    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d48mp"
Sep 15 10:18:11.142999 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:11.142834    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqms7" podUID="4015e313-4380-437f-81e5-ba8622486e13"
Sep 15 10:18:11.142999 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:11.142931    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d48mp" podUID="ecad1164-c9d0-4df5-a0b8-382e33ac5629"
Sep 15 10:18:11.299463 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:11.299425    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgqtw" event={"ID":"b552b1f6-e2a2-4c0c-a53d-2023233c6c43","Type":"ContainerStarted","Data":"2b61f8d768151c42a9bba91801efbfdd2a49e6d2f3a056c7e74e2eba79af84a0"}
Sep 15 10:18:11.315705 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:11.315648    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgqtw" podStartSLOduration=3.539366089 podStartE2EDuration="24.315627318s" totalImagesPullingTime="20.776261229s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 10:17:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:18:11.315504924 +0000 UTC m=+24.711597011" watchObservedRunningTime="2026-09-15 10:18:11.315627318 +0000 UTC m=+24.711719403"
Sep 15 10:18:11.316065 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:11.316036    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-gd25b" podStartSLOduration=6.115407326 podStartE2EDuration="24.316021931s" totalImagesPullingTime="18.200614605s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 10:17:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:18:09.298618917 +0000 UTC m=+22.694711006" watchObservedRunningTime="2026-09-15 10:18:11.316021931 +0000 UTC m=+24.712114020"
Sep 15 10:18:11.611899 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:11.611869    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-h4d8p"
Sep 15 10:18:11.612631 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:11.612609    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-h4d8p"
Sep 15 10:18:12.302973 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:12.302941    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-h4d8p"
Sep 15 10:18:13.142295 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:13.142267    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d48mp"
Sep 15 10:18:13.142295 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:13.142281    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hh4zk"
Sep 15 10:18:13.142487 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:13.142370    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d48mp" podUID="ecad1164-c9d0-4df5-a0b8-382e33ac5629"
Sep 15 10:18:13.142487 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:13.142420    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hh4zk" podUID="c101b9f1-4c96-416c-b899-fc7eee86e4ea"
Sep 15 10:18:13.142487 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:13.142479    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqms7"
Sep 15 10:18:13.142624 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:13.142568    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqms7" podUID="4015e313-4380-437f-81e5-ba8622486e13"
Sep 15 10:18:13.307043 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:13.307010    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk" event={"ID":"8db10bdb-f668-43df-8b2d-3530e0befef7","Type":"ContainerStarted","Data":"c0722c7911e744af73c1c1feb24e1356f833e63bc3774a9b494b66e33e99c3c1"}
Sep 15 10:18:13.307459 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:13.307216    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:18:13.308984 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:13.308962    2579 generic.go:356] "Generic (PLEG): container finished" podID="8821682e-804a-4bc8-9b87-f190576d59f4" containerID="b657361a81bd9f34c6166c112058f4fa65b9f1649af7ef8e701336879a178b7c" exitCode=0
Sep 15 10:18:13.309134 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:13.309028    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vl7m7" event={"ID":"8821682e-804a-4bc8-9b87-f190576d59f4","Type":"ContainerDied","Data":"b657361a81bd9f34c6166c112058f4fa65b9f1649af7ef8e701336879a178b7c"}
Sep 15 10:18:13.322215 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:13.322192    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:18:13.330331 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:13.330259    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk" podStartSLOduration=7.969339683 podStartE2EDuration="26.33024744s" totalImagesPullingTime="18.360907757s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 10:17:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:18:13.329844181 +0000 UTC m=+26.725936268" watchObservedRunningTime="2026-09-15 10:18:13.33024744 +0000 UTC m=+26.726339527"
Sep 15 10:18:14.316111 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:14.316079    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vl7m7" event={"ID":"8821682e-804a-4bc8-9b87-f190576d59f4","Type":"ContainerStarted","Data":"9a105174faacfc9406a5497605c39014446293576ac384b2d9dacb8c97917eac"}
Sep 15 10:18:14.316700 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:14.316145    2579 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 15 10:18:14.316700 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:14.316593    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:18:14.332923 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:14.332901    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:18:14.744419 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:14.744387    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-d48mp"]
Sep 15 10:18:14.744596 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:14.744521    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d48mp"
Sep 15 10:18:14.744640 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:14.744611    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d48mp" podUID="ecad1164-c9d0-4df5-a0b8-382e33ac5629"
Sep 15 10:18:14.747902 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:14.747867    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fqms7"]
Sep 15 10:18:14.748011 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:14.747979    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqms7"
Sep 15 10:18:14.748110 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:14.748079    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqms7" podUID="4015e313-4380-437f-81e5-ba8622486e13"
Sep 15 10:18:14.748536 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:14.748517    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hh4zk"]
Sep 15 10:18:14.748623 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:14.748609    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hh4zk"
Sep 15 10:18:14.748743 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:14.748701    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hh4zk" podUID="c101b9f1-4c96-416c-b899-fc7eee86e4ea"
Sep 15 10:18:15.021554 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:15.021469    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:18:15.320449 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:15.320416    2579 generic.go:356] "Generic (PLEG): container finished" podID="8821682e-804a-4bc8-9b87-f190576d59f4" containerID="9a105174faacfc9406a5497605c39014446293576ac384b2d9dacb8c97917eac" exitCode=0
Sep 15 10:18:15.320918 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:15.320489    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vl7m7" event={"ID":"8821682e-804a-4bc8-9b87-f190576d59f4","Type":"ContainerDied","Data":"9a105174faacfc9406a5497605c39014446293576ac384b2d9dacb8c97917eac"}
Sep 15 10:18:16.142157 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:16.142118    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hh4zk"
Sep 15 10:18:16.142321 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:16.142253    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hh4zk" podUID="c101b9f1-4c96-416c-b899-fc7eee86e4ea"
Sep 15 10:18:16.142434 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:16.142406    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqms7"
Sep 15 10:18:16.142563 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:16.142525    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqms7" podUID="4015e313-4380-437f-81e5-ba8622486e13"
Sep 15 10:18:16.325119 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:16.325087    2579 generic.go:356] "Generic (PLEG): container finished" podID="8821682e-804a-4bc8-9b87-f190576d59f4" containerID="96b20df1b3ec6eacdc72bdc413dcfd158caa28603b32d6017c04da75c8d4e06a" exitCode=0
Sep 15 10:18:16.325606 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:16.325173    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vl7m7" event={"ID":"8821682e-804a-4bc8-9b87-f190576d59f4","Type":"ContainerDied","Data":"96b20df1b3ec6eacdc72bdc413dcfd158caa28603b32d6017c04da75c8d4e06a"}
Sep 15 10:18:17.145672 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:17.145477    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d48mp"
Sep 15 10:18:17.145845 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:17.145783    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d48mp" podUID="ecad1164-c9d0-4df5-a0b8-382e33ac5629"
Sep 15 10:18:18.142692 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:18.142654    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqms7"
Sep 15 10:18:18.143131 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:18.142705    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hh4zk"
Sep 15 10:18:18.143131 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:18.142811    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqms7" podUID="4015e313-4380-437f-81e5-ba8622486e13"
Sep 15 10:18:18.143131 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:18.142938    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hh4zk" podUID="c101b9f1-4c96-416c-b899-fc7eee86e4ea"
Sep 15 10:18:19.146501 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:19.146464    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d48mp"
Sep 15 10:18:19.146899 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:19.146591    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d48mp" podUID="ecad1164-c9d0-4df5-a0b8-382e33ac5629"
Sep 15 10:18:20.143343 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.143039    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hh4zk"
Sep 15 10:18:20.143343 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.143068    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqms7"
Sep 15 10:18:20.143343 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:20.143180    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hh4zk" podUID="c101b9f1-4c96-416c-b899-fc7eee86e4ea"
Sep 15 10:18:20.143343 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:20.143259    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqms7" podUID="4015e313-4380-437f-81e5-ba8622486e13"
Sep 15 10:18:20.448312 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.448235    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-231.ec2.internal" event="NodeReady"
Sep 15 10:18:20.448772 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.448393    2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 15 10:18:20.484317 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.484285    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xqnct"]
Sep 15 10:18:20.519376 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.519345    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-rzxqx"]
Sep 15 10:18:20.519562 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.519481    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xqnct"
Sep 15 10:18:20.522568 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.522542    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 15 10:18:20.523061 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.522711    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 15 10:18:20.523061 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.522787    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 15 10:18:20.523254 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.523090    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-gxb7x\""
Sep 15 10:18:20.524939 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.524920    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 15 10:18:20.535339 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.535319    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j"]
Sep 15 10:18:20.535448 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.535433    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-rzxqx"
Sep 15 10:18:20.537589 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.537569    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 15 10:18:20.537682 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.537594    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-mrfqp\""
Sep 15 10:18:20.537889 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.537875    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 15 10:18:20.537966 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.537878    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 15 10:18:20.538179 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.538163    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 15 10:18:20.549779 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.549757    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xqnct"]
Sep 15 10:18:20.549900 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.549798    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-vs4m6"]
Sep 15 10:18:20.549900 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.549836    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j"
Sep 15 10:18:20.551988 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.551824    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zhqkr\""
Sep 15 10:18:20.552361 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.552204    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 15 10:18:20.552361 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.552236    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 15 10:18:20.553769 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.552623    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 15 10:18:20.556609 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.556591    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 15 10:18:20.563648 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.563631    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-mlhbw"]
Sep 15 10:18:20.563783 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.563769    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-vs4m6"
Sep 15 10:18:20.565930 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.565911    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 15 10:18:20.566058 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.566018    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 15 10:18:20.566154 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.566138    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-nz24d\""
Sep 15 10:18:20.588393 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.588372    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-rzxqx"]
Sep 15 10:18:20.588521 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.588407    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fqjvg"]
Sep 15 10:18:20.588521 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.588492    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-mlhbw"
Sep 15 10:18:20.590950 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.590926    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-lwlw5\""
Sep 15 10:18:20.591049 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.590929    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 15 10:18:20.591049 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.591013    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 15 10:18:20.611516 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.611496    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hqxdd"]
Sep 15 10:18:20.611641 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.611610    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fqjvg"
Sep 15 10:18:20.614045 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.614020    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4q5lf\""
Sep 15 10:18:20.614157 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.614051    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 15 10:18:20.614157 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.614060    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 15 10:18:20.614157 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.614062    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 15 10:18:20.635578 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.635556    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j"]
Sep 15 10:18:20.635703 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.635587    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-vs4m6"]
Sep 15 10:18:20.635703 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.635610    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fqjvg"]
Sep 15 10:18:20.635703 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.635627    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hqxdd"]
Sep 15 10:18:20.635703 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.635644    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-mlhbw"]
Sep 15 10:18:20.635931 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.635704    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hqxdd"
Sep 15 10:18:20.639122 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.639101    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 15 10:18:20.639227 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.639122    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-h7d4n\""
Sep 15 10:18:20.639227 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.639180    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 15 10:18:20.652751 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.652695    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4d8p_1a9137a7-9b75-4af5-8b82-10102bd76707/konnectivity-agent/0.log" limit=1024
Sep 15 10:18:20.668452 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.668428    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f9ee683b-5f4d-4a00-81d8-affa82ff7362-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-vs4m6\" (UID: \"f9ee683b-5f4d-4a00-81d8-affa82ff7362\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-vs4m6"
Sep 15 10:18:20.668592 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.668460    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f9ee683b-5f4d-4a00-81d8-affa82ff7362-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-vs4m6\" (UID: \"f9ee683b-5f4d-4a00-81d8-affa82ff7362\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-vs4m6"
Sep 15 10:18:20.668592 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.668491    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1798fb5d-8a9d-4068-b960-e371a235b84e-installation-pull-secrets\") pod \"image-registry-5bf5cf7cd7-mxp9j\" (UID: \"1798fb5d-8a9d-4068-b960-e371a235b84e\") " pod="openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j"
Sep 15 10:18:20.668592 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.668547    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d42015bc-21f5-4d25-8cc5-0ade2c4a93fa-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-xqnct\" (UID: \"d42015bc-21f5-4d25-8cc5-0ade2c4a93fa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xqnct"
Sep 15 10:18:20.668592 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.668571    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srjhl\" (UniqueName: \"kubernetes.io/projected/d42015bc-21f5-4d25-8cc5-0ade2c4a93fa-kube-api-access-srjhl\") pod \"kube-storage-version-migrator-operator-6c8f84f897-xqnct\" (UID: \"d42015bc-21f5-4d25-8cc5-0ade2c4a93fa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xqnct"
Sep 15 10:18:20.668774 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.668709    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1798fb5d-8a9d-4068-b960-e371a235b84e-bound-sa-token\") pod \"image-registry-5bf5cf7cd7-mxp9j\" (UID: \"1798fb5d-8a9d-4068-b960-e371a235b84e\") " pod="openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j"
Sep 15 10:18:20.668810 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.668784    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1798fb5d-8a9d-4068-b960-e371a235b84e-image-registry-private-configuration\") pod \"image-registry-5bf5cf7cd7-mxp9j\" (UID: \"1798fb5d-8a9d-4068-b960-e371a235b84e\") " pod="openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j"
Sep 15 10:18:20.668866 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.668813    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f52g8\" (UniqueName: \"kubernetes.io/projected/1798fb5d-8a9d-4068-b960-e371a235b84e-kube-api-access-f52g8\") pod \"image-registry-5bf5cf7cd7-mxp9j\" (UID: \"1798fb5d-8a9d-4068-b960-e371a235b84e\") " pod="openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j"
Sep 15 10:18:20.668866 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.668839    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj55v\" (UniqueName: \"kubernetes.io/projected/dd15b5c1-59b7-4b1b-a72a-797e290535b2-kube-api-access-kj55v\") pod \"network-check-source-6f8b768455-mlhbw\" (UID: \"dd15b5c1-59b7-4b1b-a72a-797e290535b2\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-mlhbw"
Sep 15 10:18:20.668965 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.668908    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1798fb5d-8a9d-4068-b960-e371a235b84e-registry-tls\") pod \"image-registry-5bf5cf7cd7-mxp9j\" (UID: \"1798fb5d-8a9d-4068-b960-e371a235b84e\") " pod="openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j"
Sep 15 10:18:20.668965 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.668924    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1798fb5d-8a9d-4068-b960-e371a235b84e-registry-certificates\") pod \"image-registry-5bf5cf7cd7-mxp9j\" (UID: \"1798fb5d-8a9d-4068-b960-e371a235b84e\") " pod="openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j"
Sep 15 10:18:20.668965 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.668946    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3723f1be-68cb-4624-8788-a240a3640495-serving-cert\") pod \"service-ca-operator-cf7c776b7-rzxqx\" (UID: \"3723f1be-68cb-4624-8788-a240a3640495\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-rzxqx"
Sep 15 10:18:20.669109 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.668976    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4x6s\" (UniqueName: \"kubernetes.io/projected/3723f1be-68cb-4624-8788-a240a3640495-kube-api-access-p4x6s\") pod \"service-ca-operator-cf7c776b7-rzxqx\" (UID: \"3723f1be-68cb-4624-8788-a240a3640495\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-rzxqx"
Sep 15 10:18:20.669109 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.668998    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1798fb5d-8a9d-4068-b960-e371a235b84e-trusted-ca\") pod \"image-registry-5bf5cf7cd7-mxp9j\" (UID: \"1798fb5d-8a9d-4068-b960-e371a235b84e\") " pod="openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j"
Sep 15 10:18:20.669109 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.669017    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d42015bc-21f5-4d25-8cc5-0ade2c4a93fa-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-xqnct\" (UID: \"d42015bc-21f5-4d25-8cc5-0ade2c4a93fa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xqnct"
Sep 15 10:18:20.669109 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.669065    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3723f1be-68cb-4624-8788-a240a3640495-config\") pod \"service-ca-operator-cf7c776b7-rzxqx\" (UID: \"3723f1be-68cb-4624-8788-a240a3640495\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-rzxqx"
Sep 15 10:18:20.669109 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.669084    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1798fb5d-8a9d-4068-b960-e371a235b84e-ca-trust-extracted\") pod \"image-registry-5bf5cf7cd7-mxp9j\" (UID: \"1798fb5d-8a9d-4068-b960-e371a235b84e\") " pod="openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j"
Sep 15 10:18:20.733863 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.733769    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4d8p_1a9137a7-9b75-4af5-8b82-10102bd76707/konnectivity-agent/0.log" limit=1024
Sep 15 10:18:20.769663 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.769628    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1798fb5d-8a9d-4068-b960-e371a235b84e-registry-tls\") pod \"image-registry-5bf5cf7cd7-mxp9j\" (UID: \"1798fb5d-8a9d-4068-b960-e371a235b84e\") " pod="openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j"
Sep 15 10:18:20.769663 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.769665    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1798fb5d-8a9d-4068-b960-e371a235b84e-registry-certificates\") pod \"image-registry-5bf5cf7cd7-mxp9j\" (UID: \"1798fb5d-8a9d-4068-b960-e371a235b84e\") " pod="openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j"
Sep 15 10:18:20.769881 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.769685    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3723f1be-68cb-4624-8788-a240a3640495-serving-cert\") pod \"service-ca-operator-cf7c776b7-rzxqx\" (UID: \"3723f1be-68cb-4624-8788-a240a3640495\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-rzxqx"
Sep 15 10:18:20.769881 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:20.769785    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 10:18:20.769881 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:20.769801    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j: secret "image-registry-tls" not found
Sep 15 10:18:20.769881 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.769812    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4x6s\" (UniqueName: \"kubernetes.io/projected/3723f1be-68cb-4624-8788-a240a3640495-kube-api-access-p4x6s\") pod \"service-ca-operator-cf7c776b7-rzxqx\" (UID: \"3723f1be-68cb-4624-8788-a240a3640495\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-rzxqx"
Sep 15 10:18:20.769881 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:20.769850    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1798fb5d-8a9d-4068-b960-e371a235b84e-registry-tls podName:1798fb5d-8a9d-4068-b960-e371a235b84e nodeName:}" failed. No retries permitted until 2026-09-15 10:18:21.269835165 +0000 UTC m=+34.665927230 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1798fb5d-8a9d-4068-b960-e371a235b84e-registry-tls") pod "image-registry-5bf5cf7cd7-mxp9j" (UID: "1798fb5d-8a9d-4068-b960-e371a235b84e") : secret "image-registry-tls" not found
Sep 15 10:18:20.770114 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.769883    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1798fb5d-8a9d-4068-b960-e371a235b84e-trusted-ca\") pod \"image-registry-5bf5cf7cd7-mxp9j\" (UID: \"1798fb5d-8a9d-4068-b960-e371a235b84e\") " pod="openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j"
Sep 15 10:18:20.770114 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.769911    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d42015bc-21f5-4d25-8cc5-0ade2c4a93fa-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-xqnct\" (UID: \"d42015bc-21f5-4d25-8cc5-0ade2c4a93fa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xqnct"
Sep 15 10:18:20.770114 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.769932    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3723f1be-68cb-4624-8788-a240a3640495-config\") pod \"service-ca-operator-cf7c776b7-rzxqx\" (UID: \"3723f1be-68cb-4624-8788-a240a3640495\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-rzxqx"
Sep 15 10:18:20.770114 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.769947    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1798fb5d-8a9d-4068-b960-e371a235b84e-ca-trust-extracted\") pod \"image-registry-5bf5cf7cd7-mxp9j\" (UID: \"1798fb5d-8a9d-4068-b960-e371a235b84e\") " pod="openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j"
Sep 15 10:18:20.770114 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.769974    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f9ee683b-5f4d-4a00-81d8-affa82ff7362-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-vs4m6\" (UID: \"f9ee683b-5f4d-4a00-81d8-affa82ff7362\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-vs4m6"
Sep 15 10:18:20.770114 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.770002    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a79f7e20-c11d-4204-bde9-8cd257af7a46-cert\") pod \"ingress-canary-fqjvg\" (UID: \"a79f7e20-c11d-4204-bde9-8cd257af7a46\") " pod="openshift-ingress-canary/ingress-canary-fqjvg"
Sep 15 10:18:20.770114 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.770030    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdwgz\" (UniqueName: \"kubernetes.io/projected/8bd905c9-2601-4b09-93ff-07596c04b509-kube-api-access-xdwgz\") pod \"dns-default-hqxdd\" (UID: \"8bd905c9-2601-4b09-93ff-07596c04b509\") " pod="openshift-dns/dns-default-hqxdd"
Sep 15 10:18:20.770114 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.770064    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f9ee683b-5f4d-4a00-81d8-affa82ff7362-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-vs4m6\" (UID: \"f9ee683b-5f4d-4a00-81d8-affa82ff7362\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-vs4m6"
Sep 15 10:18:20.770114 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.770093    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1798fb5d-8a9d-4068-b960-e371a235b84e-installation-pull-secrets\") pod \"image-registry-5bf5cf7cd7-mxp9j\" (UID: \"1798fb5d-8a9d-4068-b960-e371a235b84e\") " pod="openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j"
Sep 15 10:18:20.770114 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.770116    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d42015bc-21f5-4d25-8cc5-0ade2c4a93fa-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-xqnct\" (UID: \"d42015bc-21f5-4d25-8cc5-0ade2c4a93fa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xqnct"
Sep 15 10:18:20.770595 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.770141    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srjhl\" (UniqueName: \"kubernetes.io/projected/d42015bc-21f5-4d25-8cc5-0ade2c4a93fa-kube-api-access-srjhl\") pod \"kube-storage-version-migrator-operator-6c8f84f897-xqnct\" (UID: \"d42015bc-21f5-4d25-8cc5-0ade2c4a93fa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xqnct"
Sep 15 10:18:20.770595 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:20.770232    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 15 10:18:20.770595 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:20.770285    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9ee683b-5f4d-4a00-81d8-affa82ff7362-networking-console-plugin-cert podName:f9ee683b-5f4d-4a00-81d8-affa82ff7362 nodeName:}" failed. No retries permitted until 2026-09-15 10:18:21.27026821 +0000 UTC m=+34.666360281 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f9ee683b-5f4d-4a00-81d8-affa82ff7362-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-vs4m6" (UID: "f9ee683b-5f4d-4a00-81d8-affa82ff7362") : secret "networking-console-plugin-cert" not found
Sep 15 10:18:20.770595 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.770331    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1798fb5d-8a9d-4068-b960-e371a235b84e-bound-sa-token\") pod \"image-registry-5bf5cf7cd7-mxp9j\" (UID: \"1798fb5d-8a9d-4068-b960-e371a235b84e\") " pod="openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j"
Sep 15 10:18:20.770595 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.770361    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64dw4\" (UniqueName: \"kubernetes.io/projected/a79f7e20-c11d-4204-bde9-8cd257af7a46-kube-api-access-64dw4\") pod \"ingress-canary-fqjvg\" (UID: \"a79f7e20-c11d-4204-bde9-8cd257af7a46\") " pod="openshift-ingress-canary/ingress-canary-fqjvg"
Sep 15 10:18:20.770595 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.770409    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1798fb5d-8a9d-4068-b960-e371a235b84e-image-registry-private-configuration\") pod \"image-registry-5bf5cf7cd7-mxp9j\" (UID: \"1798fb5d-8a9d-4068-b960-e371a235b84e\") " pod="openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j"
Sep 15 10:18:20.770595 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.770424    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1798fb5d-8a9d-4068-b960-e371a235b84e-registry-certificates\") pod \"image-registry-5bf5cf7cd7-mxp9j\" (UID: \"1798fb5d-8a9d-4068-b960-e371a235b84e\") " pod="openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j"
Sep 15 10:18:20.770595 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.770434    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f52g8\" (UniqueName: \"kubernetes.io/projected/1798fb5d-8a9d-4068-b960-e371a235b84e-kube-api-access-f52g8\") pod \"image-registry-5bf5cf7cd7-mxp9j\" (UID: \"1798fb5d-8a9d-4068-b960-e371a235b84e\") " pod="openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j"
Sep 15 10:18:20.770595 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.770458    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj55v\" (UniqueName: \"kubernetes.io/projected/dd15b5c1-59b7-4b1b-a72a-797e290535b2-kube-api-access-kj55v\") pod \"network-check-source-6f8b768455-mlhbw\" (UID: \"dd15b5c1-59b7-4b1b-a72a-797e290535b2\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-mlhbw"
Sep 15 10:18:20.770595 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.770484    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8bd905c9-2601-4b09-93ff-07596c04b509-config-volume\") pod \"dns-default-hqxdd\" (UID: \"8bd905c9-2601-4b09-93ff-07596c04b509\") " pod="openshift-dns/dns-default-hqxdd"
Sep 15 10:18:20.770595 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.770515    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8bd905c9-2601-4b09-93ff-07596c04b509-metrics-tls\") pod \"dns-default-hqxdd\" (UID: \"8bd905c9-2601-4b09-93ff-07596c04b509\") " pod="openshift-dns/dns-default-hqxdd"
Sep 15 10:18:20.770595 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.770536    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bd905c9-2601-4b09-93ff-07596c04b509-tmp-dir\") pod \"dns-default-hqxdd\" (UID: \"8bd905c9-2601-4b09-93ff-07596c04b509\") " pod="openshift-dns/dns-default-hqxdd"
Sep 15 10:18:20.770595 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.770571    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3723f1be-68cb-4624-8788-a240a3640495-config\") pod \"service-ca-operator-cf7c776b7-rzxqx\" (UID: \"3723f1be-68cb-4624-8788-a240a3640495\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-rzxqx"
Sep 15 10:18:20.770595 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.770579    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ecad1164-c9d0-4df5-a0b8-382e33ac5629-original-pull-secret\") pod \"global-pull-secret-syncer-d48mp\" (UID: \"ecad1164-c9d0-4df5-a0b8-382e33ac5629\") " pod="kube-system/global-pull-secret-syncer-d48mp"
Sep 15 10:18:20.771296 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:20.770711    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 10:18:20.771296 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:20.770790    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecad1164-c9d0-4df5-a0b8-382e33ac5629-original-pull-secret podName:ecad1164-c9d0-4df5-a0b8-382e33ac5629 nodeName:}" failed. No retries permitted until 2026-09-15 10:18:52.770776099 +0000 UTC m=+66.166868178 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ecad1164-c9d0-4df5-a0b8-382e33ac5629-original-pull-secret") pod "global-pull-secret-syncer-d48mp" (UID: "ecad1164-c9d0-4df5-a0b8-382e33ac5629") : object "kube-system"/"original-pull-secret" not registered
Sep 15 10:18:20.771296 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.770828    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f9ee683b-5f4d-4a00-81d8-affa82ff7362-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-vs4m6\" (UID: \"f9ee683b-5f4d-4a00-81d8-affa82ff7362\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-vs4m6"
Sep 15 10:18:20.771296 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.770970    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1798fb5d-8a9d-4068-b960-e371a235b84e-ca-trust-extracted\") pod \"image-registry-5bf5cf7cd7-mxp9j\" (UID: \"1798fb5d-8a9d-4068-b960-e371a235b84e\") " pod="openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j"
Sep 15 10:18:20.771296 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.771178    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d42015bc-21f5-4d25-8cc5-0ade2c4a93fa-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-xqnct\" (UID: \"d42015bc-21f5-4d25-8cc5-0ade2c4a93fa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xqnct"
Sep 15 10:18:20.771525 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.771332    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1798fb5d-8a9d-4068-b960-e371a235b84e-trusted-ca\") pod \"image-registry-5bf5cf7cd7-mxp9j\" (UID: \"1798fb5d-8a9d-4068-b960-e371a235b84e\") " pod="openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j"
Sep 15 10:18:20.773944 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.773921    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3723f1be-68cb-4624-8788-a240a3640495-serving-cert\") pod \"service-ca-operator-cf7c776b7-rzxqx\" (UID: \"3723f1be-68cb-4624-8788-a240a3640495\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-rzxqx"
Sep 15 10:18:20.774036 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.773921    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d42015bc-21f5-4d25-8cc5-0ade2c4a93fa-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-xqnct\" (UID: \"d42015bc-21f5-4d25-8cc5-0ade2c4a93fa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xqnct"
Sep 15 10:18:20.774199 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.774181    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1798fb5d-8a9d-4068-b960-e371a235b84e-installation-pull-secrets\") pod \"image-registry-5bf5cf7cd7-mxp9j\" (UID: \"1798fb5d-8a9d-4068-b960-e371a235b84e\") " pod="openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j"
Sep 15 10:18:20.774235 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.774184    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1798fb5d-8a9d-4068-b960-e371a235b84e-image-registry-private-configuration\") pod \"image-registry-5bf5cf7cd7-mxp9j\" (UID: \"1798fb5d-8a9d-4068-b960-e371a235b84e\") " pod="openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j"
Sep 15 10:18:20.780524 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.780499    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4x6s\" (UniqueName: \"kubernetes.io/projected/3723f1be-68cb-4624-8788-a240a3640495-kube-api-access-p4x6s\") pod \"service-ca-operator-cf7c776b7-rzxqx\" (UID: \"3723f1be-68cb-4624-8788-a240a3640495\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-rzxqx"
Sep 15 10:18:20.780670 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.780503    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srjhl\" (UniqueName: \"kubernetes.io/projected/d42015bc-21f5-4d25-8cc5-0ade2c4a93fa-kube-api-access-srjhl\") pod \"kube-storage-version-migrator-operator-6c8f84f897-xqnct\" (UID: \"d42015bc-21f5-4d25-8cc5-0ade2c4a93fa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xqnct"
Sep 15 10:18:20.781368 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.781342    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj55v\" (UniqueName: \"kubernetes.io/projected/dd15b5c1-59b7-4b1b-a72a-797e290535b2-kube-api-access-kj55v\") pod \"network-check-source-6f8b768455-mlhbw\" (UID: \"dd15b5c1-59b7-4b1b-a72a-797e290535b2\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-mlhbw"
Sep 15 10:18:20.781499 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.781458    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1798fb5d-8a9d-4068-b960-e371a235b84e-bound-sa-token\") pod \"image-registry-5bf5cf7cd7-mxp9j\" (UID: \"1798fb5d-8a9d-4068-b960-e371a235b84e\") " pod="openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j"
Sep 15 10:18:20.781499 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.781469    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f52g8\" (UniqueName: \"kubernetes.io/projected/1798fb5d-8a9d-4068-b960-e371a235b84e-kube-api-access-f52g8\") pod \"image-registry-5bf5cf7cd7-mxp9j\" (UID: \"1798fb5d-8a9d-4068-b960-e371a235b84e\") " pod="openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j"
Sep 15 10:18:20.831498 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.831467    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xqnct"
Sep 15 10:18:20.843607 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.843578    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-rzxqx"
Sep 15 10:18:20.871629 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.871597    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a79f7e20-c11d-4204-bde9-8cd257af7a46-cert\") pod \"ingress-canary-fqjvg\" (UID: \"a79f7e20-c11d-4204-bde9-8cd257af7a46\") " pod="openshift-ingress-canary/ingress-canary-fqjvg"
Sep 15 10:18:20.871771 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.871641    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdwgz\" (UniqueName: \"kubernetes.io/projected/8bd905c9-2601-4b09-93ff-07596c04b509-kube-api-access-xdwgz\") pod \"dns-default-hqxdd\" (UID: \"8bd905c9-2601-4b09-93ff-07596c04b509\") " pod="openshift-dns/dns-default-hqxdd"
Sep 15 10:18:20.871771 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.871687    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c101b9f1-4c96-416c-b899-fc7eee86e4ea-metrics-certs\") pod \"network-metrics-daemon-hh4zk\" (UID: \"c101b9f1-4c96-416c-b899-fc7eee86e4ea\") " pod="openshift-multus/network-metrics-daemon-hh4zk"
Sep 15 10:18:20.871771 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.871711    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64dw4\" (UniqueName: \"kubernetes.io/projected/a79f7e20-c11d-4204-bde9-8cd257af7a46-kube-api-access-64dw4\") pod \"ingress-canary-fqjvg\" (UID: \"a79f7e20-c11d-4204-bde9-8cd257af7a46\") " pod="openshift-ingress-canary/ingress-canary-fqjvg"
Sep 15 10:18:20.871771 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.871752    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6fcn\" (UniqueName: \"kubernetes.io/projected/4015e313-4380-437f-81e5-ba8622486e13-kube-api-access-p6fcn\") pod \"network-check-target-fqms7\" (UID: \"4015e313-4380-437f-81e5-ba8622486e13\") " pod="openshift-network-diagnostics/network-check-target-fqms7"
Sep 15 10:18:20.871977 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.871784    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8bd905c9-2601-4b09-93ff-07596c04b509-config-volume\") pod \"dns-default-hqxdd\" (UID: \"8bd905c9-2601-4b09-93ff-07596c04b509\") " pod="openshift-dns/dns-default-hqxdd"
Sep 15 10:18:20.871977 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.871806    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8bd905c9-2601-4b09-93ff-07596c04b509-metrics-tls\") pod \"dns-default-hqxdd\" (UID: \"8bd905c9-2601-4b09-93ff-07596c04b509\") " pod="openshift-dns/dns-default-hqxdd"
Sep 15 10:18:20.871977 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.871830    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bd905c9-2601-4b09-93ff-07596c04b509-tmp-dir\") pod \"dns-default-hqxdd\" (UID: \"8bd905c9-2601-4b09-93ff-07596c04b509\") " pod="openshift-dns/dns-default-hqxdd"
Sep 15 10:18:20.872175 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:20.872153    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 10:18:20.872249 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:20.872236    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 10:18:20.872318 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:20.872304    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c101b9f1-4c96-416c-b899-fc7eee86e4ea-metrics-certs podName:c101b9f1-4c96-416c-b899-fc7eee86e4ea nodeName:}" failed. No retries permitted until 2026-09-15 10:18:52.872283912 +0000 UTC m=+66.268375982 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c101b9f1-4c96-416c-b899-fc7eee86e4ea-metrics-certs") pod "network-metrics-daemon-hh4zk" (UID: "c101b9f1-4c96-416c-b899-fc7eee86e4ea") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 10:18:20.872581 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:20.872566    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bd905c9-2601-4b09-93ff-07596c04b509-metrics-tls podName:8bd905c9-2601-4b09-93ff-07596c04b509 nodeName:}" failed. No retries permitted until 2026-09-15 10:18:21.37254754 +0000 UTC m=+34.768639620 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8bd905c9-2601-4b09-93ff-07596c04b509-metrics-tls") pod "dns-default-hqxdd" (UID: "8bd905c9-2601-4b09-93ff-07596c04b509") : secret "dns-default-metrics-tls" not found
Sep 15 10:18:20.872673 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.872632    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bd905c9-2601-4b09-93ff-07596c04b509-tmp-dir\") pod \"dns-default-hqxdd\" (UID: \"8bd905c9-2601-4b09-93ff-07596c04b509\") " pod="openshift-dns/dns-default-hqxdd"
Sep 15 10:18:20.872915 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.872893    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8bd905c9-2601-4b09-93ff-07596c04b509-config-volume\") pod \"dns-default-hqxdd\" (UID: \"8bd905c9-2601-4b09-93ff-07596c04b509\") " pod="openshift-dns/dns-default-hqxdd"
Sep 15 10:18:20.874381 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.874359    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a79f7e20-c11d-4204-bde9-8cd257af7a46-cert\") pod \"ingress-canary-fqjvg\" (UID: \"a79f7e20-c11d-4204-bde9-8cd257af7a46\") " pod="openshift-ingress-canary/ingress-canary-fqjvg"
Sep 15 10:18:20.874682 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.874664    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6fcn\" (UniqueName: \"kubernetes.io/projected/4015e313-4380-437f-81e5-ba8622486e13-kube-api-access-p6fcn\") pod \"network-check-target-fqms7\" (UID: \"4015e313-4380-437f-81e5-ba8622486e13\") " pod="openshift-network-diagnostics/network-check-target-fqms7"
Sep 15 10:18:20.880179 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.880153    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdwgz\" (UniqueName: \"kubernetes.io/projected/8bd905c9-2601-4b09-93ff-07596c04b509-kube-api-access-xdwgz\") pod \"dns-default-hqxdd\" (UID: \"8bd905c9-2601-4b09-93ff-07596c04b509\") " pod="openshift-dns/dns-default-hqxdd"
Sep 15 10:18:20.880408 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.880389    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64dw4\" (UniqueName: \"kubernetes.io/projected/a79f7e20-c11d-4204-bde9-8cd257af7a46-kube-api-access-64dw4\") pod \"ingress-canary-fqjvg\" (UID: \"a79f7e20-c11d-4204-bde9-8cd257af7a46\") " pod="openshift-ingress-canary/ingress-canary-fqjvg"
Sep 15 10:18:20.896423 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.896189    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-mlhbw"
Sep 15 10:18:20.918994 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:20.918966    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fqjvg"
Sep 15 10:18:21.146924 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:21.146717    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d48mp"
Sep 15 10:18:21.149426 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:21.149407    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 15 10:18:21.156580 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:21.156557    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xqnct"]
Sep 15 10:18:21.162688 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:21.162660    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-rzxqx"]
Sep 15 10:18:21.274521 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:21.274479    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f9ee683b-5f4d-4a00-81d8-affa82ff7362-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-vs4m6\" (UID: \"f9ee683b-5f4d-4a00-81d8-affa82ff7362\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-vs4m6"
Sep 15 10:18:21.274713 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:21.274601    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1798fb5d-8a9d-4068-b960-e371a235b84e-registry-tls\") pod \"image-registry-5bf5cf7cd7-mxp9j\" (UID: \"1798fb5d-8a9d-4068-b960-e371a235b84e\") " pod="openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j"
Sep 15 10:18:21.274713 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:21.274645    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 15 10:18:21.274874 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:21.274744    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9ee683b-5f4d-4a00-81d8-affa82ff7362-networking-console-plugin-cert podName:f9ee683b-5f4d-4a00-81d8-affa82ff7362 nodeName:}" failed. No retries permitted until 2026-09-15 10:18:22.274700132 +0000 UTC m=+35.670792260 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f9ee683b-5f4d-4a00-81d8-affa82ff7362-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-vs4m6" (UID: "f9ee683b-5f4d-4a00-81d8-affa82ff7362") : secret "networking-console-plugin-cert" not found
Sep 15 10:18:21.274874 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:21.274780    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 10:18:21.274874 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:21.274803    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j: secret "image-registry-tls" not found
Sep 15 10:18:21.274874 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:21.274866    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1798fb5d-8a9d-4068-b960-e371a235b84e-registry-tls podName:1798fb5d-8a9d-4068-b960-e371a235b84e nodeName:}" failed. No retries permitted until 2026-09-15 10:18:22.274847224 +0000 UTC m=+35.670939291 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1798fb5d-8a9d-4068-b960-e371a235b84e-registry-tls") pod "image-registry-5bf5cf7cd7-mxp9j" (UID: "1798fb5d-8a9d-4068-b960-e371a235b84e") : secret "image-registry-tls" not found
Sep 15 10:18:21.375912 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:21.375872    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8bd905c9-2601-4b09-93ff-07596c04b509-metrics-tls\") pod \"dns-default-hqxdd\" (UID: \"8bd905c9-2601-4b09-93ff-07596c04b509\") " pod="openshift-dns/dns-default-hqxdd"
Sep 15 10:18:21.376081 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:21.376017    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 10:18:21.376081 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:21.376077    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bd905c9-2601-4b09-93ff-07596c04b509-metrics-tls podName:8bd905c9-2601-4b09-93ff-07596c04b509 nodeName:}" failed. No retries permitted until 2026-09-15 10:18:22.376060483 +0000 UTC m=+35.772152548 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8bd905c9-2601-4b09-93ff-07596c04b509-metrics-tls") pod "dns-default-hqxdd" (UID: "8bd905c9-2601-4b09-93ff-07596c04b509") : secret "dns-default-metrics-tls" not found
Sep 15 10:18:22.142248 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:22.142213    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqms7"
Sep 15 10:18:22.142696 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:22.142213    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hh4zk"
Sep 15 10:18:22.145825 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:22.145707    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lrdhd\""
Sep 15 10:18:22.145825 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:22.145748    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 15 10:18:22.145825 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:22.145752    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-88p68\""
Sep 15 10:18:22.153445 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:22.153419    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqms7"
Sep 15 10:18:22.283071 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:22.283014    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1798fb5d-8a9d-4068-b960-e371a235b84e-registry-tls\") pod \"image-registry-5bf5cf7cd7-mxp9j\" (UID: \"1798fb5d-8a9d-4068-b960-e371a235b84e\") " pod="openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j"
Sep 15 10:18:22.283253 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:22.283092    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f9ee683b-5f4d-4a00-81d8-affa82ff7362-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-vs4m6\" (UID: \"f9ee683b-5f4d-4a00-81d8-affa82ff7362\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-vs4m6"
Sep 15 10:18:22.283253 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:22.283172    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 15 10:18:22.283253 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:22.283195    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 10:18:22.283253 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:22.283214    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j: secret "image-registry-tls" not found
Sep 15 10:18:22.283253 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:22.283241    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9ee683b-5f4d-4a00-81d8-affa82ff7362-networking-console-plugin-cert podName:f9ee683b-5f4d-4a00-81d8-affa82ff7362 nodeName:}" failed. No retries permitted until 2026-09-15 10:18:24.283223072 +0000 UTC m=+37.679315136 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f9ee683b-5f4d-4a00-81d8-affa82ff7362-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-vs4m6" (UID: "f9ee683b-5f4d-4a00-81d8-affa82ff7362") : secret "networking-console-plugin-cert" not found
Sep 15 10:18:22.283458 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:22.283264    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1798fb5d-8a9d-4068-b960-e371a235b84e-registry-tls podName:1798fb5d-8a9d-4068-b960-e371a235b84e nodeName:}" failed. No retries permitted until 2026-09-15 10:18:24.283248069 +0000 UTC m=+37.679340156 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1798fb5d-8a9d-4068-b960-e371a235b84e-registry-tls") pod "image-registry-5bf5cf7cd7-mxp9j" (UID: "1798fb5d-8a9d-4068-b960-e371a235b84e") : secret "image-registry-tls" not found
Sep 15 10:18:22.384356 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:22.384325    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8bd905c9-2601-4b09-93ff-07596c04b509-metrics-tls\") pod \"dns-default-hqxdd\" (UID: \"8bd905c9-2601-4b09-93ff-07596c04b509\") " pod="openshift-dns/dns-default-hqxdd"
Sep 15 10:18:22.384519 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:22.384445    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 10:18:22.384519 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:22.384508    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bd905c9-2601-4b09-93ff-07596c04b509-metrics-tls podName:8bd905c9-2601-4b09-93ff-07596c04b509 nodeName:}" failed. No retries permitted until 2026-09-15 10:18:24.384493561 +0000 UTC m=+37.780585626 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8bd905c9-2601-4b09-93ff-07596c04b509-metrics-tls") pod "dns-default-hqxdd" (UID: "8bd905c9-2601-4b09-93ff-07596c04b509") : secret "dns-default-metrics-tls" not found
Sep 15 10:18:22.478562 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:18:22.478474    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3723f1be_68cb_4624_8788_a240a3640495.slice/crio-0c33860e8f33e8c8d068f23a3cd4022f385ad2a5328693e456a93fc94112e3fb WatchSource:0}: Error finding container 0c33860e8f33e8c8d068f23a3cd4022f385ad2a5328693e456a93fc94112e3fb: Status 404 returned error can't find the container with id 0c33860e8f33e8c8d068f23a3cd4022f385ad2a5328693e456a93fc94112e3fb
Sep 15 10:18:22.478901 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:18:22.478876    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd42015bc_21f5_4d25_8cc5_0ade2c4a93fa.slice/crio-89b3cea38a84dd91c3908b0a763519954c28fd0bc44a24b151b781a6d669f7a3 WatchSource:0}: Error finding container 89b3cea38a84dd91c3908b0a763519954c28fd0bc44a24b151b781a6d669f7a3: Status 404 returned error can't find the container with id 89b3cea38a84dd91c3908b0a763519954c28fd0bc44a24b151b781a6d669f7a3
Sep 15 10:18:22.753545 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:22.753467    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fqms7"]
Sep 15 10:18:22.754606 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:22.754581    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-mlhbw"]
Sep 15 10:18:22.757518 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:22.757496    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fqjvg"]
Sep 15 10:18:22.844713 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:18:22.844678    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4015e313_4380_437f_81e5_ba8622486e13.slice/crio-1974910b5522896f9c8eaeff418793b4379e26a4916b9f45b8422ecc6edffc87 WatchSource:0}: Error finding container 1974910b5522896f9c8eaeff418793b4379e26a4916b9f45b8422ecc6edffc87: Status 404 returned error can't find the container with id 1974910b5522896f9c8eaeff418793b4379e26a4916b9f45b8422ecc6edffc87
Sep 15 10:18:22.845086 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:18:22.845045    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd15b5c1_59b7_4b1b_a72a_797e290535b2.slice/crio-fdb45abb43ffa2cc08affbf7217eade7362ca45298a06e4dbb8b60ae08f792d3 WatchSource:0}: Error finding container fdb45abb43ffa2cc08affbf7217eade7362ca45298a06e4dbb8b60ae08f792d3: Status 404 returned error can't find the container with id fdb45abb43ffa2cc08affbf7217eade7362ca45298a06e4dbb8b60ae08f792d3
Sep 15 10:18:22.846038 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:18:22.846010    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda79f7e20_c11d_4204_bde9_8cd257af7a46.slice/crio-29f64af358bb467f6bf5340ed09bc6db213182a2c8c5a5e1b4ed4fb15fdce8ec WatchSource:0}: Error finding container 29f64af358bb467f6bf5340ed09bc6db213182a2c8c5a5e1b4ed4fb15fdce8ec: Status 404 returned error can't find the container with id 29f64af358bb467f6bf5340ed09bc6db213182a2c8c5a5e1b4ed4fb15fdce8ec
Sep 15 10:18:23.022938 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:23.022911    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4d8p_1a9137a7-9b75-4af5-8b82-10102bd76707/konnectivity-agent/0.log" limit=1024
Sep 15 10:18:23.121199 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:23.121174    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4d8p_1a9137a7-9b75-4af5-8b82-10102bd76707/konnectivity-agent/0.log" limit=1024
Sep 15 10:18:23.221644 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:23.221605    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4d8p_1a9137a7-9b75-4af5-8b82-10102bd76707/konnectivity-agent/0.log" limit=1024
Sep 15 10:18:23.341784 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:23.341751    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fqms7" event={"ID":"4015e313-4380-437f-81e5-ba8622486e13","Type":"ContainerStarted","Data":"1974910b5522896f9c8eaeff418793b4379e26a4916b9f45b8422ecc6edffc87"}
Sep 15 10:18:23.342993 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:23.342967    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fqjvg" event={"ID":"a79f7e20-c11d-4204-bde9-8cd257af7a46","Type":"ContainerStarted","Data":"29f64af358bb467f6bf5340ed09bc6db213182a2c8c5a5e1b4ed4fb15fdce8ec"}
Sep 15 10:18:23.344364 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:23.344310    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-mlhbw" event={"ID":"dd15b5c1-59b7-4b1b-a72a-797e290535b2","Type":"ContainerStarted","Data":"fdb45abb43ffa2cc08affbf7217eade7362ca45298a06e4dbb8b60ae08f792d3"}
Sep 15 10:18:23.345617 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:23.345591    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xqnct" event={"ID":"d42015bc-21f5-4d25-8cc5-0ade2c4a93fa","Type":"ContainerStarted","Data":"89b3cea38a84dd91c3908b0a763519954c28fd0bc44a24b151b781a6d669f7a3"}
Sep 15 10:18:23.348652 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:23.348627    2579 generic.go:356] "Generic (PLEG): container finished" podID="8821682e-804a-4bc8-9b87-f190576d59f4" containerID="4eaa463c0d99da6593c4bc2950065dcbf9200adf44ae4e7f2c45fc9e2e79630f" exitCode=0
Sep 15 10:18:23.348764 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:23.348702    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vl7m7" event={"ID":"8821682e-804a-4bc8-9b87-f190576d59f4","Type":"ContainerDied","Data":"4eaa463c0d99da6593c4bc2950065dcbf9200adf44ae4e7f2c45fc9e2e79630f"}
Sep 15 10:18:23.349918 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:23.349894    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-rzxqx" event={"ID":"3723f1be-68cb-4624-8788-a240a3640495","Type":"ContainerStarted","Data":"0c33860e8f33e8c8d068f23a3cd4022f385ad2a5328693e456a93fc94112e3fb"}
Sep 15 10:18:24.016875 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:24.016763    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4d8p_1a9137a7-9b75-4af5-8b82-10102bd76707/konnectivity-agent/0.log" limit=1024
Sep 15 10:18:24.069385 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:24.069318    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4d8p_1a9137a7-9b75-4af5-8b82-10102bd76707/konnectivity-agent/0.log" limit=1024
Sep 15 10:18:24.305154 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:24.303615    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f9ee683b-5f4d-4a00-81d8-affa82ff7362-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-vs4m6\" (UID: \"f9ee683b-5f4d-4a00-81d8-affa82ff7362\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-vs4m6"
Sep 15 10:18:24.305154 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:24.303716    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1798fb5d-8a9d-4068-b960-e371a235b84e-registry-tls\") pod \"image-registry-5bf5cf7cd7-mxp9j\" (UID: \"1798fb5d-8a9d-4068-b960-e371a235b84e\") " pod="openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j"
Sep 15 10:18:24.305154 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:24.303871    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 10:18:24.305154 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:24.303885    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j: secret "image-registry-tls" not found
Sep 15 10:18:24.305154 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:24.303943    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1798fb5d-8a9d-4068-b960-e371a235b84e-registry-tls podName:1798fb5d-8a9d-4068-b960-e371a235b84e nodeName:}" failed. No retries permitted until 2026-09-15 10:18:28.303924713 +0000 UTC m=+41.700016783 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1798fb5d-8a9d-4068-b960-e371a235b84e-registry-tls") pod "image-registry-5bf5cf7cd7-mxp9j" (UID: "1798fb5d-8a9d-4068-b960-e371a235b84e") : secret "image-registry-tls" not found
Sep 15 10:18:24.305154 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:24.304335    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 15 10:18:24.305154 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:24.304385    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9ee683b-5f4d-4a00-81d8-affa82ff7362-networking-console-plugin-cert podName:f9ee683b-5f4d-4a00-81d8-affa82ff7362 nodeName:}" failed. No retries permitted until 2026-09-15 10:18:28.304371446 +0000 UTC m=+41.700463517 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f9ee683b-5f4d-4a00-81d8-affa82ff7362-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-vs4m6" (UID: "f9ee683b-5f4d-4a00-81d8-affa82ff7362") : secret "networking-console-plugin-cert" not found
Sep 15 10:18:24.365798 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:24.365035    2579 generic.go:356] "Generic (PLEG): container finished" podID="8821682e-804a-4bc8-9b87-f190576d59f4" containerID="5fb993ce3f460367e6af255d09af33ab9b0b66f7e412663c2af00b3f92d845e8" exitCode=0
Sep 15 10:18:24.365798 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:24.365124    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vl7m7" event={"ID":"8821682e-804a-4bc8-9b87-f190576d59f4","Type":"ContainerDied","Data":"5fb993ce3f460367e6af255d09af33ab9b0b66f7e412663c2af00b3f92d845e8"}
Sep 15 10:18:24.405080 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:24.405049    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8bd905c9-2601-4b09-93ff-07596c04b509-metrics-tls\") pod \"dns-default-hqxdd\" (UID: \"8bd905c9-2601-4b09-93ff-07596c04b509\") " pod="openshift-dns/dns-default-hqxdd"
Sep 15 10:18:24.405273 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:24.405245    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 10:18:24.405457 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:24.405433    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bd905c9-2601-4b09-93ff-07596c04b509-metrics-tls podName:8bd905c9-2601-4b09-93ff-07596c04b509 nodeName:}" failed. No retries permitted until 2026-09-15 10:18:28.405295544 +0000 UTC m=+41.801387613 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8bd905c9-2601-4b09-93ff-07596c04b509-metrics-tls") pod "dns-default-hqxdd" (UID: "8bd905c9-2601-4b09-93ff-07596c04b509") : secret "dns-default-metrics-tls" not found
Sep 15 10:18:25.374150 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:25.374112    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vl7m7" event={"ID":"8821682e-804a-4bc8-9b87-f190576d59f4","Type":"ContainerStarted","Data":"5616589f2a8129b91b56b7002e8e8e9b017ebf810138f76e634000ba405249f3"}
Sep 15 10:18:25.394435 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:25.394381    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vl7m7" podStartSLOduration=7.289277383 podStartE2EDuration="38.394360462s" totalImagesPullingTime="31.105083079s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 10:17:47 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:18:25.39419681 +0000 UTC m=+38.790288897" watchObservedRunningTime="2026-09-15 10:18:25.394360462 +0000 UTC m=+38.790452550"
Sep 15 10:18:25.514280 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:25.514207    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4d8p_1a9137a7-9b75-4af5-8b82-10102bd76707/konnectivity-agent/0.log" limit=1024
Sep 15 10:18:25.613885 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:25.613851    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4d8p_1a9137a7-9b75-4af5-8b82-10102bd76707/konnectivity-agent/0.log" limit=1024
Sep 15 10:18:26.096450 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:26.096420    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4d8p_1a9137a7-9b75-4af5-8b82-10102bd76707/konnectivity-agent/0.log" limit=1024
Sep 15 10:18:26.154442 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:26.154410    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4d8p_1a9137a7-9b75-4af5-8b82-10102bd76707/konnectivity-agent/0.log" limit=1024
Sep 15 10:18:27.497808 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:27.497768    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4d8p_1a9137a7-9b75-4af5-8b82-10102bd76707/konnectivity-agent/0.log" limit=1024
Sep 15 10:18:28.340689 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:28.340654    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f9ee683b-5f4d-4a00-81d8-affa82ff7362-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-vs4m6\" (UID: \"f9ee683b-5f4d-4a00-81d8-affa82ff7362\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-vs4m6"
Sep 15 10:18:28.340850 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:28.340747    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1798fb5d-8a9d-4068-b960-e371a235b84e-registry-tls\") pod \"image-registry-5bf5cf7cd7-mxp9j\" (UID: \"1798fb5d-8a9d-4068-b960-e371a235b84e\") " pod="openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j"
Sep 15 10:18:28.340850 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:28.340828    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 15 10:18:28.340850 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:28.340845    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 10:18:28.340961 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:28.340856    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j: secret "image-registry-tls" not found
Sep 15 10:18:28.340961 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:28.340899    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9ee683b-5f4d-4a00-81d8-affa82ff7362-networking-console-plugin-cert podName:f9ee683b-5f4d-4a00-81d8-affa82ff7362 nodeName:}" failed. No retries permitted until 2026-09-15 10:18:36.340882815 +0000 UTC m=+49.736974879 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f9ee683b-5f4d-4a00-81d8-affa82ff7362-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-vs4m6" (UID: "f9ee683b-5f4d-4a00-81d8-affa82ff7362") : secret "networking-console-plugin-cert" not found
Sep 15 10:18:28.340961 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:28.340914    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1798fb5d-8a9d-4068-b960-e371a235b84e-registry-tls podName:1798fb5d-8a9d-4068-b960-e371a235b84e nodeName:}" failed. No retries permitted until 2026-09-15 10:18:36.340907794 +0000 UTC m=+49.736999859 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1798fb5d-8a9d-4068-b960-e371a235b84e-registry-tls") pod "image-registry-5bf5cf7cd7-mxp9j" (UID: "1798fb5d-8a9d-4068-b960-e371a235b84e") : secret "image-registry-tls" not found
Sep 15 10:18:28.441584 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:28.441550    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8bd905c9-2601-4b09-93ff-07596c04b509-metrics-tls\") pod \"dns-default-hqxdd\" (UID: \"8bd905c9-2601-4b09-93ff-07596c04b509\") " pod="openshift-dns/dns-default-hqxdd"
Sep 15 10:18:28.441770 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:28.441686    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 10:18:28.441770 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:28.441769    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bd905c9-2601-4b09-93ff-07596c04b509-metrics-tls podName:8bd905c9-2601-4b09-93ff-07596c04b509 nodeName:}" failed. No retries permitted until 2026-09-15 10:18:36.441752408 +0000 UTC m=+49.837844492 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8bd905c9-2601-4b09-93ff-07596c04b509-metrics-tls") pod "dns-default-hqxdd" (UID: "8bd905c9-2601-4b09-93ff-07596c04b509") : secret "dns-default-metrics-tls" not found
Sep 15 10:18:29.385902 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:29.385864    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-mlhbw" event={"ID":"dd15b5c1-59b7-4b1b-a72a-797e290535b2","Type":"ContainerStarted","Data":"57476227a6749a1019206458de8897ec5a051fb45b56dfa52c8233ac0019ad52"}
Sep 15 10:18:29.387583 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:29.387548    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xqnct" event={"ID":"d42015bc-21f5-4d25-8cc5-0ade2c4a93fa","Type":"ContainerStarted","Data":"b52282e4d40a5509823017c6a30d71cc715e5c90a14996f968af2237fbdf4a8a"}
Sep 15 10:18:29.389252 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:29.389204    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-rzxqx" event={"ID":"3723f1be-68cb-4624-8788-a240a3640495","Type":"ContainerStarted","Data":"640b3264e0d3cf53da0cab59fe27f57cb013c276e5298ea39efe35732ec13a7c"}
Sep 15 10:18:29.390789 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:29.390765    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fqms7" event={"ID":"4015e313-4380-437f-81e5-ba8622486e13","Type":"ContainerStarted","Data":"b01a9cab5c9129e7ab37168320d5c30b743ed8d742fd600e9a7d0602082ea957"}
Sep 15 10:18:29.390889 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:29.390820    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-fqms7"
Sep 15 10:18:29.392243 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:29.392218    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fqjvg" event={"ID":"a79f7e20-c11d-4204-bde9-8cd257af7a46","Type":"ContainerStarted","Data":"e70b7438b5e3be54594d48ee10eda9a22c9426532d7e0b1fbdc2c321a62dbcc9"}
Sep 15 10:18:29.402019 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:29.401942    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f8b768455-mlhbw" podStartSLOduration=33.538252546 podStartE2EDuration="39.401929495s" totalImagesPullingTime="5.863676949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:17:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:18:29.401160441 +0000 UTC m=+42.797252544" watchObservedRunningTime="2026-09-15 10:18:29.401929495 +0000 UTC m=+42.798021576"
Sep 15 10:18:29.419234 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:29.418956    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-fqms7" podStartSLOduration=36.565804923 podStartE2EDuration="42.418939013s" totalImagesPullingTime="5.85313409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:17:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:18:29.418559529 +0000 UTC m=+42.814651615" watchObservedRunningTime="2026-09-15 10:18:29.418939013 +0000 UTC m=+42.815031093"
Sep 15 10:18:29.433641 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:29.433594    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-rzxqx" podStartSLOduration=33.187552775 podStartE2EDuration="39.433576943s" totalImagesPullingTime="6.246024168s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:17:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:18:29.432989079 +0000 UTC m=+42.829081167" watchObservedRunningTime="2026-09-15 10:18:29.433576943 +0000 UTC m=+42.829669026"
Sep 15 10:18:29.450663 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:29.450614    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fqjvg" podStartSLOduration=3.5974611850000002 podStartE2EDuration="9.450593283s" totalImagesPullingTime="5.853132098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:18:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:18:29.45056709 +0000 UTC m=+42.846659179" watchObservedRunningTime="2026-09-15 10:18:29.450593283 +0000 UTC m=+42.846685374"
Sep 15 10:18:29.467136 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:29.467083    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xqnct" podStartSLOduration=34.221496679 podStartE2EDuration="40.467067081s" totalImagesPullingTime="6.245570402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:17:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:18:29.465957891 +0000 UTC m=+42.862049981" watchObservedRunningTime="2026-09-15 10:18:29.467067081 +0000 UTC m=+42.863159167"
Sep 15 10:18:30.195312 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:30.195277    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-v9xzk"]
Sep 15 10:18:30.216707 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:30.216660    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-v9xzk"]
Sep 15 10:18:30.216896 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:30.216792    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-v9xzk"
Sep 15 10:18:30.219093 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:30.219072    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 15 10:18:30.219989 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:30.219969    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 15 10:18:30.220098 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:30.219985    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-5krlt\""
Sep 15 10:18:30.353072 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:30.353029    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x28tr\" (UniqueName: \"kubernetes.io/projected/e8ba041a-9aae-4323-ae15-cedce130f84b-kube-api-access-x28tr\") pod \"migrator-8b4d697c5-v9xzk\" (UID: \"e8ba041a-9aae-4323-ae15-cedce130f84b\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-v9xzk"
Sep 15 10:18:30.454101 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:30.454023    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x28tr\" (UniqueName: \"kubernetes.io/projected/e8ba041a-9aae-4323-ae15-cedce130f84b-kube-api-access-x28tr\") pod \"migrator-8b4d697c5-v9xzk\" (UID: \"e8ba041a-9aae-4323-ae15-cedce130f84b\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-v9xzk"
Sep 15 10:18:30.462881 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:30.462859    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x28tr\" (UniqueName: \"kubernetes.io/projected/e8ba041a-9aae-4323-ae15-cedce130f84b-kube-api-access-x28tr\") pod \"migrator-8b4d697c5-v9xzk\" (UID: \"e8ba041a-9aae-4323-ae15-cedce130f84b\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-v9xzk"
Sep 15 10:18:30.526644 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:30.526613    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-v9xzk"
Sep 15 10:18:30.814751 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:30.814686    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-v9xzk"]
Sep 15 10:18:30.818593 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:18:30.818563    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8ba041a_9aae_4323_ae15_cedce130f84b.slice/crio-0986c622c920f5fb91d54817d059c03a8262dcaf0ab0909af24fb84f03035333 WatchSource:0}: Error finding container 0986c622c920f5fb91d54817d059c03a8262dcaf0ab0909af24fb84f03035333: Status 404 returned error can't find the container with id 0986c622c920f5fb91d54817d059c03a8262dcaf0ab0909af24fb84f03035333
Sep 15 10:18:31.398563 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:31.398522    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-v9xzk" event={"ID":"e8ba041a-9aae-4323-ae15-cedce130f84b","Type":"ContainerStarted","Data":"0986c622c920f5fb91d54817d059c03a8262dcaf0ab0909af24fb84f03035333"}
Sep 15 10:18:32.338398 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:32.338364    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-gdksp"]
Sep 15 10:18:32.352877 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:32.352850    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-gdksp"]
Sep 15 10:18:32.353004 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:32.352950    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-gdksp"
Sep 15 10:18:32.355443 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:32.355417    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 15 10:18:32.355443 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:32.355435    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 15 10:18:32.355621 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:32.355493    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 15 10:18:32.355621 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:32.355500    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 15 10:18:32.356380 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:32.356363    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-xvz84\""
Sep 15 10:18:32.470020 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:32.469990    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b231e300-b66d-4cee-9312-e3387e887dea-signing-key\") pod \"service-ca-568869fdc5-gdksp\" (UID: \"b231e300-b66d-4cee-9312-e3387e887dea\") " pod="openshift-service-ca/service-ca-568869fdc5-gdksp"
Sep 15 10:18:32.470020 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:32.470023    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b231e300-b66d-4cee-9312-e3387e887dea-signing-cabundle\") pod \"service-ca-568869fdc5-gdksp\" (UID: \"b231e300-b66d-4cee-9312-e3387e887dea\") " pod="openshift-service-ca/service-ca-568869fdc5-gdksp"
Sep 15 10:18:32.470205 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:32.470040    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2clrk\" (UniqueName: \"kubernetes.io/projected/b231e300-b66d-4cee-9312-e3387e887dea-kube-api-access-2clrk\") pod \"service-ca-568869fdc5-gdksp\" (UID: \"b231e300-b66d-4cee-9312-e3387e887dea\") " pod="openshift-service-ca/service-ca-568869fdc5-gdksp"
Sep 15 10:18:32.571310 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:32.571286    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b231e300-b66d-4cee-9312-e3387e887dea-signing-key\") pod \"service-ca-568869fdc5-gdksp\" (UID: \"b231e300-b66d-4cee-9312-e3387e887dea\") " pod="openshift-service-ca/service-ca-568869fdc5-gdksp"
Sep 15 10:18:32.571425 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:32.571316    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b231e300-b66d-4cee-9312-e3387e887dea-signing-cabundle\") pod \"service-ca-568869fdc5-gdksp\" (UID: \"b231e300-b66d-4cee-9312-e3387e887dea\") " pod="openshift-service-ca/service-ca-568869fdc5-gdksp"
Sep 15 10:18:32.571425 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:32.571338    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2clrk\" (UniqueName: \"kubernetes.io/projected/b231e300-b66d-4cee-9312-e3387e887dea-kube-api-access-2clrk\") pod \"service-ca-568869fdc5-gdksp\" (UID: \"b231e300-b66d-4cee-9312-e3387e887dea\") " pod="openshift-service-ca/service-ca-568869fdc5-gdksp"
Sep 15 10:18:32.572038 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:32.572019    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b231e300-b66d-4cee-9312-e3387e887dea-signing-cabundle\") pod \"service-ca-568869fdc5-gdksp\" (UID: \"b231e300-b66d-4cee-9312-e3387e887dea\") " pod="openshift-service-ca/service-ca-568869fdc5-gdksp"
Sep 15 10:18:32.573454 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:32.573438    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b231e300-b66d-4cee-9312-e3387e887dea-signing-key\") pod \"service-ca-568869fdc5-gdksp\" (UID: \"b231e300-b66d-4cee-9312-e3387e887dea\") " pod="openshift-service-ca/service-ca-568869fdc5-gdksp"
Sep 15 10:18:32.586194 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:32.586175    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2clrk\" (UniqueName: \"kubernetes.io/projected/b231e300-b66d-4cee-9312-e3387e887dea-kube-api-access-2clrk\") pod \"service-ca-568869fdc5-gdksp\" (UID: \"b231e300-b66d-4cee-9312-e3387e887dea\") " pod="openshift-service-ca/service-ca-568869fdc5-gdksp"
Sep 15 10:18:32.661508 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:32.661480    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-gdksp"
Sep 15 10:18:32.969608 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:32.969133    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-gdksp"]
Sep 15 10:18:32.973208 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:18:32.973183    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb231e300_b66d_4cee_9312_e3387e887dea.slice/crio-beee7983964eadd8dacd2e1cfe98b9bf83e1f11296e4ca090a73e2ee2095b509 WatchSource:0}: Error finding container beee7983964eadd8dacd2e1cfe98b9bf83e1f11296e4ca090a73e2ee2095b509: Status 404 returned error can't find the container with id beee7983964eadd8dacd2e1cfe98b9bf83e1f11296e4ca090a73e2ee2095b509
Sep 15 10:18:33.407126 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:33.407089    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-gdksp" event={"ID":"b231e300-b66d-4cee-9312-e3387e887dea","Type":"ContainerStarted","Data":"eb7f0ddaabfa3a598bad42015790f2a0adb5d6cbfde0d14e7a0129b796506b8c"}
Sep 15 10:18:33.407591 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:33.407151    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-gdksp" event={"ID":"b231e300-b66d-4cee-9312-e3387e887dea","Type":"ContainerStarted","Data":"beee7983964eadd8dacd2e1cfe98b9bf83e1f11296e4ca090a73e2ee2095b509"}
Sep 15 10:18:33.408906 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:33.408884    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-v9xzk" event={"ID":"e8ba041a-9aae-4323-ae15-cedce130f84b","Type":"ContainerStarted","Data":"a33bbff7a8893cc15eb0bbf392d517563da2b7ad1528845022d44a036563ecdb"}
Sep 15 10:18:33.409015 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:33.408920    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-v9xzk" event={"ID":"e8ba041a-9aae-4323-ae15-cedce130f84b","Type":"ContainerStarted","Data":"df34743462c67caab07a860d155dc11fe4d1400e4a29560e7785e130f9cbe19d"}
Sep 15 10:18:33.424560 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:33.424517    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-568869fdc5-gdksp" podStartSLOduration=1.4245047610000001 podStartE2EDuration="1.424504761s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:18:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:18:33.423933875 +0000 UTC m=+46.820025963" watchObservedRunningTime="2026-09-15 10:18:33.424504761 +0000 UTC m=+46.820596847"
Sep 15 10:18:33.444093 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:33.444047    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-v9xzk" podStartSLOduration=1.752540454 podStartE2EDuration="3.44403397s" totalImagesPullingTime="1.691493516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:18:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:18:33.443072176 +0000 UTC m=+46.839164263" watchObservedRunningTime="2026-09-15 10:18:33.44403397 +0000 UTC m=+46.840126057"
Sep 15 10:18:36.402768 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:36.402717    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f9ee683b-5f4d-4a00-81d8-affa82ff7362-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-vs4m6\" (UID: \"f9ee683b-5f4d-4a00-81d8-affa82ff7362\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-vs4m6"
Sep 15 10:18:36.403172 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:36.402887    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 15 10:18:36.403172 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:36.402899    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1798fb5d-8a9d-4068-b960-e371a235b84e-registry-tls\") pod \"image-registry-5bf5cf7cd7-mxp9j\" (UID: \"1798fb5d-8a9d-4068-b960-e371a235b84e\") " pod="openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j"
Sep 15 10:18:36.403172 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:36.402965    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9ee683b-5f4d-4a00-81d8-affa82ff7362-networking-console-plugin-cert podName:f9ee683b-5f4d-4a00-81d8-affa82ff7362 nodeName:}" failed. No retries permitted until 2026-09-15 10:18:52.402944727 +0000 UTC m=+65.799036794 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f9ee683b-5f4d-4a00-81d8-affa82ff7362-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-vs4m6" (UID: "f9ee683b-5f4d-4a00-81d8-affa82ff7362") : secret "networking-console-plugin-cert" not found
Sep 15 10:18:36.403172 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:36.403006    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 10:18:36.403172 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:36.403019    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j: secret "image-registry-tls" not found
Sep 15 10:18:36.403172 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:36.403069    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1798fb5d-8a9d-4068-b960-e371a235b84e-registry-tls podName:1798fb5d-8a9d-4068-b960-e371a235b84e nodeName:}" failed. No retries permitted until 2026-09-15 10:18:52.403053761 +0000 UTC m=+65.799145827 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1798fb5d-8a9d-4068-b960-e371a235b84e-registry-tls") pod "image-registry-5bf5cf7cd7-mxp9j" (UID: "1798fb5d-8a9d-4068-b960-e371a235b84e") : secret "image-registry-tls" not found
Sep 15 10:18:36.503833 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:36.503800    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8bd905c9-2601-4b09-93ff-07596c04b509-metrics-tls\") pod \"dns-default-hqxdd\" (UID: \"8bd905c9-2601-4b09-93ff-07596c04b509\") " pod="openshift-dns/dns-default-hqxdd"
Sep 15 10:18:36.504001 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:36.503963    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 10:18:36.504051 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:18:36.504028    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bd905c9-2601-4b09-93ff-07596c04b509-metrics-tls podName:8bd905c9-2601-4b09-93ff-07596c04b509 nodeName:}" failed. No retries permitted until 2026-09-15 10:18:52.504013133 +0000 UTC m=+65.900105200 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8bd905c9-2601-4b09-93ff-07596c04b509-metrics-tls") pod "dns-default-hqxdd" (UID: "8bd905c9-2601-4b09-93ff-07596c04b509") : secret "dns-default-metrics-tls" not found
Sep 15 10:18:46.336356 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:46.336322    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xbkjk"
Sep 15 10:18:52.422001 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:52.421959    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1798fb5d-8a9d-4068-b960-e371a235b84e-registry-tls\") pod \"image-registry-5bf5cf7cd7-mxp9j\" (UID: \"1798fb5d-8a9d-4068-b960-e371a235b84e\") " pod="openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j"
Sep 15 10:18:52.422388 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:52.422025    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f9ee683b-5f4d-4a00-81d8-affa82ff7362-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-vs4m6\" (UID: \"f9ee683b-5f4d-4a00-81d8-affa82ff7362\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-vs4m6"
Sep 15 10:18:52.424533 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:52.424507    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1798fb5d-8a9d-4068-b960-e371a235b84e-registry-tls\") pod \"image-registry-5bf5cf7cd7-mxp9j\" (UID: \"1798fb5d-8a9d-4068-b960-e371a235b84e\") " pod="openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j"
Sep 15 10:18:52.424597 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:52.424513    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f9ee683b-5f4d-4a00-81d8-affa82ff7362-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-vs4m6\" (UID: \"f9ee683b-5f4d-4a00-81d8-affa82ff7362\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-vs4m6"
Sep 15 10:18:52.522356 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:52.522321    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8bd905c9-2601-4b09-93ff-07596c04b509-metrics-tls\") pod \"dns-default-hqxdd\" (UID: \"8bd905c9-2601-4b09-93ff-07596c04b509\") " pod="openshift-dns/dns-default-hqxdd"
Sep 15 10:18:52.524556 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:52.524537    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8bd905c9-2601-4b09-93ff-07596c04b509-metrics-tls\") pod \"dns-default-hqxdd\" (UID: \"8bd905c9-2601-4b09-93ff-07596c04b509\") " pod="openshift-dns/dns-default-hqxdd"
Sep 15 10:18:52.663671 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:52.663639    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zhqkr\""
Sep 15 10:18:52.671370 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:52.671348    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j"
Sep 15 10:18:52.674415 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:52.674365    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-nz24d\""
Sep 15 10:18:52.683206 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:52.683186    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-vs4m6"
Sep 15 10:18:52.747584 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:52.747414    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-h7d4n\""
Sep 15 10:18:52.755310 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:52.755285    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hqxdd"
Sep 15 10:18:52.824351 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:52.824325    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ecad1164-c9d0-4df5-a0b8-382e33ac5629-original-pull-secret\") pod \"global-pull-secret-syncer-d48mp\" (UID: \"ecad1164-c9d0-4df5-a0b8-382e33ac5629\") " pod="kube-system/global-pull-secret-syncer-d48mp"
Sep 15 10:18:52.827059 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:52.827042    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 15 10:18:52.837003 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:52.836983    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ecad1164-c9d0-4df5-a0b8-382e33ac5629-original-pull-secret\") pod \"global-pull-secret-syncer-d48mp\" (UID: \"ecad1164-c9d0-4df5-a0b8-382e33ac5629\") " pod="kube-system/global-pull-secret-syncer-d48mp"
Sep 15 10:18:52.925452 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:52.925388    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c101b9f1-4c96-416c-b899-fc7eee86e4ea-metrics-certs\") pod \"network-metrics-daemon-hh4zk\" (UID: \"c101b9f1-4c96-416c-b899-fc7eee86e4ea\") " pod="openshift-multus/network-metrics-daemon-hh4zk"
Sep 15 10:18:52.927839 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:52.927817    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 15 10:18:52.937633 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:52.937608    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c101b9f1-4c96-416c-b899-fc7eee86e4ea-metrics-certs\") pod \"network-metrics-daemon-hh4zk\" (UID: \"c101b9f1-4c96-416c-b899-fc7eee86e4ea\") " pod="openshift-multus/network-metrics-daemon-hh4zk"
Sep 15 10:18:52.944750 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:52.944712    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j"]
Sep 15 10:18:52.948244 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:18:52.948215    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1798fb5d_8a9d_4068_b960_e371a235b84e.slice/crio-a3b2d10b8c31adb33707431f07a0df266b29f25e0ee52c73d2d076118d9cf5df WatchSource:0}: Error finding container a3b2d10b8c31adb33707431f07a0df266b29f25e0ee52c73d2d076118d9cf5df: Status 404 returned error can't find the container with id a3b2d10b8c31adb33707431f07a0df266b29f25e0ee52c73d2d076118d9cf5df
Sep 15 10:18:52.961453 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:52.961427    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d48mp"
Sep 15 10:18:52.962784 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:52.962754    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-vs4m6"]
Sep 15 10:18:52.965834 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:18:52.965809    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9ee683b_5f4d_4a00_81d8_affa82ff7362.slice/crio-dfbe576960f5d00ef273aa022b86f1b09d6b1dca4034dbac9e93d81c2d438904 WatchSource:0}: Error finding container dfbe576960f5d00ef273aa022b86f1b09d6b1dca4034dbac9e93d81c2d438904: Status 404 returned error can't find the container with id dfbe576960f5d00ef273aa022b86f1b09d6b1dca4034dbac9e93d81c2d438904
Sep 15 10:18:53.031862 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.031341    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hqxdd"]
Sep 15 10:18:53.043983 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:18:53.043956    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bd905c9_2601_4b09_93ff_07596c04b509.slice/crio-34d4e3b6d252549c74e318801abb7060006bd43690a808b972b10c0798481513 WatchSource:0}: Error finding container 34d4e3b6d252549c74e318801abb7060006bd43690a808b972b10c0798481513: Status 404 returned error can't find the container with id 34d4e3b6d252549c74e318801abb7060006bd43690a808b972b10c0798481513
Sep 15 10:18:53.061251 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.061222    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lrdhd\""
Sep 15 10:18:53.070029 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.070002    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hh4zk"
Sep 15 10:18:53.248322 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.248243    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-d48mp"]
Sep 15 10:18:53.251426 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:18:53.251400    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecad1164_c9d0_4df5_a0b8_382e33ac5629.slice/crio-b9541dfa158ce8f783d2ed18a15940973b6914aefc40beae06ff9ccd536bf5db WatchSource:0}: Error finding container b9541dfa158ce8f783d2ed18a15940973b6914aefc40beae06ff9ccd536bf5db: Status 404 returned error can't find the container with id b9541dfa158ce8f783d2ed18a15940973b6914aefc40beae06ff9ccd536bf5db
Sep 15 10:18:53.353930 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:18:53.353901    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc101b9f1_4c96_416c_b899_fc7eee86e4ea.slice/crio-8592ef6732ac87f6be8cc413a55074623fcfaaac5faa949db004480deb095575 WatchSource:0}: Error finding container 8592ef6732ac87f6be8cc413a55074623fcfaaac5faa949db004480deb095575: Status 404 returned error can't find the container with id 8592ef6732ac87f6be8cc413a55074623fcfaaac5faa949db004480deb095575
Sep 15 10:18:53.354775 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.354716    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hh4zk"]
Sep 15 10:18:53.473184 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.473152    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hh4zk" event={"ID":"c101b9f1-4c96-416c-b899-fc7eee86e4ea","Type":"ContainerStarted","Data":"8592ef6732ac87f6be8cc413a55074623fcfaaac5faa949db004480deb095575"}
Sep 15 10:18:53.474206 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.474177    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hqxdd" event={"ID":"8bd905c9-2601-4b09-93ff-07596c04b509","Type":"ContainerStarted","Data":"34d4e3b6d252549c74e318801abb7060006bd43690a808b972b10c0798481513"}
Sep 15 10:18:53.475210 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.475191    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-vs4m6" event={"ID":"f9ee683b-5f4d-4a00-81d8-affa82ff7362","Type":"ContainerStarted","Data":"dfbe576960f5d00ef273aa022b86f1b09d6b1dca4034dbac9e93d81c2d438904"}
Sep 15 10:18:53.476237 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.476206    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-d48mp" event={"ID":"ecad1164-c9d0-4df5-a0b8-382e33ac5629","Type":"ContainerStarted","Data":"b9541dfa158ce8f783d2ed18a15940973b6914aefc40beae06ff9ccd536bf5db"}
Sep 15 10:18:53.477625 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.477605    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j" event={"ID":"1798fb5d-8a9d-4068-b960-e371a235b84e","Type":"ContainerStarted","Data":"db4ee5e3bc8f0b46ab2d9951babee3c4c338d2dfa2b587b82d8464fc5178d9d4"}
Sep 15 10:18:53.477708 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.477640    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j" event={"ID":"1798fb5d-8a9d-4068-b960-e371a235b84e","Type":"ContainerStarted","Data":"a3b2d10b8c31adb33707431f07a0df266b29f25e0ee52c73d2d076118d9cf5df"}
Sep 15 10:18:53.477708 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.477670    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j"
Sep 15 10:18:53.495676 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.495628    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j" podStartSLOduration=66.495610831 podStartE2EDuration="1m6.495610831s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:17:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:18:53.495014732 +0000 UTC m=+66.891106819" watchObservedRunningTime="2026-09-15 10:18:53.495610831 +0000 UTC m=+66.891702919"
Sep 15 10:18:53.538185 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.538158    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fb7c97ccc-tntd2"]
Sep 15 10:18:53.543310 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.543293    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-pzr7v"]
Sep 15 10:18:53.543424 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.543406    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fb7c97ccc-tntd2"
Sep 15 10:18:53.545960 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.545935    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 15 10:18:53.545960 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.545935    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 15 10:18:53.546125 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.546072    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 15 10:18:53.546182 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.546149    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 15 10:18:53.546417 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.546397    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd57b8cc-nhks9"]
Sep 15 10:18:53.546502 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.546489    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pzr7v"
Sep 15 10:18:53.548569 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.548554    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 15 10:18:53.549756 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.549719    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8685dd494b-7jg6t"]
Sep 15 10:18:53.549853 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.549794    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd57b8cc-nhks9"
Sep 15 10:18:53.550332 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.550312    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 15 10:18:53.550427 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.550345    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 15 10:18:53.550427 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.550382    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-n28nk\""
Sep 15 10:18:53.550427 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.550397    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 15 10:18:53.552256 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.551941    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 15 10:18:53.553049 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.552909    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-pqrzc"]
Sep 15 10:18:53.553153 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.553069    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 15 10:18:53.553228 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.553155    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 15 10:18:53.553601 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.553435    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 15 10:18:53.553709 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.553664    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8685dd494b-7jg6t"
Sep 15 10:18:53.556148 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.556127    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 15 10:18:53.556233 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.556131    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-pzr7v"]
Sep 15 10:18:53.556233 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.556194    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-pqrzc"
Sep 15 10:18:53.556233 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.556222    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8685dd494b-7jg6t"]
Sep 15 10:18:53.556406 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.556242    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fb7c97ccc-tntd2"]
Sep 15 10:18:53.556778 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.556760    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-ttxs7\""
Sep 15 10:18:53.557113 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.557094    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd57b8cc-nhks9"]
Sep 15 10:18:53.558401 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.558352    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 15 10:18:53.558651 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.558631    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-xkzjv\""
Sep 15 10:18:53.559419 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.559243    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 15 10:18:53.559419 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.559312    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 15 10:18:53.559419 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.559317    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 15 10:18:53.564794 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.564774    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 15 10:18:53.572956 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.572931    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-pqrzc"]
Sep 15 10:18:53.636093 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.636059    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4fb7ba56-a242-461d-a7b2-e03daa1b56a4-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-pzr7v\" (UID: \"4fb7ba56-a242-461d-a7b2-e03daa1b56a4\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pzr7v"
Sep 15 10:18:53.636255 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.636125    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d592c77-7bd0-4187-8f90-12c5e8f1dc32-serving-cert\") pod \"console-operator-696884fb9c-pqrzc\" (UID: \"9d592c77-7bd0-4187-8f90-12c5e8f1dc32\") " pod="openshift-console-operator/console-operator-696884fb9c-pqrzc"
Sep 15 10:18:53.636255 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.636177    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bt42\" (UniqueName: \"kubernetes.io/projected/9d592c77-7bd0-4187-8f90-12c5e8f1dc32-kube-api-access-9bt42\") pod \"console-operator-696884fb9c-pqrzc\" (UID: \"9d592c77-7bd0-4187-8f90-12c5e8f1dc32\") " pod="openshift-console-operator/console-operator-696884fb9c-pqrzc"
Sep 15 10:18:53.636255 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.636210    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8dk5\" (UniqueName: \"kubernetes.io/projected/4fb7ba56-a242-461d-a7b2-e03daa1b56a4-kube-api-access-l8dk5\") pod \"cluster-monitoring-operator-6cd954b897-pzr7v\" (UID: \"4fb7ba56-a242-461d-a7b2-e03daa1b56a4\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pzr7v"
Sep 15 10:18:53.636255 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.636247    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d592c77-7bd0-4187-8f90-12c5e8f1dc32-config\") pod \"console-operator-696884fb9c-pqrzc\" (UID: \"9d592c77-7bd0-4187-8f90-12c5e8f1dc32\") " pod="openshift-console-operator/console-operator-696884fb9c-pqrzc"
Sep 15 10:18:53.636454 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.636274    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/276c33fe-d30b-4fda-bc90-753acecda79c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6ccd57b8cc-nhks9\" (UID: \"276c33fe-d30b-4fda-bc90-753acecda79c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd57b8cc-nhks9"
Sep 15 10:18:53.636454 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.636302    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4jtm\" (UniqueName: \"kubernetes.io/projected/276c33fe-d30b-4fda-bc90-753acecda79c-kube-api-access-f4jtm\") pod \"cluster-proxy-proxy-agent-6ccd57b8cc-nhks9\" (UID: \"276c33fe-d30b-4fda-bc90-753acecda79c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd57b8cc-nhks9"
Sep 15 10:18:53.636454 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.636351    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68d20475-4c9c-4209-8479-9c2aae017d2e-tmp\") pod \"klusterlet-addon-workmgr-6fb7c97ccc-tntd2\" (UID: \"68d20475-4c9c-4209-8479-9c2aae017d2e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fb7c97ccc-tntd2"
Sep 15 10:18:53.636454 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.636391    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/276c33fe-d30b-4fda-bc90-753acecda79c-ca\") pod \"cluster-proxy-proxy-agent-6ccd57b8cc-nhks9\" (UID: \"276c33fe-d30b-4fda-bc90-753acecda79c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd57b8cc-nhks9"
Sep 15 10:18:53.636454 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.636422    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/276c33fe-d30b-4fda-bc90-753acecda79c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6ccd57b8cc-nhks9\" (UID: \"276c33fe-d30b-4fda-bc90-753acecda79c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd57b8cc-nhks9"
Sep 15 10:18:53.636454 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.636450    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ea73e653-9e44-449c-96ae-1be8ec98d662-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8685dd494b-7jg6t\" (UID: \"ea73e653-9e44-449c-96ae-1be8ec98d662\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8685dd494b-7jg6t"
Sep 15 10:18:53.636681 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.636475    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/276c33fe-d30b-4fda-bc90-753acecda79c-hub\") pod \"cluster-proxy-proxy-agent-6ccd57b8cc-nhks9\" (UID: \"276c33fe-d30b-4fda-bc90-753acecda79c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd57b8cc-nhks9"
Sep 15 10:18:53.636681 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.636524    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d592c77-7bd0-4187-8f90-12c5e8f1dc32-trusted-ca\") pod \"console-operator-696884fb9c-pqrzc\" (UID: \"9d592c77-7bd0-4187-8f90-12c5e8f1dc32\") " pod="openshift-console-operator/console-operator-696884fb9c-pqrzc"
Sep 15 10:18:53.636681 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.636563    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4fb7ba56-a242-461d-a7b2-e03daa1b56a4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-pzr7v\" (UID: \"4fb7ba56-a242-461d-a7b2-e03daa1b56a4\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pzr7v"
Sep 15 10:18:53.636681 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.636591    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lrfb\" (UniqueName: \"kubernetes.io/projected/ea73e653-9e44-449c-96ae-1be8ec98d662-kube-api-access-9lrfb\") pod \"managed-serviceaccount-addon-agent-8685dd494b-7jg6t\" (UID: \"ea73e653-9e44-449c-96ae-1be8ec98d662\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8685dd494b-7jg6t"
Sep 15 10:18:53.636681 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.636628    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/68d20475-4c9c-4209-8479-9c2aae017d2e-klusterlet-config\") pod \"klusterlet-addon-workmgr-6fb7c97ccc-tntd2\" (UID: \"68d20475-4c9c-4209-8479-9c2aae017d2e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fb7c97ccc-tntd2"
Sep 15 10:18:53.636681 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.636657    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/276c33fe-d30b-4fda-bc90-753acecda79c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6ccd57b8cc-nhks9\" (UID: \"276c33fe-d30b-4fda-bc90-753acecda79c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd57b8cc-nhks9"
Sep 15 10:18:53.636905 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.636702    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bd966\" (UniqueName: \"kubernetes.io/projected/68d20475-4c9c-4209-8479-9c2aae017d2e-kube-api-access-bd966\") pod \"klusterlet-addon-workmgr-6fb7c97ccc-tntd2\" (UID: \"68d20475-4c9c-4209-8479-9c2aae017d2e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fb7c97ccc-tntd2"
Sep 15 10:18:53.657070 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.657039    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-5d69f"]
Sep 15 10:18:53.660484 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.660456    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-rd8n7"]
Sep 15 10:18:53.661178 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.661157    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-5d69f"
Sep 15 10:18:53.663688 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.663671    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 15 10:18:53.663852 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.663837    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5844b856db-8tffb"]
Sep 15 10:18:53.663927 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.663814    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-6cf58\""
Sep 15 10:18:53.663927 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.663916    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 15 10:18:53.664778 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.663926    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-rd8n7"
Sep 15 10:18:53.667021 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.667003    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7594c67c56-ww8nk"]
Sep 15 10:18:53.667129 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.667111    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-8tffb"
Sep 15 10:18:53.669100 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.669035    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 15 10:18:53.669398 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.669378    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 15 10:18:53.669535 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.669441    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 15 10:18:53.669850 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.669833    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-mtbvs\""
Sep 15 10:18:53.670389 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.670261    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7594c67c56-ww8nk"
Sep 15 10:18:53.670677 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.670660    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 15 10:18:53.671174 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.671156    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 15 10:18:53.671296 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.671232    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 15 10:18:53.671359 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.671290    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-7pstd\""
Sep 15 10:18:53.671412 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.671346    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 15 10:18:53.671657 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.671632    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-5d69f"]
Sep 15 10:18:53.672854 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.672833    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-pdsnj\""
Sep 15 10:18:53.674182 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.674163    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 15 10:18:53.674536 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.674519    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 15 10:18:53.674698 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.674678    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 15 10:18:53.674985 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.674970    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 15 10:18:53.675261 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.675240    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 15 10:18:53.675467 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.675450    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 15 10:18:53.675897 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.675848    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-8tffb"]
Sep 15 10:18:53.675897 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.675889    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-rd8n7"]
Sep 15 10:18:53.679161 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.679137    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 15 10:18:53.679754 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.679718    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7594c67c56-ww8nk"]
Sep 15 10:18:53.737334 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.737282    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd966\" (UniqueName: \"kubernetes.io/projected/68d20475-4c9c-4209-8479-9c2aae017d2e-kube-api-access-bd966\") pod \"klusterlet-addon-workmgr-6fb7c97ccc-tntd2\" (UID: \"68d20475-4c9c-4209-8479-9c2aae017d2e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fb7c97ccc-tntd2"
Sep 15 10:18:53.737514 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.737417    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4fb7ba56-a242-461d-a7b2-e03daa1b56a4-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-pzr7v\" (UID: \"4fb7ba56-a242-461d-a7b2-e03daa1b56a4\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pzr7v"
Sep 15 10:18:53.737514 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.737468    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fc61ef2f-aa66-46c2-b5b9-59f2cc500775-snapshots\") pod \"insights-operator-5844b856db-8tffb\" (UID: \"fc61ef2f-aa66-46c2-b5b9-59f2cc500775\") " pod="openshift-insights/insights-operator-5844b856db-8tffb"
Sep 15 10:18:53.737514 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.737498    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rhft\" (UniqueName: \"kubernetes.io/projected/5a686d3b-f162-4b86-8f8e-b0f9871c0375-kube-api-access-2rhft\") pod \"volume-data-source-validator-86695b7cc7-5d69f\" (UID: \"5a686d3b-f162-4b86-8f8e-b0f9871c0375\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-5d69f"
Sep 15 10:18:53.737682 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.737522    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fc61ef2f-aa66-46c2-b5b9-59f2cc500775-serving-cert\") pod \"insights-operator-5844b856db-8tffb\" (UID: \"fc61ef2f-aa66-46c2-b5b9-59f2cc500775\") " pod="openshift-insights/insights-operator-5844b856db-8tffb"
Sep 15 10:18:53.737682 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.737551    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e50e72a0-48f2-4d2d-9490-1e77265c84b6-metrics-certs\") pod \"router-default-7594c67c56-ww8nk\" (UID: \"e50e72a0-48f2-4d2d-9490-1e77265c84b6\") " pod="openshift-ingress/router-default-7594c67c56-ww8nk"
Sep 15 10:18:53.737682 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.737578    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc61ef2f-aa66-46c2-b5b9-59f2cc500775-trusted-ca-bundle\") pod \"insights-operator-5844b856db-8tffb\" (UID: \"fc61ef2f-aa66-46c2-b5b9-59f2cc500775\") " pod="openshift-insights/insights-operator-5844b856db-8tffb"
Sep 15 10:18:53.737682 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.737611    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d592c77-7bd0-4187-8f90-12c5e8f1dc32-serving-cert\") pod \"console-operator-696884fb9c-pqrzc\" (UID: \"9d592c77-7bd0-4187-8f90-12c5e8f1dc32\") " pod="openshift-console-operator/console-operator-696884fb9c-pqrzc"
Sep 15 10:18:53.737682 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.737636    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc61ef2f-aa66-46c2-b5b9-59f2cc500775-service-ca-bundle\") pod \"insights-operator-5844b856db-8tffb\" (UID: \"fc61ef2f-aa66-46c2-b5b9-59f2cc500775\") " pod="openshift-insights/insights-operator-5844b856db-8tffb"
Sep 15 10:18:53.737682 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.737662    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxwqt\" (UniqueName: \"kubernetes.io/projected/e50e72a0-48f2-4d2d-9490-1e77265c84b6-kube-api-access-rxwqt\") pod \"router-default-7594c67c56-ww8nk\" (UID: \"e50e72a0-48f2-4d2d-9490-1e77265c84b6\") " pod="openshift-ingress/router-default-7594c67c56-ww8nk"
Sep 15 10:18:53.738701 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.737690    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bt42\" (UniqueName: \"kubernetes.io/projected/9d592c77-7bd0-4187-8f90-12c5e8f1dc32-kube-api-access-9bt42\") pod \"console-operator-696884fb9c-pqrzc\" (UID: \"9d592c77-7bd0-4187-8f90-12c5e8f1dc32\") " pod="openshift-console-operator/console-operator-696884fb9c-pqrzc"
Sep 15 10:18:53.738701 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.737716    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e50e72a0-48f2-4d2d-9490-1e77265c84b6-service-ca-bundle\") pod \"router-default-7594c67c56-ww8nk\" (UID: \"e50e72a0-48f2-4d2d-9490-1e77265c84b6\") " pod="openshift-ingress/router-default-7594c67c56-ww8nk"
Sep 15 10:18:53.738701 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.737765    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8dk5\" (UniqueName: \"kubernetes.io/projected/4fb7ba56-a242-461d-a7b2-e03daa1b56a4-kube-api-access-l8dk5\") pod \"cluster-monitoring-operator-6cd954b897-pzr7v\" (UID: \"4fb7ba56-a242-461d-a7b2-e03daa1b56a4\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pzr7v"
Sep 15 10:18:53.738701 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.737821    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d592c77-7bd0-4187-8f90-12c5e8f1dc32-config\") pod \"console-operator-696884fb9c-pqrzc\" (UID: \"9d592c77-7bd0-4187-8f90-12c5e8f1dc32\") " pod="openshift-console-operator/console-operator-696884fb9c-pqrzc"
Sep 15 10:18:53.738701 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.737860    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/276c33fe-d30b-4fda-bc90-753acecda79c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6ccd57b8cc-nhks9\" (UID: \"276c33fe-d30b-4fda-bc90-753acecda79c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd57b8cc-nhks9"
Sep 15 10:18:53.738701 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.737887    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4jtm\" (UniqueName: \"kubernetes.io/projected/276c33fe-d30b-4fda-bc90-753acecda79c-kube-api-access-f4jtm\") pod \"cluster-proxy-proxy-agent-6ccd57b8cc-nhks9\" (UID: \"276c33fe-d30b-4fda-bc90-753acecda79c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd57b8cc-nhks9"
Sep 15 10:18:53.738701 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.737916    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68d20475-4c9c-4209-8479-9c2aae017d2e-tmp\") pod \"klusterlet-addon-workmgr-6fb7c97ccc-tntd2\" (UID: \"68d20475-4c9c-4209-8479-9c2aae017d2e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fb7c97ccc-tntd2"
Sep 15 10:18:53.738701 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.737943    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e50e72a0-48f2-4d2d-9490-1e77265c84b6-default-certificate\") pod \"router-default-7594c67c56-ww8nk\" (UID: \"e50e72a0-48f2-4d2d-9490-1e77265c84b6\") " pod="openshift-ingress/router-default-7594c67c56-ww8nk"
Sep 15 10:18:53.738701 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.737976    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/276c33fe-d30b-4fda-bc90-753acecda79c-ca\") pod \"cluster-proxy-proxy-agent-6ccd57b8cc-nhks9\" (UID: \"276c33fe-d30b-4fda-bc90-753acecda79c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd57b8cc-nhks9"
Sep 15 10:18:53.738701 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.738004    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/276c33fe-d30b-4fda-bc90-753acecda79c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6ccd57b8cc-nhks9\" (UID: \"276c33fe-d30b-4fda-bc90-753acecda79c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd57b8cc-nhks9"
Sep 15 10:18:53.738701 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.738039    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ea73e653-9e44-449c-96ae-1be8ec98d662-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8685dd494b-7jg6t\" (UID: \"ea73e653-9e44-449c-96ae-1be8ec98d662\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8685dd494b-7jg6t"
Sep 15 10:18:53.738701 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.738094    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/276c33fe-d30b-4fda-bc90-753acecda79c-hub\") pod \"cluster-proxy-proxy-agent-6ccd57b8cc-nhks9\" (UID: \"276c33fe-d30b-4fda-bc90-753acecda79c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd57b8cc-nhks9"
Sep 15 10:18:53.738701 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.738119    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e50e72a0-48f2-4d2d-9490-1e77265c84b6-stats-auth\") pod \"router-default-7594c67c56-ww8nk\" (UID: \"e50e72a0-48f2-4d2d-9490-1e77265c84b6\") " pod="openshift-ingress/router-default-7594c67c56-ww8nk"
Sep 15 10:18:53.738701 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.738376    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4fb7ba56-a242-461d-a7b2-e03daa1b56a4-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-pzr7v\" (UID: \"4fb7ba56-a242-461d-a7b2-e03daa1b56a4\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pzr7v"
Sep 15 10:18:53.738701 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.738407    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68d20475-4c9c-4209-8479-9c2aae017d2e-tmp\") pod \"klusterlet-addon-workmgr-6fb7c97ccc-tntd2\" (UID: \"68d20475-4c9c-4209-8479-9c2aae017d2e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fb7c97ccc-tntd2"
Sep 15 10:18:53.739478 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.738814    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/276c33fe-d30b-4fda-bc90-753acecda79c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6ccd57b8cc-nhks9\" (UID: \"276c33fe-d30b-4fda-bc90-753acecda79c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd57b8cc-nhks9"
Sep 15 10:18:53.739478 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.738901    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d592c77-7bd0-4187-8f90-12c5e8f1dc32-trusted-ca\") pod \"console-operator-696884fb9c-pqrzc\" (UID: \"9d592c77-7bd0-4187-8f90-12c5e8f1dc32\") " pod="openshift-console-operator/console-operator-696884fb9c-pqrzc"
Sep 15 10:18:53.739478 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.739031    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d592c77-7bd0-4187-8f90-12c5e8f1dc32-config\") pod \"console-operator-696884fb9c-pqrzc\" (UID: \"9d592c77-7bd0-4187-8f90-12c5e8f1dc32\") " pod="openshift-console-operator/console-operator-696884fb9c-pqrzc"
Sep 15 10:18:53.739632 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.739487    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4fb7ba56-a242-461d-a7b2-e03daa1b56a4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-pzr7v\" (UID: \"4fb7ba56-a242-461d-a7b2-e03daa1b56a4\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pzr7v"
Sep 15 10:18:53.739632 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.739542    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lrfb\" (UniqueName: \"kubernetes.io/projected/ea73e653-9e44-449c-96ae-1be8ec98d662-kube-api-access-9lrfb\") pod \"managed-serviceaccount-addon-agent-8685dd494b-7jg6t\" (UID: \"ea73e653-9e44-449c-96ae-1be8ec98d662\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8685dd494b-7jg6t"
Sep 15 10:18:53.739632 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.739591    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc61ef2f-aa66-46c2-b5b9-59f2cc500775-tmp\") pod \"insights-operator-5844b856db-8tffb\" (UID: \"fc61ef2f-aa66-46c2-b5b9-59f2cc500775\") " pod="openshift-insights/insights-operator-5844b856db-8tffb"
Sep 15 10:18:53.739632 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.739618    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wzmp\" (UniqueName: \"kubernetes.io/projected/08c4e9b7-353b-449a-b64d-a7ec5d83fbe3-kube-api-access-9wzmp\") pod \"cluster-samples-operator-86499c89c4-rd8n7\" (UID: \"08c4e9b7-353b-449a-b64d-a7ec5d83fbe3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-rd8n7"
Sep 15 10:18:53.739862 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.739752    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d592c77-7bd0-4187-8f90-12c5e8f1dc32-trusted-ca\") pod \"console-operator-696884fb9c-pqrzc\" (UID: \"9d592c77-7bd0-4187-8f90-12c5e8f1dc32\") " pod="openshift-console-operator/console-operator-696884fb9c-pqrzc"
Sep 15 10:18:53.739942 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.739920    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/68d20475-4c9c-4209-8479-9c2aae017d2e-klusterlet-config\") pod \"klusterlet-addon-workmgr-6fb7c97ccc-tntd2\" (UID: \"68d20475-4c9c-4209-8479-9c2aae017d2e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fb7c97ccc-tntd2"
Sep 15 10:18:53.740304 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.740105    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcfzd\" (UniqueName: \"kubernetes.io/projected/fc61ef2f-aa66-46c2-b5b9-59f2cc500775-kube-api-access-zcfzd\") pod \"insights-operator-5844b856db-8tffb\" (UID: \"fc61ef2f-aa66-46c2-b5b9-59f2cc500775\") " pod="openshift-insights/insights-operator-5844b856db-8tffb"
Sep 15 10:18:53.740304 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.740139    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/08c4e9b7-353b-449a-b64d-a7ec5d83fbe3-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-rd8n7\" (UID: \"08c4e9b7-353b-449a-b64d-a7ec5d83fbe3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-rd8n7"
Sep 15 10:18:53.740304 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.740190    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/276c33fe-d30b-4fda-bc90-753acecda79c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6ccd57b8cc-nhks9\" (UID: \"276c33fe-d30b-4fda-bc90-753acecda79c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd57b8cc-nhks9"
Sep 15 10:18:53.743702 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.743102    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4fb7ba56-a242-461d-a7b2-e03daa1b56a4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-pzr7v\" (UID: \"4fb7ba56-a242-461d-a7b2-e03daa1b56a4\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pzr7v"
Sep 15 10:18:53.743702 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.743212    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d592c77-7bd0-4187-8f90-12c5e8f1dc32-serving-cert\") pod \"console-operator-696884fb9c-pqrzc\" (UID: \"9d592c77-7bd0-4187-8f90-12c5e8f1dc32\") " pod="openshift-console-operator/console-operator-696884fb9c-pqrzc"
Sep 15 10:18:53.743702 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.743239    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/276c33fe-d30b-4fda-bc90-753acecda79c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6ccd57b8cc-nhks9\" (UID: \"276c33fe-d30b-4fda-bc90-753acecda79c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd57b8cc-nhks9"
Sep 15 10:18:53.743702 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.743499    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ea73e653-9e44-449c-96ae-1be8ec98d662-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8685dd494b-7jg6t\" (UID: \"ea73e653-9e44-449c-96ae-1be8ec98d662\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8685dd494b-7jg6t"
Sep 15 10:18:53.743702 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.743658    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/68d20475-4c9c-4209-8479-9c2aae017d2e-klusterlet-config\") pod \"klusterlet-addon-workmgr-6fb7c97ccc-tntd2\" (UID: \"68d20475-4c9c-4209-8479-9c2aae017d2e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fb7c97ccc-tntd2"
Sep 15 10:18:53.744522 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.744483    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/276c33fe-d30b-4fda-bc90-753acecda79c-hub\") pod \"cluster-proxy-proxy-agent-6ccd57b8cc-nhks9\" (UID: \"276c33fe-d30b-4fda-bc90-753acecda79c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd57b8cc-nhks9"
Sep 15 10:18:53.745069 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.745020    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/276c33fe-d30b-4fda-bc90-753acecda79c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6ccd57b8cc-nhks9\" (UID: \"276c33fe-d30b-4fda-bc90-753acecda79c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd57b8cc-nhks9"
Sep 15 10:18:53.745299 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.745272    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/276c33fe-d30b-4fda-bc90-753acecda79c-ca\") pod \"cluster-proxy-proxy-agent-6ccd57b8cc-nhks9\" (UID: \"276c33fe-d30b-4fda-bc90-753acecda79c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd57b8cc-nhks9"
Sep 15 10:18:53.759084 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.758995    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8dk5\" (UniqueName: \"kubernetes.io/projected/4fb7ba56-a242-461d-a7b2-e03daa1b56a4-kube-api-access-l8dk5\") pod \"cluster-monitoring-operator-6cd954b897-pzr7v\" (UID: \"4fb7ba56-a242-461d-a7b2-e03daa1b56a4\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pzr7v"
Sep 15 10:18:53.759404 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.759109    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bt42\" (UniqueName: \"kubernetes.io/projected/9d592c77-7bd0-4187-8f90-12c5e8f1dc32-kube-api-access-9bt42\") pod \"console-operator-696884fb9c-pqrzc\" (UID: \"9d592c77-7bd0-4187-8f90-12c5e8f1dc32\") " pod="openshift-console-operator/console-operator-696884fb9c-pqrzc"
Sep 15 10:18:53.759404 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.759245    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lrfb\" (UniqueName: \"kubernetes.io/projected/ea73e653-9e44-449c-96ae-1be8ec98d662-kube-api-access-9lrfb\") pod \"managed-serviceaccount-addon-agent-8685dd494b-7jg6t\" (UID: \"ea73e653-9e44-449c-96ae-1be8ec98d662\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8685dd494b-7jg6t"
Sep 15 10:18:53.760362 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.760343    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4jtm\" (UniqueName: \"kubernetes.io/projected/276c33fe-d30b-4fda-bc90-753acecda79c-kube-api-access-f4jtm\") pod \"cluster-proxy-proxy-agent-6ccd57b8cc-nhks9\" (UID: \"276c33fe-d30b-4fda-bc90-753acecda79c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd57b8cc-nhks9"
Sep 15 10:18:53.761272 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.761232    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bd966\" (UniqueName: \"kubernetes.io/projected/68d20475-4c9c-4209-8479-9c2aae017d2e-kube-api-access-bd966\") pod \"klusterlet-addon-workmgr-6fb7c97ccc-tntd2\" (UID: \"68d20475-4c9c-4209-8479-9c2aae017d2e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fb7c97ccc-tntd2"
Sep 15 10:18:53.841978 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.841511    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e50e72a0-48f2-4d2d-9490-1e77265c84b6-service-ca-bundle\") pod \"router-default-7594c67c56-ww8nk\" (UID: \"e50e72a0-48f2-4d2d-9490-1e77265c84b6\") " pod="openshift-ingress/router-default-7594c67c56-ww8nk"
Sep 15 10:18:53.841978 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.841576    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e50e72a0-48f2-4d2d-9490-1e77265c84b6-default-certificate\") pod \"router-default-7594c67c56-ww8nk\" (UID: \"e50e72a0-48f2-4d2d-9490-1e77265c84b6\") " pod="openshift-ingress/router-default-7594c67c56-ww8nk"
Sep 15 10:18:53.841978 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.841611    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e50e72a0-48f2-4d2d-9490-1e77265c84b6-stats-auth\") pod \"router-default-7594c67c56-ww8nk\" (UID: \"e50e72a0-48f2-4d2d-9490-1e77265c84b6\") " pod="openshift-ingress/router-default-7594c67c56-ww8nk"
Sep 15 10:18:53.841978 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.841647    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc61ef2f-aa66-46c2-b5b9-59f2cc500775-tmp\") pod \"insights-operator-5844b856db-8tffb\" (UID: \"fc61ef2f-aa66-46c2-b5b9-59f2cc500775\") " pod="openshift-insights/insights-operator-5844b856db-8tffb"
Sep 15 10:18:53.841978 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.841672    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wzmp\" (UniqueName: \"kubernetes.io/projected/08c4e9b7-353b-449a-b64d-a7ec5d83fbe3-kube-api-access-9wzmp\") pod \"cluster-samples-operator-86499c89c4-rd8n7\" (UID: \"08c4e9b7-353b-449a-b64d-a7ec5d83fbe3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-rd8n7"
Sep 15 10:18:53.841978 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.841748    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcfzd\" (UniqueName: \"kubernetes.io/projected/fc61ef2f-aa66-46c2-b5b9-59f2cc500775-kube-api-access-zcfzd\") pod \"insights-operator-5844b856db-8tffb\" (UID: \"fc61ef2f-aa66-46c2-b5b9-59f2cc500775\") " pod="openshift-insights/insights-operator-5844b856db-8tffb"
Sep 15 10:18:53.841978 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.841776    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/08c4e9b7-353b-449a-b64d-a7ec5d83fbe3-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-rd8n7\" (UID: \"08c4e9b7-353b-449a-b64d-a7ec5d83fbe3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-rd8n7"
Sep 15 10:18:53.841978 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.841821    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fc61ef2f-aa66-46c2-b5b9-59f2cc500775-snapshots\") pod \"insights-operator-5844b856db-8tffb\" (UID: \"fc61ef2f-aa66-46c2-b5b9-59f2cc500775\") " pod="openshift-insights/insights-operator-5844b856db-8tffb"
Sep 15 10:18:53.841978 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.841854    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rhft\" (UniqueName: \"kubernetes.io/projected/5a686d3b-f162-4b86-8f8e-b0f9871c0375-kube-api-access-2rhft\") pod \"volume-data-source-validator-86695b7cc7-5d69f\" (UID: \"5a686d3b-f162-4b86-8f8e-b0f9871c0375\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-5d69f"
Sep 15 10:18:53.841978 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.841882    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fc61ef2f-aa66-46c2-b5b9-59f2cc500775-serving-cert\") pod \"insights-operator-5844b856db-8tffb\" (UID: \"fc61ef2f-aa66-46c2-b5b9-59f2cc500775\") " pod="openshift-insights/insights-operator-5844b856db-8tffb"
Sep 15 10:18:53.841978 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.841906    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e50e72a0-48f2-4d2d-9490-1e77265c84b6-metrics-certs\") pod \"router-default-7594c67c56-ww8nk\" (UID: \"e50e72a0-48f2-4d2d-9490-1e77265c84b6\") " pod="openshift-ingress/router-default-7594c67c56-ww8nk"
Sep 15 10:18:53.841978 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.841932    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc61ef2f-aa66-46c2-b5b9-59f2cc500775-trusted-ca-bundle\") pod \"insights-operator-5844b856db-8tffb\" (UID: \"fc61ef2f-aa66-46c2-b5b9-59f2cc500775\") " pod="openshift-insights/insights-operator-5844b856db-8tffb"
Sep 15 10:18:53.841978 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.841973    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc61ef2f-aa66-46c2-b5b9-59f2cc500775-service-ca-bundle\") pod \"insights-operator-5844b856db-8tffb\" (UID: \"fc61ef2f-aa66-46c2-b5b9-59f2cc500775\") " pod="openshift-insights/insights-operator-5844b856db-8tffb"
Sep 15 10:18:53.842718 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.841996    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxwqt\" (UniqueName: \"kubernetes.io/projected/e50e72a0-48f2-4d2d-9490-1e77265c84b6-kube-api-access-rxwqt\") pod \"router-default-7594c67c56-ww8nk\" (UID: \"e50e72a0-48f2-4d2d-9490-1e77265c84b6\") " pod="openshift-ingress/router-default-7594c67c56-ww8nk"
Sep 15 10:18:53.842718 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.842464    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e50e72a0-48f2-4d2d-9490-1e77265c84b6-service-ca-bundle\") pod \"router-default-7594c67c56-ww8nk\" (UID: \"e50e72a0-48f2-4d2d-9490-1e77265c84b6\") " pod="openshift-ingress/router-default-7594c67c56-ww8nk"
Sep 15 10:18:53.843155 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.843093    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fc61ef2f-aa66-46c2-b5b9-59f2cc500775-snapshots\") pod \"insights-operator-5844b856db-8tffb\" (UID: \"fc61ef2f-aa66-46c2-b5b9-59f2cc500775\") " pod="openshift-insights/insights-operator-5844b856db-8tffb"
Sep 15 10:18:53.843571 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.843344    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc61ef2f-aa66-46c2-b5b9-59f2cc500775-tmp\") pod \"insights-operator-5844b856db-8tffb\" (UID: \"fc61ef2f-aa66-46c2-b5b9-59f2cc500775\") " pod="openshift-insights/insights-operator-5844b856db-8tffb"
Sep 15 10:18:53.844552 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.844471    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc61ef2f-aa66-46c2-b5b9-59f2cc500775-service-ca-bundle\") pod \"insights-operator-5844b856db-8tffb\" (UID: \"fc61ef2f-aa66-46c2-b5b9-59f2cc500775\") " pod="openshift-insights/insights-operator-5844b856db-8tffb"
Sep 15 10:18:53.844650 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.844608    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc61ef2f-aa66-46c2-b5b9-59f2cc500775-trusted-ca-bundle\") pod \"insights-operator-5844b856db-8tffb\" (UID: \"fc61ef2f-aa66-46c2-b5b9-59f2cc500775\") " pod="openshift-insights/insights-operator-5844b856db-8tffb"
Sep 15 10:18:53.846132 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.846109    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e50e72a0-48f2-4d2d-9490-1e77265c84b6-stats-auth\") pod \"router-default-7594c67c56-ww8nk\" (UID: \"e50e72a0-48f2-4d2d-9490-1e77265c84b6\") " pod="openshift-ingress/router-default-7594c67c56-ww8nk"
Sep 15 10:18:53.846218 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.846138    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e50e72a0-48f2-4d2d-9490-1e77265c84b6-metrics-certs\") pod \"router-default-7594c67c56-ww8nk\" (UID: \"e50e72a0-48f2-4d2d-9490-1e77265c84b6\") " pod="openshift-ingress/router-default-7594c67c56-ww8nk"
Sep 15 10:18:53.847618 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.847570    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e50e72a0-48f2-4d2d-9490-1e77265c84b6-default-certificate\") pod \"router-default-7594c67c56-ww8nk\" (UID: \"e50e72a0-48f2-4d2d-9490-1e77265c84b6\") " pod="openshift-ingress/router-default-7594c67c56-ww8nk"
Sep 15 10:18:53.848513 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.848490    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fc61ef2f-aa66-46c2-b5b9-59f2cc500775-serving-cert\") pod \"insights-operator-5844b856db-8tffb\" (UID: \"fc61ef2f-aa66-46c2-b5b9-59f2cc500775\") " pod="openshift-insights/insights-operator-5844b856db-8tffb"
Sep 15 10:18:53.849103 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.849082    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/08c4e9b7-353b-449a-b64d-a7ec5d83fbe3-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-rd8n7\" (UID: \"08c4e9b7-353b-449a-b64d-a7ec5d83fbe3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-rd8n7"
Sep 15 10:18:53.855880 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.855690    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rhft\" (UniqueName: \"kubernetes.io/projected/5a686d3b-f162-4b86-8f8e-b0f9871c0375-kube-api-access-2rhft\") pod \"volume-data-source-validator-86695b7cc7-5d69f\" (UID: \"5a686d3b-f162-4b86-8f8e-b0f9871c0375\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-5d69f"
Sep 15 10:18:53.855985 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.855885    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fb7c97ccc-tntd2"
Sep 15 10:18:53.856060 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.856037    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wzmp\" (UniqueName: \"kubernetes.io/projected/08c4e9b7-353b-449a-b64d-a7ec5d83fbe3-kube-api-access-9wzmp\") pod \"cluster-samples-operator-86499c89c4-rd8n7\" (UID: \"08c4e9b7-353b-449a-b64d-a7ec5d83fbe3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-rd8n7"
Sep 15 10:18:53.858240 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.858187    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxwqt\" (UniqueName: \"kubernetes.io/projected/e50e72a0-48f2-4d2d-9490-1e77265c84b6-kube-api-access-rxwqt\") pod \"router-default-7594c67c56-ww8nk\" (UID: \"e50e72a0-48f2-4d2d-9490-1e77265c84b6\") " pod="openshift-ingress/router-default-7594c67c56-ww8nk"
Sep 15 10:18:53.858338 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.858245    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcfzd\" (UniqueName: \"kubernetes.io/projected/fc61ef2f-aa66-46c2-b5b9-59f2cc500775-kube-api-access-zcfzd\") pod \"insights-operator-5844b856db-8tffb\" (UID: \"fc61ef2f-aa66-46c2-b5b9-59f2cc500775\") " pod="openshift-insights/insights-operator-5844b856db-8tffb"
Sep 15 10:18:53.865361 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.865335    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pzr7v"
Sep 15 10:18:53.884490 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.884463    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd57b8cc-nhks9"
Sep 15 10:18:53.890460 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.890291    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8685dd494b-7jg6t"
Sep 15 10:18:53.906130 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.905851    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-pqrzc"
Sep 15 10:18:53.978993 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.978705    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-5d69f"
Sep 15 10:18:53.987684 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.987477    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-rd8n7"
Sep 15 10:18:53.996897 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:53.996688    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-8tffb"
Sep 15 10:18:54.003278 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:54.002628    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7594c67c56-ww8nk"
Sep 15 10:18:54.158175 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:54.157312    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fb7c97ccc-tntd2"]
Sep 15 10:18:54.174503 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:54.174422    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-pzr7v"]
Sep 15 10:18:54.204172 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:54.204100    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd57b8cc-nhks9"]
Sep 15 10:18:54.208673 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:54.208644    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-pqrzc"]
Sep 15 10:18:54.238340 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:54.238277    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8685dd494b-7jg6t"]
Sep 15 10:18:54.290250 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:54.290221    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-5d69f"]
Sep 15 10:18:54.315424 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:54.314477    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-rd8n7"]
Sep 15 10:18:54.338397 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:54.338329    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7594c67c56-ww8nk"]
Sep 15 10:18:54.358082 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:54.358010    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-8tffb"]
Sep 15 10:18:54.597416 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:18:54.597371    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podea73e653_9e44_449c_96ae_1be8ec98d662.slice/crio-096f22f1ed53a85bd0a1581651d2be474eda1e7a09f4495e635dcbce11502338 WatchSource:0}: Error finding container 096f22f1ed53a85bd0a1581651d2be474eda1e7a09f4495e635dcbce11502338: Status 404 returned error can't find the container with id 096f22f1ed53a85bd0a1581651d2be474eda1e7a09f4495e635dcbce11502338
Sep 15 10:18:54.599250 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:18:54.599220    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68d20475_4c9c_4209_8479_9c2aae017d2e.slice/crio-f10c0682e4f3103a436039c7786091a0bb8fa1f32a41201964c866ae00af9d28 WatchSource:0}: Error finding container f10c0682e4f3103a436039c7786091a0bb8fa1f32a41201964c866ae00af9d28: Status 404 returned error can't find the container with id f10c0682e4f3103a436039c7786091a0bb8fa1f32a41201964c866ae00af9d28
Sep 15 10:18:54.599711 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:18:54.599689    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode50e72a0_48f2_4d2d_9490_1e77265c84b6.slice/crio-ee04aa230e5a57ec4c6ccd0e244300d8d73893cf93ea031718b757d2c277c530 WatchSource:0}: Error finding container ee04aa230e5a57ec4c6ccd0e244300d8d73893cf93ea031718b757d2c277c530: Status 404 returned error can't find the container with id ee04aa230e5a57ec4c6ccd0e244300d8d73893cf93ea031718b757d2c277c530
Sep 15 10:18:54.604146 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:18:54.604124    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fb7ba56_a242_461d_a7b2_e03daa1b56a4.slice/crio-927524a47597f03357b89eb2837b7049bd0b84b77743092ae060bb4d0bed591c WatchSource:0}: Error finding container 927524a47597f03357b89eb2837b7049bd0b84b77743092ae060bb4d0bed591c: Status 404 returned error can't find the container with id 927524a47597f03357b89eb2837b7049bd0b84b77743092ae060bb4d0bed591c
Sep 15 10:18:54.604761 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:18:54.604702    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a686d3b_f162_4b86_8f8e_b0f9871c0375.slice/crio-fc776ebefa5b49c6e977dd8d8edd0a2b69f4832d789b76bdb9bbe358ce820f74 WatchSource:0}: Error finding container fc776ebefa5b49c6e977dd8d8edd0a2b69f4832d789b76bdb9bbe358ce820f74: Status 404 returned error can't find the container with id fc776ebefa5b49c6e977dd8d8edd0a2b69f4832d789b76bdb9bbe358ce820f74
Sep 15 10:18:55.490069 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:55.489948    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-8tffb" event={"ID":"fc61ef2f-aa66-46c2-b5b9-59f2cc500775","Type":"ContainerStarted","Data":"b5acf0044563f5b9f055b7a731a3c77b89a93648e372fe67feb0fd1d672e3709"}
Sep 15 10:18:55.491385 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:55.491353    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd57b8cc-nhks9" event={"ID":"276c33fe-d30b-4fda-bc90-753acecda79c","Type":"ContainerStarted","Data":"f0eeea2ab6547d930fc47d4597f8f43b346f44dc7f3316e94f0adba3749411d3"}
Sep 15 10:18:55.492634 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:55.492612    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-rd8n7" event={"ID":"08c4e9b7-353b-449a-b64d-a7ec5d83fbe3","Type":"ContainerStarted","Data":"e6ec824a1d366110551fcc44a569885ca6454de05f8f2ffdf1b4c6a39b5197a6"}
Sep 15 10:18:55.493970 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:55.493934    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-pqrzc" event={"ID":"9d592c77-7bd0-4187-8f90-12c5e8f1dc32","Type":"ContainerStarted","Data":"174be3168ec3e6929db6fc88b987e05ea38dafa5a413df5314a943609b6a1637"}
Sep 15 10:18:55.495779 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:55.495752    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7594c67c56-ww8nk" event={"ID":"e50e72a0-48f2-4d2d-9490-1e77265c84b6","Type":"ContainerStarted","Data":"ee04aa230e5a57ec4c6ccd0e244300d8d73893cf93ea031718b757d2c277c530"}
Sep 15 10:18:55.497142 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:55.497115    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8685dd494b-7jg6t" event={"ID":"ea73e653-9e44-449c-96ae-1be8ec98d662","Type":"ContainerStarted","Data":"096f22f1ed53a85bd0a1581651d2be474eda1e7a09f4495e635dcbce11502338"}
Sep 15 10:18:55.498680 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:55.498652    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pzr7v" event={"ID":"4fb7ba56-a242-461d-a7b2-e03daa1b56a4","Type":"ContainerStarted","Data":"927524a47597f03357b89eb2837b7049bd0b84b77743092ae060bb4d0bed591c"}
Sep 15 10:18:55.500272 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:55.500225    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-5d69f" event={"ID":"5a686d3b-f162-4b86-8f8e-b0f9871c0375","Type":"ContainerStarted","Data":"fc776ebefa5b49c6e977dd8d8edd0a2b69f4832d789b76bdb9bbe358ce820f74"}
Sep 15 10:18:55.502394 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:55.502367    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fb7c97ccc-tntd2" event={"ID":"68d20475-4c9c-4209-8479-9c2aae017d2e","Type":"ContainerStarted","Data":"f10c0682e4f3103a436039c7786091a0bb8fa1f32a41201964c866ae00af9d28"}
Sep 15 10:18:56.518752 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:56.518148    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hqxdd" event={"ID":"8bd905c9-2601-4b09-93ff-07596c04b509","Type":"ContainerStarted","Data":"4c78d7aa8c1b2f61a4e8fe5ffc10aba62a3623d11185d0f4245f42f48d6e6c3d"}
Sep 15 10:18:56.518752 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:56.518256    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hqxdd" event={"ID":"8bd905c9-2601-4b09-93ff-07596c04b509","Type":"ContainerStarted","Data":"990652e82a3e96fa545f9ac31a57182caaa3e8ababb33f1a6044a354a7e5a237"}
Sep 15 10:18:56.519812 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:56.519372    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hqxdd"
Sep 15 10:18:56.536212 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:56.536123    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hqxdd" podStartSLOduration=34.088173126 podStartE2EDuration="36.536102506s" totalImagesPullingTime="2.44792938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:18:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:18:56.534455634 +0000 UTC m=+69.930547724" watchObservedRunningTime="2026-09-15 10:18:56.536102506 +0000 UTC m=+69.932194593"
Sep 15 10:18:56.545003 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:56.544957    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7594c67c56-ww8nk" event={"ID":"e50e72a0-48f2-4d2d-9490-1e77265c84b6","Type":"ContainerStarted","Data":"53b7f381a447eb4fa0d91f1b4d1b3454ec4f8fd87e63460e1bc5962312a76a66"}
Sep 15 10:18:56.560259 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:56.560221    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hh4zk" event={"ID":"c101b9f1-4c96-416c-b899-fc7eee86e4ea","Type":"ContainerStarted","Data":"c6301bea16fa023a323314aa5201c1bac07b87029fadcd01e29cdd250610c114"}
Sep 15 10:18:56.560424 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:56.560288    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hh4zk" event={"ID":"c101b9f1-4c96-416c-b899-fc7eee86e4ea","Type":"ContainerStarted","Data":"04b9df4cb1bb7b94dd5449a065519863e47fe8146eb05af8dd10e12ec7a558ac"}
Sep 15 10:18:56.566408 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:56.566339    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7594c67c56-ww8nk" podStartSLOduration=3.566318032 podStartE2EDuration="3.566318032s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:18:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:18:56.56520916 +0000 UTC m=+69.961301249" watchObservedRunningTime="2026-09-15 10:18:56.566318032 +0000 UTC m=+69.962410121"
Sep 15 10:18:56.569875 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:56.569846    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-vs4m6" event={"ID":"f9ee683b-5f4d-4a00-81d8-affa82ff7362","Type":"ContainerStarted","Data":"5ed20225b6539a96bcb7804c71349fee785c341873ebf52a329f5e421800ab1b"}
Sep 15 10:18:56.584105 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:56.584050    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hh4zk" podStartSLOduration=67.489090564 podStartE2EDuration="1m9.584031375s" totalImagesPullingTime="2.094940811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:17:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:18:56.58286878 +0000 UTC m=+69.978960868" watchObservedRunningTime="2026-09-15 10:18:56.584031375 +0000 UTC m=+69.980123463"
Sep 15 10:18:56.598716 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:56.598635    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-vs4m6" podStartSLOduration=38.120394421 podStartE2EDuration="40.598613883s" totalImagesPullingTime="2.478219462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:18:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:18:56.597633249 +0000 UTC m=+69.993725337" watchObservedRunningTime="2026-09-15 10:18:56.598613883 +0000 UTC m=+69.994705971"
Sep 15 10:18:57.003815 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:57.003698    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7594c67c56-ww8nk"
Sep 15 10:18:57.006859 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:57.006609    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7594c67c56-ww8nk"
Sep 15 10:18:57.577536 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:57.577445    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7594c67c56-ww8nk"
Sep 15 10:18:57.579570 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:18:57.579245    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7594c67c56-ww8nk"
Sep 15 10:19:00.398460 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:00.398428    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-fqms7"
Sep 15 10:19:06.578516 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:06.578485    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hqxdd"
Sep 15 10:19:07.627299 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:07.627259    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-5d69f" event={"ID":"5a686d3b-f162-4b86-8f8e-b0f9871c0375","Type":"ContainerStarted","Data":"3054901269ebc6fa329c5369a3718f9fdab6257173e2f46d0b3952669f2aa315"}
Sep 15 10:19:07.629757 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:07.629706    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fb7c97ccc-tntd2" event={"ID":"68d20475-4c9c-4209-8479-9c2aae017d2e","Type":"ContainerStarted","Data":"7efed3be0c23ea5bfd9aa808d3fedfacc4adc0b6b44cef654ca9e843c2368e2a"}
Sep 15 10:19:07.630257 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:07.630236    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fb7c97ccc-tntd2"
Sep 15 10:19:07.631605 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:07.631581    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-8tffb" event={"ID":"fc61ef2f-aa66-46c2-b5b9-59f2cc500775","Type":"ContainerStarted","Data":"89890eb770eaa3fbaf967748649facf5ec9ca395e51685600da12007865c150f"}
Sep 15 10:19:07.632111 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:07.632089    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fb7c97ccc-tntd2"
Sep 15 10:19:07.634466 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:07.634446    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd57b8cc-nhks9" event={"ID":"276c33fe-d30b-4fda-bc90-753acecda79c","Type":"ContainerStarted","Data":"c55bc97f0ee319afbae13569a50fa2c982526be547deab2cd772318fda714028"}
Sep 15 10:19:07.634632 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:07.634611    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd57b8cc-nhks9" event={"ID":"276c33fe-d30b-4fda-bc90-753acecda79c","Type":"ContainerStarted","Data":"1339b79ecaf1f1ff8f4cbd32b54b4e12678083fef5da927e0f9dbad649e0990d"}
Sep 15 10:19:07.634754 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:07.634637    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd57b8cc-nhks9" event={"ID":"276c33fe-d30b-4fda-bc90-753acecda79c","Type":"ContainerStarted","Data":"3dbfa504a16fefcf99f949c6d557cfd1bf05f96133db03b8689cf99542438e1c"}
Sep 15 10:19:07.637090 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:07.637068    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-rd8n7" event={"ID":"08c4e9b7-353b-449a-b64d-a7ec5d83fbe3","Type":"ContainerStarted","Data":"9950a38d01db3ca4cbbe2bd592e79a098a0c91cffff0bfca03e8f8d4ccb498e9"}
Sep 15 10:19:07.637228 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:07.637215    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-rd8n7" event={"ID":"08c4e9b7-353b-449a-b64d-a7ec5d83fbe3","Type":"ContainerStarted","Data":"852496fd74cfc1753022b49d6fd478ae0a348f44b9688e325d67dfc1ad80c494"}
Sep 15 10:19:07.639084 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:07.639064    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-pqrzc" event={"ID":"9d592c77-7bd0-4187-8f90-12c5e8f1dc32","Type":"ContainerStarted","Data":"d0664ca7e3de8d1299d5974dfbde8cfa6630112707997a33e8e4fe563f965765"}
Sep 15 10:19:07.639463 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:07.639447    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-pqrzc"
Sep 15 10:19:07.642250 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:07.642212    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-5d69f" podStartSLOduration=4.232106725 podStartE2EDuration="14.642199333s" totalImagesPullingTime="10.410092608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:18:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:19:07.641788383 +0000 UTC m=+81.037880469" watchObservedRunningTime="2026-09-15 10:19:07.642199333 +0000 UTC m=+81.038291419"
Sep 15 10:19:07.642969 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:07.642950    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-d48mp" event={"ID":"ecad1164-c9d0-4df5-a0b8-382e33ac5629","Type":"ContainerStarted","Data":"14fdf71042aa76bd90297b18c3353a41d62f3e51e37615a9884524e6f01d9121"}
Sep 15 10:19:07.644937 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:07.644917    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8685dd494b-7jg6t" event={"ID":"ea73e653-9e44-449c-96ae-1be8ec98d662","Type":"ContainerStarted","Data":"882c39ce1bfb7d6d6653908e020099591d6972d13b2b3a1a5d8d5e17688098b8"}
Sep 15 10:19:07.646537 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:07.646519    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pzr7v" event={"ID":"4fb7ba56-a242-461d-a7b2-e03daa1b56a4","Type":"ContainerStarted","Data":"1a61192a208851c534b82a5e0ae5de0ccb13180b3ab05e546c6ff06542b38aab"}
Sep 15 10:19:07.663861 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:07.663803    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-rd8n7" podStartSLOduration=2.695883955 podStartE2EDuration="14.663784874s" totalImagesPullingTime="11.967900919s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:18:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:19:07.661807427 +0000 UTC m=+81.057899517" watchObservedRunningTime="2026-09-15 10:19:07.663784874 +0000 UTC m=+81.059876961"
Sep 15 10:19:07.678922 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:07.678853    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fb7c97ccc-tntd2" podStartSLOduration=2.311548568 podStartE2EDuration="14.678832802s" totalImagesPullingTime="12.367284234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:18:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:19:07.677767515 +0000 UTC m=+81.073859604" watchObservedRunningTime="2026-09-15 10:19:07.678832802 +0000 UTC m=+81.074924890"
Sep 15 10:19:07.714794 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:07.714738    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd57b8cc-nhks9" podStartSLOduration=2.436367994 podStartE2EDuration="14.714701784s" totalImagesPullingTime="12.27833379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:18:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:19:07.699881092 +0000 UTC m=+81.095973181" watchObservedRunningTime="2026-09-15 10:19:07.714701784 +0000 UTC m=+81.110793874"
Sep 15 10:19:07.715281 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:07.715255    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-696884fb9c-pqrzc" podStartSLOduration=2.440038783 podStartE2EDuration="14.715241797s" totalImagesPullingTime="12.275203014s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:18:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:19:07.714407169 +0000 UTC m=+81.110499258" watchObservedRunningTime="2026-09-15 10:19:07.715241797 +0000 UTC m=+81.111333882"
Sep 15 10:19:07.732257 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:07.732196    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5844b856db-8tffb" podStartSLOduration=2.458684008 podStartE2EDuration="14.732174077s" totalImagesPullingTime="12.273490069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:18:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:19:07.730241764 +0000 UTC m=+81.126333842" watchObservedRunningTime="2026-09-15 10:19:07.732174077 +0000 UTC m=+81.128266160"
Sep 15 10:19:07.745933 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:07.745680    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pzr7v" podStartSLOduration=2.471406203 podStartE2EDuration="14.745663011s" totalImagesPullingTime="12.274256808s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:18:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:19:07.744456238 +0000 UTC m=+81.140548328" watchObservedRunningTime="2026-09-15 10:19:07.745663011 +0000 UTC m=+81.141755099"
Sep 15 10:19:07.759311 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:07.759258    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8685dd494b-7jg6t" podStartSLOduration=2.476687799 podStartE2EDuration="14.759243486s" totalImagesPullingTime="12.282555687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:18:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:19:07.757448764 +0000 UTC m=+81.153540843" watchObservedRunningTime="2026-09-15 10:19:07.759243486 +0000 UTC m=+81.155335572"
Sep 15 10:19:07.772797 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:07.772675    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-d48mp" podStartSLOduration=67.141596288 podStartE2EDuration="1m20.772660328s" totalImagesPullingTime="13.63106404s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 10:17:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:19:07.772361755 +0000 UTC m=+81.168453843" watchObservedRunningTime="2026-09-15 10:19:07.772660328 +0000 UTC m=+81.168752416"
Sep 15 10:19:07.954955 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:07.954852    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fmwsn"]
Sep 15 10:19:07.958710 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:07.958683    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fmwsn"
Sep 15 10:19:07.961188 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:07.961167    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 15 10:19:07.961288 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:07.961195    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fxj4z\""
Sep 15 10:19:07.961288 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:07.961251    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 15 10:19:07.969483 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:07.969457    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fmwsn"]
Sep 15 10:19:08.091857 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:08.091821    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/217b59f7-d005-4acd-b7ef-144d5be0991e-crio-socket\") pod \"insights-runtime-extractor-fmwsn\" (UID: \"217b59f7-d005-4acd-b7ef-144d5be0991e\") " pod="openshift-insights/insights-runtime-extractor-fmwsn"
Sep 15 10:19:08.092007 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:08.091866    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52p8f\" (UniqueName: \"kubernetes.io/projected/217b59f7-d005-4acd-b7ef-144d5be0991e-kube-api-access-52p8f\") pod \"insights-runtime-extractor-fmwsn\" (UID: \"217b59f7-d005-4acd-b7ef-144d5be0991e\") " pod="openshift-insights/insights-runtime-extractor-fmwsn"
Sep 15 10:19:08.092007 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:08.091894    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/217b59f7-d005-4acd-b7ef-144d5be0991e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fmwsn\" (UID: \"217b59f7-d005-4acd-b7ef-144d5be0991e\") " pod="openshift-insights/insights-runtime-extractor-fmwsn"
Sep 15 10:19:08.092007 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:08.091949    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/217b59f7-d005-4acd-b7ef-144d5be0991e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fmwsn\" (UID: \"217b59f7-d005-4acd-b7ef-144d5be0991e\") " pod="openshift-insights/insights-runtime-extractor-fmwsn"
Sep 15 10:19:08.092007 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:08.091990    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/217b59f7-d005-4acd-b7ef-144d5be0991e-data-volume\") pod \"insights-runtime-extractor-fmwsn\" (UID: \"217b59f7-d005-4acd-b7ef-144d5be0991e\") " pod="openshift-insights/insights-runtime-extractor-fmwsn"
Sep 15 10:19:08.142672 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:08.142644    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-696884fb9c-pqrzc"
Sep 15 10:19:08.192579 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:08.192531    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/217b59f7-d005-4acd-b7ef-144d5be0991e-crio-socket\") pod \"insights-runtime-extractor-fmwsn\" (UID: \"217b59f7-d005-4acd-b7ef-144d5be0991e\") " pod="openshift-insights/insights-runtime-extractor-fmwsn"
Sep 15 10:19:08.192579 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:08.192577    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52p8f\" (UniqueName: \"kubernetes.io/projected/217b59f7-d005-4acd-b7ef-144d5be0991e-kube-api-access-52p8f\") pod \"insights-runtime-extractor-fmwsn\" (UID: \"217b59f7-d005-4acd-b7ef-144d5be0991e\") " pod="openshift-insights/insights-runtime-extractor-fmwsn"
Sep 15 10:19:08.192865 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:08.192606    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/217b59f7-d005-4acd-b7ef-144d5be0991e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fmwsn\" (UID: \"217b59f7-d005-4acd-b7ef-144d5be0991e\") " pod="openshift-insights/insights-runtime-extractor-fmwsn"
Sep 15 10:19:08.192865 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:08.192634    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/217b59f7-d005-4acd-b7ef-144d5be0991e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fmwsn\" (UID: \"217b59f7-d005-4acd-b7ef-144d5be0991e\") " pod="openshift-insights/insights-runtime-extractor-fmwsn"
Sep 15 10:19:08.192865 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:08.192662    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/217b59f7-d005-4acd-b7ef-144d5be0991e-crio-socket\") pod \"insights-runtime-extractor-fmwsn\" (UID: \"217b59f7-d005-4acd-b7ef-144d5be0991e\") " pod="openshift-insights/insights-runtime-extractor-fmwsn"
Sep 15 10:19:08.192865 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:08.192670    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/217b59f7-d005-4acd-b7ef-144d5be0991e-data-volume\") pod \"insights-runtime-extractor-fmwsn\" (UID: \"217b59f7-d005-4acd-b7ef-144d5be0991e\") " pod="openshift-insights/insights-runtime-extractor-fmwsn"
Sep 15 10:19:08.192865 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:19:08.192779    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 10:19:08.192865 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:19:08.192849    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/217b59f7-d005-4acd-b7ef-144d5be0991e-kube-rbac-proxy-cm podName:217b59f7-d005-4acd-b7ef-144d5be0991e nodeName:}" failed. No retries permitted until 2026-09-15 10:19:08.692832272 +0000 UTC m=+82.088924338 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/217b59f7-d005-4acd-b7ef-144d5be0991e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fmwsn" (UID: "217b59f7-d005-4acd-b7ef-144d5be0991e") : configmap "kube-rbac-proxy" not found
Sep 15 10:19:08.192865 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:19:08.192779    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 10:19:08.193199 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:19:08.192906    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/217b59f7-d005-4acd-b7ef-144d5be0991e-insights-runtime-extractor-tls podName:217b59f7-d005-4acd-b7ef-144d5be0991e nodeName:}" failed. No retries permitted until 2026-09-15 10:19:08.692891657 +0000 UTC m=+82.088983729 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/217b59f7-d005-4acd-b7ef-144d5be0991e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fmwsn" (UID: "217b59f7-d005-4acd-b7ef-144d5be0991e") : secret "insights-runtime-extractor-tls" not found
Sep 15 10:19:08.193199 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:08.192988    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/217b59f7-d005-4acd-b7ef-144d5be0991e-data-volume\") pod \"insights-runtime-extractor-fmwsn\" (UID: \"217b59f7-d005-4acd-b7ef-144d5be0991e\") " pod="openshift-insights/insights-runtime-extractor-fmwsn"
Sep 15 10:19:08.200456 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:08.200429    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52p8f\" (UniqueName: \"kubernetes.io/projected/217b59f7-d005-4acd-b7ef-144d5be0991e-kube-api-access-52p8f\") pod \"insights-runtime-extractor-fmwsn\" (UID: \"217b59f7-d005-4acd-b7ef-144d5be0991e\") " pod="openshift-insights/insights-runtime-extractor-fmwsn"
Sep 15 10:19:08.696424 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:08.696384    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/217b59f7-d005-4acd-b7ef-144d5be0991e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fmwsn\" (UID: \"217b59f7-d005-4acd-b7ef-144d5be0991e\") " pod="openshift-insights/insights-runtime-extractor-fmwsn"
Sep 15 10:19:08.696871 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:08.696500    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/217b59f7-d005-4acd-b7ef-144d5be0991e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fmwsn\" (UID: \"217b59f7-d005-4acd-b7ef-144d5be0991e\") " pod="openshift-insights/insights-runtime-extractor-fmwsn"
Sep 15 10:19:08.696871 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:19:08.696517    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 10:19:08.696871 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:19:08.696594    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/217b59f7-d005-4acd-b7ef-144d5be0991e-kube-rbac-proxy-cm podName:217b59f7-d005-4acd-b7ef-144d5be0991e nodeName:}" failed. No retries permitted until 2026-09-15 10:19:09.696577017 +0000 UTC m=+83.092669159 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/217b59f7-d005-4acd-b7ef-144d5be0991e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fmwsn" (UID: "217b59f7-d005-4acd-b7ef-144d5be0991e") : configmap "kube-rbac-proxy" not found
Sep 15 10:19:08.696871 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:19:08.696613    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 10:19:08.696871 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:19:08.696656    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/217b59f7-d005-4acd-b7ef-144d5be0991e-insights-runtime-extractor-tls podName:217b59f7-d005-4acd-b7ef-144d5be0991e nodeName:}" failed. No retries permitted until 2026-09-15 10:19:09.696645428 +0000 UTC m=+83.092737512 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/217b59f7-d005-4acd-b7ef-144d5be0991e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fmwsn" (UID: "217b59f7-d005-4acd-b7ef-144d5be0991e") : secret "insights-runtime-extractor-tls" not found
Sep 15 10:19:08.953716 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:08.953611    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hqxdd_8bd905c9-2601-4b09-93ff-07596c04b509/dns/0.log"
Sep 15 10:19:09.157162 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:09.157056    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hqxdd_8bd905c9-2601-4b09-93ff-07596c04b509/kube-rbac-proxy/0.log"
Sep 15 10:19:09.705634 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:09.705595    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/217b59f7-d005-4acd-b7ef-144d5be0991e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fmwsn\" (UID: \"217b59f7-d005-4acd-b7ef-144d5be0991e\") " pod="openshift-insights/insights-runtime-extractor-fmwsn"
Sep 15 10:19:09.705634 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:09.705639    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/217b59f7-d005-4acd-b7ef-144d5be0991e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fmwsn\" (UID: \"217b59f7-d005-4acd-b7ef-144d5be0991e\") " pod="openshift-insights/insights-runtime-extractor-fmwsn"
Sep 15 10:19:09.706089 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:19:09.705771    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 10:19:09.706089 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:19:09.705774    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 10:19:09.706089 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:19:09.705830    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/217b59f7-d005-4acd-b7ef-144d5be0991e-kube-rbac-proxy-cm podName:217b59f7-d005-4acd-b7ef-144d5be0991e nodeName:}" failed. No retries permitted until 2026-09-15 10:19:11.705815653 +0000 UTC m=+85.101907719 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/217b59f7-d005-4acd-b7ef-144d5be0991e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fmwsn" (UID: "217b59f7-d005-4acd-b7ef-144d5be0991e") : configmap "kube-rbac-proxy" not found
Sep 15 10:19:09.706089 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:19:09.705847    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/217b59f7-d005-4acd-b7ef-144d5be0991e-insights-runtime-extractor-tls podName:217b59f7-d005-4acd-b7ef-144d5be0991e nodeName:}" failed. No retries permitted until 2026-09-15 10:19:11.705841704 +0000 UTC m=+85.101933769 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/217b59f7-d005-4acd-b7ef-144d5be0991e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fmwsn" (UID: "217b59f7-d005-4acd-b7ef-144d5be0991e") : secret "insights-runtime-extractor-tls" not found
Sep 15 10:19:10.153103 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:10.153070    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t5gjf_764a519b-87a8-4759-b03a-585cc4731146/dns-node-resolver/0.log"
Sep 15 10:19:10.352385 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:10.352355    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5bf5cf7cd7-mxp9j_1798fb5d-8a9d-4068-b960-e371a235b84e/registry/0.log"
Sep 15 10:19:11.152788 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:11.152761    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pbf8k_aaa39564-bf93-4ed2-b834-bdb0dba37aea/node-ca/0.log"
Sep 15 10:19:11.353718 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:11.353682    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7594c67c56-ww8nk_e50e72a0-48f2-4d2d-9490-1e77265c84b6/router/0.log"
Sep 15 10:19:11.552612 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:11.552582    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fqjvg_a79f7e20-c11d-4204-bde9-8cd257af7a46/serve-healthcheck-canary/0.log"
Sep 15 10:19:11.725133 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:11.725093    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/217b59f7-d005-4acd-b7ef-144d5be0991e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fmwsn\" (UID: \"217b59f7-d005-4acd-b7ef-144d5be0991e\") " pod="openshift-insights/insights-runtime-extractor-fmwsn"
Sep 15 10:19:11.725133 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:11.725136    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/217b59f7-d005-4acd-b7ef-144d5be0991e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fmwsn\" (UID: \"217b59f7-d005-4acd-b7ef-144d5be0991e\") " pod="openshift-insights/insights-runtime-extractor-fmwsn"
Sep 15 10:19:11.725342 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:19:11.725223    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 10:19:11.725342 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:19:11.725270    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 10:19:11.725342 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:19:11.725280    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/217b59f7-d005-4acd-b7ef-144d5be0991e-kube-rbac-proxy-cm podName:217b59f7-d005-4acd-b7ef-144d5be0991e nodeName:}" failed. No retries permitted until 2026-09-15 10:19:15.725265582 +0000 UTC m=+89.121357664 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/217b59f7-d005-4acd-b7ef-144d5be0991e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fmwsn" (UID: "217b59f7-d005-4acd-b7ef-144d5be0991e") : configmap "kube-rbac-proxy" not found
Sep 15 10:19:11.725459 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:19:11.725356    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/217b59f7-d005-4acd-b7ef-144d5be0991e-insights-runtime-extractor-tls podName:217b59f7-d005-4acd-b7ef-144d5be0991e nodeName:}" failed. No retries permitted until 2026-09-15 10:19:15.725338479 +0000 UTC m=+89.121430559 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/217b59f7-d005-4acd-b7ef-144d5be0991e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fmwsn" (UID: "217b59f7-d005-4acd-b7ef-144d5be0991e") : secret "insights-runtime-extractor-tls" not found
Sep 15 10:19:12.675923 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:12.675885    2579 patch_prober.go:28] interesting pod/image-registry-5bf5cf7cd7-mxp9j container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 15 10:19:12.676301 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:12.675939    2579 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j" podUID="1798fb5d-8a9d-4068-b960-e371a235b84e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 10:19:14.487837 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:14.487806    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j"
Sep 15 10:19:15.757984 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:15.757944    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/217b59f7-d005-4acd-b7ef-144d5be0991e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fmwsn\" (UID: \"217b59f7-d005-4acd-b7ef-144d5be0991e\") " pod="openshift-insights/insights-runtime-extractor-fmwsn"
Sep 15 10:19:15.758380 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:15.757991    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/217b59f7-d005-4acd-b7ef-144d5be0991e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fmwsn\" (UID: \"217b59f7-d005-4acd-b7ef-144d5be0991e\") " pod="openshift-insights/insights-runtime-extractor-fmwsn"
Sep 15 10:19:15.758380 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:19:15.758093    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 10:19:15.758380 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:19:15.758108    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 10:19:15.758380 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:19:15.758151    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/217b59f7-d005-4acd-b7ef-144d5be0991e-kube-rbac-proxy-cm podName:217b59f7-d005-4acd-b7ef-144d5be0991e nodeName:}" failed. No retries permitted until 2026-09-15 10:19:23.758136653 +0000 UTC m=+97.154228719 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/217b59f7-d005-4acd-b7ef-144d5be0991e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fmwsn" (UID: "217b59f7-d005-4acd-b7ef-144d5be0991e") : configmap "kube-rbac-proxy" not found
Sep 15 10:19:15.758380 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:19:15.758171    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/217b59f7-d005-4acd-b7ef-144d5be0991e-insights-runtime-extractor-tls podName:217b59f7-d005-4acd-b7ef-144d5be0991e nodeName:}" failed. No retries permitted until 2026-09-15 10:19:23.758157239 +0000 UTC m=+97.154249304 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/217b59f7-d005-4acd-b7ef-144d5be0991e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fmwsn" (UID: "217b59f7-d005-4acd-b7ef-144d5be0991e") : secret "insights-runtime-extractor-tls" not found
Sep 15 10:19:16.044557 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:16.044523    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j"]
Sep 15 10:19:20.017428 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:20.017392    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jkbvn"]
Sep 15 10:19:20.022371 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:20.022350    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jkbvn"
Sep 15 10:19:20.024559 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:20.024535    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 15 10:19:20.025403 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:20.025382    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 15 10:19:20.025498 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:20.025382    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vpk4z\""
Sep 15 10:19:20.025498 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:20.025390    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 15 10:19:20.025603 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:20.025390    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 15 10:19:20.203063 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:20.203031    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db4c0e16-f681-40e7-9048-0002a5eb04e0-metrics-client-ca\") pod \"node-exporter-jkbvn\" (UID: \"db4c0e16-f681-40e7-9048-0002a5eb04e0\") " pod="openshift-monitoring/node-exporter-jkbvn"
Sep 15 10:19:20.203252 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:20.203076    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/db4c0e16-f681-40e7-9048-0002a5eb04e0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jkbvn\" (UID: \"db4c0e16-f681-40e7-9048-0002a5eb04e0\") " pod="openshift-monitoring/node-exporter-jkbvn"
Sep 15 10:19:20.203252 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:20.203107    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/db4c0e16-f681-40e7-9048-0002a5eb04e0-node-exporter-textfile\") pod \"node-exporter-jkbvn\" (UID: \"db4c0e16-f681-40e7-9048-0002a5eb04e0\") " pod="openshift-monitoring/node-exporter-jkbvn"
Sep 15 10:19:20.203252 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:20.203141    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db4c0e16-f681-40e7-9048-0002a5eb04e0-sys\") pod \"node-exporter-jkbvn\" (UID: \"db4c0e16-f681-40e7-9048-0002a5eb04e0\") " pod="openshift-monitoring/node-exporter-jkbvn"
Sep 15 10:19:20.203252 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:20.203158    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/db4c0e16-f681-40e7-9048-0002a5eb04e0-node-exporter-tls\") pod \"node-exporter-jkbvn\" (UID: \"db4c0e16-f681-40e7-9048-0002a5eb04e0\") " pod="openshift-monitoring/node-exporter-jkbvn"
Sep 15 10:19:20.203252 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:20.203210    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/db4c0e16-f681-40e7-9048-0002a5eb04e0-root\") pod \"node-exporter-jkbvn\" (UID: \"db4c0e16-f681-40e7-9048-0002a5eb04e0\") " pod="openshift-monitoring/node-exporter-jkbvn"
Sep 15 10:19:20.203252 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:20.203229    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/db4c0e16-f681-40e7-9048-0002a5eb04e0-node-exporter-accelerators-collector-config\") pod \"node-exporter-jkbvn\" (UID: \"db4c0e16-f681-40e7-9048-0002a5eb04e0\") " pod="openshift-monitoring/node-exporter-jkbvn"
Sep 15 10:19:20.203517 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:20.203299    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/db4c0e16-f681-40e7-9048-0002a5eb04e0-node-exporter-wtmp\") pod \"node-exporter-jkbvn\" (UID: \"db4c0e16-f681-40e7-9048-0002a5eb04e0\") " pod="openshift-monitoring/node-exporter-jkbvn"
Sep 15 10:19:20.203517 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:20.203373    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgrt9\" (UniqueName: \"kubernetes.io/projected/db4c0e16-f681-40e7-9048-0002a5eb04e0-kube-api-access-dgrt9\") pod \"node-exporter-jkbvn\" (UID: \"db4c0e16-f681-40e7-9048-0002a5eb04e0\") " pod="openshift-monitoring/node-exporter-jkbvn"
Sep 15 10:19:20.304843 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:20.304802    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/db4c0e16-f681-40e7-9048-0002a5eb04e0-root\") pod \"node-exporter-jkbvn\" (UID: \"db4c0e16-f681-40e7-9048-0002a5eb04e0\") " pod="openshift-monitoring/node-exporter-jkbvn"
Sep 15 10:19:20.304843 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:20.304847    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/db4c0e16-f681-40e7-9048-0002a5eb04e0-node-exporter-accelerators-collector-config\") pod \"node-exporter-jkbvn\" (UID: \"db4c0e16-f681-40e7-9048-0002a5eb04e0\") " pod="openshift-monitoring/node-exporter-jkbvn"
Sep 15 10:19:20.305105 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:20.304876    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/db4c0e16-f681-40e7-9048-0002a5eb04e0-node-exporter-wtmp\") pod \"node-exporter-jkbvn\" (UID: \"db4c0e16-f681-40e7-9048-0002a5eb04e0\") " pod="openshift-monitoring/node-exporter-jkbvn"
Sep 15 10:19:20.305105 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:20.304917    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgrt9\" (UniqueName: \"kubernetes.io/projected/db4c0e16-f681-40e7-9048-0002a5eb04e0-kube-api-access-dgrt9\") pod \"node-exporter-jkbvn\" (UID: \"db4c0e16-f681-40e7-9048-0002a5eb04e0\") " pod="openshift-monitoring/node-exporter-jkbvn"
Sep 15 10:19:20.305105 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:20.304943    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/db4c0e16-f681-40e7-9048-0002a5eb04e0-root\") pod \"node-exporter-jkbvn\" (UID: \"db4c0e16-f681-40e7-9048-0002a5eb04e0\") " pod="openshift-monitoring/node-exporter-jkbvn"
Sep 15 10:19:20.305105 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:20.304951    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db4c0e16-f681-40e7-9048-0002a5eb04e0-metrics-client-ca\") pod \"node-exporter-jkbvn\" (UID: \"db4c0e16-f681-40e7-9048-0002a5eb04e0\") " pod="openshift-monitoring/node-exporter-jkbvn"
Sep 15 10:19:20.305105 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:20.305039    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/db4c0e16-f681-40e7-9048-0002a5eb04e0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jkbvn\" (UID: \"db4c0e16-f681-40e7-9048-0002a5eb04e0\") " pod="openshift-monitoring/node-exporter-jkbvn"
Sep 15 10:19:20.305105 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:20.305074    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/db4c0e16-f681-40e7-9048-0002a5eb04e0-node-exporter-textfile\") pod \"node-exporter-jkbvn\" (UID: \"db4c0e16-f681-40e7-9048-0002a5eb04e0\") " pod="openshift-monitoring/node-exporter-jkbvn"
Sep 15 10:19:20.305105 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:20.305099    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db4c0e16-f681-40e7-9048-0002a5eb04e0-sys\") pod \"node-exporter-jkbvn\" (UID: \"db4c0e16-f681-40e7-9048-0002a5eb04e0\") " pod="openshift-monitoring/node-exporter-jkbvn"
Sep 15 10:19:20.305448 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:20.305127    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/db4c0e16-f681-40e7-9048-0002a5eb04e0-node-exporter-tls\") pod \"node-exporter-jkbvn\" (UID: \"db4c0e16-f681-40e7-9048-0002a5eb04e0\") " pod="openshift-monitoring/node-exporter-jkbvn"
Sep 15 10:19:20.305548 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:20.305524    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db4c0e16-f681-40e7-9048-0002a5eb04e0-metrics-client-ca\") pod \"node-exporter-jkbvn\" (UID: \"db4c0e16-f681-40e7-9048-0002a5eb04e0\") " pod="openshift-monitoring/node-exporter-jkbvn"
Sep 15 10:19:20.305621 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:20.305524    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/db4c0e16-f681-40e7-9048-0002a5eb04e0-node-exporter-accelerators-collector-config\") pod \"node-exporter-jkbvn\" (UID: \"db4c0e16-f681-40e7-9048-0002a5eb04e0\") " pod="openshift-monitoring/node-exporter-jkbvn"
Sep 15 10:19:20.305675 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:20.305640    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/db4c0e16-f681-40e7-9048-0002a5eb04e0-node-exporter-wtmp\") pod \"node-exporter-jkbvn\" (UID: \"db4c0e16-f681-40e7-9048-0002a5eb04e0\") " pod="openshift-monitoring/node-exporter-jkbvn"
Sep 15 10:19:20.305746 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:20.305684    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db4c0e16-f681-40e7-9048-0002a5eb04e0-sys\") pod \"node-exporter-jkbvn\" (UID: \"db4c0e16-f681-40e7-9048-0002a5eb04e0\") " pod="openshift-monitoring/node-exporter-jkbvn"
Sep 15 10:19:20.306089 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:20.306061    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/db4c0e16-f681-40e7-9048-0002a5eb04e0-node-exporter-textfile\") pod \"node-exporter-jkbvn\" (UID: \"db4c0e16-f681-40e7-9048-0002a5eb04e0\") " pod="openshift-monitoring/node-exporter-jkbvn"
Sep 15 10:19:20.307739 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:20.307701    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/db4c0e16-f681-40e7-9048-0002a5eb04e0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jkbvn\" (UID: \"db4c0e16-f681-40e7-9048-0002a5eb04e0\") " pod="openshift-monitoring/node-exporter-jkbvn"
Sep 15 10:19:20.307961 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:20.307943    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/db4c0e16-f681-40e7-9048-0002a5eb04e0-node-exporter-tls\") pod \"node-exporter-jkbvn\" (UID: \"db4c0e16-f681-40e7-9048-0002a5eb04e0\") " pod="openshift-monitoring/node-exporter-jkbvn"
Sep 15 10:19:20.313247 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:20.313214    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgrt9\" (UniqueName: \"kubernetes.io/projected/db4c0e16-f681-40e7-9048-0002a5eb04e0-kube-api-access-dgrt9\") pod \"node-exporter-jkbvn\" (UID: \"db4c0e16-f681-40e7-9048-0002a5eb04e0\") " pod="openshift-monitoring/node-exporter-jkbvn"
Sep 15 10:19:20.334111 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:20.334089    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jkbvn"
Sep 15 10:19:20.348943 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:19:20.348912    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb4c0e16_f681_40e7_9048_0002a5eb04e0.slice/crio-61fa06d9a2809c56d232fe594093def5d457965466fec8b9ed752b79e10da4b4 WatchSource:0}: Error finding container 61fa06d9a2809c56d232fe594093def5d457965466fec8b9ed752b79e10da4b4: Status 404 returned error can't find the container with id 61fa06d9a2809c56d232fe594093def5d457965466fec8b9ed752b79e10da4b4
Sep 15 10:19:20.706413 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:20.706327    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jkbvn" event={"ID":"db4c0e16-f681-40e7-9048-0002a5eb04e0","Type":"ContainerStarted","Data":"61fa06d9a2809c56d232fe594093def5d457965466fec8b9ed752b79e10da4b4"}
Sep 15 10:19:22.716229 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:22.716178    2579 generic.go:356] "Generic (PLEG): container finished" podID="db4c0e16-f681-40e7-9048-0002a5eb04e0" containerID="d63de0fcd1c1e61fd15479de1d1b074946f71413bd6c07329763dd439e01395c" exitCode=0
Sep 15 10:19:22.716625 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:22.716243    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jkbvn" event={"ID":"db4c0e16-f681-40e7-9048-0002a5eb04e0","Type":"ContainerDied","Data":"d63de0fcd1c1e61fd15479de1d1b074946f71413bd6c07329763dd439e01395c"}
Sep 15 10:19:23.726906 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:23.726867    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jkbvn" event={"ID":"db4c0e16-f681-40e7-9048-0002a5eb04e0","Type":"ContainerStarted","Data":"3a11cb324de7d10522f0414d6ffd72ed830f624925cf164047bccfbcb06326a4"}
Sep 15 10:19:23.727336 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:23.726941    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jkbvn" event={"ID":"db4c0e16-f681-40e7-9048-0002a5eb04e0","Type":"ContainerStarted","Data":"20c7c38e8f5354c2343e9ba5aa53f8a5bd2f5efa4794fe6149fa3385e7c00f2b"}
Sep 15 10:19:23.746194 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:23.746143    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jkbvn" podStartSLOduration=3.285199504 podStartE2EDuration="4.746127766s" totalImagesPullingTime="1.399119253s" totalInitContainerRuntime="61.809009ms" isStatefulPod=true podCreationTimestamp="2026-09-15 10:19:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:19:23.744888735 +0000 UTC m=+97.140980824" watchObservedRunningTime="2026-09-15 10:19:23.746127766 +0000 UTC m=+97.142219853"
Sep 15 10:19:23.832912 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:23.832876    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/217b59f7-d005-4acd-b7ef-144d5be0991e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fmwsn\" (UID: \"217b59f7-d005-4acd-b7ef-144d5be0991e\") " pod="openshift-insights/insights-runtime-extractor-fmwsn"
Sep 15 10:19:23.833079 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:23.832918    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/217b59f7-d005-4acd-b7ef-144d5be0991e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fmwsn\" (UID: \"217b59f7-d005-4acd-b7ef-144d5be0991e\") " pod="openshift-insights/insights-runtime-extractor-fmwsn"
Sep 15 10:19:23.833079 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:19:23.833025    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 10:19:23.833148 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:19:23.833099    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/217b59f7-d005-4acd-b7ef-144d5be0991e-insights-runtime-extractor-tls podName:217b59f7-d005-4acd-b7ef-144d5be0991e nodeName:}" failed. No retries permitted until 2026-09-15 10:19:39.8330802 +0000 UTC m=+113.229172279 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/217b59f7-d005-4acd-b7ef-144d5be0991e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fmwsn" (UID: "217b59f7-d005-4acd-b7ef-144d5be0991e") : secret "insights-runtime-extractor-tls" not found
Sep 15 10:19:23.833539 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:23.833522    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/217b59f7-d005-4acd-b7ef-144d5be0991e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fmwsn\" (UID: \"217b59f7-d005-4acd-b7ef-144d5be0991e\") " pod="openshift-insights/insights-runtime-extractor-fmwsn"
Sep 15 10:19:34.775059 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:34.775026    2579 generic.go:356] "Generic (PLEG): container finished" podID="d42015bc-21f5-4d25-8cc5-0ade2c4a93fa" containerID="b52282e4d40a5509823017c6a30d71cc715e5c90a14996f968af2237fbdf4a8a" exitCode=0
Sep 15 10:19:34.775458 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:34.775069    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xqnct" event={"ID":"d42015bc-21f5-4d25-8cc5-0ade2c4a93fa","Type":"ContainerDied","Data":"b52282e4d40a5509823017c6a30d71cc715e5c90a14996f968af2237fbdf4a8a"}
Sep 15 10:19:34.775458 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:34.775358    2579 scope.go:117] "RemoveContainer" containerID="b52282e4d40a5509823017c6a30d71cc715e5c90a14996f968af2237fbdf4a8a"
Sep 15 10:19:35.780415 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:35.780382    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xqnct" event={"ID":"d42015bc-21f5-4d25-8cc5-0ade2c4a93fa","Type":"ContainerStarted","Data":"ec52a9cfa7df75034a20976356fcdfa42282e4d2f043a637082995220a449822"}
Sep 15 10:19:39.854052 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:39.854015    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/217b59f7-d005-4acd-b7ef-144d5be0991e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fmwsn\" (UID: \"217b59f7-d005-4acd-b7ef-144d5be0991e\") " pod="openshift-insights/insights-runtime-extractor-fmwsn"
Sep 15 10:19:39.856329 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:39.856308    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/217b59f7-d005-4acd-b7ef-144d5be0991e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fmwsn\" (UID: \"217b59f7-d005-4acd-b7ef-144d5be0991e\") " pod="openshift-insights/insights-runtime-extractor-fmwsn"
Sep 15 10:19:40.068099 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:40.068059    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fmwsn"
Sep 15 10:19:40.359392 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:40.359359    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fmwsn"]
Sep 15 10:19:40.362977 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:19:40.362952    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod217b59f7_d005_4acd_b7ef_144d5be0991e.slice/crio-f80187a3d11c41376b0d7563a589ba211e21ce6b51201316ec7a978d7ca11d42 WatchSource:0}: Error finding container f80187a3d11c41376b0d7563a589ba211e21ce6b51201316ec7a978d7ca11d42: Status 404 returned error can't find the container with id f80187a3d11c41376b0d7563a589ba211e21ce6b51201316ec7a978d7ca11d42
Sep 15 10:19:40.801934 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:40.801902    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fmwsn" event={"ID":"217b59f7-d005-4acd-b7ef-144d5be0991e","Type":"ContainerStarted","Data":"1d5b68315f2d1e3d1d34720c33301b876944d1c49294e450eed9c65ec76a4a9d"}
Sep 15 10:19:40.802093 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:40.801959    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fmwsn" event={"ID":"217b59f7-d005-4acd-b7ef-144d5be0991e","Type":"ContainerStarted","Data":"f80187a3d11c41376b0d7563a589ba211e21ce6b51201316ec7a978d7ca11d42"}
Sep 15 10:19:41.064105 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:41.064018    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j" podUID="1798fb5d-8a9d-4068-b960-e371a235b84e" containerName="registry" containerID="cri-o://db4ee5e3bc8f0b46ab2d9951babee3c4c338d2dfa2b587b82d8464fc5178d9d4" gracePeriod=30
Sep 15 10:19:41.428375 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:41.428345    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j"
Sep 15 10:19:41.467131 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:41.467099    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1798fb5d-8a9d-4068-b960-e371a235b84e-ca-trust-extracted\") pod \"1798fb5d-8a9d-4068-b960-e371a235b84e\" (UID: \"1798fb5d-8a9d-4068-b960-e371a235b84e\") "
Sep 15 10:19:41.467131 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:41.467134    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1798fb5d-8a9d-4068-b960-e371a235b84e-trusted-ca\") pod \"1798fb5d-8a9d-4068-b960-e371a235b84e\" (UID: \"1798fb5d-8a9d-4068-b960-e371a235b84e\") "
Sep 15 10:19:41.467362 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:41.467163    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1798fb5d-8a9d-4068-b960-e371a235b84e-image-registry-private-configuration\") pod \"1798fb5d-8a9d-4068-b960-e371a235b84e\" (UID: \"1798fb5d-8a9d-4068-b960-e371a235b84e\") "
Sep 15 10:19:41.467362 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:41.467191    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1798fb5d-8a9d-4068-b960-e371a235b84e-registry-certificates\") pod \"1798fb5d-8a9d-4068-b960-e371a235b84e\" (UID: \"1798fb5d-8a9d-4068-b960-e371a235b84e\") "
Sep 15 10:19:41.467362 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:41.467217    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1798fb5d-8a9d-4068-b960-e371a235b84e-installation-pull-secrets\") pod \"1798fb5d-8a9d-4068-b960-e371a235b84e\" (UID: \"1798fb5d-8a9d-4068-b960-e371a235b84e\") "
Sep 15 10:19:41.467362 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:41.467245    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1798fb5d-8a9d-4068-b960-e371a235b84e-registry-tls\") pod \"1798fb5d-8a9d-4068-b960-e371a235b84e\" (UID: \"1798fb5d-8a9d-4068-b960-e371a235b84e\") "
Sep 15 10:19:41.467362 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:41.467291    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1798fb5d-8a9d-4068-b960-e371a235b84e-bound-sa-token\") pod \"1798fb5d-8a9d-4068-b960-e371a235b84e\" (UID: \"1798fb5d-8a9d-4068-b960-e371a235b84e\") "
Sep 15 10:19:41.467362 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:41.467359    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f52g8\" (UniqueName: \"kubernetes.io/projected/1798fb5d-8a9d-4068-b960-e371a235b84e-kube-api-access-f52g8\") pod \"1798fb5d-8a9d-4068-b960-e371a235b84e\" (UID: \"1798fb5d-8a9d-4068-b960-e371a235b84e\") "
Sep 15 10:19:41.467653 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:41.467588    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1798fb5d-8a9d-4068-b960-e371a235b84e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "1798fb5d-8a9d-4068-b960-e371a235b84e" (UID: "1798fb5d-8a9d-4068-b960-e371a235b84e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:19:41.467945 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:41.467917    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1798fb5d-8a9d-4068-b960-e371a235b84e-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "1798fb5d-8a9d-4068-b960-e371a235b84e" (UID: "1798fb5d-8a9d-4068-b960-e371a235b84e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:19:41.469846 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:41.469807    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1798fb5d-8a9d-4068-b960-e371a235b84e-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "1798fb5d-8a9d-4068-b960-e371a235b84e" (UID: "1798fb5d-8a9d-4068-b960-e371a235b84e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 10:19:41.470143 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:41.470115    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1798fb5d-8a9d-4068-b960-e371a235b84e-kube-api-access-f52g8" (OuterVolumeSpecName: "kube-api-access-f52g8") pod "1798fb5d-8a9d-4068-b960-e371a235b84e" (UID: "1798fb5d-8a9d-4068-b960-e371a235b84e"). InnerVolumeSpecName "kube-api-access-f52g8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:19:41.470384 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:41.470351    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1798fb5d-8a9d-4068-b960-e371a235b84e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "1798fb5d-8a9d-4068-b960-e371a235b84e" (UID: "1798fb5d-8a9d-4068-b960-e371a235b84e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:19:41.470465 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:41.470370    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1798fb5d-8a9d-4068-b960-e371a235b84e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1798fb5d-8a9d-4068-b960-e371a235b84e" (UID: "1798fb5d-8a9d-4068-b960-e371a235b84e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:19:41.470465 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:41.470385    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1798fb5d-8a9d-4068-b960-e371a235b84e-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "1798fb5d-8a9d-4068-b960-e371a235b84e" (UID: "1798fb5d-8a9d-4068-b960-e371a235b84e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 10:19:41.476004 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:41.475978    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1798fb5d-8a9d-4068-b960-e371a235b84e-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "1798fb5d-8a9d-4068-b960-e371a235b84e" (UID: "1798fb5d-8a9d-4068-b960-e371a235b84e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:19:41.568299 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:41.568264    2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1798fb5d-8a9d-4068-b960-e371a235b84e-bound-sa-token\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:19:41.568299 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:41.568291    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f52g8\" (UniqueName: \"kubernetes.io/projected/1798fb5d-8a9d-4068-b960-e371a235b84e-kube-api-access-f52g8\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:19:41.568299 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:41.568305    2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1798fb5d-8a9d-4068-b960-e371a235b84e-ca-trust-extracted\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:19:41.568524 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:41.568316    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1798fb5d-8a9d-4068-b960-e371a235b84e-trusted-ca\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:19:41.568524 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:41.568325    2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1798fb5d-8a9d-4068-b960-e371a235b84e-image-registry-private-configuration\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:19:41.568524 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:41.568333    2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1798fb5d-8a9d-4068-b960-e371a235b84e-registry-certificates\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:19:41.568524 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:41.568341    2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1798fb5d-8a9d-4068-b960-e371a235b84e-installation-pull-secrets\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:19:41.568524 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:41.568350    2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1798fb5d-8a9d-4068-b960-e371a235b84e-registry-tls\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:19:41.806590 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:41.806563    2579 generic.go:356] "Generic (PLEG): container finished" podID="1798fb5d-8a9d-4068-b960-e371a235b84e" containerID="db4ee5e3bc8f0b46ab2d9951babee3c4c338d2dfa2b587b82d8464fc5178d9d4" exitCode=0
Sep 15 10:19:41.806704 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:41.806609    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j"
Sep 15 10:19:41.806704 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:41.806631    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j" event={"ID":"1798fb5d-8a9d-4068-b960-e371a235b84e","Type":"ContainerDied","Data":"db4ee5e3bc8f0b46ab2d9951babee3c4c338d2dfa2b587b82d8464fc5178d9d4"}
Sep 15 10:19:41.806704 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:41.806669    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j" event={"ID":"1798fb5d-8a9d-4068-b960-e371a235b84e","Type":"ContainerDied","Data":"a3b2d10b8c31adb33707431f07a0df266b29f25e0ee52c73d2d076118d9cf5df"}
Sep 15 10:19:41.806704 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:41.806687    2579 scope.go:117] "RemoveContainer" containerID="db4ee5e3bc8f0b46ab2d9951babee3c4c338d2dfa2b587b82d8464fc5178d9d4"
Sep 15 10:19:41.814541 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:41.814510    2579 scope.go:117] "RemoveContainer" containerID="db4ee5e3bc8f0b46ab2d9951babee3c4c338d2dfa2b587b82d8464fc5178d9d4"
Sep 15 10:19:41.814874 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:19:41.814847    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db4ee5e3bc8f0b46ab2d9951babee3c4c338d2dfa2b587b82d8464fc5178d9d4\": container with ID starting with db4ee5e3bc8f0b46ab2d9951babee3c4c338d2dfa2b587b82d8464fc5178d9d4 not found: ID does not exist" containerID="db4ee5e3bc8f0b46ab2d9951babee3c4c338d2dfa2b587b82d8464fc5178d9d4"
Sep 15 10:19:41.814947 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:41.814886    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db4ee5e3bc8f0b46ab2d9951babee3c4c338d2dfa2b587b82d8464fc5178d9d4"} err="failed to get container status \"db4ee5e3bc8f0b46ab2d9951babee3c4c338d2dfa2b587b82d8464fc5178d9d4\": rpc error: code = NotFound desc = could not find container \"db4ee5e3bc8f0b46ab2d9951babee3c4c338d2dfa2b587b82d8464fc5178d9d4\": container with ID starting with db4ee5e3bc8f0b46ab2d9951babee3c4c338d2dfa2b587b82d8464fc5178d9d4 not found: ID does not exist"
Sep 15 10:19:41.828345 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:41.828322    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j"]
Sep 15 10:19:41.832368 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:41.832348    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5bf5cf7cd7-mxp9j"]
Sep 15 10:19:42.813165 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:42.813126    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fmwsn" event={"ID":"217b59f7-d005-4acd-b7ef-144d5be0991e","Type":"ContainerStarted","Data":"4c83e0dc9e89f5b2c6de673eb21d0471d9985e69e616dee24674a7b76a78ffea"}
Sep 15 10:19:43.148242 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:43.148164    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1798fb5d-8a9d-4068-b960-e371a235b84e" path="/var/lib/kubelet/pods/1798fb5d-8a9d-4068-b960-e371a235b84e/volumes"
Sep 15 10:19:43.818572 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:43.818536    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fmwsn" event={"ID":"217b59f7-d005-4acd-b7ef-144d5be0991e","Type":"ContainerStarted","Data":"a2d9bd7ca39eaa602cfce1853f9cd61a01a2ca489e58bb16c8a984dc7b5a00d9"}
Sep 15 10:19:43.839825 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:43.839781    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fmwsn" podStartSLOduration=33.776551189 podStartE2EDuration="36.839767912s" totalImagesPullingTime="3.063216723s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 10:19:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:19:43.838092193 +0000 UTC m=+117.234184279" watchObservedRunningTime="2026-09-15 10:19:43.839767912 +0000 UTC m=+117.235859999"
Sep 15 10:19:44.823436 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:44.823398    2579 generic.go:356] "Generic (PLEG): container finished" podID="3723f1be-68cb-4624-8788-a240a3640495" containerID="640b3264e0d3cf53da0cab59fe27f57cb013c276e5298ea39efe35732ec13a7c" exitCode=0
Sep 15 10:19:44.823895 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:44.823472    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-rzxqx" event={"ID":"3723f1be-68cb-4624-8788-a240a3640495","Type":"ContainerDied","Data":"640b3264e0d3cf53da0cab59fe27f57cb013c276e5298ea39efe35732ec13a7c"}
Sep 15 10:19:44.823895 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:44.823788    2579 scope.go:117] "RemoveContainer" containerID="640b3264e0d3cf53da0cab59fe27f57cb013c276e5298ea39efe35732ec13a7c"
Sep 15 10:19:45.828857 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:19:45.828821    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-rzxqx" event={"ID":"3723f1be-68cb-4624-8788-a240a3640495","Type":"ContainerStarted","Data":"0b2d4a1049e03edf1558565dee46b0cd03e256741d71e05249e87284cec6dc74"}
Sep 15 10:22:47.025480 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:22:47.025448    2579 kubelet.go:1648] "Image garbage collection succeeded"
Sep 15 10:23:12.254133 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:12.254096    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6699d7bd9c-bl6dv"]
Sep 15 10:23:12.256411 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:12.254398    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1798fb5d-8a9d-4068-b960-e371a235b84e" containerName="registry"
Sep 15 10:23:12.256411 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:12.254409    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1798fb5d-8a9d-4068-b960-e371a235b84e" containerName="registry"
Sep 15 10:23:12.256411 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:12.254480    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1798fb5d-8a9d-4068-b960-e371a235b84e" containerName="registry"
Sep 15 10:23:12.257407 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:12.257387    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6699d7bd9c-bl6dv"
Sep 15 10:23:12.263565 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:12.263530    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 15 10:23:12.263565 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:12.263568    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 15 10:23:12.263816 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:12.263568    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 15 10:23:12.263816 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:12.263598    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jkrwv\""
Sep 15 10:23:12.263816 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:12.263699    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 15 10:23:12.272552 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:12.272528    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6699d7bd9c-bl6dv"]
Sep 15 10:23:12.320580 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:12.320542    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f1f0c8e4-2edc-4730-b139-e5963034c519-manifests\") pod \"opendatahub-operator-controller-manager-6699d7bd9c-bl6dv\" (UID: \"f1f0c8e4-2edc-4730-b139-e5963034c519\") " pod="opendatahub/opendatahub-operator-controller-manager-6699d7bd9c-bl6dv"
Sep 15 10:23:12.320774 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:12.320593    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1f0c8e4-2edc-4730-b139-e5963034c519-tmp\") pod \"opendatahub-operator-controller-manager-6699d7bd9c-bl6dv\" (UID: \"f1f0c8e4-2edc-4730-b139-e5963034c519\") " pod="opendatahub/opendatahub-operator-controller-manager-6699d7bd9c-bl6dv"
Sep 15 10:23:12.320774 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:12.320648    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f1f0c8e4-2edc-4730-b139-e5963034c519-webhook-cert\") pod \"opendatahub-operator-controller-manager-6699d7bd9c-bl6dv\" (UID: \"f1f0c8e4-2edc-4730-b139-e5963034c519\") " pod="opendatahub/opendatahub-operator-controller-manager-6699d7bd9c-bl6dv"
Sep 15 10:23:12.320774 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:12.320718    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f1f0c8e4-2edc-4730-b139-e5963034c519-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6699d7bd9c-bl6dv\" (UID: \"f1f0c8e4-2edc-4730-b139-e5963034c519\") " pod="opendatahub/opendatahub-operator-controller-manager-6699d7bd9c-bl6dv"
Sep 15 10:23:12.320916 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:12.320824    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc74j\" (UniqueName: \"kubernetes.io/projected/f1f0c8e4-2edc-4730-b139-e5963034c519-kube-api-access-lc74j\") pod \"opendatahub-operator-controller-manager-6699d7bd9c-bl6dv\" (UID: \"f1f0c8e4-2edc-4730-b139-e5963034c519\") " pod="opendatahub/opendatahub-operator-controller-manager-6699d7bd9c-bl6dv"
Sep 15 10:23:12.421368 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:12.421332    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f1f0c8e4-2edc-4730-b139-e5963034c519-manifests\") pod \"opendatahub-operator-controller-manager-6699d7bd9c-bl6dv\" (UID: \"f1f0c8e4-2edc-4730-b139-e5963034c519\") " pod="opendatahub/opendatahub-operator-controller-manager-6699d7bd9c-bl6dv"
Sep 15 10:23:12.421368 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:12.421375    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1f0c8e4-2edc-4730-b139-e5963034c519-tmp\") pod \"opendatahub-operator-controller-manager-6699d7bd9c-bl6dv\" (UID: \"f1f0c8e4-2edc-4730-b139-e5963034c519\") " pod="opendatahub/opendatahub-operator-controller-manager-6699d7bd9c-bl6dv"
Sep 15 10:23:12.421628 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:12.421393    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f1f0c8e4-2edc-4730-b139-e5963034c519-webhook-cert\") pod \"opendatahub-operator-controller-manager-6699d7bd9c-bl6dv\" (UID: \"f1f0c8e4-2edc-4730-b139-e5963034c519\") " pod="opendatahub/opendatahub-operator-controller-manager-6699d7bd9c-bl6dv"
Sep 15 10:23:12.421628 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:12.421427    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f1f0c8e4-2edc-4730-b139-e5963034c519-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6699d7bd9c-bl6dv\" (UID: \"f1f0c8e4-2edc-4730-b139-e5963034c519\") " pod="opendatahub/opendatahub-operator-controller-manager-6699d7bd9c-bl6dv"
Sep 15 10:23:12.421628 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:12.421463    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc74j\" (UniqueName: \"kubernetes.io/projected/f1f0c8e4-2edc-4730-b139-e5963034c519-kube-api-access-lc74j\") pod \"opendatahub-operator-controller-manager-6699d7bd9c-bl6dv\" (UID: \"f1f0c8e4-2edc-4730-b139-e5963034c519\") " pod="opendatahub/opendatahub-operator-controller-manager-6699d7bd9c-bl6dv"
Sep 15 10:23:12.421868 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:12.421845    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f1f0c8e4-2edc-4730-b139-e5963034c519-manifests\") pod \"opendatahub-operator-controller-manager-6699d7bd9c-bl6dv\" (UID: \"f1f0c8e4-2edc-4730-b139-e5963034c519\") " pod="opendatahub/opendatahub-operator-controller-manager-6699d7bd9c-bl6dv"
Sep 15 10:23:12.423741 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:12.423706    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1f0c8e4-2edc-4730-b139-e5963034c519-tmp\") pod \"opendatahub-operator-controller-manager-6699d7bd9c-bl6dv\" (UID: \"f1f0c8e4-2edc-4730-b139-e5963034c519\") " pod="opendatahub/opendatahub-operator-controller-manager-6699d7bd9c-bl6dv"
Sep 15 10:23:12.423992 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:12.423977    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f1f0c8e4-2edc-4730-b139-e5963034c519-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6699d7bd9c-bl6dv\" (UID: \"f1f0c8e4-2edc-4730-b139-e5963034c519\") " pod="opendatahub/opendatahub-operator-controller-manager-6699d7bd9c-bl6dv"
Sep 15 10:23:12.424039 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:12.424019    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f1f0c8e4-2edc-4730-b139-e5963034c519-webhook-cert\") pod \"opendatahub-operator-controller-manager-6699d7bd9c-bl6dv\" (UID: \"f1f0c8e4-2edc-4730-b139-e5963034c519\") " pod="opendatahub/opendatahub-operator-controller-manager-6699d7bd9c-bl6dv"
Sep 15 10:23:12.429042 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:12.429009    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc74j\" (UniqueName: \"kubernetes.io/projected/f1f0c8e4-2edc-4730-b139-e5963034c519-kube-api-access-lc74j\") pod \"opendatahub-operator-controller-manager-6699d7bd9c-bl6dv\" (UID: \"f1f0c8e4-2edc-4730-b139-e5963034c519\") " pod="opendatahub/opendatahub-operator-controller-manager-6699d7bd9c-bl6dv"
Sep 15 10:23:12.574780 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:12.574718    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6699d7bd9c-bl6dv"
Sep 15 10:23:12.852172 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:12.852144    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6699d7bd9c-bl6dv"]
Sep 15 10:23:12.853310 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:23:12.853275    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1f0c8e4_2edc_4730_b139_e5963034c519.slice/crio-a33eed2d4096026f40f6185456ef528d9c7e7cf16f028ab0516714af13faa319 WatchSource:0}: Error finding container a33eed2d4096026f40f6185456ef528d9c7e7cf16f028ab0516714af13faa319: Status 404 returned error can't find the container with id a33eed2d4096026f40f6185456ef528d9c7e7cf16f028ab0516714af13faa319
Sep 15 10:23:12.854983 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:12.854965    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 10:23:13.615775 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:13.615713    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6699d7bd9c-bl6dv" event={"ID":"f1f0c8e4-2edc-4730-b139-e5963034c519","Type":"ContainerStarted","Data":"a33eed2d4096026f40f6185456ef528d9c7e7cf16f028ab0516714af13faa319"}
Sep 15 10:23:16.628882 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:16.628840    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6699d7bd9c-bl6dv" event={"ID":"f1f0c8e4-2edc-4730-b139-e5963034c519","Type":"ContainerStarted","Data":"cb4d1ff63ed3e64fb4cb53651f77d6b53a23fb5fd0fa547a854db0301770dbb7"}
Sep 15 10:23:17.635444 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:17.635408    2579 generic.go:356] "Generic (PLEG): container finished" podID="f1f0c8e4-2edc-4730-b139-e5963034c519" containerID="cb4d1ff63ed3e64fb4cb53651f77d6b53a23fb5fd0fa547a854db0301770dbb7" exitCode=0
Sep 15 10:23:17.635860 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:17.635493    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6699d7bd9c-bl6dv" event={"ID":"f1f0c8e4-2edc-4730-b139-e5963034c519","Type":"ContainerDied","Data":"cb4d1ff63ed3e64fb4cb53651f77d6b53a23fb5fd0fa547a854db0301770dbb7"}
Sep 15 10:23:18.642589 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:18.642548    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6699d7bd9c-bl6dv" event={"ID":"f1f0c8e4-2edc-4730-b139-e5963034c519","Type":"ContainerStarted","Data":"9cb2300ec30106727e7da89051f7ed3e677b8b7ec7b8b51b783b2d552c8ea6b5"}
Sep 15 10:23:18.643028 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:18.642687    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6699d7bd9c-bl6dv"
Sep 15 10:23:18.664597 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:18.664542    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6699d7bd9c-bl6dv" podStartSLOduration=2.27834904 podStartE2EDuration="6.664525276s" totalImagesPullingTime="3.307204996s" totalInitContainerRuntime="1.07897124s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:23:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:23:18.663336049 +0000 UTC m=+332.059428140" watchObservedRunningTime="2026-09-15 10:23:18.664525276 +0000 UTC m=+332.060617364"
Sep 15 10:23:29.649278 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:29.649247    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6699d7bd9c-bl6dv"
Sep 15 10:23:31.641850 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:31.641815    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-58df565b49-nnp8b"]
Sep 15 10:23:31.656005 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:31.655971    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-58df565b49-nnp8b"
Sep 15 10:23:31.656913 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:31.656890    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-58df565b49-nnp8b"]
Sep 15 10:23:31.658547 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:31.658525    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 15 10:23:31.659023 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:31.658998    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 15 10:23:31.774944 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:31.774908    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df6356ab-59ce-4c29-b89e-e1fd72214d47-tls-certs\") pod \"kube-auth-proxy-58df565b49-nnp8b\" (UID: \"df6356ab-59ce-4c29-b89e-e1fd72214d47\") " pod="openshift-ingress/kube-auth-proxy-58df565b49-nnp8b"
Sep 15 10:23:31.774944 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:31.774951    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df6356ab-59ce-4c29-b89e-e1fd72214d47-tmp\") pod \"kube-auth-proxy-58df565b49-nnp8b\" (UID: \"df6356ab-59ce-4c29-b89e-e1fd72214d47\") " pod="openshift-ingress/kube-auth-proxy-58df565b49-nnp8b"
Sep 15 10:23:31.775153 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:31.774967    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7s9v4\" (UniqueName: \"kubernetes.io/projected/df6356ab-59ce-4c29-b89e-e1fd72214d47-kube-api-access-7s9v4\") pod \"kube-auth-proxy-58df565b49-nnp8b\" (UID: \"df6356ab-59ce-4c29-b89e-e1fd72214d47\") " pod="openshift-ingress/kube-auth-proxy-58df565b49-nnp8b"
Sep 15 10:23:31.876192 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:31.876155    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df6356ab-59ce-4c29-b89e-e1fd72214d47-tls-certs\") pod \"kube-auth-proxy-58df565b49-nnp8b\" (UID: \"df6356ab-59ce-4c29-b89e-e1fd72214d47\") " pod="openshift-ingress/kube-auth-proxy-58df565b49-nnp8b"
Sep 15 10:23:31.876192 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:31.876195    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df6356ab-59ce-4c29-b89e-e1fd72214d47-tmp\") pod \"kube-auth-proxy-58df565b49-nnp8b\" (UID: \"df6356ab-59ce-4c29-b89e-e1fd72214d47\") " pod="openshift-ingress/kube-auth-proxy-58df565b49-nnp8b"
Sep 15 10:23:31.876395 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:31.876212    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7s9v4\" (UniqueName: \"kubernetes.io/projected/df6356ab-59ce-4c29-b89e-e1fd72214d47-kube-api-access-7s9v4\") pod \"kube-auth-proxy-58df565b49-nnp8b\" (UID: \"df6356ab-59ce-4c29-b89e-e1fd72214d47\") " pod="openshift-ingress/kube-auth-proxy-58df565b49-nnp8b"
Sep 15 10:23:31.876395 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:23:31.876304    2579 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Sep 15 10:23:31.876395 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:23:31.876390    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df6356ab-59ce-4c29-b89e-e1fd72214d47-tls-certs podName:df6356ab-59ce-4c29-b89e-e1fd72214d47 nodeName:}" failed. No retries permitted until 2026-09-15 10:23:32.376369828 +0000 UTC m=+345.772461899 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/df6356ab-59ce-4c29-b89e-e1fd72214d47-tls-certs") pod "kube-auth-proxy-58df565b49-nnp8b" (UID: "df6356ab-59ce-4c29-b89e-e1fd72214d47") : secret "kube-auth-proxy-tls" not found
Sep 15 10:23:31.878378 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:31.878360    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df6356ab-59ce-4c29-b89e-e1fd72214d47-tmp\") pod \"kube-auth-proxy-58df565b49-nnp8b\" (UID: \"df6356ab-59ce-4c29-b89e-e1fd72214d47\") " pod="openshift-ingress/kube-auth-proxy-58df565b49-nnp8b"
Sep 15 10:23:31.889495 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:31.889470    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7s9v4\" (UniqueName: \"kubernetes.io/projected/df6356ab-59ce-4c29-b89e-e1fd72214d47-kube-api-access-7s9v4\") pod \"kube-auth-proxy-58df565b49-nnp8b\" (UID: \"df6356ab-59ce-4c29-b89e-e1fd72214d47\") " pod="openshift-ingress/kube-auth-proxy-58df565b49-nnp8b"
Sep 15 10:23:32.379663 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:32.379628    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df6356ab-59ce-4c29-b89e-e1fd72214d47-tls-certs\") pod \"kube-auth-proxy-58df565b49-nnp8b\" (UID: \"df6356ab-59ce-4c29-b89e-e1fd72214d47\") " pod="openshift-ingress/kube-auth-proxy-58df565b49-nnp8b"
Sep 15 10:23:32.382165 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:32.382145    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df6356ab-59ce-4c29-b89e-e1fd72214d47-tls-certs\") pod \"kube-auth-proxy-58df565b49-nnp8b\" (UID: \"df6356ab-59ce-4c29-b89e-e1fd72214d47\") " pod="openshift-ingress/kube-auth-proxy-58df565b49-nnp8b"
Sep 15 10:23:32.566551 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:32.566515    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-58df565b49-nnp8b"
Sep 15 10:23:32.834908 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:32.834878    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-58df565b49-nnp8b"]
Sep 15 10:23:32.837428 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:23:32.837394    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf6356ab_59ce_4c29_b89e_e1fd72214d47.slice/crio-88ed90f09700b7d0161250c1af42bab0cb383553178e6f2314e96a1bb3a07bcf WatchSource:0}: Error finding container 88ed90f09700b7d0161250c1af42bab0cb383553178e6f2314e96a1bb3a07bcf: Status 404 returned error can't find the container with id 88ed90f09700b7d0161250c1af42bab0cb383553178e6f2314e96a1bb3a07bcf
Sep 15 10:23:33.038502 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:33.038470    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5jvzp"]
Sep 15 10:23:33.044416 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:33.044385    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5jvzp"
Sep 15 10:23:33.046890 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:33.046871    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 15 10:23:33.047195 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:33.047180    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 15 10:23:33.047268 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:33.047205    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 15 10:23:33.047268 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:33.047223    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-rfv6l\""
Sep 15 10:23:33.047268 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:33.047205    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 15 10:23:33.060109 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:33.060082    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5jvzp"]
Sep 15 10:23:33.185967 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:33.185882    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-5jvzp\" (UID: \"16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5jvzp"
Sep 15 10:23:33.185967 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:33.185920    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87rll\" (UniqueName: \"kubernetes.io/projected/16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8-kube-api-access-87rll\") pod \"istiod-openshift-gateway-7b7995d5cd-5jvzp\" (UID: \"16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5jvzp"
Sep 15 10:23:33.186155 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:33.185978    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-5jvzp\" (UID: \"16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5jvzp"
Sep 15 10:23:33.186155 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:33.186012    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-5jvzp\" (UID: \"16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5jvzp"
Sep 15 10:23:33.186155 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:33.186072    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-5jvzp\" (UID: \"16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5jvzp"
Sep 15 10:23:33.186155 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:33.186107    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-5jvzp\" (UID: \"16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5jvzp"
Sep 15 10:23:33.186297 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:33.186162    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-5jvzp\" (UID: \"16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5jvzp"
Sep 15 10:23:33.287070 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:33.287025    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-5jvzp\" (UID: \"16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5jvzp"
Sep 15 10:23:33.287269 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:33.287105    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-5jvzp\" (UID: \"16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5jvzp"
Sep 15 10:23:33.287269 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:33.287146    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87rll\" (UniqueName: \"kubernetes.io/projected/16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8-kube-api-access-87rll\") pod \"istiod-openshift-gateway-7b7995d5cd-5jvzp\" (UID: \"16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5jvzp"
Sep 15 10:23:33.287386 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:33.287269    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-5jvzp\" (UID: \"16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5jvzp"
Sep 15 10:23:33.287386 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:33.287309    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-5jvzp\" (UID: \"16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5jvzp"
Sep 15 10:23:33.287386 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:33.287355    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-5jvzp\" (UID: \"16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5jvzp"
Sep 15 10:23:33.287522 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:33.287502    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-5jvzp\" (UID: \"16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5jvzp"
Sep 15 10:23:33.288007 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:33.287981    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-5jvzp\" (UID: \"16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5jvzp"
Sep 15 10:23:33.289676 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:33.289653    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-5jvzp\" (UID: \"16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5jvzp"
Sep 15 10:23:33.289802 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:33.289676    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-5jvzp\" (UID: \"16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5jvzp"
Sep 15 10:23:33.290041 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:33.290024    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-5jvzp\" (UID: \"16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5jvzp"
Sep 15 10:23:33.290083 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:33.290040    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-5jvzp\" (UID: \"16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5jvzp"
Sep 15 10:23:33.296519 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:33.296497    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87rll\" (UniqueName: \"kubernetes.io/projected/16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8-kube-api-access-87rll\") pod \"istiod-openshift-gateway-7b7995d5cd-5jvzp\" (UID: \"16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5jvzp"
Sep 15 10:23:33.297074 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:33.297054    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-5jvzp\" (UID: \"16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5jvzp"
Sep 15 10:23:33.354483 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:33.354432    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5jvzp"
Sep 15 10:23:33.632661 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:33.632627    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5jvzp"]
Sep 15 10:23:33.634170 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:23:33.634139    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16362c1d_e6c0_4a8e_bbb3_2ed78fdca6a8.slice/crio-413870d69e8ae971c2ff076dcafe6f0186b237ee58391c1658f6dc15425bac52 WatchSource:0}: Error finding container 413870d69e8ae971c2ff076dcafe6f0186b237ee58391c1658f6dc15425bac52: Status 404 returned error can't find the container with id 413870d69e8ae971c2ff076dcafe6f0186b237ee58391c1658f6dc15425bac52
Sep 15 10:23:33.708294 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:33.708143    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5jvzp" event={"ID":"16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8","Type":"ContainerStarted","Data":"413870d69e8ae971c2ff076dcafe6f0186b237ee58391c1658f6dc15425bac52"}
Sep 15 10:23:33.709933 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:33.709887    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-58df565b49-nnp8b" event={"ID":"df6356ab-59ce-4c29-b89e-e1fd72214d47","Type":"ContainerStarted","Data":"88ed90f09700b7d0161250c1af42bab0cb383553178e6f2314e96a1bb3a07bcf"}
Sep 15 10:23:35.721680 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:35.721641    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-58df565b49-nnp8b" event={"ID":"df6356ab-59ce-4c29-b89e-e1fd72214d47","Type":"ContainerStarted","Data":"e07674d20b36bb526c51a24094145e747541c82445c38bfc8169b7a839c3346e"}
Sep 15 10:23:35.740458 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:35.740390    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-58df565b49-nnp8b" podStartSLOduration=2.06125081 podStartE2EDuration="4.740365254s" totalImagesPullingTime="2.679114444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:23:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:23:35.737171799 +0000 UTC m=+349.133263887" watchObservedRunningTime="2026-09-15 10:23:35.740365254 +0000 UTC m=+349.136457369"
Sep 15 10:23:37.305957 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:37.305917    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:23:37.306203 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:37.305994    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:23:37.733051 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:37.732953    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5jvzp" event={"ID":"16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8","Type":"ContainerStarted","Data":"b57ac24c681bddd7e7490c4fc84552c2ed17865c989cb0142d24b46393647f5a"}
Sep 15 10:23:37.733051 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:37.733019    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5jvzp"
Sep 15 10:23:37.757816 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:37.757758    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5jvzp" podStartSLOduration=1.088912593 podStartE2EDuration="4.757743634s" totalImagesPullingTime="3.668831041s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:23:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:23:37.755936825 +0000 UTC m=+351.152028912" watchObservedRunningTime="2026-09-15 10:23:37.757743634 +0000 UTC m=+351.153835715"
Sep 15 10:23:38.739513 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:38.739482    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5jvzp"
Sep 15 10:23:51.556383 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:51.556306    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-w665l"]
Sep 15 10:23:51.561100 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:51.561067    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-w665l"
Sep 15 10:23:51.563916 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:51.563890    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 15 10:23:51.564224 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:51.564200    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-lg9qm\""
Sep 15 10:23:51.573322 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:51.573298    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-w665l"]
Sep 15 10:23:51.648522 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:51.648476    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdrm7\" (UniqueName: \"kubernetes.io/projected/5c106c2b-9cab-4065-94fc-570cb38a824c-kube-api-access-gdrm7\") pod \"llmisvc-controller-manager-777c6bd7d5-w665l\" (UID: \"5c106c2b-9cab-4065-94fc-570cb38a824c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-w665l"
Sep 15 10:23:51.648715 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:51.648540    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c106c2b-9cab-4065-94fc-570cb38a824c-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-w665l\" (UID: \"5c106c2b-9cab-4065-94fc-570cb38a824c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-w665l"
Sep 15 10:23:51.749083 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:51.749022    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdrm7\" (UniqueName: \"kubernetes.io/projected/5c106c2b-9cab-4065-94fc-570cb38a824c-kube-api-access-gdrm7\") pod \"llmisvc-controller-manager-777c6bd7d5-w665l\" (UID: \"5c106c2b-9cab-4065-94fc-570cb38a824c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-w665l"
Sep 15 10:23:51.749259 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:51.749119    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c106c2b-9cab-4065-94fc-570cb38a824c-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-w665l\" (UID: \"5c106c2b-9cab-4065-94fc-570cb38a824c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-w665l"
Sep 15 10:23:51.751511 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:51.751486    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c106c2b-9cab-4065-94fc-570cb38a824c-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-w665l\" (UID: \"5c106c2b-9cab-4065-94fc-570cb38a824c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-w665l"
Sep 15 10:23:51.758646 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:51.758627    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdrm7\" (UniqueName: \"kubernetes.io/projected/5c106c2b-9cab-4065-94fc-570cb38a824c-kube-api-access-gdrm7\") pod \"llmisvc-controller-manager-777c6bd7d5-w665l\" (UID: \"5c106c2b-9cab-4065-94fc-570cb38a824c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-w665l"
Sep 15 10:23:51.874688 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:51.874594    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-w665l"
Sep 15 10:23:52.145068 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:52.144886    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-w665l"]
Sep 15 10:23:52.147363 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:23:52.147342    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5c106c2b_9cab_4065_94fc_570cb38a824c.slice/crio-3cf9f25e5fcec3bf3e681d81457af8a0fc68e6c11b3615bd5e72bfdd5567ff51 WatchSource:0}: Error finding container 3cf9f25e5fcec3bf3e681d81457af8a0fc68e6c11b3615bd5e72bfdd5567ff51: Status 404 returned error can't find the container with id 3cf9f25e5fcec3bf3e681d81457af8a0fc68e6c11b3615bd5e72bfdd5567ff51
Sep 15 10:23:52.803178 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:52.803147    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-w665l" event={"ID":"5c106c2b-9cab-4065-94fc-570cb38a824c","Type":"ContainerStarted","Data":"3cf9f25e5fcec3bf3e681d81457af8a0fc68e6c11b3615bd5e72bfdd5567ff51"}
Sep 15 10:23:53.880764 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:53.880716    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5jvzp"]
Sep 15 10:23:53.881167 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:53.880934    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5jvzp" podUID="16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8" containerName="discovery" containerID="cri-o://b57ac24c681bddd7e7490c4fc84552c2ed17865c989cb0142d24b46393647f5a" gracePeriod=30
Sep 15 10:23:54.134511 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:54.134452    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5jvzp"
Sep 15 10:23:54.272642 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:54.272595    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-87rll\" (UniqueName: \"kubernetes.io/projected/16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8-kube-api-access-87rll\") pod \"16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8\" (UID: \"16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8\") "
Sep 15 10:23:54.272642 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:54.272644    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8-istio-kubeconfig\") pod \"16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8\" (UID: \"16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8\") "
Sep 15 10:23:54.272906 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:54.272684    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8-istio-csr-dns-cert\") pod \"16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8\" (UID: \"16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8\") "
Sep 15 10:23:54.272906 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:54.272711    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8-cacerts\") pod \"16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8\" (UID: \"16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8\") "
Sep 15 10:23:54.272906 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:54.272764    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8-local-certs\") pod \"16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8\" (UID: \"16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8\") "
Sep 15 10:23:54.272906 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:54.272787    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8-istio-csr-ca-configmap\") pod \"16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8\" (UID: \"16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8\") "
Sep 15 10:23:54.272906 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:54.272853    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8-istio-token\") pod \"16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8\" (UID: \"16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8\") "
Sep 15 10:23:54.273298 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:54.273271    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8" (UID: "16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:23:54.275173 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:54.275143    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8" (UID: "16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 10:23:54.275294 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:54.275166    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8-cacerts" (OuterVolumeSpecName: "cacerts") pod "16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8" (UID: "16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 10:23:54.275352 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:54.275284    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8-local-certs" (OuterVolumeSpecName: "local-certs") pod "16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8" (UID: "16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:23:54.275352 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:54.275301    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8-kube-api-access-87rll" (OuterVolumeSpecName: "kube-api-access-87rll") pod "16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8" (UID: "16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8"). InnerVolumeSpecName "kube-api-access-87rll". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:23:54.275435 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:54.275404    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8" (UID: "16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 10:23:54.275470 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:54.275437    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8-istio-token" (OuterVolumeSpecName: "istio-token") pod "16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8" (UID: "16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:23:54.374138 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:54.374104    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-87rll\" (UniqueName: \"kubernetes.io/projected/16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8-kube-api-access-87rll\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:23:54.374138 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:54.374134    2579 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8-istio-kubeconfig\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:23:54.374138 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:54.374144    2579 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8-istio-csr-dns-cert\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:23:54.374369 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:54.374152    2579 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8-cacerts\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:23:54.374369 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:54.374162    2579 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8-local-certs\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:23:54.374369 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:54.374170    2579 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8-istio-csr-ca-configmap\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:23:54.374369 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:54.374178    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8-istio-token\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:23:54.815945 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:54.815910    2579 generic.go:356] "Generic (PLEG): container finished" podID="16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8" containerID="b57ac24c681bddd7e7490c4fc84552c2ed17865c989cb0142d24b46393647f5a" exitCode=0
Sep 15 10:23:54.816135 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:54.815951    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5jvzp"
Sep 15 10:23:54.816135 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:54.815982    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5jvzp" event={"ID":"16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8","Type":"ContainerDied","Data":"b57ac24c681bddd7e7490c4fc84552c2ed17865c989cb0142d24b46393647f5a"}
Sep 15 10:23:54.816135 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:54.816049    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5jvzp" event={"ID":"16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8","Type":"ContainerDied","Data":"413870d69e8ae971c2ff076dcafe6f0186b237ee58391c1658f6dc15425bac52"}
Sep 15 10:23:54.816135 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:54.816077    2579 scope.go:117] "RemoveContainer" containerID="b57ac24c681bddd7e7490c4fc84552c2ed17865c989cb0142d24b46393647f5a"
Sep 15 10:23:54.841765 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:54.841715    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5jvzp"]
Sep 15 10:23:54.846591 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:54.846560    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5jvzp"]
Sep 15 10:23:54.969022 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:54.968866    2579 scope.go:117] "RemoveContainer" containerID="b57ac24c681bddd7e7490c4fc84552c2ed17865c989cb0142d24b46393647f5a"
Sep 15 10:23:54.969251 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:23:54.969212    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b57ac24c681bddd7e7490c4fc84552c2ed17865c989cb0142d24b46393647f5a\": container with ID starting with b57ac24c681bddd7e7490c4fc84552c2ed17865c989cb0142d24b46393647f5a not found: ID does not exist" containerID="b57ac24c681bddd7e7490c4fc84552c2ed17865c989cb0142d24b46393647f5a"
Sep 15 10:23:54.969289 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:54.969254    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b57ac24c681bddd7e7490c4fc84552c2ed17865c989cb0142d24b46393647f5a"} err="failed to get container status \"b57ac24c681bddd7e7490c4fc84552c2ed17865c989cb0142d24b46393647f5a\": rpc error: code = NotFound desc = could not find container \"b57ac24c681bddd7e7490c4fc84552c2ed17865c989cb0142d24b46393647f5a\": container with ID starting with b57ac24c681bddd7e7490c4fc84552c2ed17865c989cb0142d24b46393647f5a not found: ID does not exist"
Sep 15 10:23:55.147553 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:55.147524    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8" path="/var/lib/kubelet/pods/16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8/volumes"
Sep 15 10:23:55.822247 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:55.822210    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-w665l" event={"ID":"5c106c2b-9cab-4065-94fc-570cb38a824c","Type":"ContainerStarted","Data":"2596c48303479e3688743ffd6fbf7d5412607244a005ddb5c3b71d69372edcfa"}
Sep 15 10:23:55.822431 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:23:55.822338    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-w665l"
Sep 15 10:24:26.829586 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:24:26.829551    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-w665l"
Sep 15 10:24:26.846155 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:24:26.846090    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-w665l" podStartSLOduration=32.978618299 podStartE2EDuration="35.846067904s" totalImagesPullingTime="2.867449605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:23:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:23:55.864303744 +0000 UTC m=+369.260395836" watchObservedRunningTime="2026-09-15 10:24:26.846067904 +0000 UTC m=+400.242159994"
Sep 15 10:24:59.115188 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:24:59.115153    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-h784l"]
Sep 15 10:24:59.115613 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:24:59.115480    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8" containerName="discovery"
Sep 15 10:24:59.115613 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:24:59.115492    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8" containerName="discovery"
Sep 15 10:24:59.115613 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:24:59.115560    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="16362c1d-e6c0-4a8e-bbb3-2ed78fdca6a8" containerName="discovery"
Sep 15 10:24:59.119755 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:24:59.119719    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-h784l"
Sep 15 10:24:59.123185 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:24:59.123166    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 15 10:24:59.123469 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:24:59.123452    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-vlv5n\""
Sep 15 10:24:59.123572 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:24:59.123554    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 15 10:24:59.124071 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:24:59.124057    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 15 10:24:59.133687 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:24:59.133660    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-h784l"]
Sep 15 10:24:59.299853 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:24:59.299810    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7pvd\" (UniqueName: \"kubernetes.io/projected/63c8dc47-0204-4647-a628-0aba034f0496-kube-api-access-d7pvd\") pod \"dns-operator-controller-manager-7b84cd7c9c-h784l\" (UID: \"63c8dc47-0204-4647-a628-0aba034f0496\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-h784l"
Sep 15 10:24:59.400485 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:24:59.400397    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7pvd\" (UniqueName: \"kubernetes.io/projected/63c8dc47-0204-4647-a628-0aba034f0496-kube-api-access-d7pvd\") pod \"dns-operator-controller-manager-7b84cd7c9c-h784l\" (UID: \"63c8dc47-0204-4647-a628-0aba034f0496\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-h784l"
Sep 15 10:24:59.409749 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:24:59.409711    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7pvd\" (UniqueName: \"kubernetes.io/projected/63c8dc47-0204-4647-a628-0aba034f0496-kube-api-access-d7pvd\") pod \"dns-operator-controller-manager-7b84cd7c9c-h784l\" (UID: \"63c8dc47-0204-4647-a628-0aba034f0496\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-h784l"
Sep 15 10:24:59.430170 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:24:59.430140    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-h784l"
Sep 15 10:24:59.701077 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:24:59.701051    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-h784l"]
Sep 15 10:24:59.703340 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:24:59.703311    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63c8dc47_0204_4647_a628_0aba034f0496.slice/crio-39b257f64469fcf3093f6e10dcd5833ba861e7fc5253749046d9e08652264970 WatchSource:0}: Error finding container 39b257f64469fcf3093f6e10dcd5833ba861e7fc5253749046d9e08652264970: Status 404 returned error can't find the container with id 39b257f64469fcf3093f6e10dcd5833ba861e7fc5253749046d9e08652264970
Sep 15 10:25:00.095411 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:00.095375    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-h784l" event={"ID":"63c8dc47-0204-4647-a628-0aba034f0496","Type":"ContainerStarted","Data":"39b257f64469fcf3093f6e10dcd5833ba861e7fc5253749046d9e08652264970"}
Sep 15 10:25:01.572687 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:01.572650    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-rwzr7"]
Sep 15 10:25:01.583250 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:01.583214    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-rwzr7"
Sep 15 10:25:01.586243 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:01.586210    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-nt84p\""
Sep 15 10:25:01.588496 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:01.588453    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-rwzr7"]
Sep 15 10:25:01.720213 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:01.720167    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9zcl\" (UniqueName: \"kubernetes.io/projected/ce598231-f2bd-402d-9de6-cc60a655f4f8-kube-api-access-h9zcl\") pod \"authorino-operator-76b478bd78-rwzr7\" (UID: \"ce598231-f2bd-402d-9de6-cc60a655f4f8\") " pod="kuadrant-system/authorino-operator-76b478bd78-rwzr7"
Sep 15 10:25:01.821096 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:01.821053    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9zcl\" (UniqueName: \"kubernetes.io/projected/ce598231-f2bd-402d-9de6-cc60a655f4f8-kube-api-access-h9zcl\") pod \"authorino-operator-76b478bd78-rwzr7\" (UID: \"ce598231-f2bd-402d-9de6-cc60a655f4f8\") " pod="kuadrant-system/authorino-operator-76b478bd78-rwzr7"
Sep 15 10:25:01.833032 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:01.832953    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9zcl\" (UniqueName: \"kubernetes.io/projected/ce598231-f2bd-402d-9de6-cc60a655f4f8-kube-api-access-h9zcl\") pod \"authorino-operator-76b478bd78-rwzr7\" (UID: \"ce598231-f2bd-402d-9de6-cc60a655f4f8\") " pod="kuadrant-system/authorino-operator-76b478bd78-rwzr7"
Sep 15 10:25:01.897343 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:01.897305    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-rwzr7"
Sep 15 10:25:02.312846 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:02.312811    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-rwzr7"]
Sep 15 10:25:02.316305 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:25:02.316274    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce598231_f2bd_402d_9de6_cc60a655f4f8.slice/crio-62a123b94bae2b5a3b85f2a8e1e10fccfca5523e23c47b0ba6c573b8266af758 WatchSource:0}: Error finding container 62a123b94bae2b5a3b85f2a8e1e10fccfca5523e23c47b0ba6c573b8266af758: Status 404 returned error can't find the container with id 62a123b94bae2b5a3b85f2a8e1e10fccfca5523e23c47b0ba6c573b8266af758
Sep 15 10:25:03.115641 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:03.115607    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-h784l" event={"ID":"63c8dc47-0204-4647-a628-0aba034f0496","Type":"ContainerStarted","Data":"7c1e602153f8232ccecf8b3dd3f80941777845548edce8577f340066a7552c2c"}
Sep 15 10:25:03.116055 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:03.115740    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-h784l"
Sep 15 10:25:03.117028 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:03.117006    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-rwzr7" event={"ID":"ce598231-f2bd-402d-9de6-cc60a655f4f8","Type":"ContainerStarted","Data":"62a123b94bae2b5a3b85f2a8e1e10fccfca5523e23c47b0ba6c573b8266af758"}
Sep 15 10:25:03.134776 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:03.134686    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-h784l" podStartSLOduration=1.728738267 podStartE2EDuration="4.134667348s" totalImagesPullingTime="2.405929081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:24:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:25:03.133968349 +0000 UTC m=+436.530060437" watchObservedRunningTime="2026-09-15 10:25:03.134667348 +0000 UTC m=+436.530759437"
Sep 15 10:25:04.049231 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:04.049193    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-tw5h4"]
Sep 15 10:25:04.053013 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:04.052989    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-tw5h4"
Sep 15 10:25:04.057119 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:04.057065    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-qbsf8\""
Sep 15 10:25:04.065812 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:04.065788    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-tw5h4"]
Sep 15 10:25:04.140130 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:04.140090    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qb2sz\" (UniqueName: \"kubernetes.io/projected/d9234926-294c-4c4d-958b-e1973436dc8b-kube-api-access-qb2sz\") pod \"limitador-operator-controller-manager-74495c69f8-tw5h4\" (UID: \"d9234926-294c-4c4d-958b-e1973436dc8b\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-tw5h4"
Sep 15 10:25:04.241255 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:04.241219    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qb2sz\" (UniqueName: \"kubernetes.io/projected/d9234926-294c-4c4d-958b-e1973436dc8b-kube-api-access-qb2sz\") pod \"limitador-operator-controller-manager-74495c69f8-tw5h4\" (UID: \"d9234926-294c-4c4d-958b-e1973436dc8b\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-tw5h4"
Sep 15 10:25:04.249793 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:04.249764    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qb2sz\" (UniqueName: \"kubernetes.io/projected/d9234926-294c-4c4d-958b-e1973436dc8b-kube-api-access-qb2sz\") pod \"limitador-operator-controller-manager-74495c69f8-tw5h4\" (UID: \"d9234926-294c-4c4d-958b-e1973436dc8b\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-tw5h4"
Sep 15 10:25:04.366041 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:04.365955    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-tw5h4"
Sep 15 10:25:04.737484 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:04.737458    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-tw5h4"]
Sep 15 10:25:04.739520 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:25:04.739487    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9234926_294c_4c4d_958b_e1973436dc8b.slice/crio-491c204d356e0085262bef10a91135fe131253dffb965d3aa6e5c2a023b83f62 WatchSource:0}: Error finding container 491c204d356e0085262bef10a91135fe131253dffb965d3aa6e5c2a023b83f62: Status 404 returned error can't find the container with id 491c204d356e0085262bef10a91135fe131253dffb965d3aa6e5c2a023b83f62
Sep 15 10:25:05.127742 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:05.127686    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-tw5h4" event={"ID":"d9234926-294c-4c4d-958b-e1973436dc8b","Type":"ContainerStarted","Data":"491c204d356e0085262bef10a91135fe131253dffb965d3aa6e5c2a023b83f62"}
Sep 15 10:25:05.129282 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:05.129257    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-rwzr7" event={"ID":"ce598231-f2bd-402d-9de6-cc60a655f4f8","Type":"ContainerStarted","Data":"c5d3e5f51a3710f71e403e30b310eaf3cf9da58faf52df49d4fdccc78726460c"}
Sep 15 10:25:05.129417 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:05.129401    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-rwzr7"
Sep 15 10:25:05.158050 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:05.157994    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-rwzr7" podStartSLOduration=1.9462630220000001 podStartE2EDuration="4.157967031s" totalImagesPullingTime="2.211704009s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:25:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:25:05.156507651 +0000 UTC m=+438.552599738" watchObservedRunningTime="2026-09-15 10:25:05.157967031 +0000 UTC m=+438.554059117"
Sep 15 10:25:07.141361 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:07.141323    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-tw5h4" event={"ID":"d9234926-294c-4c4d-958b-e1973436dc8b","Type":"ContainerStarted","Data":"7ab6d74145ae499cfbb89bf5870525982e32a4a91102ee66d24f164cbc5ad3a5"}
Sep 15 10:25:07.141752 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:07.141386    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-tw5h4"
Sep 15 10:25:07.160631 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:07.160576    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-tw5h4" podStartSLOduration=1.628089635 podStartE2EDuration="3.160562003s" totalImagesPullingTime="1.532472368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:25:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:25:07.160467039 +0000 UTC m=+440.556559125" watchObservedRunningTime="2026-09-15 10:25:07.160562003 +0000 UTC m=+440.556654090"
Sep 15 10:25:07.895464 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:07.895422    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs6gd"]
Sep 15 10:25:07.899050 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:07.899026    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs6gd"
Sep 15 10:25:07.901816 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:07.901792    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-z7jr5\""
Sep 15 10:25:07.910918 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:07.910889    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs6gd"]
Sep 15 10:25:08.074068 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:08.074034    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2vbc\" (UniqueName: \"kubernetes.io/projected/8bbfc790-8ac2-46ea-abeb-83aed3c900bb-kube-api-access-z2vbc\") pod \"kuadrant-operator-controller-manager-76f8f686bf-qs6gd\" (UID: \"8bbfc790-8ac2-46ea-abeb-83aed3c900bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs6gd"
Sep 15 10:25:08.074068 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:08.074074    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8bbfc790-8ac2-46ea-abeb-83aed3c900bb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-qs6gd\" (UID: \"8bbfc790-8ac2-46ea-abeb-83aed3c900bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs6gd"
Sep 15 10:25:08.175169 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:08.175068    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2vbc\" (UniqueName: \"kubernetes.io/projected/8bbfc790-8ac2-46ea-abeb-83aed3c900bb-kube-api-access-z2vbc\") pod \"kuadrant-operator-controller-manager-76f8f686bf-qs6gd\" (UID: \"8bbfc790-8ac2-46ea-abeb-83aed3c900bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs6gd"
Sep 15 10:25:08.175169 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:08.175110    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8bbfc790-8ac2-46ea-abeb-83aed3c900bb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-qs6gd\" (UID: \"8bbfc790-8ac2-46ea-abeb-83aed3c900bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs6gd"
Sep 15 10:25:08.175587 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:08.175479    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8bbfc790-8ac2-46ea-abeb-83aed3c900bb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-qs6gd\" (UID: \"8bbfc790-8ac2-46ea-abeb-83aed3c900bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs6gd"
Sep 15 10:25:08.183156 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:08.183126    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2vbc\" (UniqueName: \"kubernetes.io/projected/8bbfc790-8ac2-46ea-abeb-83aed3c900bb-kube-api-access-z2vbc\") pod \"kuadrant-operator-controller-manager-76f8f686bf-qs6gd\" (UID: \"8bbfc790-8ac2-46ea-abeb-83aed3c900bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs6gd"
Sep 15 10:25:08.209174 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:08.209138    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs6gd"
Sep 15 10:25:08.487138 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:08.487112    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs6gd"]
Sep 15 10:25:08.488214 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:25:08.488192    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bbfc790_8ac2_46ea_abeb_83aed3c900bb.slice/crio-372390b5956726b7604eb2850598c69dc5e8f698a7250dd69446ad619bbf1314 WatchSource:0}: Error finding container 372390b5956726b7604eb2850598c69dc5e8f698a7250dd69446ad619bbf1314: Status 404 returned error can't find the container with id 372390b5956726b7604eb2850598c69dc5e8f698a7250dd69446ad619bbf1314
Sep 15 10:25:09.152606 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:09.152528    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs6gd" event={"ID":"8bbfc790-8ac2-46ea-abeb-83aed3c900bb","Type":"ContainerStarted","Data":"372390b5956726b7604eb2850598c69dc5e8f698a7250dd69446ad619bbf1314"}
Sep 15 10:25:13.179521 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:13.179479    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs6gd" event={"ID":"8bbfc790-8ac2-46ea-abeb-83aed3c900bb","Type":"ContainerStarted","Data":"22968a952c56a3ba11dba55fac393424f535a84a418eddbc636aa1cb52aeca05"}
Sep 15 10:25:13.179981 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:13.179560    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs6gd"
Sep 15 10:25:13.204639 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:13.204586    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs6gd" podStartSLOduration=2.405717426 podStartE2EDuration="6.204569389s" totalImagesPullingTime="3.798851963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:25:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:25:13.201171582 +0000 UTC m=+446.597263709" watchObservedRunningTime="2026-09-15 10:25:13.204569389 +0000 UTC m=+446.600661475"
Sep 15 10:25:14.125482 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:14.125453    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-h784l"
Sep 15 10:25:16.137402 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:16.137368    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-rwzr7"
Sep 15 10:25:18.149846 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:18.149815    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-tw5h4"
Sep 15 10:25:24.186182 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:24.186149    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs6gd"
Sep 15 10:25:25.130418 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:25.130381    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-rbbrf"]
Sep 15 10:25:25.137110 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:25.137083    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-rbbrf"
Sep 15 10:25:25.149442 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:25.149417    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-rbbrf"]
Sep 15 10:25:25.219341 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:25.219302    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phcql\" (UniqueName: \"kubernetes.io/projected/36711b9a-855e-47dd-9948-468aef2f0fe4-kube-api-access-phcql\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-rbbrf\" (UID: \"36711b9a-855e-47dd-9948-468aef2f0fe4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-rbbrf"
Sep 15 10:25:25.219341 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:25.219347    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/36711b9a-855e-47dd-9948-468aef2f0fe4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-rbbrf\" (UID: \"36711b9a-855e-47dd-9948-468aef2f0fe4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-rbbrf"
Sep 15 10:25:25.320034 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:25.319996    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phcql\" (UniqueName: \"kubernetes.io/projected/36711b9a-855e-47dd-9948-468aef2f0fe4-kube-api-access-phcql\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-rbbrf\" (UID: \"36711b9a-855e-47dd-9948-468aef2f0fe4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-rbbrf"
Sep 15 10:25:25.320034 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:25.320041    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/36711b9a-855e-47dd-9948-468aef2f0fe4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-rbbrf\" (UID: \"36711b9a-855e-47dd-9948-468aef2f0fe4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-rbbrf"
Sep 15 10:25:25.320391 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:25.320375    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/36711b9a-855e-47dd-9948-468aef2f0fe4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-rbbrf\" (UID: \"36711b9a-855e-47dd-9948-468aef2f0fe4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-rbbrf"
Sep 15 10:25:25.329301 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:25.329274    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phcql\" (UniqueName: \"kubernetes.io/projected/36711b9a-855e-47dd-9948-468aef2f0fe4-kube-api-access-phcql\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-rbbrf\" (UID: \"36711b9a-855e-47dd-9948-468aef2f0fe4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-rbbrf"
Sep 15 10:25:25.447845 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:25.447758    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-rbbrf"
Sep 15 10:25:25.726776 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:25.726662    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-rbbrf"]
Sep 15 10:25:25.729814 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:25:25.729788    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36711b9a_855e_47dd_9948_468aef2f0fe4.slice/crio-8d34572cc642d37b7dd52568d14c7e9e07243e97e69cd663e9db4d4f9453ee35 WatchSource:0}: Error finding container 8d34572cc642d37b7dd52568d14c7e9e07243e97e69cd663e9db4d4f9453ee35: Status 404 returned error can't find the container with id 8d34572cc642d37b7dd52568d14c7e9e07243e97e69cd663e9db4d4f9453ee35
Sep 15 10:25:26.160363 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.160328    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-rbbrf"]
Sep 15 10:25:26.167181 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.167150    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-rbbrf"]
Sep 15 10:25:26.179050 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.179018    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs6gd"]
Sep 15 10:25:26.179261 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.179235    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs6gd" podUID="8bbfc790-8ac2-46ea-abeb-83aed3c900bb" containerName="manager" containerID="cri-o://22968a952c56a3ba11dba55fac393424f535a84a418eddbc636aa1cb52aeca05" gracePeriod=2
Sep 15 10:25:26.182266 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.182243    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-x7x96"]
Sep 15 10:25:26.182634 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.182619    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36711b9a-855e-47dd-9948-468aef2f0fe4" containerName="manager"
Sep 15 10:25:26.182634 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.182636    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="36711b9a-855e-47dd-9948-468aef2f0fe4" containerName="manager"
Sep 15 10:25:26.182793 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.182707    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="36711b9a-855e-47dd-9948-468aef2f0fe4" containerName="manager"
Sep 15 10:25:26.201257 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:25:26.201185    2579 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"8bbfc790-8ac2-46ea-abeb-83aed3c900bb\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-76f8f686bf-qs6gd\": pods \"kuadrant-operator-controller-manager-76f8f686bf-qs6gd\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs6gd"
Sep 15 10:25:26.203193 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.203080    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs6gd"]
Sep 15 10:25:26.203342 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.203188    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-x7x96"
Sep 15 10:25:26.206755 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.206664    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-x7x96"]
Sep 15 10:25:26.209017 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.208984    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rb47p"]
Sep 15 10:25:26.209877 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.209854    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bbfc790-8ac2-46ea-abeb-83aed3c900bb" containerName="manager"
Sep 15 10:25:26.211917 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.211187    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bbfc790-8ac2-46ea-abeb-83aed3c900bb" containerName="manager"
Sep 15 10:25:26.211917 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.211318    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bbfc790-8ac2-46ea-abeb-83aed3c900bb" containerName="manager"
Sep 15 10:25:26.227277 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.227245    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6v7r\" (UniqueName: \"kubernetes.io/projected/96e3bc5d-e004-4936-956f-5e9288cebd25-kube-api-access-b6v7r\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-x7x96\" (UID: \"96e3bc5d-e004-4936-956f-5e9288cebd25\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-x7x96"
Sep 15 10:25:26.227714 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.227394    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/96e3bc5d-e004-4936-956f-5e9288cebd25-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-x7x96\" (UID: \"96e3bc5d-e004-4936-956f-5e9288cebd25\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-x7x96"
Sep 15 10:25:26.231410 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:25:26.231355    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-qs6gd\" is forbidden: User \"system:node:ip-10-0-135-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-231.ec2.internal' and this object" podUID="8bbfc790-8ac2-46ea-abeb-83aed3c900bb" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs6gd"
Sep 15 10:25:26.233641 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.233614    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-tw5h4"]
Sep 15 10:25:26.233766 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.233672    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-tw5h4"]
Sep 15 10:25:26.233766 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.233704    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rb47p"]
Sep 15 10:25:26.233766 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.233752    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-4gb2h"]
Sep 15 10:25:26.233938 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.233906    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-tw5h4" podUID="d9234926-294c-4c4d-958b-e1973436dc8b" containerName="manager" containerID="cri-o://7ab6d74145ae499cfbb89bf5870525982e32a4a91102ee66d24f164cbc5ad3a5" gracePeriod=2
Sep 15 10:25:26.234104 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.234087    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rb47p"
Sep 15 10:25:26.234330 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.234136    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9234926-294c-4c4d-958b-e1973436dc8b" containerName="manager"
Sep 15 10:25:26.234330 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.234282    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9234926-294c-4c4d-958b-e1973436dc8b" containerName="manager"
Sep 15 10:25:26.234466 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.234451    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9234926-294c-4c4d-958b-e1973436dc8b" containerName="manager"
Sep 15 10:25:26.236286 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:25:26.236252    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-tw5h4\" is forbidden: User \"system:node:ip-10-0-135-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-231.ec2.internal' and this object" podUID="d9234926-294c-4c4d-958b-e1973436dc8b" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-tw5h4"
Sep 15 10:25:26.238328 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:25:26.238290    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-qs6gd\" is forbidden: User \"system:node:ip-10-0-135-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-231.ec2.internal' and this object" podUID="8bbfc790-8ac2-46ea-abeb-83aed3c900bb" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs6gd"
Sep 15 10:25:26.242932 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:25:26.242914    2579 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-rbbrf" container="manager"
Sep 15 10:25:26.249614 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.249580    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-4gb2h"]
Sep 15 10:25:26.249712 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.249684    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4gb2h"
Sep 15 10:25:26.272862 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:25:26.272830    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-tw5h4\" is forbidden: User \"system:node:ip-10-0-135-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-231.ec2.internal' and this object" podUID="d9234926-294c-4c4d-958b-e1973436dc8b" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-tw5h4"
Sep 15 10:25:26.275323 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:25:26.275301    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-qs6gd\" is forbidden: User \"system:node:ip-10-0-135-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-231.ec2.internal' and this object" podUID="8bbfc790-8ac2-46ea-abeb-83aed3c900bb" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs6gd"
Sep 15 10:25:26.277592 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:25:26.277568    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-qs6gd\" is forbidden: User \"system:node:ip-10-0-135-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-231.ec2.internal' and this object" podUID="8bbfc790-8ac2-46ea-abeb-83aed3c900bb" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs6gd"
Sep 15 10:25:26.279963 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:25:26.279934    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-rbbrf\" is forbidden: User \"system:node:ip-10-0-135-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-231.ec2.internal' and this object" podUID="36711b9a-855e-47dd-9948-468aef2f0fe4" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-rbbrf"
Sep 15 10:25:26.317274 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:25:26.317242    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-tw5h4\" is forbidden: User \"system:node:ip-10-0-135-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-231.ec2.internal' and this object" podUID="d9234926-294c-4c4d-958b-e1973436dc8b" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-tw5h4"
Sep 15 10:25:26.328521 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.328495    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6v7r\" (UniqueName: \"kubernetes.io/projected/96e3bc5d-e004-4936-956f-5e9288cebd25-kube-api-access-b6v7r\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-x7x96\" (UID: \"96e3bc5d-e004-4936-956f-5e9288cebd25\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-x7x96"
Sep 15 10:25:26.328622 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.328539    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/436ff204-fce7-4a36-a784-1aa787ae5cfb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-rb47p\" (UID: \"436ff204-fce7-4a36-a784-1aa787ae5cfb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rb47p"
Sep 15 10:25:26.328622 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.328574    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-274gd\" (UniqueName: \"kubernetes.io/projected/d07bf3fa-0b4e-4118-8d17-791cc11bcf35-kube-api-access-274gd\") pod \"limitador-operator-controller-manager-74495c69f8-4gb2h\" (UID: \"d07bf3fa-0b4e-4118-8d17-791cc11bcf35\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4gb2h"
Sep 15 10:25:26.328697 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.328675    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/96e3bc5d-e004-4936-956f-5e9288cebd25-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-x7x96\" (UID: \"96e3bc5d-e004-4936-956f-5e9288cebd25\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-x7x96"
Sep 15 10:25:26.328762 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.328714    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhghl\" (UniqueName: \"kubernetes.io/projected/436ff204-fce7-4a36-a784-1aa787ae5cfb-kube-api-access-lhghl\") pod \"kuadrant-operator-controller-manager-76f8f686bf-rb47p\" (UID: \"436ff204-fce7-4a36-a784-1aa787ae5cfb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rb47p"
Sep 15 10:25:26.329057 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.329037    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/96e3bc5d-e004-4936-956f-5e9288cebd25-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-x7x96\" (UID: \"96e3bc5d-e004-4936-956f-5e9288cebd25\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-x7x96"
Sep 15 10:25:26.342410 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.342386    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6v7r\" (UniqueName: \"kubernetes.io/projected/96e3bc5d-e004-4936-956f-5e9288cebd25-kube-api-access-b6v7r\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-x7x96\" (UID: \"96e3bc5d-e004-4936-956f-5e9288cebd25\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-x7x96"
Sep 15 10:25:26.429292 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.429249    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhghl\" (UniqueName: \"kubernetes.io/projected/436ff204-fce7-4a36-a784-1aa787ae5cfb-kube-api-access-lhghl\") pod \"kuadrant-operator-controller-manager-76f8f686bf-rb47p\" (UID: \"436ff204-fce7-4a36-a784-1aa787ae5cfb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rb47p"
Sep 15 10:25:26.429447 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.429356    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/436ff204-fce7-4a36-a784-1aa787ae5cfb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-rb47p\" (UID: \"436ff204-fce7-4a36-a784-1aa787ae5cfb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rb47p"
Sep 15 10:25:26.429447 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.429397    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-274gd\" (UniqueName: \"kubernetes.io/projected/d07bf3fa-0b4e-4118-8d17-791cc11bcf35-kube-api-access-274gd\") pod \"limitador-operator-controller-manager-74495c69f8-4gb2h\" (UID: \"d07bf3fa-0b4e-4118-8d17-791cc11bcf35\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4gb2h"
Sep 15 10:25:26.430390 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.430364    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/436ff204-fce7-4a36-a784-1aa787ae5cfb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-rb47p\" (UID: \"436ff204-fce7-4a36-a784-1aa787ae5cfb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rb47p"
Sep 15 10:25:26.438912 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.438887    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-274gd\" (UniqueName: \"kubernetes.io/projected/d07bf3fa-0b4e-4118-8d17-791cc11bcf35-kube-api-access-274gd\") pod \"limitador-operator-controller-manager-74495c69f8-4gb2h\" (UID: \"d07bf3fa-0b4e-4118-8d17-791cc11bcf35\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4gb2h"
Sep 15 10:25:26.440916 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.440895    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhghl\" (UniqueName: \"kubernetes.io/projected/436ff204-fce7-4a36-a784-1aa787ae5cfb-kube-api-access-lhghl\") pod \"kuadrant-operator-controller-manager-76f8f686bf-rb47p\" (UID: \"436ff204-fce7-4a36-a784-1aa787ae5cfb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rb47p"
Sep 15 10:25:26.508541 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.508512    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-tw5h4"
Sep 15 10:25:26.510976 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:25:26.510948    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-tw5h4\" is forbidden: User \"system:node:ip-10-0-135-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-231.ec2.internal' and this object" podUID="d9234926-294c-4c4d-958b-e1973436dc8b" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-tw5h4"
Sep 15 10:25:26.513482 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:25:26.513456    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-qs6gd\" is forbidden: User \"system:node:ip-10-0-135-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-231.ec2.internal' and this object" podUID="8bbfc790-8ac2-46ea-abeb-83aed3c900bb" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs6gd"
Sep 15 10:25:26.517566 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:25:26.517546    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-rbbrf\" is forbidden: User \"system:node:ip-10-0-135-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-231.ec2.internal' and this object" podUID="36711b9a-855e-47dd-9948-468aef2f0fe4" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-rbbrf"
Sep 15 10:25:26.522448 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.522430    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs6gd"
Sep 15 10:25:26.524832 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:25:26.524812    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-tw5h4\" is forbidden: User \"system:node:ip-10-0-135-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-231.ec2.internal' and this object" podUID="d9234926-294c-4c4d-958b-e1973436dc8b" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-tw5h4"
Sep 15 10:25:26.526848 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:25:26.526829    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-qs6gd\" is forbidden: User \"system:node:ip-10-0-135-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-231.ec2.internal' and this object" podUID="8bbfc790-8ac2-46ea-abeb-83aed3c900bb" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs6gd"
Sep 15 10:25:26.528782 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:25:26.528763    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-rbbrf\" is forbidden: User \"system:node:ip-10-0-135-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-231.ec2.internal' and this object" podUID="36711b9a-855e-47dd-9948-468aef2f0fe4" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-rbbrf"
Sep 15 10:25:26.562007 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.561977    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-x7x96"
Sep 15 10:25:26.614462 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.614422    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rb47p"
Sep 15 10:25:26.618522 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.618501    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4gb2h"
Sep 15 10:25:26.631395 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.631373    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z2vbc\" (UniqueName: \"kubernetes.io/projected/8bbfc790-8ac2-46ea-abeb-83aed3c900bb-kube-api-access-z2vbc\") pod \"8bbfc790-8ac2-46ea-abeb-83aed3c900bb\" (UID: \"8bbfc790-8ac2-46ea-abeb-83aed3c900bb\") "
Sep 15 10:25:26.631513 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.631409    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8bbfc790-8ac2-46ea-abeb-83aed3c900bb-extensions-socket-volume\") pod \"8bbfc790-8ac2-46ea-abeb-83aed3c900bb\" (UID: \"8bbfc790-8ac2-46ea-abeb-83aed3c900bb\") "
Sep 15 10:25:26.631513 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.631481    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qb2sz\" (UniqueName: \"kubernetes.io/projected/d9234926-294c-4c4d-958b-e1973436dc8b-kube-api-access-qb2sz\") pod \"d9234926-294c-4c4d-958b-e1973436dc8b\" (UID: \"d9234926-294c-4c4d-958b-e1973436dc8b\") "
Sep 15 10:25:26.632100 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.632068    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bbfc790-8ac2-46ea-abeb-83aed3c900bb-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8bbfc790-8ac2-46ea-abeb-83aed3c900bb" (UID: "8bbfc790-8ac2-46ea-abeb-83aed3c900bb"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:25:26.633745 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.633700    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bbfc790-8ac2-46ea-abeb-83aed3c900bb-kube-api-access-z2vbc" (OuterVolumeSpecName: "kube-api-access-z2vbc") pod "8bbfc790-8ac2-46ea-abeb-83aed3c900bb" (UID: "8bbfc790-8ac2-46ea-abeb-83aed3c900bb"). InnerVolumeSpecName "kube-api-access-z2vbc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:25:26.635451 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.635426    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9234926-294c-4c4d-958b-e1973436dc8b-kube-api-access-qb2sz" (OuterVolumeSpecName: "kube-api-access-qb2sz") pod "d9234926-294c-4c4d-958b-e1973436dc8b" (UID: "d9234926-294c-4c4d-958b-e1973436dc8b"). InnerVolumeSpecName "kube-api-access-qb2sz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:25:26.732377 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.732350    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z2vbc\" (UniqueName: \"kubernetes.io/projected/8bbfc790-8ac2-46ea-abeb-83aed3c900bb-kube-api-access-z2vbc\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:25:26.732377 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.732379    2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8bbfc790-8ac2-46ea-abeb-83aed3c900bb-extensions-socket-volume\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:25:26.732518 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.732389    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qb2sz\" (UniqueName: \"kubernetes.io/projected/d9234926-294c-4c4d-958b-e1973436dc8b-kube-api-access-qb2sz\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:25:26.852137 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.852113    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-x7x96"]
Sep 15 10:25:26.854353 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:25:26.854332    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96e3bc5d_e004_4936_956f_5e9288cebd25.slice/crio-00ca2361456c6fc41ede0d1df9a5bc938bffec6b76a6e6f911ab811e0bb29274 WatchSource:0}: Error finding container 00ca2361456c6fc41ede0d1df9a5bc938bffec6b76a6e6f911ab811e0bb29274: Status 404 returned error can't find the container with id 00ca2361456c6fc41ede0d1df9a5bc938bffec6b76a6e6f911ab811e0bb29274
Sep 15 10:25:26.911872 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.911845    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rb47p"]
Sep 15 10:25:26.914885 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:25:26.914858    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod436ff204_fce7_4a36_a784_1aa787ae5cfb.slice/crio-e24bc1a1e5adae80bcebb04c88f76850db2477acd369c08674c302e84a88e012 WatchSource:0}: Error finding container e24bc1a1e5adae80bcebb04c88f76850db2477acd369c08674c302e84a88e012: Status 404 returned error can't find the container with id e24bc1a1e5adae80bcebb04c88f76850db2477acd369c08674c302e84a88e012
Sep 15 10:25:26.956579 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:26.955984    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-4gb2h"]
Sep 15 10:25:26.959452 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:25:26.959426    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd07bf3fa_0b4e_4118_8d17_791cc11bcf35.slice/crio-d98b4e45d8708bd148c7030f8f1f7a8cd5086de387bac320b8c56900f6846f8b WatchSource:0}: Error finding container d98b4e45d8708bd148c7030f8f1f7a8cd5086de387bac320b8c56900f6846f8b: Status 404 returned error can't find the container with id d98b4e45d8708bd148c7030f8f1f7a8cd5086de387bac320b8c56900f6846f8b
Sep 15 10:25:27.146571 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:25:27.146528    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-tw5h4\" is forbidden: User \"system:node:ip-10-0-135-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-231.ec2.internal' and this object" podUID="d9234926-294c-4c4d-958b-e1973436dc8b" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-tw5h4"
Sep 15 10:25:27.148452 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:25:27.148422    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-qs6gd\" is forbidden: User \"system:node:ip-10-0-135-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-231.ec2.internal' and this object" podUID="8bbfc790-8ac2-46ea-abeb-83aed3c900bb" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs6gd"
Sep 15 10:25:27.148555 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:27.148446    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8bbfc790-8ac2-46ea-abeb-83aed3c900bb" path="/var/lib/kubelet/pods/8bbfc790-8ac2-46ea-abeb-83aed3c900bb/volumes"
Sep 15 10:25:27.148805 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:27.148790    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9234926-294c-4c4d-958b-e1973436dc8b" path="/var/lib/kubelet/pods/d9234926-294c-4c4d-958b-e1973436dc8b/volumes"
Sep 15 10:25:27.150255 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:25:27.150232    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-rbbrf\" is forbidden: User \"system:node:ip-10-0-135-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-231.ec2.internal' and this object" podUID="36711b9a-855e-47dd-9948-468aef2f0fe4" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-rbbrf"
Sep 15 10:25:27.249074 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:27.248997    2579 generic.go:356] "Generic (PLEG): container finished" podID="8bbfc790-8ac2-46ea-abeb-83aed3c900bb" containerID="22968a952c56a3ba11dba55fac393424f535a84a418eddbc636aa1cb52aeca05" exitCode=0
Sep 15 10:25:27.249074 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:27.249067    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qs6gd"
Sep 15 10:25:27.249540 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:27.249091    2579 scope.go:117] "RemoveContainer" containerID="22968a952c56a3ba11dba55fac393424f535a84a418eddbc636aa1cb52aeca05"
Sep 15 10:25:27.250622 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:27.250583    2579 generic.go:356] "Generic (PLEG): container finished" podID="d9234926-294c-4c4d-958b-e1973436dc8b" containerID="7ab6d74145ae499cfbb89bf5870525982e32a4a91102ee66d24f164cbc5ad3a5" exitCode=0
Sep 15 10:25:27.250769 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:27.250642    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-tw5h4"
Sep 15 10:25:27.253135 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:27.253110    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4gb2h" event={"ID":"d07bf3fa-0b4e-4118-8d17-791cc11bcf35","Type":"ContainerStarted","Data":"154450c522d94384c7186bfa5e4040ab22c7e1c41b94148ef54777a0b868d319"}
Sep 15 10:25:27.253233 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:27.253166    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4gb2h" event={"ID":"d07bf3fa-0b4e-4118-8d17-791cc11bcf35","Type":"ContainerStarted","Data":"d98b4e45d8708bd148c7030f8f1f7a8cd5086de387bac320b8c56900f6846f8b"}
Sep 15 10:25:27.253371 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:27.253352    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4gb2h"
Sep 15 10:25:27.255022 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:27.254998    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rb47p" event={"ID":"436ff204-fce7-4a36-a784-1aa787ae5cfb","Type":"ContainerStarted","Data":"ef05ed4e6d9e6611e7e700f338b8fa23e2a7f8b1643506d9ff822b75fd845af9"}
Sep 15 10:25:27.255107 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:27.255046    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rb47p" event={"ID":"436ff204-fce7-4a36-a784-1aa787ae5cfb","Type":"ContainerStarted","Data":"e24bc1a1e5adae80bcebb04c88f76850db2477acd369c08674c302e84a88e012"}
Sep 15 10:25:27.255107 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:27.255081    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rb47p"
Sep 15 10:25:27.256757 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:27.256708    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-rbbrf" podUID="36711b9a-855e-47dd-9948-468aef2f0fe4" containerName="manager" containerID="cri-o://cb22ed45043feec037db01b9d75380d87b2c29ef1d62df24ffb2871a94c971ba" gracePeriod=2
Sep 15 10:25:27.258376 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:27.258354    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-x7x96" event={"ID":"96e3bc5d-e004-4936-956f-5e9288cebd25","Type":"ContainerStarted","Data":"370f86c181c8ec0cd64b9942d3e4abc992a80073eed75bd11f3bcaa0f96ea922"}
Sep 15 10:25:27.258469 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:27.258389    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-x7x96" event={"ID":"96e3bc5d-e004-4936-956f-5e9288cebd25","Type":"ContainerStarted","Data":"00ca2361456c6fc41ede0d1df9a5bc938bffec6b76a6e6f911ab811e0bb29274"}
Sep 15 10:25:27.258469 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:27.258430    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-x7x96"
Sep 15 10:25:27.259508 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:27.259397    2579 scope.go:117] "RemoveContainer" containerID="22968a952c56a3ba11dba55fac393424f535a84a418eddbc636aa1cb52aeca05"
Sep 15 10:25:27.259763 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:25:27.259660    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22968a952c56a3ba11dba55fac393424f535a84a418eddbc636aa1cb52aeca05\": container with ID starting with 22968a952c56a3ba11dba55fac393424f535a84a418eddbc636aa1cb52aeca05 not found: ID does not exist" containerID="22968a952c56a3ba11dba55fac393424f535a84a418eddbc636aa1cb52aeca05"
Sep 15 10:25:27.259763 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:27.259693    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22968a952c56a3ba11dba55fac393424f535a84a418eddbc636aa1cb52aeca05"} err="failed to get container status \"22968a952c56a3ba11dba55fac393424f535a84a418eddbc636aa1cb52aeca05\": rpc error: code = NotFound desc = could not find container \"22968a952c56a3ba11dba55fac393424f535a84a418eddbc636aa1cb52aeca05\": container with ID starting with 22968a952c56a3ba11dba55fac393424f535a84a418eddbc636aa1cb52aeca05 not found: ID does not exist"
Sep 15 10:25:27.259763 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:27.259712    2579 scope.go:117] "RemoveContainer" containerID="7ab6d74145ae499cfbb89bf5870525982e32a4a91102ee66d24f164cbc5ad3a5"
Sep 15 10:25:27.267673 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:27.267654    2579 scope.go:117] "RemoveContainer" containerID="7ab6d74145ae499cfbb89bf5870525982e32a4a91102ee66d24f164cbc5ad3a5"
Sep 15 10:25:27.267965 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:25:27.267949    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ab6d74145ae499cfbb89bf5870525982e32a4a91102ee66d24f164cbc5ad3a5\": container with ID starting with 7ab6d74145ae499cfbb89bf5870525982e32a4a91102ee66d24f164cbc5ad3a5 not found: ID does not exist" containerID="7ab6d74145ae499cfbb89bf5870525982e32a4a91102ee66d24f164cbc5ad3a5"
Sep 15 10:25:27.268019 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:27.267971    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ab6d74145ae499cfbb89bf5870525982e32a4a91102ee66d24f164cbc5ad3a5"} err="failed to get container status \"7ab6d74145ae499cfbb89bf5870525982e32a4a91102ee66d24f164cbc5ad3a5\": rpc error: code = NotFound desc = could not find container \"7ab6d74145ae499cfbb89bf5870525982e32a4a91102ee66d24f164cbc5ad3a5\": container with ID starting with 7ab6d74145ae499cfbb89bf5870525982e32a4a91102ee66d24f164cbc5ad3a5 not found: ID does not exist"
Sep 15 10:25:27.274169 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:27.273691    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4gb2h" podStartSLOduration=1.273676902 podStartE2EDuration="1.273676902s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:25:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:25:27.272245253 +0000 UTC m=+460.668337342" watchObservedRunningTime="2026-09-15 10:25:27.273676902 +0000 UTC m=+460.669768988"
Sep 15 10:25:27.291547 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:27.291495    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rb47p" podStartSLOduration=1.2914782599999999 podStartE2EDuration="1.29147826s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:25:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:25:27.28921204 +0000 UTC m=+460.685304123" watchObservedRunningTime="2026-09-15 10:25:27.29147826 +0000 UTC m=+460.687570346"
Sep 15 10:25:27.312668 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:27.312619    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-x7x96" podStartSLOduration=1.312602984 podStartE2EDuration="1.312602984s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:25:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:25:27.311241708 +0000 UTC m=+460.707333840" watchObservedRunningTime="2026-09-15 10:25:27.312602984 +0000 UTC m=+460.708695070"
Sep 15 10:25:27.559494 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:27.559462    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-rbbrf"
Sep 15 10:25:27.561733 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:25:27.561698    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-rbbrf\" is forbidden: User \"system:node:ip-10-0-135-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-231.ec2.internal' and this object" podUID="36711b9a-855e-47dd-9948-468aef2f0fe4" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-rbbrf"
Sep 15 10:25:27.639668 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:27.639632    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/36711b9a-855e-47dd-9948-468aef2f0fe4-extensions-socket-volume\") pod \"36711b9a-855e-47dd-9948-468aef2f0fe4\" (UID: \"36711b9a-855e-47dd-9948-468aef2f0fe4\") "
Sep 15 10:25:27.639851 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:27.639690    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-phcql\" (UniqueName: \"kubernetes.io/projected/36711b9a-855e-47dd-9948-468aef2f0fe4-kube-api-access-phcql\") pod \"36711b9a-855e-47dd-9948-468aef2f0fe4\" (UID: \"36711b9a-855e-47dd-9948-468aef2f0fe4\") "
Sep 15 10:25:27.640034 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:27.640005    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36711b9a-855e-47dd-9948-468aef2f0fe4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "36711b9a-855e-47dd-9948-468aef2f0fe4" (UID: "36711b9a-855e-47dd-9948-468aef2f0fe4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:25:27.641777 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:27.641744    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36711b9a-855e-47dd-9948-468aef2f0fe4-kube-api-access-phcql" (OuterVolumeSpecName: "kube-api-access-phcql") pod "36711b9a-855e-47dd-9948-468aef2f0fe4" (UID: "36711b9a-855e-47dd-9948-468aef2f0fe4"). InnerVolumeSpecName "kube-api-access-phcql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:25:27.740655 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:27.740613    2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/36711b9a-855e-47dd-9948-468aef2f0fe4-extensions-socket-volume\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:25:27.740655 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:27.740640    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-phcql\" (UniqueName: \"kubernetes.io/projected/36711b9a-855e-47dd-9948-468aef2f0fe4-kube-api-access-phcql\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:25:28.266360 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:28.266327    2579 generic.go:356] "Generic (PLEG): container finished" podID="36711b9a-855e-47dd-9948-468aef2f0fe4" containerID="cb22ed45043feec037db01b9d75380d87b2c29ef1d62df24ffb2871a94c971ba" exitCode=0
Sep 15 10:25:28.266854 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:28.266373    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-rbbrf"
Sep 15 10:25:28.266854 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:28.266440    2579 scope.go:117] "RemoveContainer" containerID="cb22ed45043feec037db01b9d75380d87b2c29ef1d62df24ffb2871a94c971ba"
Sep 15 10:25:28.268916 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:25:28.268893    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-rbbrf\" is forbidden: User \"system:node:ip-10-0-135-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-231.ec2.internal' and this object" podUID="36711b9a-855e-47dd-9948-468aef2f0fe4" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-rbbrf"
Sep 15 10:25:28.275416 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:28.275399    2579 scope.go:117] "RemoveContainer" containerID="cb22ed45043feec037db01b9d75380d87b2c29ef1d62df24ffb2871a94c971ba"
Sep 15 10:25:28.275718 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:25:28.275699    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb22ed45043feec037db01b9d75380d87b2c29ef1d62df24ffb2871a94c971ba\": container with ID starting with cb22ed45043feec037db01b9d75380d87b2c29ef1d62df24ffb2871a94c971ba not found: ID does not exist" containerID="cb22ed45043feec037db01b9d75380d87b2c29ef1d62df24ffb2871a94c971ba"
Sep 15 10:25:28.275785 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:28.275742    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb22ed45043feec037db01b9d75380d87b2c29ef1d62df24ffb2871a94c971ba"} err="failed to get container status \"cb22ed45043feec037db01b9d75380d87b2c29ef1d62df24ffb2871a94c971ba\": rpc error: code = NotFound desc = could not find container \"cb22ed45043feec037db01b9d75380d87b2c29ef1d62df24ffb2871a94c971ba\": container with ID starting with cb22ed45043feec037db01b9d75380d87b2c29ef1d62df24ffb2871a94c971ba not found: ID does not exist"
Sep 15 10:25:28.277279 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:25:28.277257    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-rbbrf\" is forbidden: User \"system:node:ip-10-0-135-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-231.ec2.internal' and this object" podUID="36711b9a-855e-47dd-9948-468aef2f0fe4" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-rbbrf"
Sep 15 10:25:29.148938 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:29.148908    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36711b9a-855e-47dd-9948-468aef2f0fe4" path="/var/lib/kubelet/pods/36711b9a-855e-47dd-9948-468aef2f0fe4/volumes"
Sep 15 10:25:38.268761 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:38.268705    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4gb2h"
Sep 15 10:25:38.269285 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:38.268810    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-x7x96"
Sep 15 10:25:38.269285 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:38.268848    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rb47p"
Sep 15 10:25:38.354379 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:38.354343    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rb47p"]
Sep 15 10:25:38.354564 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:38.354539    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rb47p" podUID="436ff204-fce7-4a36-a784-1aa787ae5cfb" containerName="manager" containerID="cri-o://ef05ed4e6d9e6611e7e700f338b8fa23e2a7f8b1643506d9ff822b75fd845af9" gracePeriod=10
Sep 15 10:25:38.610129 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:38.610103    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rb47p"
Sep 15 10:25:38.678706 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:38.678670    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-jkvtf"]
Sep 15 10:25:38.679099 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:38.679084    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="436ff204-fce7-4a36-a784-1aa787ae5cfb" containerName="manager"
Sep 15 10:25:38.679141 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:38.679100    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="436ff204-fce7-4a36-a784-1aa787ae5cfb" containerName="manager"
Sep 15 10:25:38.679181 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:38.679158    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="436ff204-fce7-4a36-a784-1aa787ae5cfb" containerName="manager"
Sep 15 10:25:38.681974 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:38.681959    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-jkvtf"
Sep 15 10:25:38.698288 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:38.698257    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-jkvtf"]
Sep 15 10:25:38.741551 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:38.741517    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/436ff204-fce7-4a36-a784-1aa787ae5cfb-extensions-socket-volume\") pod \"436ff204-fce7-4a36-a784-1aa787ae5cfb\" (UID: \"436ff204-fce7-4a36-a784-1aa787ae5cfb\") "
Sep 15 10:25:38.741551 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:38.741557    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhghl\" (UniqueName: \"kubernetes.io/projected/436ff204-fce7-4a36-a784-1aa787ae5cfb-kube-api-access-lhghl\") pod \"436ff204-fce7-4a36-a784-1aa787ae5cfb\" (UID: \"436ff204-fce7-4a36-a784-1aa787ae5cfb\") "
Sep 15 10:25:38.741819 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:38.741670    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdqlb\" (UniqueName: \"kubernetes.io/projected/7f478d38-ac67-43e5-b85c-f47ea55d09a7-kube-api-access-vdqlb\") pod \"kuadrant-operator-controller-manager-5769f99d9f-jkvtf\" (UID: \"7f478d38-ac67-43e5-b85c-f47ea55d09a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-jkvtf"
Sep 15 10:25:38.741819 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:38.741784    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7f478d38-ac67-43e5-b85c-f47ea55d09a7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-jkvtf\" (UID: \"7f478d38-ac67-43e5-b85c-f47ea55d09a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-jkvtf"
Sep 15 10:25:38.742093 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:38.742062    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/436ff204-fce7-4a36-a784-1aa787ae5cfb-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "436ff204-fce7-4a36-a784-1aa787ae5cfb" (UID: "436ff204-fce7-4a36-a784-1aa787ae5cfb"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:25:38.743697 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:38.743680    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/436ff204-fce7-4a36-a784-1aa787ae5cfb-kube-api-access-lhghl" (OuterVolumeSpecName: "kube-api-access-lhghl") pod "436ff204-fce7-4a36-a784-1aa787ae5cfb" (UID: "436ff204-fce7-4a36-a784-1aa787ae5cfb"). InnerVolumeSpecName "kube-api-access-lhghl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:25:38.842873 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:38.842838    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7f478d38-ac67-43e5-b85c-f47ea55d09a7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-jkvtf\" (UID: \"7f478d38-ac67-43e5-b85c-f47ea55d09a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-jkvtf"
Sep 15 10:25:38.843052 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:38.842915    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdqlb\" (UniqueName: \"kubernetes.io/projected/7f478d38-ac67-43e5-b85c-f47ea55d09a7-kube-api-access-vdqlb\") pod \"kuadrant-operator-controller-manager-5769f99d9f-jkvtf\" (UID: \"7f478d38-ac67-43e5-b85c-f47ea55d09a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-jkvtf"
Sep 15 10:25:38.843052 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:38.842953    2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/436ff204-fce7-4a36-a784-1aa787ae5cfb-extensions-socket-volume\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:25:38.843052 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:38.842963    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhghl\" (UniqueName: \"kubernetes.io/projected/436ff204-fce7-4a36-a784-1aa787ae5cfb-kube-api-access-lhghl\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:25:38.843238 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:38.843214    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7f478d38-ac67-43e5-b85c-f47ea55d09a7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-jkvtf\" (UID: \"7f478d38-ac67-43e5-b85c-f47ea55d09a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-jkvtf"
Sep 15 10:25:38.853461 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:38.853421    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdqlb\" (UniqueName: \"kubernetes.io/projected/7f478d38-ac67-43e5-b85c-f47ea55d09a7-kube-api-access-vdqlb\") pod \"kuadrant-operator-controller-manager-5769f99d9f-jkvtf\" (UID: \"7f478d38-ac67-43e5-b85c-f47ea55d09a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-jkvtf"
Sep 15 10:25:38.992748 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:38.992675    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-jkvtf"
Sep 15 10:25:39.287939 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:39.287913    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-jkvtf"]
Sep 15 10:25:39.290282 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:25:39.290253    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f478d38_ac67_43e5_b85c_f47ea55d09a7.slice/crio-f30fbdd1af6ad8b1e8ef9fa5471c3e02cac1251c579d3594e7ac334a3aa4b08b WatchSource:0}: Error finding container f30fbdd1af6ad8b1e8ef9fa5471c3e02cac1251c579d3594e7ac334a3aa4b08b: Status 404 returned error can't find the container with id f30fbdd1af6ad8b1e8ef9fa5471c3e02cac1251c579d3594e7ac334a3aa4b08b
Sep 15 10:25:39.326007 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:39.325977    2579 generic.go:356] "Generic (PLEG): container finished" podID="436ff204-fce7-4a36-a784-1aa787ae5cfb" containerID="ef05ed4e6d9e6611e7e700f338b8fa23e2a7f8b1643506d9ff822b75fd845af9" exitCode=0
Sep 15 10:25:39.326150 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:39.326040    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rb47p"
Sep 15 10:25:39.326150 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:39.326055    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rb47p" event={"ID":"436ff204-fce7-4a36-a784-1aa787ae5cfb","Type":"ContainerDied","Data":"ef05ed4e6d9e6611e7e700f338b8fa23e2a7f8b1643506d9ff822b75fd845af9"}
Sep 15 10:25:39.326150 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:39.326115    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rb47p" event={"ID":"436ff204-fce7-4a36-a784-1aa787ae5cfb","Type":"ContainerDied","Data":"e24bc1a1e5adae80bcebb04c88f76850db2477acd369c08674c302e84a88e012"}
Sep 15 10:25:39.326150 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:39.326144    2579 scope.go:117] "RemoveContainer" containerID="ef05ed4e6d9e6611e7e700f338b8fa23e2a7f8b1643506d9ff822b75fd845af9"
Sep 15 10:25:39.327583 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:39.327522    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-jkvtf" event={"ID":"7f478d38-ac67-43e5-b85c-f47ea55d09a7","Type":"ContainerStarted","Data":"f30fbdd1af6ad8b1e8ef9fa5471c3e02cac1251c579d3594e7ac334a3aa4b08b"}
Sep 15 10:25:39.335445 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:39.335423    2579 scope.go:117] "RemoveContainer" containerID="ef05ed4e6d9e6611e7e700f338b8fa23e2a7f8b1643506d9ff822b75fd845af9"
Sep 15 10:25:39.335884 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:25:39.335853    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef05ed4e6d9e6611e7e700f338b8fa23e2a7f8b1643506d9ff822b75fd845af9\": container with ID starting with ef05ed4e6d9e6611e7e700f338b8fa23e2a7f8b1643506d9ff822b75fd845af9 not found: ID does not exist" containerID="ef05ed4e6d9e6611e7e700f338b8fa23e2a7f8b1643506d9ff822b75fd845af9"
Sep 15 10:25:39.336002 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:39.335896    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef05ed4e6d9e6611e7e700f338b8fa23e2a7f8b1643506d9ff822b75fd845af9"} err="failed to get container status \"ef05ed4e6d9e6611e7e700f338b8fa23e2a7f8b1643506d9ff822b75fd845af9\": rpc error: code = NotFound desc = could not find container \"ef05ed4e6d9e6611e7e700f338b8fa23e2a7f8b1643506d9ff822b75fd845af9\": container with ID starting with ef05ed4e6d9e6611e7e700f338b8fa23e2a7f8b1643506d9ff822b75fd845af9 not found: ID does not exist"
Sep 15 10:25:39.365134 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:39.365095    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rb47p"]
Sep 15 10:25:39.384344 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:39.384310    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rb47p"]
Sep 15 10:25:40.334606 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:40.334562    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-jkvtf" event={"ID":"7f478d38-ac67-43e5-b85c-f47ea55d09a7","Type":"ContainerStarted","Data":"ece5d685b3ff4fceed72979d801f0fa0f9535c291a5c4fb69d9dd27ba34fca74"}
Sep 15 10:25:40.334992 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:40.334665    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-jkvtf"
Sep 15 10:25:40.366872 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:40.366830    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-jkvtf" podStartSLOduration=2.366815374 podStartE2EDuration="2.366815374s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:25:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:25:40.365325432 +0000 UTC m=+473.761417519" watchObservedRunningTime="2026-09-15 10:25:40.366815374 +0000 UTC m=+473.762907461"
Sep 15 10:25:41.148140 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:41.148105    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="436ff204-fce7-4a36-a784-1aa787ae5cfb" path="/var/lib/kubelet/pods/436ff204-fce7-4a36-a784-1aa787ae5cfb/volumes"
Sep 15 10:25:51.341320 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:51.341284    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-jkvtf"
Sep 15 10:25:51.391864 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:51.391834    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-x7x96"]
Sep 15 10:25:51.392069 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:51.392030    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-x7x96" podUID="96e3bc5d-e004-4936-956f-5e9288cebd25" containerName="manager" containerID="cri-o://370f86c181c8ec0cd64b9942d3e4abc992a80073eed75bd11f3bcaa0f96ea922" gracePeriod=10
Sep 15 10:25:51.635636 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:51.635598    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-x7x96"
Sep 15 10:25:51.761334 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:51.761298    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b6v7r\" (UniqueName: \"kubernetes.io/projected/96e3bc5d-e004-4936-956f-5e9288cebd25-kube-api-access-b6v7r\") pod \"96e3bc5d-e004-4936-956f-5e9288cebd25\" (UID: \"96e3bc5d-e004-4936-956f-5e9288cebd25\") "
Sep 15 10:25:51.761510 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:51.761365    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/96e3bc5d-e004-4936-956f-5e9288cebd25-extensions-socket-volume\") pod \"96e3bc5d-e004-4936-956f-5e9288cebd25\" (UID: \"96e3bc5d-e004-4936-956f-5e9288cebd25\") "
Sep 15 10:25:51.761765 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:51.761719    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96e3bc5d-e004-4936-956f-5e9288cebd25-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "96e3bc5d-e004-4936-956f-5e9288cebd25" (UID: "96e3bc5d-e004-4936-956f-5e9288cebd25"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:25:51.763344 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:51.763323    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96e3bc5d-e004-4936-956f-5e9288cebd25-kube-api-access-b6v7r" (OuterVolumeSpecName: "kube-api-access-b6v7r") pod "96e3bc5d-e004-4936-956f-5e9288cebd25" (UID: "96e3bc5d-e004-4936-956f-5e9288cebd25"). InnerVolumeSpecName "kube-api-access-b6v7r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:25:51.862634 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:51.862597    2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/96e3bc5d-e004-4936-956f-5e9288cebd25-extensions-socket-volume\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:25:51.862634 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:51.862627    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b6v7r\" (UniqueName: \"kubernetes.io/projected/96e3bc5d-e004-4936-956f-5e9288cebd25-kube-api-access-b6v7r\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:25:52.397323 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:52.397286    2579 generic.go:356] "Generic (PLEG): container finished" podID="96e3bc5d-e004-4936-956f-5e9288cebd25" containerID="370f86c181c8ec0cd64b9942d3e4abc992a80073eed75bd11f3bcaa0f96ea922" exitCode=0
Sep 15 10:25:52.397795 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:52.397349    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-x7x96"
Sep 15 10:25:52.397795 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:52.397341    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-x7x96" event={"ID":"96e3bc5d-e004-4936-956f-5e9288cebd25","Type":"ContainerDied","Data":"370f86c181c8ec0cd64b9942d3e4abc992a80073eed75bd11f3bcaa0f96ea922"}
Sep 15 10:25:52.397795 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:52.397490    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-x7x96" event={"ID":"96e3bc5d-e004-4936-956f-5e9288cebd25","Type":"ContainerDied","Data":"00ca2361456c6fc41ede0d1df9a5bc938bffec6b76a6e6f911ab811e0bb29274"}
Sep 15 10:25:52.397795 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:52.397525    2579 scope.go:117] "RemoveContainer" containerID="370f86c181c8ec0cd64b9942d3e4abc992a80073eed75bd11f3bcaa0f96ea922"
Sep 15 10:25:52.405881 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:52.405862    2579 scope.go:117] "RemoveContainer" containerID="370f86c181c8ec0cd64b9942d3e4abc992a80073eed75bd11f3bcaa0f96ea922"
Sep 15 10:25:52.406171 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:25:52.406149    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"370f86c181c8ec0cd64b9942d3e4abc992a80073eed75bd11f3bcaa0f96ea922\": container with ID starting with 370f86c181c8ec0cd64b9942d3e4abc992a80073eed75bd11f3bcaa0f96ea922 not found: ID does not exist" containerID="370f86c181c8ec0cd64b9942d3e4abc992a80073eed75bd11f3bcaa0f96ea922"
Sep 15 10:25:52.406250 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:52.406179    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"370f86c181c8ec0cd64b9942d3e4abc992a80073eed75bd11f3bcaa0f96ea922"} err="failed to get container status \"370f86c181c8ec0cd64b9942d3e4abc992a80073eed75bd11f3bcaa0f96ea922\": rpc error: code = NotFound desc = could not find container \"370f86c181c8ec0cd64b9942d3e4abc992a80073eed75bd11f3bcaa0f96ea922\": container with ID starting with 370f86c181c8ec0cd64b9942d3e4abc992a80073eed75bd11f3bcaa0f96ea922 not found: ID does not exist"
Sep 15 10:25:52.424736 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:52.424697    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-x7x96"]
Sep 15 10:25:52.430688 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:52.430664    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-x7x96"]
Sep 15 10:25:53.148213 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:53.148182    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96e3bc5d-e004-4936-956f-5e9288cebd25" path="/var/lib/kubelet/pods/96e3bc5d-e004-4936-956f-5e9288cebd25/volumes"
Sep 15 10:25:54.574075 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:54.574040    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkz5"]
Sep 15 10:25:54.574546 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:54.574530    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96e3bc5d-e004-4936-956f-5e9288cebd25" containerName="manager"
Sep 15 10:25:54.574604 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:54.574548    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="96e3bc5d-e004-4936-956f-5e9288cebd25" containerName="manager"
Sep 15 10:25:54.574660 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:54.574641    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="96e3bc5d-e004-4936-956f-5e9288cebd25" containerName="manager"
Sep 15 10:25:54.579129 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:54.579106    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkz5"
Sep 15 10:25:54.581474 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:54.581452    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 15 10:25:54.581586 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:54.581524    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-8bjwl\""
Sep 15 10:25:54.589517 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:54.589491    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkz5"]
Sep 15 10:25:54.687078 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:54.687034    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1c808c8-4ef3-4a21-bf2a-d632af367669-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7kkz5\" (UID: \"c1c808c8-4ef3-4a21-bf2a-d632af367669\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkz5"
Sep 15 10:25:54.687078 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:54.687079    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1c808c8-4ef3-4a21-bf2a-d632af367669-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7kkz5\" (UID: \"c1c808c8-4ef3-4a21-bf2a-d632af367669\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkz5"
Sep 15 10:25:54.687279 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:54.687116    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2svzr\" (UniqueName: \"kubernetes.io/projected/c1c808c8-4ef3-4a21-bf2a-d632af367669-kube-api-access-2svzr\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7kkz5\" (UID: \"c1c808c8-4ef3-4a21-bf2a-d632af367669\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkz5"
Sep 15 10:25:54.687279 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:54.687176    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1c808c8-4ef3-4a21-bf2a-d632af367669-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7kkz5\" (UID: \"c1c808c8-4ef3-4a21-bf2a-d632af367669\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkz5"
Sep 15 10:25:54.687279 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:54.687218    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1c808c8-4ef3-4a21-bf2a-d632af367669-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7kkz5\" (UID: \"c1c808c8-4ef3-4a21-bf2a-d632af367669\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkz5"
Sep 15 10:25:54.687279 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:54.687239    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1c808c8-4ef3-4a21-bf2a-d632af367669-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7kkz5\" (UID: \"c1c808c8-4ef3-4a21-bf2a-d632af367669\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkz5"
Sep 15 10:25:54.687279 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:54.687272    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1c808c8-4ef3-4a21-bf2a-d632af367669-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7kkz5\" (UID: \"c1c808c8-4ef3-4a21-bf2a-d632af367669\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkz5"
Sep 15 10:25:54.687457 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:54.687295    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1c808c8-4ef3-4a21-bf2a-d632af367669-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7kkz5\" (UID: \"c1c808c8-4ef3-4a21-bf2a-d632af367669\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkz5"
Sep 15 10:25:54.687457 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:54.687355    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1c808c8-4ef3-4a21-bf2a-d632af367669-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7kkz5\" (UID: \"c1c808c8-4ef3-4a21-bf2a-d632af367669\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkz5"
Sep 15 10:25:54.788051 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:54.788017    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1c808c8-4ef3-4a21-bf2a-d632af367669-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7kkz5\" (UID: \"c1c808c8-4ef3-4a21-bf2a-d632af367669\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkz5"
Sep 15 10:25:54.788051 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:54.788056    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1c808c8-4ef3-4a21-bf2a-d632af367669-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7kkz5\" (UID: \"c1c808c8-4ef3-4a21-bf2a-d632af367669\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkz5"
Sep 15 10:25:54.788276 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:54.788077    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1c808c8-4ef3-4a21-bf2a-d632af367669-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7kkz5\" (UID: \"c1c808c8-4ef3-4a21-bf2a-d632af367669\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkz5"
Sep 15 10:25:54.788276 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:54.788195    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2svzr\" (UniqueName: \"kubernetes.io/projected/c1c808c8-4ef3-4a21-bf2a-d632af367669-kube-api-access-2svzr\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7kkz5\" (UID: \"c1c808c8-4ef3-4a21-bf2a-d632af367669\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkz5"
Sep 15 10:25:54.788276 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:54.788266    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1c808c8-4ef3-4a21-bf2a-d632af367669-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7kkz5\" (UID: \"c1c808c8-4ef3-4a21-bf2a-d632af367669\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkz5"
Sep 15 10:25:54.788438 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:54.788302    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1c808c8-4ef3-4a21-bf2a-d632af367669-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7kkz5\" (UID: \"c1c808c8-4ef3-4a21-bf2a-d632af367669\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkz5"
Sep 15 10:25:54.788438 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:54.788330    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1c808c8-4ef3-4a21-bf2a-d632af367669-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7kkz5\" (UID: \"c1c808c8-4ef3-4a21-bf2a-d632af367669\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkz5"
Sep 15 10:25:54.788438 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:54.788378    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1c808c8-4ef3-4a21-bf2a-d632af367669-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7kkz5\" (UID: \"c1c808c8-4ef3-4a21-bf2a-d632af367669\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkz5"
Sep 15 10:25:54.788438 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:54.788404    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1c808c8-4ef3-4a21-bf2a-d632af367669-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7kkz5\" (UID: \"c1c808c8-4ef3-4a21-bf2a-d632af367669\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkz5"
Sep 15 10:25:54.788642 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:54.788438    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1c808c8-4ef3-4a21-bf2a-d632af367669-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7kkz5\" (UID: \"c1c808c8-4ef3-4a21-bf2a-d632af367669\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkz5"
Sep 15 10:25:54.788878 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:54.788855    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1c808c8-4ef3-4a21-bf2a-d632af367669-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7kkz5\" (UID: \"c1c808c8-4ef3-4a21-bf2a-d632af367669\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkz5"
Sep 15 10:25:54.788957 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:54.788901    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1c808c8-4ef3-4a21-bf2a-d632af367669-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7kkz5\" (UID: \"c1c808c8-4ef3-4a21-bf2a-d632af367669\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkz5"
Sep 15 10:25:54.789087 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:54.789069    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1c808c8-4ef3-4a21-bf2a-d632af367669-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7kkz5\" (UID: \"c1c808c8-4ef3-4a21-bf2a-d632af367669\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkz5"
Sep 15 10:25:54.789148 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:54.789131    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1c808c8-4ef3-4a21-bf2a-d632af367669-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7kkz5\" (UID: \"c1c808c8-4ef3-4a21-bf2a-d632af367669\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkz5"
Sep 15 10:25:54.790478 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:54.790458    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1c808c8-4ef3-4a21-bf2a-d632af367669-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7kkz5\" (UID: \"c1c808c8-4ef3-4a21-bf2a-d632af367669\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkz5"
Sep 15 10:25:54.790785 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:54.790765    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1c808c8-4ef3-4a21-bf2a-d632af367669-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7kkz5\" (UID: \"c1c808c8-4ef3-4a21-bf2a-d632af367669\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkz5"
Sep 15 10:25:54.795386 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:54.795357    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1c808c8-4ef3-4a21-bf2a-d632af367669-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7kkz5\" (UID: \"c1c808c8-4ef3-4a21-bf2a-d632af367669\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkz5"
Sep 15 10:25:54.795568 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:54.795547    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2svzr\" (UniqueName: \"kubernetes.io/projected/c1c808c8-4ef3-4a21-bf2a-d632af367669-kube-api-access-2svzr\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7kkz5\" (UID: \"c1c808c8-4ef3-4a21-bf2a-d632af367669\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkz5"
Sep 15 10:25:54.892649 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:54.892553    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkz5"
Sep 15 10:25:55.169224 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:55.169197    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkz5"]
Sep 15 10:25:55.170763 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:25:55.170715    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1c808c8_4ef3_4a21_bf2a_d632af367669.slice/crio-67aef7932d534ce11c009e19bd51ff546527cc9c504ac717e62ac097b60321dc WatchSource:0}: Error finding container 67aef7932d534ce11c009e19bd51ff546527cc9c504ac717e62ac097b60321dc: Status 404 returned error can't find the container with id 67aef7932d534ce11c009e19bd51ff546527cc9c504ac717e62ac097b60321dc
Sep 15 10:25:55.413244 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:55.413208    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkz5" event={"ID":"c1c808c8-4ef3-4a21-bf2a-d632af367669","Type":"ContainerStarted","Data":"67aef7932d534ce11c009e19bd51ff546527cc9c504ac717e62ac097b60321dc"}
Sep 15 10:25:57.820781 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:57.820743    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:25:57.821134 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:57.820833    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:25:57.821134 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:57.820884    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:25:58.430160 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:58.430126    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkz5" event={"ID":"c1c808c8-4ef3-4a21-bf2a-d632af367669","Type":"ContainerStarted","Data":"f71cd5648f84ae945d1f424b683cfa956488b6aed58dfb37f8ab1fb2779e5635"}
Sep 15 10:25:58.450562 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:58.450339    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkz5" podStartSLOduration=1.8026183759999999 podStartE2EDuration="4.450320587s" totalImagesPullingTime="2.647702211s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:25:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:25:58.449883268 +0000 UTC m=+491.845975355" watchObservedRunningTime="2026-09-15 10:25:58.450320587 +0000 UTC m=+491.846412676"
Sep 15 10:25:58.893545 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:58.893509    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkz5"
Sep 15 10:25:58.898482 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:58.898453    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkz5"
Sep 15 10:25:59.434852 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:59.434816    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkz5"
Sep 15 10:25:59.435577 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:25:59.435558    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkz5"
Sep 15 10:26:11.011394 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:11.011356    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-xq8dm"]
Sep 15 10:26:11.014676 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:11.014648    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-xq8dm"
Sep 15 10:26:11.017174 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:11.017146    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-8c94h\""
Sep 15 10:26:11.017303 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:11.017146    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 15 10:26:11.025987 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:11.025958    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-xq8dm"]
Sep 15 10:26:11.109924 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:11.109883    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hv7j2\" (UniqueName: \"kubernetes.io/projected/36fa4ac0-d64a-4407-8773-577b0adb4c6a-kube-api-access-hv7j2\") pod \"limitador-limitador-8588749977-xq8dm\" (UID: \"36fa4ac0-d64a-4407-8773-577b0adb4c6a\") " pod="kuadrant-system/limitador-limitador-8588749977-xq8dm"
Sep 15 10:26:11.110094 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:11.110031    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/36fa4ac0-d64a-4407-8773-577b0adb4c6a-config-file\") pod \"limitador-limitador-8588749977-xq8dm\" (UID: \"36fa4ac0-d64a-4407-8773-577b0adb4c6a\") " pod="kuadrant-system/limitador-limitador-8588749977-xq8dm"
Sep 15 10:26:11.110761 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:11.110718    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-xq8dm"]
Sep 15 10:26:11.210897 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:11.210853    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hv7j2\" (UniqueName: \"kubernetes.io/projected/36fa4ac0-d64a-4407-8773-577b0adb4c6a-kube-api-access-hv7j2\") pod \"limitador-limitador-8588749977-xq8dm\" (UID: \"36fa4ac0-d64a-4407-8773-577b0adb4c6a\") " pod="kuadrant-system/limitador-limitador-8588749977-xq8dm"
Sep 15 10:26:11.211109 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:11.210987    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/36fa4ac0-d64a-4407-8773-577b0adb4c6a-config-file\") pod \"limitador-limitador-8588749977-xq8dm\" (UID: \"36fa4ac0-d64a-4407-8773-577b0adb4c6a\") " pod="kuadrant-system/limitador-limitador-8588749977-xq8dm"
Sep 15 10:26:11.212031 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:11.212002    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/36fa4ac0-d64a-4407-8773-577b0adb4c6a-config-file\") pod \"limitador-limitador-8588749977-xq8dm\" (UID: \"36fa4ac0-d64a-4407-8773-577b0adb4c6a\") " pod="kuadrant-system/limitador-limitador-8588749977-xq8dm"
Sep 15 10:26:11.221599 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:11.221574    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hv7j2\" (UniqueName: \"kubernetes.io/projected/36fa4ac0-d64a-4407-8773-577b0adb4c6a-kube-api-access-hv7j2\") pod \"limitador-limitador-8588749977-xq8dm\" (UID: \"36fa4ac0-d64a-4407-8773-577b0adb4c6a\") " pod="kuadrant-system/limitador-limitador-8588749977-xq8dm"
Sep 15 10:26:11.324554 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:11.324522    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-xq8dm"
Sep 15 10:26:11.597251 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:11.597227    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-xq8dm"]
Sep 15 10:26:11.599649 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:26:11.599618    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36fa4ac0_d64a_4407_8773_577b0adb4c6a.slice/crio-e9853b2d2ba109c39113e49bdc1a335f1376629f8ab6e1c48bff1f05fb527119 WatchSource:0}: Error finding container e9853b2d2ba109c39113e49bdc1a335f1376629f8ab6e1c48bff1f05fb527119: Status 404 returned error can't find the container with id e9853b2d2ba109c39113e49bdc1a335f1376629f8ab6e1c48bff1f05fb527119
Sep 15 10:26:12.497667 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:12.497630    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-xq8dm" event={"ID":"36fa4ac0-d64a-4407-8773-577b0adb4c6a","Type":"ContainerStarted","Data":"e9853b2d2ba109c39113e49bdc1a335f1376629f8ab6e1c48bff1f05fb527119"}
Sep 15 10:26:13.503901 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:13.503862    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-xq8dm" event={"ID":"36fa4ac0-d64a-4407-8773-577b0adb4c6a","Type":"ContainerStarted","Data":"fb30f4764a01617ad67b32dc1656f559380422b0c3d7a65c125ae537f5bd616b"}
Sep 15 10:26:13.504271 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:13.503920    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-xq8dm"
Sep 15 10:26:13.521260 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:13.521213    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-xq8dm" podStartSLOduration=2.299065977 podStartE2EDuration="3.521200607s" totalImagesPullingTime="1.22213463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:26:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:26:13.519185263 +0000 UTC m=+506.915277361" watchObservedRunningTime="2026-09-15 10:26:13.521200607 +0000 UTC m=+506.917292694"
Sep 15 10:26:24.510384 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:24.510350    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-xq8dm"
Sep 15 10:26:25.836042 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:25.836007    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-xq8dm"]
Sep 15 10:26:25.836441 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:25.836190    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-xq8dm" podUID="36fa4ac0-d64a-4407-8773-577b0adb4c6a" containerName="limitador" containerID="cri-o://fb30f4764a01617ad67b32dc1656f559380422b0c3d7a65c125ae537f5bd616b" gracePeriod=30
Sep 15 10:26:26.374421 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:26.374393    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-xq8dm"
Sep 15 10:26:26.433516 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:26.433428    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/36fa4ac0-d64a-4407-8773-577b0adb4c6a-config-file\") pod \"36fa4ac0-d64a-4407-8773-577b0adb4c6a\" (UID: \"36fa4ac0-d64a-4407-8773-577b0adb4c6a\") "
Sep 15 10:26:26.433666 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:26.433546    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hv7j2\" (UniqueName: \"kubernetes.io/projected/36fa4ac0-d64a-4407-8773-577b0adb4c6a-kube-api-access-hv7j2\") pod \"36fa4ac0-d64a-4407-8773-577b0adb4c6a\" (UID: \"36fa4ac0-d64a-4407-8773-577b0adb4c6a\") "
Sep 15 10:26:26.433870 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:26.433851    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36fa4ac0-d64a-4407-8773-577b0adb4c6a-config-file" (OuterVolumeSpecName: "config-file") pod "36fa4ac0-d64a-4407-8773-577b0adb4c6a" (UID: "36fa4ac0-d64a-4407-8773-577b0adb4c6a"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:26:26.435572 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:26.435550    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36fa4ac0-d64a-4407-8773-577b0adb4c6a-kube-api-access-hv7j2" (OuterVolumeSpecName: "kube-api-access-hv7j2") pod "36fa4ac0-d64a-4407-8773-577b0adb4c6a" (UID: "36fa4ac0-d64a-4407-8773-577b0adb4c6a"). InnerVolumeSpecName "kube-api-access-hv7j2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:26:26.534676 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:26.534641    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hv7j2\" (UniqueName: \"kubernetes.io/projected/36fa4ac0-d64a-4407-8773-577b0adb4c6a-kube-api-access-hv7j2\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:26:26.534676 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:26.534670    2579 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/36fa4ac0-d64a-4407-8773-577b0adb4c6a-config-file\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:26:26.565045 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:26.565011    2579 generic.go:356] "Generic (PLEG): container finished" podID="36fa4ac0-d64a-4407-8773-577b0adb4c6a" containerID="fb30f4764a01617ad67b32dc1656f559380422b0c3d7a65c125ae537f5bd616b" exitCode=0
Sep 15 10:26:26.565234 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:26.565052    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-xq8dm"
Sep 15 10:26:26.565234 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:26.565070    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-xq8dm" event={"ID":"36fa4ac0-d64a-4407-8773-577b0adb4c6a","Type":"ContainerDied","Data":"fb30f4764a01617ad67b32dc1656f559380422b0c3d7a65c125ae537f5bd616b"}
Sep 15 10:26:26.565234 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:26.565124    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-xq8dm" event={"ID":"36fa4ac0-d64a-4407-8773-577b0adb4c6a","Type":"ContainerDied","Data":"e9853b2d2ba109c39113e49bdc1a335f1376629f8ab6e1c48bff1f05fb527119"}
Sep 15 10:26:26.565234 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:26.565151    2579 scope.go:117] "RemoveContainer" containerID="fb30f4764a01617ad67b32dc1656f559380422b0c3d7a65c125ae537f5bd616b"
Sep 15 10:26:26.573919 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:26.573901    2579 scope.go:117] "RemoveContainer" containerID="fb30f4764a01617ad67b32dc1656f559380422b0c3d7a65c125ae537f5bd616b"
Sep 15 10:26:26.574202 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:26:26.574182    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb30f4764a01617ad67b32dc1656f559380422b0c3d7a65c125ae537f5bd616b\": container with ID starting with fb30f4764a01617ad67b32dc1656f559380422b0c3d7a65c125ae537f5bd616b not found: ID does not exist" containerID="fb30f4764a01617ad67b32dc1656f559380422b0c3d7a65c125ae537f5bd616b"
Sep 15 10:26:26.574267 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:26.574214    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb30f4764a01617ad67b32dc1656f559380422b0c3d7a65c125ae537f5bd616b"} err="failed to get container status \"fb30f4764a01617ad67b32dc1656f559380422b0c3d7a65c125ae537f5bd616b\": rpc error: code = NotFound desc = could not find container \"fb30f4764a01617ad67b32dc1656f559380422b0c3d7a65c125ae537f5bd616b\": container with ID starting with fb30f4764a01617ad67b32dc1656f559380422b0c3d7a65c125ae537f5bd616b not found: ID does not exist"
Sep 15 10:26:26.585175 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:26.585141    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-xq8dm"]
Sep 15 10:26:26.588654 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:26.588630    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-xq8dm"]
Sep 15 10:26:27.149493 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:27.149457    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36fa4ac0-d64a-4407-8773-577b0adb4c6a" path="/var/lib/kubelet/pods/36fa4ac0-d64a-4407-8773-577b0adb4c6a/volumes"
Sep 15 10:26:31.195718 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:31.195665    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-tgfw6"]
Sep 15 10:26:31.196266 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:31.196249    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36fa4ac0-d64a-4407-8773-577b0adb4c6a" containerName="limitador"
Sep 15 10:26:31.196377 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:31.196270    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="36fa4ac0-d64a-4407-8773-577b0adb4c6a" containerName="limitador"
Sep 15 10:26:31.196419 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:31.196376    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="36fa4ac0-d64a-4407-8773-577b0adb4c6a" containerName="limitador"
Sep 15 10:26:31.204894 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:31.204870    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tgfw6"
Sep 15 10:26:31.206421 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:31.206396    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-tgfw6"]
Sep 15 10:26:31.207407 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:31.207389    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 15 10:26:31.207504 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:31.207454    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-5kphr\""
Sep 15 10:26:31.207593 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:31.207577    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 15 10:26:31.208414 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:31.208391    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 10:26:31.270005 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:31.269962    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m6m9\" (UniqueName: \"kubernetes.io/projected/6772359c-7969-4cb6-bd66-4e4103d050fb-kube-api-access-6m6m9\") pod \"postgres-69fb4594cf-tgfw6\" (UID: \"6772359c-7969-4cb6-bd66-4e4103d050fb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tgfw6"
Sep 15 10:26:31.270005 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:31.270006    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/6772359c-7969-4cb6-bd66-4e4103d050fb-data\") pod \"postgres-69fb4594cf-tgfw6\" (UID: \"6772359c-7969-4cb6-bd66-4e4103d050fb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tgfw6"
Sep 15 10:26:31.371310 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:31.371270    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m6m9\" (UniqueName: \"kubernetes.io/projected/6772359c-7969-4cb6-bd66-4e4103d050fb-kube-api-access-6m6m9\") pod \"postgres-69fb4594cf-tgfw6\" (UID: \"6772359c-7969-4cb6-bd66-4e4103d050fb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tgfw6"
Sep 15 10:26:31.371310 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:31.371310    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/6772359c-7969-4cb6-bd66-4e4103d050fb-data\") pod \"postgres-69fb4594cf-tgfw6\" (UID: \"6772359c-7969-4cb6-bd66-4e4103d050fb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tgfw6"
Sep 15 10:26:31.371660 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:31.371643    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/6772359c-7969-4cb6-bd66-4e4103d050fb-data\") pod \"postgres-69fb4594cf-tgfw6\" (UID: \"6772359c-7969-4cb6-bd66-4e4103d050fb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tgfw6"
Sep 15 10:26:31.381192 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:31.381161    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m6m9\" (UniqueName: \"kubernetes.io/projected/6772359c-7969-4cb6-bd66-4e4103d050fb-kube-api-access-6m6m9\") pod \"postgres-69fb4594cf-tgfw6\" (UID: \"6772359c-7969-4cb6-bd66-4e4103d050fb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tgfw6"
Sep 15 10:26:31.516633 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:31.516523    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tgfw6"
Sep 15 10:26:31.784580 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:31.784544    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-tgfw6"]
Sep 15 10:26:31.786789 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:26:31.786762    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6772359c_7969_4cb6_bd66_4e4103d050fb.slice/crio-f3f1ebfef8ba617e07f788f1555ac2f37668e8023c330151d763905f57145cb6 WatchSource:0}: Error finding container f3f1ebfef8ba617e07f788f1555ac2f37668e8023c330151d763905f57145cb6: Status 404 returned error can't find the container with id f3f1ebfef8ba617e07f788f1555ac2f37668e8023c330151d763905f57145cb6
Sep 15 10:26:32.604338 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:32.604219    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tgfw6" event={"ID":"6772359c-7969-4cb6-bd66-4e4103d050fb","Type":"ContainerStarted","Data":"f3f1ebfef8ba617e07f788f1555ac2f37668e8023c330151d763905f57145cb6"}
Sep 15 10:26:36.628337 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:36.628298    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tgfw6" event={"ID":"6772359c-7969-4cb6-bd66-4e4103d050fb","Type":"ContainerStarted","Data":"dfdacbfd57f2d1d26d22ff8e5e04ecc376a77dbb836c89e2ed243fcee123aae1"}
Sep 15 10:26:36.628688 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:36.628374    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tgfw6"
Sep 15 10:26:36.643837 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:36.643789    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tgfw6" podStartSLOduration=0.901904031 podStartE2EDuration="5.643773287s" totalImagesPullingTime="4.741869256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:26:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:26:36.643340992 +0000 UTC m=+530.039433079" watchObservedRunningTime="2026-09-15 10:26:36.643773287 +0000 UTC m=+530.039865373"
Sep 15 10:26:42.662599 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:42.662516    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tgfw6"
Sep 15 10:26:49.588502 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:49.588468    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-88768db8d-rcshg"]
Sep 15 10:26:49.593563 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:49.593542    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-88768db8d-rcshg"
Sep 15 10:26:49.597798 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:49.597773    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 15 10:26:49.597921 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:49.597818    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-w8pwn\""
Sep 15 10:26:49.598072 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:49.598053    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 15 10:26:49.598155 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:49.598133    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 15 10:26:49.603944 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:49.603921    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-88768db8d-rcshg"]
Sep 15 10:26:49.745651 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:49.745607    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ba0c18e-9545-476d-b6cf-a4d29be33432-metrics-certs\") pod \"maas-controller-88768db8d-rcshg\" (UID: \"1ba0c18e-9545-476d-b6cf-a4d29be33432\") " pod="opendatahub/maas-controller-88768db8d-rcshg"
Sep 15 10:26:49.745838 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:49.745659    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1ba0c18e-9545-476d-b6cf-a4d29be33432-webhook-cert\") pod \"maas-controller-88768db8d-rcshg\" (UID: \"1ba0c18e-9545-476d-b6cf-a4d29be33432\") " pod="opendatahub/maas-controller-88768db8d-rcshg"
Sep 15 10:26:49.745889 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:49.745827    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5hpd\" (UniqueName: \"kubernetes.io/projected/1ba0c18e-9545-476d-b6cf-a4d29be33432-kube-api-access-j5hpd\") pod \"maas-controller-88768db8d-rcshg\" (UID: \"1ba0c18e-9545-476d-b6cf-a4d29be33432\") " pod="opendatahub/maas-controller-88768db8d-rcshg"
Sep 15 10:26:49.753743 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:49.753691    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-568cc65688-kdq2q"]
Sep 15 10:26:49.757141 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:49.757119    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-568cc65688-kdq2q"
Sep 15 10:26:49.765627 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:49.765598    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-568cc65688-kdq2q"]
Sep 15 10:26:49.847084 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:49.846981    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wz2sc\" (UniqueName: \"kubernetes.io/projected/a35176ff-1489-4671-bbd4-cfb2815b3aa6-kube-api-access-wz2sc\") pod \"maas-controller-568cc65688-kdq2q\" (UID: \"a35176ff-1489-4671-bbd4-cfb2815b3aa6\") " pod="opendatahub/maas-controller-568cc65688-kdq2q"
Sep 15 10:26:49.847084 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:49.847042    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5hpd\" (UniqueName: \"kubernetes.io/projected/1ba0c18e-9545-476d-b6cf-a4d29be33432-kube-api-access-j5hpd\") pod \"maas-controller-88768db8d-rcshg\" (UID: \"1ba0c18e-9545-476d-b6cf-a4d29be33432\") " pod="opendatahub/maas-controller-88768db8d-rcshg"
Sep 15 10:26:49.847317 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:49.847111    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a35176ff-1489-4671-bbd4-cfb2815b3aa6-metrics-certs\") pod \"maas-controller-568cc65688-kdq2q\" (UID: \"a35176ff-1489-4671-bbd4-cfb2815b3aa6\") " pod="opendatahub/maas-controller-568cc65688-kdq2q"
Sep 15 10:26:49.847317 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:49.847149    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ba0c18e-9545-476d-b6cf-a4d29be33432-metrics-certs\") pod \"maas-controller-88768db8d-rcshg\" (UID: \"1ba0c18e-9545-476d-b6cf-a4d29be33432\") " pod="opendatahub/maas-controller-88768db8d-rcshg"
Sep 15 10:26:49.847317 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:49.847173    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1ba0c18e-9545-476d-b6cf-a4d29be33432-webhook-cert\") pod \"maas-controller-88768db8d-rcshg\" (UID: \"1ba0c18e-9545-476d-b6cf-a4d29be33432\") " pod="opendatahub/maas-controller-88768db8d-rcshg"
Sep 15 10:26:49.847317 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:49.847246    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a35176ff-1489-4671-bbd4-cfb2815b3aa6-webhook-cert\") pod \"maas-controller-568cc65688-kdq2q\" (UID: \"a35176ff-1489-4671-bbd4-cfb2815b3aa6\") " pod="opendatahub/maas-controller-568cc65688-kdq2q"
Sep 15 10:26:49.849667 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:49.849642    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ba0c18e-9545-476d-b6cf-a4d29be33432-metrics-certs\") pod \"maas-controller-88768db8d-rcshg\" (UID: \"1ba0c18e-9545-476d-b6cf-a4d29be33432\") " pod="opendatahub/maas-controller-88768db8d-rcshg"
Sep 15 10:26:49.849797 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:49.849685    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1ba0c18e-9545-476d-b6cf-a4d29be33432-webhook-cert\") pod \"maas-controller-88768db8d-rcshg\" (UID: \"1ba0c18e-9545-476d-b6cf-a4d29be33432\") " pod="opendatahub/maas-controller-88768db8d-rcshg"
Sep 15 10:26:49.855656 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:49.855622    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5hpd\" (UniqueName: \"kubernetes.io/projected/1ba0c18e-9545-476d-b6cf-a4d29be33432-kube-api-access-j5hpd\") pod \"maas-controller-88768db8d-rcshg\" (UID: \"1ba0c18e-9545-476d-b6cf-a4d29be33432\") " pod="opendatahub/maas-controller-88768db8d-rcshg"
Sep 15 10:26:49.906647 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:49.906609    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-88768db8d-rcshg"
Sep 15 10:26:49.948698 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:49.948666    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a35176ff-1489-4671-bbd4-cfb2815b3aa6-webhook-cert\") pod \"maas-controller-568cc65688-kdq2q\" (UID: \"a35176ff-1489-4671-bbd4-cfb2815b3aa6\") " pod="opendatahub/maas-controller-568cc65688-kdq2q"
Sep 15 10:26:49.948906 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:49.948744    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wz2sc\" (UniqueName: \"kubernetes.io/projected/a35176ff-1489-4671-bbd4-cfb2815b3aa6-kube-api-access-wz2sc\") pod \"maas-controller-568cc65688-kdq2q\" (UID: \"a35176ff-1489-4671-bbd4-cfb2815b3aa6\") " pod="opendatahub/maas-controller-568cc65688-kdq2q"
Sep 15 10:26:49.948906 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:49.948794    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a35176ff-1489-4671-bbd4-cfb2815b3aa6-metrics-certs\") pod \"maas-controller-568cc65688-kdq2q\" (UID: \"a35176ff-1489-4671-bbd4-cfb2815b3aa6\") " pod="opendatahub/maas-controller-568cc65688-kdq2q"
Sep 15 10:26:49.951314 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:49.951277    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a35176ff-1489-4671-bbd4-cfb2815b3aa6-webhook-cert\") pod \"maas-controller-568cc65688-kdq2q\" (UID: \"a35176ff-1489-4671-bbd4-cfb2815b3aa6\") " pod="opendatahub/maas-controller-568cc65688-kdq2q"
Sep 15 10:26:49.951451 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:49.951395    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a35176ff-1489-4671-bbd4-cfb2815b3aa6-metrics-certs\") pod \"maas-controller-568cc65688-kdq2q\" (UID: \"a35176ff-1489-4671-bbd4-cfb2815b3aa6\") " pod="opendatahub/maas-controller-568cc65688-kdq2q"
Sep 15 10:26:49.958207 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:49.958143    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wz2sc\" (UniqueName: \"kubernetes.io/projected/a35176ff-1489-4671-bbd4-cfb2815b3aa6-kube-api-access-wz2sc\") pod \"maas-controller-568cc65688-kdq2q\" (UID: \"a35176ff-1489-4671-bbd4-cfb2815b3aa6\") " pod="opendatahub/maas-controller-568cc65688-kdq2q"
Sep 15 10:26:50.067688 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:50.067641    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-568cc65688-kdq2q"
Sep 15 10:26:50.176200 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:50.176178    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-88768db8d-rcshg"]
Sep 15 10:26:50.178087 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:26:50.178063    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ba0c18e_9545_476d_b6cf_a4d29be33432.slice/crio-3eb3daddfb25d0dd71760ac721441401aeaae6fd71ff7bcde1e9d448b83fdd87 WatchSource:0}: Error finding container 3eb3daddfb25d0dd71760ac721441401aeaae6fd71ff7bcde1e9d448b83fdd87: Status 404 returned error can't find the container with id 3eb3daddfb25d0dd71760ac721441401aeaae6fd71ff7bcde1e9d448b83fdd87
Sep 15 10:26:50.337143 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:50.337121    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-568cc65688-kdq2q"]
Sep 15 10:26:50.339643 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:26:50.339616    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda35176ff_1489_4671_bbd4_cfb2815b3aa6.slice/crio-076c0e9d8d347ac05e9654193a31e8dcde8a2e278a513d1d0d971b99d27d7448 WatchSource:0}: Error finding container 076c0e9d8d347ac05e9654193a31e8dcde8a2e278a513d1d0d971b99d27d7448: Status 404 returned error can't find the container with id 076c0e9d8d347ac05e9654193a31e8dcde8a2e278a513d1d0d971b99d27d7448
Sep 15 10:26:50.695351 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:50.695317    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-568cc65688-kdq2q" event={"ID":"a35176ff-1489-4671-bbd4-cfb2815b3aa6","Type":"ContainerStarted","Data":"076c0e9d8d347ac05e9654193a31e8dcde8a2e278a513d1d0d971b99d27d7448"}
Sep 15 10:26:50.696464 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:50.696437    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-88768db8d-rcshg" event={"ID":"1ba0c18e-9545-476d-b6cf-a4d29be33432","Type":"ContainerStarted","Data":"3eb3daddfb25d0dd71760ac721441401aeaae6fd71ff7bcde1e9d448b83fdd87"}
Sep 15 10:26:53.716836 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:53.716801    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-568cc65688-kdq2q" event={"ID":"a35176ff-1489-4671-bbd4-cfb2815b3aa6","Type":"ContainerStarted","Data":"33de2f9b905cb5b6bff02c5b4aa480d8e63f0d7a53ac9abdedb6c44f15aafa3c"}
Sep 15 10:26:53.717339 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:53.716886    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-568cc65688-kdq2q"
Sep 15 10:26:53.718324 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:53.718301    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-88768db8d-rcshg" event={"ID":"1ba0c18e-9545-476d-b6cf-a4d29be33432","Type":"ContainerStarted","Data":"ec9f1251f40123d0691bfe94963ed8767650ae6af2a0198bd4366cfb2c2070b4"}
Sep 15 10:26:53.718437 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:53.718373    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-88768db8d-rcshg"
Sep 15 10:26:53.738758 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:53.738690    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-568cc65688-kdq2q" podStartSLOduration=2.2587891190000002 podStartE2EDuration="4.738673411s" totalImagesPullingTime="2.479884292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:26:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:26:53.737208968 +0000 UTC m=+547.133301066" watchObservedRunningTime="2026-09-15 10:26:53.738673411 +0000 UTC m=+547.134765498"
Sep 15 10:26:53.754980 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:26:53.754928    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-88768db8d-rcshg" podStartSLOduration=2.125897165 podStartE2EDuration="4.754911911s" totalImagesPullingTime="2.629014746s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:26:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:26:53.754172132 +0000 UTC m=+547.150264212" watchObservedRunningTime="2026-09-15 10:26:53.754911911 +0000 UTC m=+547.151003997"
Sep 15 10:27:04.724698 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:04.724665    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-568cc65688-kdq2q"
Sep 15 10:27:04.725189 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:04.724758    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-88768db8d-rcshg"
Sep 15 10:27:04.789014 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:04.788973    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-88768db8d-rcshg"]
Sep 15 10:27:04.789234 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:04.789208    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-88768db8d-rcshg" podUID="1ba0c18e-9545-476d-b6cf-a4d29be33432" containerName="manager" containerID="cri-o://ec9f1251f40123d0691bfe94963ed8767650ae6af2a0198bd4366cfb2c2070b4" gracePeriod=30
Sep 15 10:27:05.037352 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:05.037328    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-88768db8d-rcshg"
Sep 15 10:27:05.078524 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:05.078481    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1ba0c18e-9545-476d-b6cf-a4d29be33432-webhook-cert\") pod \"1ba0c18e-9545-476d-b6cf-a4d29be33432\" (UID: \"1ba0c18e-9545-476d-b6cf-a4d29be33432\") "
Sep 15 10:27:05.078708 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:05.078533    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j5hpd\" (UniqueName: \"kubernetes.io/projected/1ba0c18e-9545-476d-b6cf-a4d29be33432-kube-api-access-j5hpd\") pod \"1ba0c18e-9545-476d-b6cf-a4d29be33432\" (UID: \"1ba0c18e-9545-476d-b6cf-a4d29be33432\") "
Sep 15 10:27:05.078708 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:05.078579    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ba0c18e-9545-476d-b6cf-a4d29be33432-metrics-certs\") pod \"1ba0c18e-9545-476d-b6cf-a4d29be33432\" (UID: \"1ba0c18e-9545-476d-b6cf-a4d29be33432\") "
Sep 15 10:27:05.080915 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:05.080879    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ba0c18e-9545-476d-b6cf-a4d29be33432-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "1ba0c18e-9545-476d-b6cf-a4d29be33432" (UID: "1ba0c18e-9545-476d-b6cf-a4d29be33432"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 10:27:05.080915 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:05.080905    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ba0c18e-9545-476d-b6cf-a4d29be33432-kube-api-access-j5hpd" (OuterVolumeSpecName: "kube-api-access-j5hpd") pod "1ba0c18e-9545-476d-b6cf-a4d29be33432" (UID: "1ba0c18e-9545-476d-b6cf-a4d29be33432"). InnerVolumeSpecName "kube-api-access-j5hpd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:27:05.081099 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:05.080940    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ba0c18e-9545-476d-b6cf-a4d29be33432-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1ba0c18e-9545-476d-b6cf-a4d29be33432" (UID: "1ba0c18e-9545-476d-b6cf-a4d29be33432"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 10:27:05.179950 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:05.179922    2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1ba0c18e-9545-476d-b6cf-a4d29be33432-webhook-cert\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:27:05.179950 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:05.179947    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5hpd\" (UniqueName: \"kubernetes.io/projected/1ba0c18e-9545-476d-b6cf-a4d29be33432-kube-api-access-j5hpd\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:27:05.179950 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:05.179956    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ba0c18e-9545-476d-b6cf-a4d29be33432-metrics-certs\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:27:05.774602 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:05.774570    2579 generic.go:356] "Generic (PLEG): container finished" podID="1ba0c18e-9545-476d-b6cf-a4d29be33432" containerID="ec9f1251f40123d0691bfe94963ed8767650ae6af2a0198bd4366cfb2c2070b4" exitCode=0
Sep 15 10:27:05.775000 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:05.774610    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-88768db8d-rcshg"
Sep 15 10:27:05.775000 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:05.774660    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-88768db8d-rcshg" event={"ID":"1ba0c18e-9545-476d-b6cf-a4d29be33432","Type":"ContainerDied","Data":"ec9f1251f40123d0691bfe94963ed8767650ae6af2a0198bd4366cfb2c2070b4"}
Sep 15 10:27:05.775000 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:05.774708    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-88768db8d-rcshg" event={"ID":"1ba0c18e-9545-476d-b6cf-a4d29be33432","Type":"ContainerDied","Data":"3eb3daddfb25d0dd71760ac721441401aeaae6fd71ff7bcde1e9d448b83fdd87"}
Sep 15 10:27:05.775000 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:05.774762    2579 scope.go:117] "RemoveContainer" containerID="ec9f1251f40123d0691bfe94963ed8767650ae6af2a0198bd4366cfb2c2070b4"
Sep 15 10:27:05.787013 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:05.786992    2579 scope.go:117] "RemoveContainer" containerID="ec9f1251f40123d0691bfe94963ed8767650ae6af2a0198bd4366cfb2c2070b4"
Sep 15 10:27:05.787345 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:27:05.787324    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec9f1251f40123d0691bfe94963ed8767650ae6af2a0198bd4366cfb2c2070b4\": container with ID starting with ec9f1251f40123d0691bfe94963ed8767650ae6af2a0198bd4366cfb2c2070b4 not found: ID does not exist" containerID="ec9f1251f40123d0691bfe94963ed8767650ae6af2a0198bd4366cfb2c2070b4"
Sep 15 10:27:05.787409 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:05.787352    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec9f1251f40123d0691bfe94963ed8767650ae6af2a0198bd4366cfb2c2070b4"} err="failed to get container status \"ec9f1251f40123d0691bfe94963ed8767650ae6af2a0198bd4366cfb2c2070b4\": rpc error: code = NotFound desc = could not find container \"ec9f1251f40123d0691bfe94963ed8767650ae6af2a0198bd4366cfb2c2070b4\": container with ID starting with ec9f1251f40123d0691bfe94963ed8767650ae6af2a0198bd4366cfb2c2070b4 not found: ID does not exist"
Sep 15 10:27:05.795526 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:05.795501    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-88768db8d-rcshg"]
Sep 15 10:27:05.798853 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:05.798831    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-88768db8d-rcshg"]
Sep 15 10:27:07.148526 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:07.148495    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ba0c18e-9545-476d-b6cf-a4d29be33432" path="/var/lib/kubelet/pods/1ba0c18e-9545-476d-b6cf-a4d29be33432/volumes"
Sep 15 10:27:26.432968 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:26.432927    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-svrrd"]
Sep 15 10:27:26.433403 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:26.433299    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ba0c18e-9545-476d-b6cf-a4d29be33432" containerName="manager"
Sep 15 10:27:26.433403 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:26.433312    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ba0c18e-9545-476d-b6cf-a4d29be33432" containerName="manager"
Sep 15 10:27:26.433403 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:26.433382    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ba0c18e-9545-476d-b6cf-a4d29be33432" containerName="manager"
Sep 15 10:27:26.439813 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:26.439790    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-svrrd"
Sep 15 10:27:26.442387 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:26.442362    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-mfzxm\""
Sep 15 10:27:26.442667 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:26.442650    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 15 10:27:26.448442 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:26.448417    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-svrrd"]
Sep 15 10:27:26.462157 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:26.462127    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-frx6w"]
Sep 15 10:27:26.465803 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:26.465776    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-frx6w"
Sep 15 10:27:26.483266 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:26.483235    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-frx6w"]
Sep 15 10:27:26.563981 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:26.563940    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vnxl\" (UniqueName: \"kubernetes.io/projected/0cdce33f-918e-4ba0-b2bc-f6e9a95f7996-kube-api-access-4vnxl\") pod \"payload-pre-processing-59fbc47bf8-svrrd\" (UID: \"0cdce33f-918e-4ba0-b2bc-f6e9a95f7996\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-svrrd"
Sep 15 10:27:26.564271 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:26.564252    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2e4baf3-a86b-4bc0-9eca-144514bfafa8-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-frx6w\" (UID: \"b2e4baf3-a86b-4bc0-9eca-144514bfafa8\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-frx6w"
Sep 15 10:27:26.564443 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:26.564427    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52lzm\" (UniqueName: \"kubernetes.io/projected/b2e4baf3-a86b-4bc0-9eca-144514bfafa8-kube-api-access-52lzm\") pod \"payload-processing-5b54b7fbb7-frx6w\" (UID: \"b2e4baf3-a86b-4bc0-9eca-144514bfafa8\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-frx6w"
Sep 15 10:27:26.564593 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:26.564578    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0cdce33f-918e-4ba0-b2bc-f6e9a95f7996-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-svrrd\" (UID: \"0cdce33f-918e-4ba0-b2bc-f6e9a95f7996\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-svrrd"
Sep 15 10:27:26.665759 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:26.665691    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52lzm\" (UniqueName: \"kubernetes.io/projected/b2e4baf3-a86b-4bc0-9eca-144514bfafa8-kube-api-access-52lzm\") pod \"payload-processing-5b54b7fbb7-frx6w\" (UID: \"b2e4baf3-a86b-4bc0-9eca-144514bfafa8\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-frx6w"
Sep 15 10:27:26.665759 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:26.665767    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0cdce33f-918e-4ba0-b2bc-f6e9a95f7996-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-svrrd\" (UID: \"0cdce33f-918e-4ba0-b2bc-f6e9a95f7996\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-svrrd"
Sep 15 10:27:26.666002 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:26.665822    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vnxl\" (UniqueName: \"kubernetes.io/projected/0cdce33f-918e-4ba0-b2bc-f6e9a95f7996-kube-api-access-4vnxl\") pod \"payload-pre-processing-59fbc47bf8-svrrd\" (UID: \"0cdce33f-918e-4ba0-b2bc-f6e9a95f7996\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-svrrd"
Sep 15 10:27:26.666002 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:26.665862    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2e4baf3-a86b-4bc0-9eca-144514bfafa8-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-frx6w\" (UID: \"b2e4baf3-a86b-4bc0-9eca-144514bfafa8\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-frx6w"
Sep 15 10:27:26.666487 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:26.666466    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0cdce33f-918e-4ba0-b2bc-f6e9a95f7996-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-svrrd\" (UID: \"0cdce33f-918e-4ba0-b2bc-f6e9a95f7996\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-svrrd"
Sep 15 10:27:26.666567 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:26.666548    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2e4baf3-a86b-4bc0-9eca-144514bfafa8-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-frx6w\" (UID: \"b2e4baf3-a86b-4bc0-9eca-144514bfafa8\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-frx6w"
Sep 15 10:27:26.674344 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:26.674313    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52lzm\" (UniqueName: \"kubernetes.io/projected/b2e4baf3-a86b-4bc0-9eca-144514bfafa8-kube-api-access-52lzm\") pod \"payload-processing-5b54b7fbb7-frx6w\" (UID: \"b2e4baf3-a86b-4bc0-9eca-144514bfafa8\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-frx6w"
Sep 15 10:27:26.674450 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:26.674354    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vnxl\" (UniqueName: \"kubernetes.io/projected/0cdce33f-918e-4ba0-b2bc-f6e9a95f7996-kube-api-access-4vnxl\") pod \"payload-pre-processing-59fbc47bf8-svrrd\" (UID: \"0cdce33f-918e-4ba0-b2bc-f6e9a95f7996\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-svrrd"
Sep 15 10:27:26.752219 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:26.752129    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-svrrd"
Sep 15 10:27:26.776586 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:26.776556    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-frx6w"
Sep 15 10:27:27.026536 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:27.026509    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-svrrd"]
Sep 15 10:27:27.028658 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:27:27.028632    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cdce33f_918e_4ba0_b2bc_f6e9a95f7996.slice/crio-54c2b1f72d70fd5faffeeb6e2edb1b4059c8101416223d054885616b721ffd10 WatchSource:0}: Error finding container 54c2b1f72d70fd5faffeeb6e2edb1b4059c8101416223d054885616b721ffd10: Status 404 returned error can't find the container with id 54c2b1f72d70fd5faffeeb6e2edb1b4059c8101416223d054885616b721ffd10
Sep 15 10:27:27.060349 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:27.060324    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-frx6w"]
Sep 15 10:27:27.062462 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:27:27.062433    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2e4baf3_a86b_4bc0_9eca_144514bfafa8.slice/crio-4e03cd601d46f86c4c96070dbb6f4ee5b95ffa98446ec99f610531f87b792143 WatchSource:0}: Error finding container 4e03cd601d46f86c4c96070dbb6f4ee5b95ffa98446ec99f610531f87b792143: Status 404 returned error can't find the container with id 4e03cd601d46f86c4c96070dbb6f4ee5b95ffa98446ec99f610531f87b792143
Sep 15 10:27:27.889332 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:27.889283    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-frx6w" event={"ID":"b2e4baf3-a86b-4bc0-9eca-144514bfafa8","Type":"ContainerStarted","Data":"4e03cd601d46f86c4c96070dbb6f4ee5b95ffa98446ec99f610531f87b792143"}
Sep 15 10:27:27.891610 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:27.891556    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-svrrd" event={"ID":"0cdce33f-918e-4ba0-b2bc-f6e9a95f7996","Type":"ContainerStarted","Data":"54c2b1f72d70fd5faffeeb6e2edb1b4059c8101416223d054885616b721ffd10"}
Sep 15 10:27:30.935276 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:30.935236    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-frx6w" event={"ID":"b2e4baf3-a86b-4bc0-9eca-144514bfafa8","Type":"ContainerStarted","Data":"bde921ab7000d460ad50952750250098679fc9ca650aee064e4ce7d36442b543"}
Sep 15 10:27:30.935822 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:30.935526    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-frx6w"
Sep 15 10:27:30.937555 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:30.937524    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-svrrd" event={"ID":"0cdce33f-918e-4ba0-b2bc-f6e9a95f7996","Type":"ContainerStarted","Data":"5dff037b4c5c3cd02918fcd5f96ec3b7a33e9f1f3936f2c4eed03d16d17cb48f"}
Sep 15 10:27:30.937835 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:30.937819    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-svrrd"
Sep 15 10:27:30.950574 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:30.950533    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-frx6w" podStartSLOduration=1.69205399 podStartE2EDuration="4.950520631s" totalImagesPullingTime="3.258466641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:27:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:27:30.949554451 +0000 UTC m=+584.345646529" watchObservedRunningTime="2026-09-15 10:27:30.950520631 +0000 UTC m=+584.346612718"
Sep 15 10:27:30.965290 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:30.965243    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-svrrd" podStartSLOduration=1.66206942 podStartE2EDuration="4.965229075s" totalImagesPullingTime="3.303159655s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:27:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:27:30.963713087 +0000 UTC m=+584.359805175" watchObservedRunningTime="2026-09-15 10:27:30.965229075 +0000 UTC m=+584.361321169"
Sep 15 10:27:35.966295 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:35.966210    2579 generic.go:356] "Generic (PLEG): container finished" podID="c1c808c8-4ef3-4a21-bf2a-d632af367669" containerID="f71cd5648f84ae945d1f424b683cfa956488b6aed58dfb37f8ab1fb2779e5635" exitCode=0
Sep 15 10:27:35.966295 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:35.966283    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkz5" event={"ID":"c1c808c8-4ef3-4a21-bf2a-d632af367669","Type":"ContainerDied","Data":"f71cd5648f84ae945d1f424b683cfa956488b6aed58dfb37f8ab1fb2779e5635"}
Sep 15 10:27:35.966744 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:35.966664    2579 scope.go:117] "RemoveContainer" containerID="f71cd5648f84ae945d1f424b683cfa956488b6aed58dfb37f8ab1fb2779e5635"
Sep 15 10:27:35.967647 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:35.967616    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:27:35.967718 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:35.967703    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:27:35.967780 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:35.967762    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:27:36.972542 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:36.972510    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkz5" event={"ID":"c1c808c8-4ef3-4a21-bf2a-d632af367669","Type":"ContainerStarted","Data":"5f055f5e24f28440febb5febd2e35c80a9606175ec7ef31441d518c0b7bb5a09"}
Sep 15 10:27:37.893356 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:37.893316    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkz5"
Sep 15 10:27:37.893583 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:37.893561    2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-7kkz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Sep 15 10:27:37.893628 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:37.893609    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkz5" podUID="c1c808c8-4ef3-4a21-bf2a-d632af367669" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Sep 15 10:27:38.893613 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:38.893578    2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-7kkz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Sep 15 10:27:38.894008 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:38.893633    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkz5" podUID="c1c808c8-4ef3-4a21-bf2a-d632af367669" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Sep 15 10:27:39.893231 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:39.893191    2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-7kkz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Sep 15 10:27:39.893424 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:39.893246    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkz5" podUID="c1c808c8-4ef3-4a21-bf2a-d632af367669" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Sep 15 10:27:40.894043 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:40.893999    2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-7kkz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Sep 15 10:27:40.894532 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:40.894063    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkz5" podUID="c1c808c8-4ef3-4a21-bf2a-d632af367669" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Sep 15 10:27:41.894003 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:41.893966    2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-7kkz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Sep 15 10:27:41.894185 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:41.894023    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkz5" podUID="c1c808c8-4ef3-4a21-bf2a-d632af367669" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Sep 15 10:27:41.945224 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:41.945190    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-frx6w"
Sep 15 10:27:41.945423 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:41.945402    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-svrrd"
Sep 15 10:27:42.898099 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:42.898064    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkz5"
Sep 15 10:27:42.898543 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:42.898319    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkz5"
Sep 15 10:27:42.899083 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:42.899065    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7kkz5"
Sep 15 10:27:59.148830 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:59.148795    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx5ch"]
Sep 15 10:27:59.153941 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:59.153908    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx5ch"
Sep 15 10:27:59.156558 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:59.156525    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx5ch"]
Sep 15 10:27:59.157054 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:59.157025    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 15 10:27:59.157689 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:59.157668    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 15 10:27:59.157828 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:59.157715    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-fwljq\""
Sep 15 10:27:59.157828 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:59.157753    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 15 10:27:59.163684 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:59.163656    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dd7e51d-4452-45fa-9d8d-b2c05259a2bd-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xx5ch\" (UID: \"5dd7e51d-4452-45fa-9d8d-b2c05259a2bd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx5ch"
Sep 15 10:27:59.163832 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:59.163749    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5dd7e51d-4452-45fa-9d8d-b2c05259a2bd-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xx5ch\" (UID: \"5dd7e51d-4452-45fa-9d8d-b2c05259a2bd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx5ch"
Sep 15 10:27:59.163832 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:59.163779    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vzxm\" (UniqueName: \"kubernetes.io/projected/5dd7e51d-4452-45fa-9d8d-b2c05259a2bd-kube-api-access-8vzxm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xx5ch\" (UID: \"5dd7e51d-4452-45fa-9d8d-b2c05259a2bd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx5ch"
Sep 15 10:27:59.164199 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:59.163842    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5dd7e51d-4452-45fa-9d8d-b2c05259a2bd-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xx5ch\" (UID: \"5dd7e51d-4452-45fa-9d8d-b2c05259a2bd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx5ch"
Sep 15 10:27:59.164199 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:59.163861    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5dd7e51d-4452-45fa-9d8d-b2c05259a2bd-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xx5ch\" (UID: \"5dd7e51d-4452-45fa-9d8d-b2c05259a2bd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx5ch"
Sep 15 10:27:59.164199 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:59.163903    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5dd7e51d-4452-45fa-9d8d-b2c05259a2bd-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xx5ch\" (UID: \"5dd7e51d-4452-45fa-9d8d-b2c05259a2bd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx5ch"
Sep 15 10:27:59.265229 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:59.265191    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5dd7e51d-4452-45fa-9d8d-b2c05259a2bd-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xx5ch\" (UID: \"5dd7e51d-4452-45fa-9d8d-b2c05259a2bd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx5ch"
Sep 15 10:27:59.265426 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:59.265243    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5dd7e51d-4452-45fa-9d8d-b2c05259a2bd-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xx5ch\" (UID: \"5dd7e51d-4452-45fa-9d8d-b2c05259a2bd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx5ch"
Sep 15 10:27:59.265426 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:59.265290    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5dd7e51d-4452-45fa-9d8d-b2c05259a2bd-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xx5ch\" (UID: \"5dd7e51d-4452-45fa-9d8d-b2c05259a2bd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx5ch"
Sep 15 10:27:59.265426 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:59.265318    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dd7e51d-4452-45fa-9d8d-b2c05259a2bd-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xx5ch\" (UID: \"5dd7e51d-4452-45fa-9d8d-b2c05259a2bd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx5ch"
Sep 15 10:27:59.265426 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:59.265400    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5dd7e51d-4452-45fa-9d8d-b2c05259a2bd-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xx5ch\" (UID: \"5dd7e51d-4452-45fa-9d8d-b2c05259a2bd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx5ch"
Sep 15 10:27:59.265636 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:59.265425    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vzxm\" (UniqueName: \"kubernetes.io/projected/5dd7e51d-4452-45fa-9d8d-b2c05259a2bd-kube-api-access-8vzxm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xx5ch\" (UID: \"5dd7e51d-4452-45fa-9d8d-b2c05259a2bd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx5ch"
Sep 15 10:27:59.265697 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:59.265646    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5dd7e51d-4452-45fa-9d8d-b2c05259a2bd-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xx5ch\" (UID: \"5dd7e51d-4452-45fa-9d8d-b2c05259a2bd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx5ch"
Sep 15 10:27:59.265778 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:59.265692    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5dd7e51d-4452-45fa-9d8d-b2c05259a2bd-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xx5ch\" (UID: \"5dd7e51d-4452-45fa-9d8d-b2c05259a2bd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx5ch"
Sep 15 10:27:59.265778 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:59.265753    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dd7e51d-4452-45fa-9d8d-b2c05259a2bd-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xx5ch\" (UID: \"5dd7e51d-4452-45fa-9d8d-b2c05259a2bd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx5ch"
Sep 15 10:27:59.267672 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:59.267655    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5dd7e51d-4452-45fa-9d8d-b2c05259a2bd-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xx5ch\" (UID: \"5dd7e51d-4452-45fa-9d8d-b2c05259a2bd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx5ch"
Sep 15 10:27:59.267834 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:59.267818    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5dd7e51d-4452-45fa-9d8d-b2c05259a2bd-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xx5ch\" (UID: \"5dd7e51d-4452-45fa-9d8d-b2c05259a2bd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx5ch"
Sep 15 10:27:59.272855 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:59.272832    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vzxm\" (UniqueName: \"kubernetes.io/projected/5dd7e51d-4452-45fa-9d8d-b2c05259a2bd-kube-api-access-8vzxm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xx5ch\" (UID: \"5dd7e51d-4452-45fa-9d8d-b2c05259a2bd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx5ch"
Sep 15 10:27:59.468311 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:59.468221    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx5ch"
Sep 15 10:27:59.745359 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:27:59.745285    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx5ch"]
Sep 15 10:27:59.748621 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:27:59.748592    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dd7e51d_4452_45fa_9d8d_b2c05259a2bd.slice/crio-d5d595363d7ac3abef6cbe2c8bf6c31b4619e039a7d697e63c9519f565e6454e WatchSource:0}: Error finding container d5d595363d7ac3abef6cbe2c8bf6c31b4619e039a7d697e63c9519f565e6454e: Status 404 returned error can't find the container with id d5d595363d7ac3abef6cbe2c8bf6c31b4619e039a7d697e63c9519f565e6454e
Sep 15 10:28:00.084417 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:28:00.084379    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx5ch" event={"ID":"5dd7e51d-4452-45fa-9d8d-b2c05259a2bd","Type":"ContainerStarted","Data":"d5d595363d7ac3abef6cbe2c8bf6c31b4619e039a7d697e63c9519f565e6454e"}
Sep 15 10:28:01.091053 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:28:01.091013    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx5ch" event={"ID":"5dd7e51d-4452-45fa-9d8d-b2c05259a2bd","Type":"ContainerStarted","Data":"66a90ef830cb9d75da61e73de19ca11f0828de76c221fc52c66db61a5e8bc08b"}
Sep 15 10:28:01.109812 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:28:01.109762    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx5ch" podStartSLOduration=1.079479974 podStartE2EDuration="2.109746581s" totalImagesPullingTime="1.030266607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:27:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:28:01.107258713 +0000 UTC m=+614.503350826" watchObservedRunningTime="2026-09-15 10:28:01.109746581 +0000 UTC m=+614.505838667"
Sep 15 10:28:09.468886 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:28:09.468809    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx5ch"
Sep 15 10:28:09.468886 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:28:09.468867    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx5ch"
Sep 15 10:28:09.481584 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:28:09.481559    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx5ch"
Sep 15 10:28:10.150330 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:28:10.150300    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xx5ch"
Sep 15 10:30:00.144660 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:00.144622    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29824470-7wzq6"]
Sep 15 10:30:00.148466 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:00.148449    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824470-7wzq6"
Sep 15 10:30:00.151037 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:00.151017    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5jrzm\""
Sep 15 10:30:00.154919 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:00.154898    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29824470-7wzq6"]
Sep 15 10:30:00.160829 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:00.160811    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824470-7wzq6"
Sep 15 10:30:00.429747 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:00.429707    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29824470-7wzq6"]
Sep 15 10:30:00.431973 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:30:00.431943    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fce7680_e335_4adf_8b99_66aec1612eb0.slice/crio-83b32c6774ffb2df0cd0135b39b2d63a57b4dd33f6c81feb8fc71d01b28fe65c WatchSource:0}: Error finding container 83b32c6774ffb2df0cd0135b39b2d63a57b4dd33f6c81feb8fc71d01b28fe65c: Status 404 returned error can't find the container with id 83b32c6774ffb2df0cd0135b39b2d63a57b4dd33f6c81feb8fc71d01b28fe65c
Sep 15 10:30:00.433707 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:00.433690    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 10:30:00.682002 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:00.681914    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824470-7wzq6" event={"ID":"5fce7680-e335-4adf-8b99-66aec1612eb0","Type":"ContainerStarted","Data":"83b32c6774ffb2df0cd0135b39b2d63a57b4dd33f6c81feb8fc71d01b28fe65c"}
Sep 15 10:30:04.706214 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:04.706182    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824470-7wzq6" event={"ID":"5fce7680-e335-4adf-8b99-66aec1612eb0","Type":"ContainerStarted","Data":"bc9c1147edf7390ab76d5fcabe60c0fd57d24e3011978133a92584d90ef8abe5"}
Sep 15 10:30:04.722227 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:04.722174    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824470-7wzq6" podStartSLOduration=1.252150807 podStartE2EDuration="4.722156567s" totalImagesPullingTime="3.47000576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:30:04.720466166 +0000 UTC m=+738.116558258" watchObservedRunningTime="2026-09-15 10:30:04.722156567 +0000 UTC m=+738.118248672"
Sep 15 10:30:05.712017 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:05.711984    2579 generic.go:356] "Generic (PLEG): container finished" podID="5fce7680-e335-4adf-8b99-66aec1612eb0" containerID="bc9c1147edf7390ab76d5fcabe60c0fd57d24e3011978133a92584d90ef8abe5" exitCode=0
Sep 15 10:30:05.712403 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:05.712073    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824470-7wzq6" event={"ID":"5fce7680-e335-4adf-8b99-66aec1612eb0","Type":"ContainerDied","Data":"bc9c1147edf7390ab76d5fcabe60c0fd57d24e3011978133a92584d90ef8abe5"}
Sep 15 10:30:06.868132 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:06.868107    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824470-7wzq6"
Sep 15 10:30:07.723663 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:07.723634    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824470-7wzq6"
Sep 15 10:30:07.723843 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:07.723636    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824470-7wzq6" event={"ID":"5fce7680-e335-4adf-8b99-66aec1612eb0","Type":"ContainerDied","Data":"83b32c6774ffb2df0cd0135b39b2d63a57b4dd33f6c81feb8fc71d01b28fe65c"}
Sep 15 10:30:07.723843 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:07.723769    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="83b32c6774ffb2df0cd0135b39b2d63a57b4dd33f6c81feb8fc71d01b28fe65c"
Sep 15 10:30:14.893414 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:14.893381    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq"]
Sep 15 10:30:14.893992 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:14.893972    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fce7680-e335-4adf-8b99-66aec1612eb0" containerName="cleanup"
Sep 15 10:30:14.894081 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:14.893994    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fce7680-e335-4adf-8b99-66aec1612eb0" containerName="cleanup"
Sep 15 10:30:14.894140 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:14.894087    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fce7680-e335-4adf-8b99-66aec1612eb0" containerName="cleanup"
Sep 15 10:30:14.897235 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:14.897214    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq"
Sep 15 10:30:14.899878 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:14.899853    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-ff0655-openshift-default-dockercfg-rpsrz\""
Sep 15 10:30:14.910424 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:14.910396    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq"]
Sep 15 10:30:14.957615 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:14.957572    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm"]
Sep 15 10:30:14.961777 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:14.961757    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm"
Sep 15 10:30:14.964899 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:14.964854    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-8c1047-openshift-default-dockercfg-pd4qd\""
Sep 15 10:30:14.971292 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:14.971267    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm"]
Sep 15 10:30:15.063773 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.063678    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0d8bd17-2aa5-4895-bdab-7dd375af9a26-credential-socket\") pod \"e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm\" (UID: \"d0d8bd17-2aa5-4895-bdab-7dd375af9a26\") " pod="openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm"
Sep 15 10:30:15.063955 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.063819    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f82258b-ec03-4785-83f7-13de6b4178a2-credential-socket\") pod \"e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq\" (UID: \"8f82258b-ec03-4785-83f7-13de6b4178a2\") " pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq"
Sep 15 10:30:15.063955 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.063845    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f82258b-ec03-4785-83f7-13de6b4178a2-istio-envoy\") pod \"e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq\" (UID: \"8f82258b-ec03-4785-83f7-13de6b4178a2\") " pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq"
Sep 15 10:30:15.063955 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.063872    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f82258b-ec03-4785-83f7-13de6b4178a2-istio-data\") pod \"e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq\" (UID: \"8f82258b-ec03-4785-83f7-13de6b4178a2\") " pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq"
Sep 15 10:30:15.063955 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.063924    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0d8bd17-2aa5-4895-bdab-7dd375af9a26-istio-token\") pod \"e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm\" (UID: \"d0d8bd17-2aa5-4895-bdab-7dd375af9a26\") " pod="openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm"
Sep 15 10:30:15.063955 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.063946    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f82258b-ec03-4785-83f7-13de6b4178a2-workload-socket\") pod \"e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq\" (UID: \"8f82258b-ec03-4785-83f7-13de6b4178a2\") " pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq"
Sep 15 10:30:15.064232 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.063973    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0d8bd17-2aa5-4895-bdab-7dd375af9a26-istio-data\") pod \"e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm\" (UID: \"d0d8bd17-2aa5-4895-bdab-7dd375af9a26\") " pod="openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm"
Sep 15 10:30:15.064232 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.063996    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hxqx\" (UniqueName: \"kubernetes.io/projected/d0d8bd17-2aa5-4895-bdab-7dd375af9a26-kube-api-access-8hxqx\") pod \"e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm\" (UID: \"d0d8bd17-2aa5-4895-bdab-7dd375af9a26\") " pod="openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm"
Sep 15 10:30:15.064232 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.064054    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f82258b-ec03-4785-83f7-13de6b4178a2-istio-podinfo\") pod \"e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq\" (UID: \"8f82258b-ec03-4785-83f7-13de6b4178a2\") " pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq"
Sep 15 10:30:15.064232 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.064080    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f82258b-ec03-4785-83f7-13de6b4178a2-istio-token\") pod \"e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq\" (UID: \"8f82258b-ec03-4785-83f7-13de6b4178a2\") " pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq"
Sep 15 10:30:15.064232 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.064105    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52tb7\" (UniqueName: \"kubernetes.io/projected/8f82258b-ec03-4785-83f7-13de6b4178a2-kube-api-access-52tb7\") pod \"e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq\" (UID: \"8f82258b-ec03-4785-83f7-13de6b4178a2\") " pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq"
Sep 15 10:30:15.064232 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.064164    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0d8bd17-2aa5-4895-bdab-7dd375af9a26-istio-envoy\") pod \"e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm\" (UID: \"d0d8bd17-2aa5-4895-bdab-7dd375af9a26\") " pod="openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm"
Sep 15 10:30:15.064232 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.064219    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0d8bd17-2aa5-4895-bdab-7dd375af9a26-workload-socket\") pod \"e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm\" (UID: \"d0d8bd17-2aa5-4895-bdab-7dd375af9a26\") " pod="openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm"
Sep 15 10:30:15.064557 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.064242    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0d8bd17-2aa5-4895-bdab-7dd375af9a26-workload-certs\") pod \"e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm\" (UID: \"d0d8bd17-2aa5-4895-bdab-7dd375af9a26\") " pod="openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm"
Sep 15 10:30:15.064557 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.064269    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f82258b-ec03-4785-83f7-13de6b4178a2-workload-certs\") pod \"e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq\" (UID: \"8f82258b-ec03-4785-83f7-13de6b4178a2\") " pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq"
Sep 15 10:30:15.064557 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.064298    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0d8bd17-2aa5-4895-bdab-7dd375af9a26-istio-podinfo\") pod \"e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm\" (UID: \"d0d8bd17-2aa5-4895-bdab-7dd375af9a26\") " pod="openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm"
Sep 15 10:30:15.064557 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.064356    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0d8bd17-2aa5-4895-bdab-7dd375af9a26-istiod-ca-cert\") pod \"e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm\" (UID: \"d0d8bd17-2aa5-4895-bdab-7dd375af9a26\") " pod="openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm"
Sep 15 10:30:15.064557 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.064396    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f82258b-ec03-4785-83f7-13de6b4178a2-istiod-ca-cert\") pod \"e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq\" (UID: \"8f82258b-ec03-4785-83f7-13de6b4178a2\") " pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq"
Sep 15 10:30:15.165767 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.165674    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0d8bd17-2aa5-4895-bdab-7dd375af9a26-istiod-ca-cert\") pod \"e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm\" (UID: \"d0d8bd17-2aa5-4895-bdab-7dd375af9a26\") " pod="openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm"
Sep 15 10:30:15.165767 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.165746    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f82258b-ec03-4785-83f7-13de6b4178a2-istiod-ca-cert\") pod \"e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq\" (UID: \"8f82258b-ec03-4785-83f7-13de6b4178a2\") " pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq"
Sep 15 10:30:15.165984 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.165790    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0d8bd17-2aa5-4895-bdab-7dd375af9a26-credential-socket\") pod \"e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm\" (UID: \"d0d8bd17-2aa5-4895-bdab-7dd375af9a26\") " pod="openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm"
Sep 15 10:30:15.165984 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.165815    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f82258b-ec03-4785-83f7-13de6b4178a2-credential-socket\") pod \"e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq\" (UID: \"8f82258b-ec03-4785-83f7-13de6b4178a2\") " pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq"
Sep 15 10:30:15.165984 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.165853    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f82258b-ec03-4785-83f7-13de6b4178a2-istio-envoy\") pod \"e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq\" (UID: \"8f82258b-ec03-4785-83f7-13de6b4178a2\") " pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq"
Sep 15 10:30:15.165984 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.165878    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f82258b-ec03-4785-83f7-13de6b4178a2-istio-data\") pod \"e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq\" (UID: \"8f82258b-ec03-4785-83f7-13de6b4178a2\") " pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq"
Sep 15 10:30:15.167590 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.166264    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f82258b-ec03-4785-83f7-13de6b4178a2-credential-socket\") pod \"e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq\" (UID: \"8f82258b-ec03-4785-83f7-13de6b4178a2\") " pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq"
Sep 15 10:30:15.167590 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.166265    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0d8bd17-2aa5-4895-bdab-7dd375af9a26-credential-socket\") pod \"e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm\" (UID: \"d0d8bd17-2aa5-4895-bdab-7dd375af9a26\") " pod="openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm"
Sep 15 10:30:15.167590 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.166315    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0d8bd17-2aa5-4895-bdab-7dd375af9a26-istio-token\") pod \"e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm\" (UID: \"d0d8bd17-2aa5-4895-bdab-7dd375af9a26\") " pod="openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm"
Sep 15 10:30:15.167590 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.166346    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f82258b-ec03-4785-83f7-13de6b4178a2-workload-socket\") pod \"e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq\" (UID: \"8f82258b-ec03-4785-83f7-13de6b4178a2\") " pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq"
Sep 15 10:30:15.167590 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.166397    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0d8bd17-2aa5-4895-bdab-7dd375af9a26-istio-data\") pod \"e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm\" (UID: \"d0d8bd17-2aa5-4895-bdab-7dd375af9a26\") " pod="openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm"
Sep 15 10:30:15.167590 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.166424    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hxqx\" (UniqueName: \"kubernetes.io/projected/d0d8bd17-2aa5-4895-bdab-7dd375af9a26-kube-api-access-8hxqx\") pod \"e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm\" (UID: \"d0d8bd17-2aa5-4895-bdab-7dd375af9a26\") " pod="openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm"
Sep 15 10:30:15.167590 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.166481    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f82258b-ec03-4785-83f7-13de6b4178a2-istio-podinfo\") pod \"e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq\" (UID: \"8f82258b-ec03-4785-83f7-13de6b4178a2\") " pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq"
Sep 15 10:30:15.167590 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.166507    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f82258b-ec03-4785-83f7-13de6b4178a2-istio-token\") pod \"e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq\" (UID: \"8f82258b-ec03-4785-83f7-13de6b4178a2\") " pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq"
Sep 15 10:30:15.167590 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.166531    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52tb7\" (UniqueName: \"kubernetes.io/projected/8f82258b-ec03-4785-83f7-13de6b4178a2-kube-api-access-52tb7\") pod \"e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq\" (UID: \"8f82258b-ec03-4785-83f7-13de6b4178a2\") " pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq"
Sep 15 10:30:15.167590 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.166533    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f82258b-ec03-4785-83f7-13de6b4178a2-istio-data\") pod \"e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq\" (UID: \"8f82258b-ec03-4785-83f7-13de6b4178a2\") " pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq"
Sep 15 10:30:15.167590 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.166627    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0d8bd17-2aa5-4895-bdab-7dd375af9a26-istio-envoy\") pod \"e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm\" (UID: \"d0d8bd17-2aa5-4895-bdab-7dd375af9a26\") " pod="openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm"
Sep 15 10:30:15.167590 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.166634    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0d8bd17-2aa5-4895-bdab-7dd375af9a26-istiod-ca-cert\") pod \"e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm\" (UID: \"d0d8bd17-2aa5-4895-bdab-7dd375af9a26\") " pod="openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm"
Sep 15 10:30:15.167590 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.166947    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0d8bd17-2aa5-4895-bdab-7dd375af9a26-istio-data\") pod \"e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm\" (UID: \"d0d8bd17-2aa5-4895-bdab-7dd375af9a26\") " pod="openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm"
Sep 15 10:30:15.167590 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.166999    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0d8bd17-2aa5-4895-bdab-7dd375af9a26-workload-socket\") pod \"e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm\" (UID: \"d0d8bd17-2aa5-4895-bdab-7dd375af9a26\") " pod="openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm"
Sep 15 10:30:15.167590 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.167023    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0d8bd17-2aa5-4895-bdab-7dd375af9a26-workload-certs\") pod \"e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm\" (UID: \"d0d8bd17-2aa5-4895-bdab-7dd375af9a26\") " pod="openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm"
Sep 15 10:30:15.168523 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.167057    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f82258b-ec03-4785-83f7-13de6b4178a2-workload-certs\") pod \"e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq\" (UID: \"8f82258b-ec03-4785-83f7-13de6b4178a2\") " pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq"
Sep 15 10:30:15.168523 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.167090    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0d8bd17-2aa5-4895-bdab-7dd375af9a26-istio-podinfo\") pod \"e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm\" (UID: \"d0d8bd17-2aa5-4895-bdab-7dd375af9a26\") " pod="openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm"
Sep 15 10:30:15.168523 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.167255    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f82258b-ec03-4785-83f7-13de6b4178a2-workload-socket\") pod \"e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq\" (UID: \"8f82258b-ec03-4785-83f7-13de6b4178a2\") " pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq"
Sep 15 10:30:15.168523 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.167464    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0d8bd17-2aa5-4895-bdab-7dd375af9a26-workload-certs\") pod \"e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm\" (UID: \"d0d8bd17-2aa5-4895-bdab-7dd375af9a26\") " pod="openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm"
Sep 15 10:30:15.168523 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.167534    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f82258b-ec03-4785-83f7-13de6b4178a2-workload-certs\") pod \"e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq\" (UID: \"8f82258b-ec03-4785-83f7-13de6b4178a2\") " pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq"
Sep 15 10:30:15.168523 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.167792    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0d8bd17-2aa5-4895-bdab-7dd375af9a26-workload-socket\") pod \"e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm\" (UID: \"d0d8bd17-2aa5-4895-bdab-7dd375af9a26\") " pod="openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm"
Sep 15 10:30:15.168870 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.168591    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f82258b-ec03-4785-83f7-13de6b4178a2-istio-envoy\") pod \"e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq\" (UID: \"8f82258b-ec03-4785-83f7-13de6b4178a2\") " pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq"
Sep 15 10:30:15.169435 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.169410    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0d8bd17-2aa5-4895-bdab-7dd375af9a26-istio-envoy\") pod \"e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm\" (UID: \"d0d8bd17-2aa5-4895-bdab-7dd375af9a26\") " pod="openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm"
Sep 15 10:30:15.169649 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.169628    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f82258b-ec03-4785-83f7-13de6b4178a2-istiod-ca-cert\") pod \"e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq\" (UID: \"8f82258b-ec03-4785-83f7-13de6b4178a2\") " pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq"
Sep 15 10:30:15.170064 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.170040    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0d8bd17-2aa5-4895-bdab-7dd375af9a26-istio-podinfo\") pod \"e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm\" (UID: \"d0d8bd17-2aa5-4895-bdab-7dd375af9a26\") " pod="openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm"
Sep 15 10:30:15.170940 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.170914    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f82258b-ec03-4785-83f7-13de6b4178a2-istio-podinfo\") pod \"e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq\" (UID: \"8f82258b-ec03-4785-83f7-13de6b4178a2\") " pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq"
Sep 15 10:30:15.177266 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.176662    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0d8bd17-2aa5-4895-bdab-7dd375af9a26-istio-token\") pod \"e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm\" (UID: \"d0d8bd17-2aa5-4895-bdab-7dd375af9a26\") " pod="openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm"
Sep 15 10:30:15.177266 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.176819    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52tb7\" (UniqueName: \"kubernetes.io/projected/8f82258b-ec03-4785-83f7-13de6b4178a2-kube-api-access-52tb7\") pod \"e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq\" (UID: \"8f82258b-ec03-4785-83f7-13de6b4178a2\") " pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq"
Sep 15 10:30:15.182777 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.179644    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hxqx\" (UniqueName: \"kubernetes.io/projected/d0d8bd17-2aa5-4895-bdab-7dd375af9a26-kube-api-access-8hxqx\") pod \"e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm\" (UID: \"d0d8bd17-2aa5-4895-bdab-7dd375af9a26\") " pod="openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm"
Sep 15 10:30:15.189313 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.189288    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f82258b-ec03-4785-83f7-13de6b4178a2-istio-token\") pod \"e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq\" (UID: \"8f82258b-ec03-4785-83f7-13de6b4178a2\") " pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq"
Sep 15 10:30:15.209526 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.209496    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq"
Sep 15 10:30:15.279849 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.279443    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm"
Sep 15 10:30:15.494951 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.494920    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq"]
Sep 15 10:30:15.496713 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:30:15.496682    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f82258b_ec03_4785_83f7_13de6b4178a2.slice/crio-d73838a3e96fb32b75b36048440c694db61e939270d964755da281dc4f3f9e64 WatchSource:0}: Error finding container d73838a3e96fb32b75b36048440c694db61e939270d964755da281dc4f3f9e64: Status 404 returned error can't find the container with id d73838a3e96fb32b75b36048440c694db61e939270d964755da281dc4f3f9e64
Sep 15 10:30:15.499188 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.499151    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:30:15.499285 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.499247    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:30:15.499348 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.499296    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:30:15.581266 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.581239    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm"]
Sep 15 10:30:15.582463 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:30:15.582440    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0d8bd17_2aa5_4895_bdab_7dd375af9a26.slice/crio-297c31016e8a7614bf2364d3e32ae5e2c2e1b19f6a64b59f5c90ffa285d4fa7f WatchSource:0}: Error finding container 297c31016e8a7614bf2364d3e32ae5e2c2e1b19f6a64b59f5c90ffa285d4fa7f: Status 404 returned error can't find the container with id 297c31016e8a7614bf2364d3e32ae5e2c2e1b19f6a64b59f5c90ffa285d4fa7f
Sep 15 10:30:15.584801 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.584764    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:30:15.584875 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.584849    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:30:15.584923 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.584894    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:30:15.767199 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.767096    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq" event={"ID":"8f82258b-ec03-4785-83f7-13de6b4178a2","Type":"ContainerStarted","Data":"c5b826667c05b906c078b2625e95c23703cd80d1381a49d79742765243a8ee44"}
Sep 15 10:30:15.767199 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.767164    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq" event={"ID":"8f82258b-ec03-4785-83f7-13de6b4178a2","Type":"ContainerStarted","Data":"d73838a3e96fb32b75b36048440c694db61e939270d964755da281dc4f3f9e64"}
Sep 15 10:30:15.769406 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.769382    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm" event={"ID":"d0d8bd17-2aa5-4895-bdab-7dd375af9a26","Type":"ContainerStarted","Data":"98f9bd1ed7dacb9a0295b2291f727018285b887bdddfc09f50770244ab4fac17"}
Sep 15 10:30:15.769584 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.769568    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm" event={"ID":"d0d8bd17-2aa5-4895-bdab-7dd375af9a26","Type":"ContainerStarted","Data":"297c31016e8a7614bf2364d3e32ae5e2c2e1b19f6a64b59f5c90ffa285d4fa7f"}
Sep 15 10:30:15.792746 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.792669    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq" podStartSLOduration=1.792649511 podStartE2EDuration="1.792649511s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:30:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:30:15.7911718 +0000 UTC m=+749.187263888" watchObservedRunningTime="2026-09-15 10:30:15.792649511 +0000 UTC m=+749.188741599"
Sep 15 10:30:15.816978 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:15.816914    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm" podStartSLOduration=1.81689308 podStartE2EDuration="1.81689308s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:30:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:30:15.815337608 +0000 UTC m=+749.211429696" watchObservedRunningTime="2026-09-15 10:30:15.81689308 +0000 UTC m=+749.212985168"
Sep 15 10:30:16.209905 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:16.209855    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq"
Sep 15 10:30:16.211590 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:16.211565    2579 patch_prober.go:28] interesting pod/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Sep 15 10:30:16.211693 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:16.211624    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq" podUID="8f82258b-ec03-4785-83f7-13de6b4178a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Sep 15 10:30:16.280771 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:16.280741    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm"
Sep 15 10:30:16.285671 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:16.285646    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm"
Sep 15 10:30:16.774543 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:16.774514    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm"
Sep 15 10:30:16.775707 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:16.775685    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm"
Sep 15 10:30:17.214428 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:17.214390    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq"
Sep 15 10:30:17.779769 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:17.779715    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq"
Sep 15 10:30:17.780627 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:17.780609    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq"
Sep 15 10:30:19.914156 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:19.914125    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-8c1047-f868c84f8-kvbvz"]
Sep 15 10:30:19.917922 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:19.917902    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-8c1047-f868c84f8-kvbvz"
Sep 15 10:30:19.920772 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:19.920750    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-8c1047-dockercfg-95vx6\""
Sep 15 10:30:19.920929 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:19.920910    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-8c1047\""
Sep 15 10:30:19.929250 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:19.929227    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-8c1047-f868c84f8-kvbvz"]
Sep 15 10:30:19.942441 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:19.942411    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-8c1047-5c884df8b9-8gbtl"]
Sep 15 10:30:19.946011 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:19.945989    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-8c1047-5c884df8b9-8gbtl"
Sep 15 10:30:19.959791 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:19.959764    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-8c1047-5c884df8b9-8gbtl"]
Sep 15 10:30:20.014004 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:20.013967    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41b86081-62bf-4b69-ad77-557580df292d-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-8c1047-f868c84f8-kvbvz\" (UID: \"41b86081-62bf-4b69-ad77-557580df292d\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-8c1047-f868c84f8-kvbvz"
Sep 15 10:30:20.014167 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:20.014012    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcjtt\" (UniqueName: \"kubernetes.io/projected/41b86081-62bf-4b69-ad77-557580df292d-kube-api-access-fcjtt\") pod \"payload-pre-processing-e2e-worker-w0-8c1047-f868c84f8-kvbvz\" (UID: \"41b86081-62bf-4b69-ad77-557580df292d\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-8c1047-f868c84f8-kvbvz"
Sep 15 10:30:20.115329 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:20.115283    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41b86081-62bf-4b69-ad77-557580df292d-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-8c1047-f868c84f8-kvbvz\" (UID: \"41b86081-62bf-4b69-ad77-557580df292d\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-8c1047-f868c84f8-kvbvz"
Sep 15 10:30:20.115329 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:20.115330    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4da162e6-e931-4af8-af3f-f23f543afc4c-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-8c1047-5c884df8b9-8gbtl\" (UID: \"4da162e6-e931-4af8-af3f-f23f543afc4c\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-8c1047-5c884df8b9-8gbtl"
Sep 15 10:30:20.115581 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:20.115444    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcjtt\" (UniqueName: \"kubernetes.io/projected/41b86081-62bf-4b69-ad77-557580df292d-kube-api-access-fcjtt\") pod \"payload-pre-processing-e2e-worker-w0-8c1047-f868c84f8-kvbvz\" (UID: \"41b86081-62bf-4b69-ad77-557580df292d\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-8c1047-f868c84f8-kvbvz"
Sep 15 10:30:20.115581 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:20.115558    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w27nf\" (UniqueName: \"kubernetes.io/projected/4da162e6-e931-4af8-af3f-f23f543afc4c-kube-api-access-w27nf\") pod \"payload-processing-e2e-worker-w0-8c1047-5c884df8b9-8gbtl\" (UID: \"4da162e6-e931-4af8-af3f-f23f543afc4c\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-8c1047-5c884df8b9-8gbtl"
Sep 15 10:30:20.116055 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:20.116034    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41b86081-62bf-4b69-ad77-557580df292d-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-8c1047-f868c84f8-kvbvz\" (UID: \"41b86081-62bf-4b69-ad77-557580df292d\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-8c1047-f868c84f8-kvbvz"
Sep 15 10:30:20.123329 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:20.123305    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcjtt\" (UniqueName: \"kubernetes.io/projected/41b86081-62bf-4b69-ad77-557580df292d-kube-api-access-fcjtt\") pod \"payload-pre-processing-e2e-worker-w0-8c1047-f868c84f8-kvbvz\" (UID: \"41b86081-62bf-4b69-ad77-557580df292d\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-8c1047-f868c84f8-kvbvz"
Sep 15 10:30:20.216607 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:20.216523    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w27nf\" (UniqueName: \"kubernetes.io/projected/4da162e6-e931-4af8-af3f-f23f543afc4c-kube-api-access-w27nf\") pod \"payload-processing-e2e-worker-w0-8c1047-5c884df8b9-8gbtl\" (UID: \"4da162e6-e931-4af8-af3f-f23f543afc4c\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-8c1047-5c884df8b9-8gbtl"
Sep 15 10:30:20.216607 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:20.216580    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4da162e6-e931-4af8-af3f-f23f543afc4c-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-8c1047-5c884df8b9-8gbtl\" (UID: \"4da162e6-e931-4af8-af3f-f23f543afc4c\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-8c1047-5c884df8b9-8gbtl"
Sep 15 10:30:20.217360 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:20.217338    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4da162e6-e931-4af8-af3f-f23f543afc4c-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-8c1047-5c884df8b9-8gbtl\" (UID: \"4da162e6-e931-4af8-af3f-f23f543afc4c\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-8c1047-5c884df8b9-8gbtl"
Sep 15 10:30:20.225719 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:20.225694    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w27nf\" (UniqueName: \"kubernetes.io/projected/4da162e6-e931-4af8-af3f-f23f543afc4c-kube-api-access-w27nf\") pod \"payload-processing-e2e-worker-w0-8c1047-5c884df8b9-8gbtl\" (UID: \"4da162e6-e931-4af8-af3f-f23f543afc4c\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-8c1047-5c884df8b9-8gbtl"
Sep 15 10:30:20.229588 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:20.229564    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-8c1047-f868c84f8-kvbvz"
Sep 15 10:30:20.256508 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:20.256477    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-8c1047-5c884df8b9-8gbtl"
Sep 15 10:30:20.518041 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:20.517992    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-8c1047-f868c84f8-kvbvz"]
Sep 15 10:30:20.520340 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:30:20.520312    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41b86081_62bf_4b69_ad77_557580df292d.slice/crio-e4132a0491d4697370e8074b65d512c8dddf14cefdbbd957802946403d41bcde WatchSource:0}: Error finding container e4132a0491d4697370e8074b65d512c8dddf14cefdbbd957802946403d41bcde: Status 404 returned error can't find the container with id e4132a0491d4697370e8074b65d512c8dddf14cefdbbd957802946403d41bcde
Sep 15 10:30:20.551401 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:20.551370    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-8c1047-5c884df8b9-8gbtl"]
Sep 15 10:30:20.552905 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:30:20.552882    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4da162e6_e931_4af8_af3f_f23f543afc4c.slice/crio-8d26ae216fadc916a5969b61622000b1bc971c5bcfadd105236cabe648ea58bf WatchSource:0}: Error finding container 8d26ae216fadc916a5969b61622000b1bc971c5bcfadd105236cabe648ea58bf: Status 404 returned error can't find the container with id 8d26ae216fadc916a5969b61622000b1bc971c5bcfadd105236cabe648ea58bf
Sep 15 10:30:20.793422 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:20.793390    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-ff0655-9b677758-djj76"]
Sep 15 10:30:20.799200 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:20.799167    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ff0655-9b677758-djj76"
Sep 15 10:30:20.799349 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:20.799284    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-8c1047-f868c84f8-kvbvz" event={"ID":"41b86081-62bf-4b69-ad77-557580df292d","Type":"ContainerStarted","Data":"c763f4c1914fb98472534ad0cdede2ae9e355230bfd7aa29fab587f964c63b8e"}
Sep 15 10:30:20.799349 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:20.799336    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-8c1047-f868c84f8-kvbvz" event={"ID":"41b86081-62bf-4b69-ad77-557580df292d","Type":"ContainerStarted","Data":"e4132a0491d4697370e8074b65d512c8dddf14cefdbbd957802946403d41bcde"}
Sep 15 10:30:20.800058 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:20.800041    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-8c1047-f868c84f8-kvbvz"
Sep 15 10:30:20.802063 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:20.801680    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-ff0655\""
Sep 15 10:30:20.802313 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:20.802293    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-ff0655-dockercfg-tdwh5\""
Sep 15 10:30:20.803768 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:20.803271    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-8c1047-5c884df8b9-8gbtl" event={"ID":"4da162e6-e931-4af8-af3f-f23f543afc4c","Type":"ContainerStarted","Data":"a5c12df5f024865657bd3c518c7e2c380d13c6090db3dff3afc044001bcd862a"}
Sep 15 10:30:20.803768 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:20.803330    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-8c1047-5c884df8b9-8gbtl" event={"ID":"4da162e6-e931-4af8-af3f-f23f543afc4c","Type":"ContainerStarted","Data":"8d26ae216fadc916a5969b61622000b1bc971c5bcfadd105236cabe648ea58bf"}
Sep 15 10:30:20.803910 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:20.803778    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-8c1047-5c884df8b9-8gbtl"
Sep 15 10:30:20.808665 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:20.808599    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-ff0655-9b677758-djj76"]
Sep 15 10:30:20.816746 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:20.816700    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-ff0655-5687dbf867-c4bpj"]
Sep 15 10:30:20.821644 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:20.821615    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-ff0655-5687dbf867-c4bpj"
Sep 15 10:30:20.836222 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:20.836198    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-ff0655-5687dbf867-c4bpj"]
Sep 15 10:30:20.838293 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:20.838232    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-8c1047-f868c84f8-kvbvz" podStartSLOduration=1.838216671 podStartE2EDuration="1.838216671s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:30:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:30:20.83487523 +0000 UTC m=+754.230967321" watchObservedRunningTime="2026-09-15 10:30:20.838216671 +0000 UTC m=+754.234308759"
Sep 15 10:30:20.853820 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:20.853776    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w0-8c1047-5c884df8b9-8gbtl" podStartSLOduration=1.853760276 podStartE2EDuration="1.853760276s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:30:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:30:20.851734711 +0000 UTC m=+754.247826790" watchObservedRunningTime="2026-09-15 10:30:20.853760276 +0000 UTC m=+754.249852389"
Sep 15 10:30:20.924990 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:20.924945    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90d97adf-06bd-498e-8a70-5b89e27baa88-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-ff0655-9b677758-djj76\" (UID: \"90d97adf-06bd-498e-8a70-5b89e27baa88\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ff0655-9b677758-djj76"
Sep 15 10:30:20.925456 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:20.925037    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtbgq\" (UniqueName: \"kubernetes.io/projected/90d97adf-06bd-498e-8a70-5b89e27baa88-kube-api-access-gtbgq\") pod \"payload-pre-processing-e2e-worker-w4-ff0655-9b677758-djj76\" (UID: \"90d97adf-06bd-498e-8a70-5b89e27baa88\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ff0655-9b677758-djj76"
Sep 15 10:30:20.925456 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:20.925191    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e592f08-8fd8-4665-b4e1-91ec9e1a7152-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-ff0655-5687dbf867-c4bpj\" (UID: \"6e592f08-8fd8-4665-b4e1-91ec9e1a7152\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-ff0655-5687dbf867-c4bpj"
Sep 15 10:30:20.925456 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:20.925217    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx5v7\" (UniqueName: \"kubernetes.io/projected/6e592f08-8fd8-4665-b4e1-91ec9e1a7152-kube-api-access-wx5v7\") pod \"payload-processing-e2e-worker-w4-ff0655-5687dbf867-c4bpj\" (UID: \"6e592f08-8fd8-4665-b4e1-91ec9e1a7152\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-ff0655-5687dbf867-c4bpj"
Sep 15 10:30:21.025701 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:21.025664    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90d97adf-06bd-498e-8a70-5b89e27baa88-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-ff0655-9b677758-djj76\" (UID: \"90d97adf-06bd-498e-8a70-5b89e27baa88\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ff0655-9b677758-djj76"
Sep 15 10:30:21.025938 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:21.025735    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtbgq\" (UniqueName: \"kubernetes.io/projected/90d97adf-06bd-498e-8a70-5b89e27baa88-kube-api-access-gtbgq\") pod \"payload-pre-processing-e2e-worker-w4-ff0655-9b677758-djj76\" (UID: \"90d97adf-06bd-498e-8a70-5b89e27baa88\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ff0655-9b677758-djj76"
Sep 15 10:30:21.025938 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:21.025812    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e592f08-8fd8-4665-b4e1-91ec9e1a7152-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-ff0655-5687dbf867-c4bpj\" (UID: \"6e592f08-8fd8-4665-b4e1-91ec9e1a7152\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-ff0655-5687dbf867-c4bpj"
Sep 15 10:30:21.025938 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:21.025830    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx5v7\" (UniqueName: \"kubernetes.io/projected/6e592f08-8fd8-4665-b4e1-91ec9e1a7152-kube-api-access-wx5v7\") pod \"payload-processing-e2e-worker-w4-ff0655-5687dbf867-c4bpj\" (UID: \"6e592f08-8fd8-4665-b4e1-91ec9e1a7152\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-ff0655-5687dbf867-c4bpj"
Sep 15 10:30:21.026759 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:21.026708    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e592f08-8fd8-4665-b4e1-91ec9e1a7152-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-ff0655-5687dbf867-c4bpj\" (UID: \"6e592f08-8fd8-4665-b4e1-91ec9e1a7152\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-ff0655-5687dbf867-c4bpj"
Sep 15 10:30:21.026759 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:21.026708    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90d97adf-06bd-498e-8a70-5b89e27baa88-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-ff0655-9b677758-djj76\" (UID: \"90d97adf-06bd-498e-8a70-5b89e27baa88\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ff0655-9b677758-djj76"
Sep 15 10:30:21.034740 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:21.034685    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtbgq\" (UniqueName: \"kubernetes.io/projected/90d97adf-06bd-498e-8a70-5b89e27baa88-kube-api-access-gtbgq\") pod \"payload-pre-processing-e2e-worker-w4-ff0655-9b677758-djj76\" (UID: \"90d97adf-06bd-498e-8a70-5b89e27baa88\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ff0655-9b677758-djj76"
Sep 15 10:30:21.034864 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:21.034848    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx5v7\" (UniqueName: \"kubernetes.io/projected/6e592f08-8fd8-4665-b4e1-91ec9e1a7152-kube-api-access-wx5v7\") pod \"payload-processing-e2e-worker-w4-ff0655-5687dbf867-c4bpj\" (UID: \"6e592f08-8fd8-4665-b4e1-91ec9e1a7152\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-ff0655-5687dbf867-c4bpj"
Sep 15 10:30:21.114862 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:21.114768    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ff0655-9b677758-djj76"
Sep 15 10:30:21.135792 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:21.135103    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-ff0655-5687dbf867-c4bpj"
Sep 15 10:30:21.409149 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:21.409045    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-ff0655-9b677758-djj76"]
Sep 15 10:30:21.441161 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:21.441140    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-ff0655-5687dbf867-c4bpj"]
Sep 15 10:30:21.443834 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:30:21.443802    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e592f08_8fd8_4665_b4e1_91ec9e1a7152.slice/crio-30ca9ae9188182b5001212f2f1360c3499a9a11408717f20deb63a9d42550323 WatchSource:0}: Error finding container 30ca9ae9188182b5001212f2f1360c3499a9a11408717f20deb63a9d42550323: Status 404 returned error can't find the container with id 30ca9ae9188182b5001212f2f1360c3499a9a11408717f20deb63a9d42550323
Sep 15 10:30:21.812540 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:21.812488    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-ff0655-5687dbf867-c4bpj" event={"ID":"6e592f08-8fd8-4665-b4e1-91ec9e1a7152","Type":"ContainerStarted","Data":"0f68c80a14f7fe98c4f926889001a509f5b117fb01efe459bf368251dd137c24"}
Sep 15 10:30:21.812770 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:21.812604    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-ff0655-5687dbf867-c4bpj" event={"ID":"6e592f08-8fd8-4665-b4e1-91ec9e1a7152","Type":"ContainerStarted","Data":"30ca9ae9188182b5001212f2f1360c3499a9a11408717f20deb63a9d42550323"}
Sep 15 10:30:21.812770 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:21.812639    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-ff0655-5687dbf867-c4bpj"
Sep 15 10:30:21.815233 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:21.815201    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ff0655-9b677758-djj76" event={"ID":"90d97adf-06bd-498e-8a70-5b89e27baa88","Type":"ContainerStarted","Data":"fc84cd81db54f30254494cd0c35b8f66345e9c6fdfd0ecf3f14838ccc4b76f8e"}
Sep 15 10:30:21.815455 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:21.815430    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ff0655-9b677758-djj76" event={"ID":"90d97adf-06bd-498e-8a70-5b89e27baa88","Type":"ContainerStarted","Data":"86e95d4c62a4b2b26269c8813282fe5bb6fa4bec229784538b919662a85f28e4"}
Sep 15 10:30:21.815649 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:21.815632    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ff0655-9b677758-djj76"
Sep 15 10:30:21.830786 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:21.830735    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w4-ff0655-5687dbf867-c4bpj" podStartSLOduration=1.830701655 podStartE2EDuration="1.830701655s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:30:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:30:21.828447381 +0000 UTC m=+755.224539468" watchObservedRunningTime="2026-09-15 10:30:21.830701655 +0000 UTC m=+755.226793742"
Sep 15 10:30:21.841098 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:21.841072    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-86a8f5-6bdb75c5f8-jhfrz"]
Sep 15 10:30:21.845240 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:21.845219    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-86a8f5-6bdb75c5f8-jhfrz"
Sep 15 10:30:21.847503 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:21.847462    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ff0655-9b677758-djj76" podStartSLOduration=1.847448844 podStartE2EDuration="1.847448844s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:30:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:30:21.845460867 +0000 UTC m=+755.241552953" watchObservedRunningTime="2026-09-15 10:30:21.847448844 +0000 UTC m=+755.243540930"
Sep 15 10:30:21.847719 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:21.847701    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-86a8f5\""
Sep 15 10:30:21.847828 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:21.847806    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-86a8f5-dockercfg-2t4n6\""
Sep 15 10:30:21.857650 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:21.857625    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-86a8f5-6bdb75c5f8-jhfrz"]
Sep 15 10:30:22.035976 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:22.035934    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23631531-c363-46a5-9067-613569676471-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-86a8f5-6bdb75c5f8-jhfrz\" (UID: \"23631531-c363-46a5-9067-613569676471\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-86a8f5-6bdb75c5f8-jhfrz"
Sep 15 10:30:22.036424 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:22.036012    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr8l8\" (UniqueName: \"kubernetes.io/projected/23631531-c363-46a5-9067-613569676471-kube-api-access-kr8l8\") pod \"payload-pre-processing-e2e-inf-a-86a8f5-6bdb75c5f8-jhfrz\" (UID: \"23631531-c363-46a5-9067-613569676471\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-86a8f5-6bdb75c5f8-jhfrz"
Sep 15 10:30:22.137251 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:22.137154    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr8l8\" (UniqueName: \"kubernetes.io/projected/23631531-c363-46a5-9067-613569676471-kube-api-access-kr8l8\") pod \"payload-pre-processing-e2e-inf-a-86a8f5-6bdb75c5f8-jhfrz\" (UID: \"23631531-c363-46a5-9067-613569676471\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-86a8f5-6bdb75c5f8-jhfrz"
Sep 15 10:30:22.137251 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:22.137225    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23631531-c363-46a5-9067-613569676471-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-86a8f5-6bdb75c5f8-jhfrz\" (UID: \"23631531-c363-46a5-9067-613569676471\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-86a8f5-6bdb75c5f8-jhfrz"
Sep 15 10:30:22.137995 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:22.137973    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23631531-c363-46a5-9067-613569676471-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-86a8f5-6bdb75c5f8-jhfrz\" (UID: \"23631531-c363-46a5-9067-613569676471\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-86a8f5-6bdb75c5f8-jhfrz"
Sep 15 10:30:22.146196 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:22.146165    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr8l8\" (UniqueName: \"kubernetes.io/projected/23631531-c363-46a5-9067-613569676471-kube-api-access-kr8l8\") pod \"payload-pre-processing-e2e-inf-a-86a8f5-6bdb75c5f8-jhfrz\" (UID: \"23631531-c363-46a5-9067-613569676471\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-86a8f5-6bdb75c5f8-jhfrz"
Sep 15 10:30:22.155847 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:22.155819    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-86a8f5-6bdb75c5f8-jhfrz"
Sep 15 10:30:22.439660 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:22.439627    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-86a8f5-6bdb75c5f8-jhfrz"]
Sep 15 10:30:22.441879 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:30:22.441848    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23631531_c363_46a5_9067_613569676471.slice/crio-63716ca4ed05794e4d139e486e0858d73c206c00e63426252f7fbb28e3635828 WatchSource:0}: Error finding container 63716ca4ed05794e4d139e486e0858d73c206c00e63426252f7fbb28e3635828: Status 404 returned error can't find the container with id 63716ca4ed05794e4d139e486e0858d73c206c00e63426252f7fbb28e3635828
Sep 15 10:30:22.825315 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:22.825271    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-86a8f5-6bdb75c5f8-jhfrz" event={"ID":"23631531-c363-46a5-9067-613569676471","Type":"ContainerStarted","Data":"43ae100b6dd4923a269349566cff7adab63e3dbf8a4016af12a2cff25044565a"}
Sep 15 10:30:22.825497 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:22.825344    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-86a8f5-6bdb75c5f8-jhfrz" event={"ID":"23631531-c363-46a5-9067-613569676471","Type":"ContainerStarted","Data":"63716ca4ed05794e4d139e486e0858d73c206c00e63426252f7fbb28e3635828"}
Sep 15 10:30:22.825644 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:22.825625    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-86a8f5-6bdb75c5f8-jhfrz"
Sep 15 10:30:22.850605 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:22.850557    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-86a8f5-6bdb75c5f8-jhfrz" podStartSLOduration=1.850543506 podStartE2EDuration="1.850543506s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:30:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:30:22.847788241 +0000 UTC m=+756.243880332" watchObservedRunningTime="2026-09-15 10:30:22.850543506 +0000 UTC m=+756.246635592"
Sep 15 10:30:23.357189 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:23.357150    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r"]
Sep 15 10:30:23.361042 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:23.361017    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r"
Sep 15 10:30:23.363552 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:23.363531    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-b8e8c34b-openshift-default-dockercfg-pslvm\""
Sep 15 10:30:23.372708 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:23.372681    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r"]
Sep 15 10:30:23.552088 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:23.552049    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86adc1ce-70c4-4ed5-9593-0b5f3c886626-istio-podinfo\") pod \"e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r\" (UID: \"86adc1ce-70c4-4ed5-9593-0b5f3c886626\") " pod="openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r"
Sep 15 10:30:23.552333 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:23.552106    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86adc1ce-70c4-4ed5-9593-0b5f3c886626-istio-data\") pod \"e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r\" (UID: \"86adc1ce-70c4-4ed5-9593-0b5f3c886626\") " pod="openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r"
Sep 15 10:30:23.552333 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:23.552151    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86adc1ce-70c4-4ed5-9593-0b5f3c886626-istio-envoy\") pod \"e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r\" (UID: \"86adc1ce-70c4-4ed5-9593-0b5f3c886626\") " pod="openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r"
Sep 15 10:30:23.552333 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:23.552172    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86adc1ce-70c4-4ed5-9593-0b5f3c886626-istio-token\") pod \"e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r\" (UID: \"86adc1ce-70c4-4ed5-9593-0b5f3c886626\") " pod="openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r"
Sep 15 10:30:23.552333 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:23.552187    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86adc1ce-70c4-4ed5-9593-0b5f3c886626-istiod-ca-cert\") pod \"e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r\" (UID: \"86adc1ce-70c4-4ed5-9593-0b5f3c886626\") " pod="openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r"
Sep 15 10:30:23.552333 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:23.552300    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkpzm\" (UniqueName: \"kubernetes.io/projected/86adc1ce-70c4-4ed5-9593-0b5f3c886626-kube-api-access-hkpzm\") pod \"e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r\" (UID: \"86adc1ce-70c4-4ed5-9593-0b5f3c886626\") " pod="openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r"
Sep 15 10:30:23.552558 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:23.552375    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86adc1ce-70c4-4ed5-9593-0b5f3c886626-workload-socket\") pod \"e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r\" (UID: \"86adc1ce-70c4-4ed5-9593-0b5f3c886626\") " pod="openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r"
Sep 15 10:30:23.552558 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:23.552420    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86adc1ce-70c4-4ed5-9593-0b5f3c886626-credential-socket\") pod \"e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r\" (UID: \"86adc1ce-70c4-4ed5-9593-0b5f3c886626\") " pod="openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r"
Sep 15 10:30:23.552558 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:23.552473    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86adc1ce-70c4-4ed5-9593-0b5f3c886626-workload-certs\") pod \"e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r\" (UID: \"86adc1ce-70c4-4ed5-9593-0b5f3c886626\") " pod="openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r"
Sep 15 10:30:23.653209 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:23.653124    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86adc1ce-70c4-4ed5-9593-0b5f3c886626-workload-socket\") pod \"e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r\" (UID: \"86adc1ce-70c4-4ed5-9593-0b5f3c886626\") " pod="openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r"
Sep 15 10:30:23.653209 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:23.653177    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86adc1ce-70c4-4ed5-9593-0b5f3c886626-credential-socket\") pod \"e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r\" (UID: \"86adc1ce-70c4-4ed5-9593-0b5f3c886626\") " pod="openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r"
Sep 15 10:30:23.653209 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:23.653209    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86adc1ce-70c4-4ed5-9593-0b5f3c886626-workload-certs\") pod \"e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r\" (UID: \"86adc1ce-70c4-4ed5-9593-0b5f3c886626\") " pod="openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r"
Sep 15 10:30:23.653473 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:23.653234    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86adc1ce-70c4-4ed5-9593-0b5f3c886626-istio-podinfo\") pod \"e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r\" (UID: \"86adc1ce-70c4-4ed5-9593-0b5f3c886626\") " pod="openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r"
Sep 15 10:30:23.653473 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:23.653277    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86adc1ce-70c4-4ed5-9593-0b5f3c886626-istio-data\") pod \"e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r\" (UID: \"86adc1ce-70c4-4ed5-9593-0b5f3c886626\") " pod="openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r"
Sep 15 10:30:23.653473 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:23.653320    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86adc1ce-70c4-4ed5-9593-0b5f3c886626-istio-envoy\") pod \"e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r\" (UID: \"86adc1ce-70c4-4ed5-9593-0b5f3c886626\") " pod="openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r"
Sep 15 10:30:23.653473 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:23.653353    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86adc1ce-70c4-4ed5-9593-0b5f3c886626-istio-token\") pod \"e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r\" (UID: \"86adc1ce-70c4-4ed5-9593-0b5f3c886626\") " pod="openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r"
Sep 15 10:30:23.653473 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:23.653377    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86adc1ce-70c4-4ed5-9593-0b5f3c886626-istiod-ca-cert\") pod \"e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r\" (UID: \"86adc1ce-70c4-4ed5-9593-0b5f3c886626\") " pod="openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r"
Sep 15 10:30:23.653473 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:23.653413    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkpzm\" (UniqueName: \"kubernetes.io/projected/86adc1ce-70c4-4ed5-9593-0b5f3c886626-kube-api-access-hkpzm\") pod \"e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r\" (UID: \"86adc1ce-70c4-4ed5-9593-0b5f3c886626\") " pod="openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r"
Sep 15 10:30:23.653809 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:23.653600    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86adc1ce-70c4-4ed5-9593-0b5f3c886626-workload-socket\") pod \"e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r\" (UID: \"86adc1ce-70c4-4ed5-9593-0b5f3c886626\") " pod="openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r"
Sep 15 10:30:23.653809 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:23.653630    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86adc1ce-70c4-4ed5-9593-0b5f3c886626-workload-certs\") pod \"e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r\" (UID: \"86adc1ce-70c4-4ed5-9593-0b5f3c886626\") " pod="openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r"
Sep 15 10:30:23.653809 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:23.653703    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86adc1ce-70c4-4ed5-9593-0b5f3c886626-credential-socket\") pod \"e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r\" (UID: \"86adc1ce-70c4-4ed5-9593-0b5f3c886626\") " pod="openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r"
Sep 15 10:30:23.653809 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:23.653756    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86adc1ce-70c4-4ed5-9593-0b5f3c886626-istio-data\") pod \"e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r\" (UID: \"86adc1ce-70c4-4ed5-9593-0b5f3c886626\") " pod="openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r"
Sep 15 10:30:23.654184 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:23.654161    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86adc1ce-70c4-4ed5-9593-0b5f3c886626-istiod-ca-cert\") pod \"e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r\" (UID: \"86adc1ce-70c4-4ed5-9593-0b5f3c886626\") " pod="openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r"
Sep 15 10:30:23.655813 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:23.655784    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86adc1ce-70c4-4ed5-9593-0b5f3c886626-istio-envoy\") pod \"e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r\" (UID: \"86adc1ce-70c4-4ed5-9593-0b5f3c886626\") " pod="openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r"
Sep 15 10:30:23.655912 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:23.655812    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86adc1ce-70c4-4ed5-9593-0b5f3c886626-istio-podinfo\") pod \"e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r\" (UID: \"86adc1ce-70c4-4ed5-9593-0b5f3c886626\") " pod="openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r"
Sep 15 10:30:23.661312 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:23.661292    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86adc1ce-70c4-4ed5-9593-0b5f3c886626-istio-token\") pod \"e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r\" (UID: \"86adc1ce-70c4-4ed5-9593-0b5f3c886626\") " pod="openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r"
Sep 15 10:30:23.661497 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:23.661475    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkpzm\" (UniqueName: \"kubernetes.io/projected/86adc1ce-70c4-4ed5-9593-0b5f3c886626-kube-api-access-hkpzm\") pod \"e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r\" (UID: \"86adc1ce-70c4-4ed5-9593-0b5f3c886626\") " pod="openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r"
Sep 15 10:30:23.675392 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:23.675361    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r"
Sep 15 10:30:23.964375 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:23.964347    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r"]
Sep 15 10:30:23.965600 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:30:23.965571    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86adc1ce_70c4_4ed5_9593_0b5f3c886626.slice/crio-1e859ca52153d15b161819914aab5b6303149b87b21b62f41e8d7a7de443136b WatchSource:0}: Error finding container 1e859ca52153d15b161819914aab5b6303149b87b21b62f41e8d7a7de443136b: Status 404 returned error can't find the container with id 1e859ca52153d15b161819914aab5b6303149b87b21b62f41e8d7a7de443136b
Sep 15 10:30:23.967897 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:23.967863    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:30:23.967951 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:23.967930    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:30:23.967983 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:23.967961    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:30:24.839681 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:24.839642    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r" event={"ID":"86adc1ce-70c4-4ed5-9593-0b5f3c886626","Type":"ContainerStarted","Data":"56db6b27ad150845feafca05bc7a706a9b964ee3f1f0a6fcc3054ed23a4b7fc0"}
Sep 15 10:30:24.840052 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:24.839698    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r" event={"ID":"86adc1ce-70c4-4ed5-9593-0b5f3c886626","Type":"ContainerStarted","Data":"1e859ca52153d15b161819914aab5b6303149b87b21b62f41e8d7a7de443136b"}
Sep 15 10:30:24.891025 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:24.890961    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r" podStartSLOduration=1.890945729 podStartE2EDuration="1.890945729s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:30:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:30:24.884270267 +0000 UTC m=+758.280362353" watchObservedRunningTime="2026-09-15 10:30:24.890945729 +0000 UTC m=+758.287037815"
Sep 15 10:30:25.676109 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:25.676070    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r"
Sep 15 10:30:25.681256 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:25.681231    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r"
Sep 15 10:30:25.845172 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:25.845139    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r"
Sep 15 10:30:25.846553 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:25.846531    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r"
Sep 15 10:30:31.492978 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:31.492933    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-b8e8c34b-6b4f85fbcc-whqvx"]
Sep 15 10:30:31.508748 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:31.506927    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-b8e8c34b-6b4f85fbcc-whqvx"
Sep 15 10:30:31.528748 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:31.525251    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-b8e8c34b-dockercfg-j5vp5\""
Sep 15 10:30:31.528748 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:31.526850    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-b8e8c34b\""
Sep 15 10:30:31.535750 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:31.532214    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-b8e8c34b-6b4f85fbcc-whqvx"]
Sep 15 10:30:31.565252 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:31.565205    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54231eed-bd4c-4cc9-8197-8bef8f8d5d28-plugins-config-volume\") pod \"payload-processing-e2e-ait-b8e8c34b-6b4f85fbcc-whqvx\" (UID: \"54231eed-bd4c-4cc9-8197-8bef8f8d5d28\") " pod="openshift-ingress/payload-processing-e2e-ait-b8e8c34b-6b4f85fbcc-whqvx"
Sep 15 10:30:31.565561 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:31.565532    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fm8xz\" (UniqueName: \"kubernetes.io/projected/54231eed-bd4c-4cc9-8197-8bef8f8d5d28-kube-api-access-fm8xz\") pod \"payload-processing-e2e-ait-b8e8c34b-6b4f85fbcc-whqvx\" (UID: \"54231eed-bd4c-4cc9-8197-8bef8f8d5d28\") " pod="openshift-ingress/payload-processing-e2e-ait-b8e8c34b-6b4f85fbcc-whqvx"
Sep 15 10:30:31.666755 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:31.666247    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54231eed-bd4c-4cc9-8197-8bef8f8d5d28-plugins-config-volume\") pod \"payload-processing-e2e-ait-b8e8c34b-6b4f85fbcc-whqvx\" (UID: \"54231eed-bd4c-4cc9-8197-8bef8f8d5d28\") " pod="openshift-ingress/payload-processing-e2e-ait-b8e8c34b-6b4f85fbcc-whqvx"
Sep 15 10:30:31.666755 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:31.666301    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm8xz\" (UniqueName: \"kubernetes.io/projected/54231eed-bd4c-4cc9-8197-8bef8f8d5d28-kube-api-access-fm8xz\") pod \"payload-processing-e2e-ait-b8e8c34b-6b4f85fbcc-whqvx\" (UID: \"54231eed-bd4c-4cc9-8197-8bef8f8d5d28\") " pod="openshift-ingress/payload-processing-e2e-ait-b8e8c34b-6b4f85fbcc-whqvx"
Sep 15 10:30:31.667195 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:31.667170    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54231eed-bd4c-4cc9-8197-8bef8f8d5d28-plugins-config-volume\") pod \"payload-processing-e2e-ait-b8e8c34b-6b4f85fbcc-whqvx\" (UID: \"54231eed-bd4c-4cc9-8197-8bef8f8d5d28\") " pod="openshift-ingress/payload-processing-e2e-ait-b8e8c34b-6b4f85fbcc-whqvx"
Sep 15 10:30:31.674500 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:31.674472    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fm8xz\" (UniqueName: \"kubernetes.io/projected/54231eed-bd4c-4cc9-8197-8bef8f8d5d28-kube-api-access-fm8xz\") pod \"payload-processing-e2e-ait-b8e8c34b-6b4f85fbcc-whqvx\" (UID: \"54231eed-bd4c-4cc9-8197-8bef8f8d5d28\") " pod="openshift-ingress/payload-processing-e2e-ait-b8e8c34b-6b4f85fbcc-whqvx"
Sep 15 10:30:31.818893 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:31.818850    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-8c1047-f868c84f8-kvbvz"
Sep 15 10:30:31.819893 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:31.819864    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-8c1047-5c884df8b9-8gbtl"
Sep 15 10:30:31.840743 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:31.840688    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-b8e8c34b-6b4f85fbcc-whqvx"
Sep 15 10:30:32.205269 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:32.205176    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-b8e8c34b-6b4f85fbcc-whqvx"]
Sep 15 10:30:32.223337 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:30:32.223279    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54231eed_bd4c_4cc9_8197_8bef8f8d5d28.slice/crio-6384c6da2e78ca227e19c6715e52b306fbefb5c392fc547153ec254c0bb95c64 WatchSource:0}: Error finding container 6384c6da2e78ca227e19c6715e52b306fbefb5c392fc547153ec254c0bb95c64: Status 404 returned error can't find the container with id 6384c6da2e78ca227e19c6715e52b306fbefb5c392fc547153ec254c0bb95c64
Sep 15 10:30:32.828951 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:32.828916    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-ff0655-5687dbf867-c4bpj"
Sep 15 10:30:32.895933 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:32.895902    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-b8e8c34b-6b4f85fbcc-whqvx" event={"ID":"54231eed-bd4c-4cc9-8197-8bef8f8d5d28","Type":"ContainerStarted","Data":"6b1e1b05bd9eef41b786fd42e54d6939f08ec2a1e287b71da0e9c6db5c616d30"}
Sep 15 10:30:32.896131 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:32.895958    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-b8e8c34b-6b4f85fbcc-whqvx" event={"ID":"54231eed-bd4c-4cc9-8197-8bef8f8d5d28","Type":"ContainerStarted","Data":"6384c6da2e78ca227e19c6715e52b306fbefb5c392fc547153ec254c0bb95c64"}
Sep 15 10:30:32.896131 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:32.895978    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-b8e8c34b-6b4f85fbcc-whqvx"
Sep 15 10:30:33.180430 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:33.180326    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-b8e8c34b-6b4f85fbcc-whqvx" podStartSLOduration=2.180297617 podStartE2EDuration="2.180297617s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:30:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:30:32.926917167 +0000 UTC m=+766.323009258" watchObservedRunningTime="2026-09-15 10:30:33.180297617 +0000 UTC m=+766.576389704"
Sep 15 10:30:33.180793 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:33.180773    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn"]
Sep 15 10:30:33.184876 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:33.184856    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn"
Sep 15 10:30:33.187355 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:33.187330    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-234840-openshift-default-dockercfg-8jsrw\""
Sep 15 10:30:33.207818 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:33.207782    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn"]
Sep 15 10:30:33.284490 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:33.283224    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2d1b95b-f48e-4672-9be4-311309e7476c-istio-envoy\") pod \"e2e-inf-b-234840-openshift-default-689549674-dxdtn\" (UID: \"b2d1b95b-f48e-4672-9be4-311309e7476c\") " pod="openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn"
Sep 15 10:30:33.284490 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:33.283290    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2d1b95b-f48e-4672-9be4-311309e7476c-istio-data\") pod \"e2e-inf-b-234840-openshift-default-689549674-dxdtn\" (UID: \"b2d1b95b-f48e-4672-9be4-311309e7476c\") " pod="openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn"
Sep 15 10:30:33.284490 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:33.283330    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2d1b95b-f48e-4672-9be4-311309e7476c-workload-socket\") pod \"e2e-inf-b-234840-openshift-default-689549674-dxdtn\" (UID: \"b2d1b95b-f48e-4672-9be4-311309e7476c\") " pod="openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn"
Sep 15 10:30:33.284490 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:33.283406    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2d1b95b-f48e-4672-9be4-311309e7476c-istio-podinfo\") pod \"e2e-inf-b-234840-openshift-default-689549674-dxdtn\" (UID: \"b2d1b95b-f48e-4672-9be4-311309e7476c\") " pod="openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn"
Sep 15 10:30:33.284490 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:33.283445    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp4tt\" (UniqueName: \"kubernetes.io/projected/b2d1b95b-f48e-4672-9be4-311309e7476c-kube-api-access-jp4tt\") pod \"e2e-inf-b-234840-openshift-default-689549674-dxdtn\" (UID: \"b2d1b95b-f48e-4672-9be4-311309e7476c\") " pod="openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn"
Sep 15 10:30:33.284490 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:33.283479    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2d1b95b-f48e-4672-9be4-311309e7476c-credential-socket\") pod \"e2e-inf-b-234840-openshift-default-689549674-dxdtn\" (UID: \"b2d1b95b-f48e-4672-9be4-311309e7476c\") " pod="openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn"
Sep 15 10:30:33.284490 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:33.283508    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2d1b95b-f48e-4672-9be4-311309e7476c-workload-certs\") pod \"e2e-inf-b-234840-openshift-default-689549674-dxdtn\" (UID: \"b2d1b95b-f48e-4672-9be4-311309e7476c\") " pod="openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn"
Sep 15 10:30:33.284490 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:33.283537    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2d1b95b-f48e-4672-9be4-311309e7476c-istio-token\") pod \"e2e-inf-b-234840-openshift-default-689549674-dxdtn\" (UID: \"b2d1b95b-f48e-4672-9be4-311309e7476c\") " pod="openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn"
Sep 15 10:30:33.284490 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:33.283575    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2d1b95b-f48e-4672-9be4-311309e7476c-istiod-ca-cert\") pod \"e2e-inf-b-234840-openshift-default-689549674-dxdtn\" (UID: \"b2d1b95b-f48e-4672-9be4-311309e7476c\") " pod="openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn"
Sep 15 10:30:33.384946 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:33.384903    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2d1b95b-f48e-4672-9be4-311309e7476c-istiod-ca-cert\") pod \"e2e-inf-b-234840-openshift-default-689549674-dxdtn\" (UID: \"b2d1b95b-f48e-4672-9be4-311309e7476c\") " pod="openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn"
Sep 15 10:30:33.385149 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:33.384956    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2d1b95b-f48e-4672-9be4-311309e7476c-istio-envoy\") pod \"e2e-inf-b-234840-openshift-default-689549674-dxdtn\" (UID: \"b2d1b95b-f48e-4672-9be4-311309e7476c\") " pod="openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn"
Sep 15 10:30:33.385149 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:33.384987    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2d1b95b-f48e-4672-9be4-311309e7476c-istio-data\") pod \"e2e-inf-b-234840-openshift-default-689549674-dxdtn\" (UID: \"b2d1b95b-f48e-4672-9be4-311309e7476c\") " pod="openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn"
Sep 15 10:30:33.385149 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:33.385013    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2d1b95b-f48e-4672-9be4-311309e7476c-workload-socket\") pod \"e2e-inf-b-234840-openshift-default-689549674-dxdtn\" (UID: \"b2d1b95b-f48e-4672-9be4-311309e7476c\") " pod="openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn"
Sep 15 10:30:33.385149 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:33.385063    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2d1b95b-f48e-4672-9be4-311309e7476c-istio-podinfo\") pod \"e2e-inf-b-234840-openshift-default-689549674-dxdtn\" (UID: \"b2d1b95b-f48e-4672-9be4-311309e7476c\") " pod="openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn"
Sep 15 10:30:33.385149 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:33.385087    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jp4tt\" (UniqueName: \"kubernetes.io/projected/b2d1b95b-f48e-4672-9be4-311309e7476c-kube-api-access-jp4tt\") pod \"e2e-inf-b-234840-openshift-default-689549674-dxdtn\" (UID: \"b2d1b95b-f48e-4672-9be4-311309e7476c\") " pod="openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn"
Sep 15 10:30:33.385149 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:33.385108    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2d1b95b-f48e-4672-9be4-311309e7476c-credential-socket\") pod \"e2e-inf-b-234840-openshift-default-689549674-dxdtn\" (UID: \"b2d1b95b-f48e-4672-9be4-311309e7476c\") " pod="openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn"
Sep 15 10:30:33.385149 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:33.385133    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2d1b95b-f48e-4672-9be4-311309e7476c-workload-certs\") pod \"e2e-inf-b-234840-openshift-default-689549674-dxdtn\" (UID: \"b2d1b95b-f48e-4672-9be4-311309e7476c\") " pod="openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn"
Sep 15 10:30:33.385543 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:33.385160    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2d1b95b-f48e-4672-9be4-311309e7476c-istio-token\") pod \"e2e-inf-b-234840-openshift-default-689549674-dxdtn\" (UID: \"b2d1b95b-f48e-4672-9be4-311309e7476c\") " pod="openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn"
Sep 15 10:30:33.385543 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:33.385454    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2d1b95b-f48e-4672-9be4-311309e7476c-istio-data\") pod \"e2e-inf-b-234840-openshift-default-689549674-dxdtn\" (UID: \"b2d1b95b-f48e-4672-9be4-311309e7476c\") " pod="openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn"
Sep 15 10:30:33.385668 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:33.385646    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2d1b95b-f48e-4672-9be4-311309e7476c-workload-socket\") pod \"e2e-inf-b-234840-openshift-default-689549674-dxdtn\" (UID: \"b2d1b95b-f48e-4672-9be4-311309e7476c\") " pod="openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn"
Sep 15 10:30:33.385763 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:33.385741    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2d1b95b-f48e-4672-9be4-311309e7476c-credential-socket\") pod \"e2e-inf-b-234840-openshift-default-689549674-dxdtn\" (UID: \"b2d1b95b-f48e-4672-9be4-311309e7476c\") " pod="openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn"
Sep 15 10:30:33.385825 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:33.385758    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2d1b95b-f48e-4672-9be4-311309e7476c-workload-certs\") pod \"e2e-inf-b-234840-openshift-default-689549674-dxdtn\" (UID: \"b2d1b95b-f48e-4672-9be4-311309e7476c\") " pod="openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn"
Sep 15 10:30:33.386006 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:33.385986    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2d1b95b-f48e-4672-9be4-311309e7476c-istiod-ca-cert\") pod \"e2e-inf-b-234840-openshift-default-689549674-dxdtn\" (UID: \"b2d1b95b-f48e-4672-9be4-311309e7476c\") " pod="openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn"
Sep 15 10:30:33.388311 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:33.388293    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2d1b95b-f48e-4672-9be4-311309e7476c-istio-podinfo\") pod \"e2e-inf-b-234840-openshift-default-689549674-dxdtn\" (UID: \"b2d1b95b-f48e-4672-9be4-311309e7476c\") " pod="openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn"
Sep 15 10:30:33.388979 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:33.388958    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2d1b95b-f48e-4672-9be4-311309e7476c-istio-envoy\") pod \"e2e-inf-b-234840-openshift-default-689549674-dxdtn\" (UID: \"b2d1b95b-f48e-4672-9be4-311309e7476c\") " pod="openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn"
Sep 15 10:30:33.407745 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:33.402599    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2d1b95b-f48e-4672-9be4-311309e7476c-istio-token\") pod \"e2e-inf-b-234840-openshift-default-689549674-dxdtn\" (UID: \"b2d1b95b-f48e-4672-9be4-311309e7476c\") " pod="openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn"
Sep 15 10:30:33.407745 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:33.402601    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp4tt\" (UniqueName: \"kubernetes.io/projected/b2d1b95b-f48e-4672-9be4-311309e7476c-kube-api-access-jp4tt\") pod \"e2e-inf-b-234840-openshift-default-689549674-dxdtn\" (UID: \"b2d1b95b-f48e-4672-9be4-311309e7476c\") " pod="openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn"
Sep 15 10:30:33.507709 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:33.507600    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn"
Sep 15 10:30:33.836421 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:33.835637    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ff0655-9b677758-djj76"
Sep 15 10:30:33.836421 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:33.836000    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-86a8f5-6bdb75c5f8-jhfrz"
Sep 15 10:30:33.848145 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:33.848122    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn"]
Sep 15 10:30:33.850706 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:30:33.850453    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2d1b95b_f48e_4672_9be4_311309e7476c.slice/crio-aeea6a15468901edd261a5e8627e747640e430e1dd287c25b8ab2370b4055ba0 WatchSource:0}: Error finding container aeea6a15468901edd261a5e8627e747640e430e1dd287c25b8ab2370b4055ba0: Status 404 returned error can't find the container with id aeea6a15468901edd261a5e8627e747640e430e1dd287c25b8ab2370b4055ba0
Sep 15 10:30:33.853176 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:33.853116    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:30:33.853296 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:33.853205    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:30:33.853296 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:33.853250    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:30:33.952675 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:33.942292    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn" event={"ID":"b2d1b95b-f48e-4672-9be4-311309e7476c","Type":"ContainerStarted","Data":"aeea6a15468901edd261a5e8627e747640e430e1dd287c25b8ab2370b4055ba0"}
Sep 15 10:30:34.949417 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:34.949376    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn" event={"ID":"b2d1b95b-f48e-4672-9be4-311309e7476c","Type":"ContainerStarted","Data":"00f5c41361e36b521ecb61a47d952317a925ff00484cddccaf1523cf2a4820a9"}
Sep 15 10:30:34.970708 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:34.970635    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn" podStartSLOduration=1.9706139120000001 podStartE2EDuration="1.970613912s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:30:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:30:34.969580166 +0000 UTC m=+768.365672257" watchObservedRunningTime="2026-09-15 10:30:34.970613912 +0000 UTC m=+768.366706001"
Sep 15 10:30:35.508232 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:35.508195    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn"
Sep 15 10:30:35.513989 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:35.513955    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn"
Sep 15 10:30:35.957238 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:35.957197    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn"
Sep 15 10:30:35.958471 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:35.958440    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn"
Sep 15 10:30:37.968884 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:37.968850    2579 generic.go:356] "Generic (PLEG): container finished" podID="8f82258b-ec03-4785-83f7-13de6b4178a2" containerID="c5b826667c05b906c078b2625e95c23703cd80d1381a49d79742765243a8ee44" exitCode=0
Sep 15 10:30:37.969388 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:37.968921    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq" event={"ID":"8f82258b-ec03-4785-83f7-13de6b4178a2","Type":"ContainerDied","Data":"c5b826667c05b906c078b2625e95c23703cd80d1381a49d79742765243a8ee44"}
Sep 15 10:30:37.969388 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:37.969350    2579 scope.go:117] "RemoveContainer" containerID="c5b826667c05b906c078b2625e95c23703cd80d1381a49d79742765243a8ee44"
Sep 15 10:30:37.970535 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:37.970505    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:30:37.970635 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:37.970572    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:30:37.970635 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:37.970607    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:30:37.970743 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:37.970707    2579 generic.go:356] "Generic (PLEG): container finished" podID="d0d8bd17-2aa5-4895-bdab-7dd375af9a26" containerID="98f9bd1ed7dacb9a0295b2291f727018285b887bdddfc09f50770244ab4fac17" exitCode=0
Sep 15 10:30:37.970792 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:37.970762    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm" event={"ID":"d0d8bd17-2aa5-4895-bdab-7dd375af9a26","Type":"ContainerDied","Data":"98f9bd1ed7dacb9a0295b2291f727018285b887bdddfc09f50770244ab4fac17"}
Sep 15 10:30:37.971270 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:37.971254    2579 scope.go:117] "RemoveContainer" containerID="98f9bd1ed7dacb9a0295b2291f727018285b887bdddfc09f50770244ab4fac17"
Sep 15 10:30:37.972312 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:37.972283    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:30:37.972420 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:37.972350    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:30:37.972487 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:37.972425    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:30:38.984236 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:38.984192    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq" event={"ID":"8f82258b-ec03-4785-83f7-13de6b4178a2","Type":"ContainerStarted","Data":"3ac8be1b251899642188d2d398743c8ee5aa4b05701201373b8c31a4049531e3"}
Sep 15 10:30:38.986586 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:38.986562    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm" event={"ID":"d0d8bd17-2aa5-4895-bdab-7dd375af9a26","Type":"ContainerStarted","Data":"2c87f337c74043c1cee5d250a432299b05d12ca16d31a29eb7aa8aae25550f4c"}
Sep 15 10:30:39.210616 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:39.210521    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq"
Sep 15 10:30:39.210874 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:39.210839    2579 patch_prober.go:28] interesting pod/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Sep 15 10:30:39.211093 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:39.211066    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq" podUID="8f82258b-ec03-4785-83f7-13de6b4178a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Sep 15 10:30:39.280325 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:39.280251    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm"
Sep 15 10:30:39.280603 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:39.280584    2579 patch_prober.go:28] interesting pod/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Sep 15 10:30:39.280647 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:39.280627    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm" podUID="d0d8bd17-2aa5-4895-bdab-7dd375af9a26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Sep 15 10:30:40.210098 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:40.210052    2579 patch_prober.go:28] interesting pod/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Sep 15 10:30:40.210689 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:40.210641    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq" podUID="8f82258b-ec03-4785-83f7-13de6b4178a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Sep 15 10:30:40.280807 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:40.280338    2579 patch_prober.go:28] interesting pod/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Sep 15 10:30:40.280807 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:40.280401    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm" podUID="d0d8bd17-2aa5-4895-bdab-7dd375af9a26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Sep 15 10:30:41.211193 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:41.211153    2579 patch_prober.go:28] interesting pod/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Sep 15 10:30:41.211792 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:41.211759    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq" podUID="8f82258b-ec03-4785-83f7-13de6b4178a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Sep 15 10:30:41.280395 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:41.280347    2579 patch_prober.go:28] interesting pod/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Sep 15 10:30:41.280602 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:41.280418    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm" podUID="d0d8bd17-2aa5-4895-bdab-7dd375af9a26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Sep 15 10:30:42.210393 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:42.210353    2579 patch_prober.go:28] interesting pod/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Sep 15 10:30:42.210664 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:42.210637    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq" podUID="8f82258b-ec03-4785-83f7-13de6b4178a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Sep 15 10:30:42.280570 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:42.280515    2579 patch_prober.go:28] interesting pod/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Sep 15 10:30:42.281067 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:42.280817    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm" podUID="d0d8bd17-2aa5-4895-bdab-7dd375af9a26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Sep 15 10:30:43.211764 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:43.210566    2579 patch_prober.go:28] interesting pod/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Sep 15 10:30:43.211764 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:43.210635    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq" podUID="8f82258b-ec03-4785-83f7-13de6b4178a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Sep 15 10:30:43.280628 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:43.280590    2579 patch_prober.go:28] interesting pod/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Sep 15 10:30:43.281160 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:43.280651    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm" podUID="d0d8bd17-2aa5-4895-bdab-7dd375af9a26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Sep 15 10:30:43.946754 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:43.945896    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-b8e8c34b-6b4f85fbcc-whqvx"
Sep 15 10:30:44.210431 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:44.210333    2579 patch_prober.go:28] interesting pod/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Sep 15 10:30:44.210697 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:44.210665    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq" podUID="8f82258b-ec03-4785-83f7-13de6b4178a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Sep 15 10:30:44.366439 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:44.365895    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm"
Sep 15 10:30:44.366439 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:44.366257    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm"
Sep 15 10:30:44.367508 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:44.367485    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm"
Sep 15 10:30:45.214871 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:45.214839    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq"
Sep 15 10:30:45.215241 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:45.215218    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq"
Sep 15 10:30:45.215970 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:45.215946    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq"
Sep 15 10:30:48.095607 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:48.095573    2579 generic.go:356] "Generic (PLEG): container finished" podID="86adc1ce-70c4-4ed5-9593-0b5f3c886626" containerID="56db6b27ad150845feafca05bc7a706a9b964ee3f1f0a6fcc3054ed23a4b7fc0" exitCode=0
Sep 15 10:30:48.096063 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:48.095648    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r" event={"ID":"86adc1ce-70c4-4ed5-9593-0b5f3c886626","Type":"ContainerDied","Data":"56db6b27ad150845feafca05bc7a706a9b964ee3f1f0a6fcc3054ed23a4b7fc0"}
Sep 15 10:30:48.096154 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:48.096136    2579 scope.go:117] "RemoveContainer" containerID="56db6b27ad150845feafca05bc7a706a9b964ee3f1f0a6fcc3054ed23a4b7fc0"
Sep 15 10:30:48.097552 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:48.097516    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:30:48.097655 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:48.097601    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:30:48.097655 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:48.097642    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:30:49.106134 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:49.106096    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r" event={"ID":"86adc1ce-70c4-4ed5-9593-0b5f3c886626","Type":"ContainerStarted","Data":"959a54b0e99a2aba62410f0fb0ab414789d218bc510ca4b08450d9e8f283c495"}
Sep 15 10:30:49.675839 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:49.675798    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r"
Sep 15 10:30:49.676015 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:49.675853    2579 patch_prober.go:28] interesting pod/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 15 10:30:49.676015 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:49.675893    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r" podUID="86adc1ce-70c4-4ed5-9593-0b5f3c886626" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 15 10:30:50.676544 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:50.676502    2579 patch_prober.go:28] interesting pod/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 15 10:30:50.677023 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:50.676561    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r" podUID="86adc1ce-70c4-4ed5-9593-0b5f3c886626" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 15 10:30:51.676733 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:51.676677    2579 patch_prober.go:28] interesting pod/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 15 10:30:51.677130 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:51.676795    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r" podUID="86adc1ce-70c4-4ed5-9593-0b5f3c886626" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 15 10:30:51.884452 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:51.884409    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b8e8c34b-lf5ts"]
Sep 15 10:30:51.889381 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:51.889358    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b8e8c34b-lf5ts"
Sep 15 10:30:51.892098 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:51.892065    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5jrzm\""
Sep 15 10:30:51.894592 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:51.894563    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b8e8c34b-lf5ts"]
Sep 15 10:30:52.052514 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:52.052472    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ddea4fa8-1786-47a0-89d7-9bf47c48c4ce-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b8e8c34b-lf5ts\" (UID: \"ddea4fa8-1786-47a0-89d7-9bf47c48c4ce\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b8e8c34b-lf5ts"
Sep 15 10:30:52.154708 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:52.154661    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ddea4fa8-1786-47a0-89d7-9bf47c48c4ce-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b8e8c34b-lf5ts\" (UID: \"ddea4fa8-1786-47a0-89d7-9bf47c48c4ce\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b8e8c34b-lf5ts"
Sep 15 10:30:52.155568 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:52.155542    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ddea4fa8-1786-47a0-89d7-9bf47c48c4ce-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b8e8c34b-lf5ts\" (UID: \"ddea4fa8-1786-47a0-89d7-9bf47c48c4ce\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b8e8c34b-lf5ts"
Sep 15 10:30:52.213750 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:52.212880    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b8e8c34b-lf5ts"
Sep 15 10:30:52.555048 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:52.555017    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b8e8c34b-lf5ts"]
Sep 15 10:30:52.558471 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:30:52.558442    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddea4fa8_1786_47a0_89d7_9bf47c48c4ce.slice/crio-f41bbac1f8c046e68355f4092d95488289fc3bac730075bd4d7377b24df16a1b WatchSource:0}: Error finding container f41bbac1f8c046e68355f4092d95488289fc3bac730075bd4d7377b24df16a1b: Status 404 returned error can't find the container with id f41bbac1f8c046e68355f4092d95488289fc3bac730075bd4d7377b24df16a1b
Sep 15 10:30:52.676406 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:52.676369    2579 patch_prober.go:28] interesting pod/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 15 10:30:52.676570 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:52.676427    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r" podUID="86adc1ce-70c4-4ed5-9593-0b5f3c886626" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 15 10:30:53.161865 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:53.161781    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b8e8c34b-lf5ts" event={"ID":"ddea4fa8-1786-47a0-89d7-9bf47c48c4ce","Type":"ContainerStarted","Data":"638475fc35807a47ca4eef198f5f28d20d3bca917583c047b8224f180652d825"}
Sep 15 10:30:53.162301 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:53.162259    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b8e8c34b-lf5ts" event={"ID":"ddea4fa8-1786-47a0-89d7-9bf47c48c4ce","Type":"ContainerStarted","Data":"f41bbac1f8c046e68355f4092d95488289fc3bac730075bd4d7377b24df16a1b"}
Sep 15 10:30:53.171196 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:53.171146    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b8e8c34b-lf5ts" podStartSLOduration=2.171131799 podStartE2EDuration="2.171131799s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:30:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:30:53.168693554 +0000 UTC m=+786.564785641" watchObservedRunningTime="2026-09-15 10:30:53.171131799 +0000 UTC m=+786.567223885"
Sep 15 10:30:53.676518 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:53.676475    2579 patch_prober.go:28] interesting pod/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 15 10:30:53.676747 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:53.676559    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r" podUID="86adc1ce-70c4-4ed5-9593-0b5f3c886626" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 15 10:30:54.162336 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:54.162302    2579 generic.go:356] "Generic (PLEG): container finished" podID="ddea4fa8-1786-47a0-89d7-9bf47c48c4ce" containerID="638475fc35807a47ca4eef198f5f28d20d3bca917583c047b8224f180652d825" exitCode=0
Sep 15 10:30:54.162764 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:54.162358    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b8e8c34b-lf5ts" event={"ID":"ddea4fa8-1786-47a0-89d7-9bf47c48c4ce","Type":"ContainerDied","Data":"638475fc35807a47ca4eef198f5f28d20d3bca917583c047b8224f180652d825"}
Sep 15 10:30:54.676597 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:54.676558    2579 patch_prober.go:28] interesting pod/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 15 10:30:54.676803 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:54.676611    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r" podUID="86adc1ce-70c4-4ed5-9593-0b5f3c886626" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 15 10:30:55.334228 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:55.334202    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b8e8c34b-lf5ts"
Sep 15 10:30:55.391951 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:55.391872    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ddea4fa8-1786-47a0-89d7-9bf47c48c4ce-maas-api-service-ca\") pod \"ddea4fa8-1786-47a0-89d7-9bf47c48c4ce\" (UID: \"ddea4fa8-1786-47a0-89d7-9bf47c48c4ce\") "
Sep 15 10:30:55.392211 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:55.392188    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddea4fa8-1786-47a0-89d7-9bf47c48c4ce-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ddea4fa8-1786-47a0-89d7-9bf47c48c4ce" (UID: "ddea4fa8-1786-47a0-89d7-9bf47c48c4ce"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:30:55.492615 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:55.492579    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ddea4fa8-1786-47a0-89d7-9bf47c48c4ce-maas-api-service-ca\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:30:55.680544 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:55.680463    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r"
Sep 15 10:30:55.680784 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:55.680761    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r"
Sep 15 10:30:55.681528 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:55.681511    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r"
Sep 15 10:30:56.176788 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:56.176713    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b8e8c34b-lf5ts" event={"ID":"ddea4fa8-1786-47a0-89d7-9bf47c48c4ce","Type":"ContainerDied","Data":"f41bbac1f8c046e68355f4092d95488289fc3bac730075bd4d7377b24df16a1b"}
Sep 15 10:30:56.176995 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:56.176807    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f41bbac1f8c046e68355f4092d95488289fc3bac730075bd4d7377b24df16a1b"
Sep 15 10:30:56.176995 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:56.176759    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b8e8c34b-lf5ts"
Sep 15 10:30:58.847564 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:58.847530    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-b8e8c34b-6b4f85fbcc-whqvx"]
Sep 15 10:30:58.848093 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:58.847747    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-b8e8c34b-6b4f85fbcc-whqvx" podUID="54231eed-bd4c-4cc9-8197-8bef8f8d5d28" containerName="payload-processing" containerID="cri-o://6b1e1b05bd9eef41b786fd42e54d6939f08ec2a1e287b71da0e9c6db5c616d30" gracePeriod=30
Sep 15 10:30:59.002284 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:59.002171    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b8e8c34b-lf5ts"]
Sep 15 10:30:59.005046 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:59.005016    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b8e8c34b-lf5ts"]
Sep 15 10:30:59.140170 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:59.128089    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r"]
Sep 15 10:30:59.140170 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:59.128301    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r" podUID="86adc1ce-70c4-4ed5-9593-0b5f3c886626" containerName="istio-proxy" containerID="cri-o://959a54b0e99a2aba62410f0fb0ab414789d218bc510ca4b08450d9e8f283c495" gracePeriod=30
Sep 15 10:30:59.156617 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:59.156556    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddea4fa8-1786-47a0-89d7-9bf47c48c4ce" path="/var/lib/kubelet/pods/ddea4fa8-1786-47a0-89d7-9bf47c48c4ce/volumes"
Sep 15 10:30:59.160022 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:59.159996    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-b8e8c34b-6b4f85fbcc-whqvx"
Sep 15 10:30:59.196127 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:59.196095    2579 generic.go:356] "Generic (PLEG): container finished" podID="b2d1b95b-f48e-4672-9be4-311309e7476c" containerID="00f5c41361e36b521ecb61a47d952317a925ff00484cddccaf1523cf2a4820a9" exitCode=0
Sep 15 10:30:59.196127 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:59.196175    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn" event={"ID":"b2d1b95b-f48e-4672-9be4-311309e7476c","Type":"ContainerDied","Data":"00f5c41361e36b521ecb61a47d952317a925ff00484cddccaf1523cf2a4820a9"}
Sep 15 10:30:59.200744 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:59.196889    2579 scope.go:117] "RemoveContainer" containerID="00f5c41361e36b521ecb61a47d952317a925ff00484cddccaf1523cf2a4820a9"
Sep 15 10:30:59.209048 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:59.208986    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:30:59.209193 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:59.209100    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:30:59.209193 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:59.209144    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:30:59.210927 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:59.210900    2579 generic.go:356] "Generic (PLEG): container finished" podID="54231eed-bd4c-4cc9-8197-8bef8f8d5d28" containerID="6b1e1b05bd9eef41b786fd42e54d6939f08ec2a1e287b71da0e9c6db5c616d30" exitCode=0
Sep 15 10:30:59.211519 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:59.210957    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-b8e8c34b-6b4f85fbcc-whqvx"
Sep 15 10:30:59.211519 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:59.210976    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-b8e8c34b-6b4f85fbcc-whqvx" event={"ID":"54231eed-bd4c-4cc9-8197-8bef8f8d5d28","Type":"ContainerDied","Data":"6b1e1b05bd9eef41b786fd42e54d6939f08ec2a1e287b71da0e9c6db5c616d30"}
Sep 15 10:30:59.211519 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:59.211307    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-b8e8c34b-6b4f85fbcc-whqvx" event={"ID":"54231eed-bd4c-4cc9-8197-8bef8f8d5d28","Type":"ContainerDied","Data":"6384c6da2e78ca227e19c6715e52b306fbefb5c392fc547153ec254c0bb95c64"}
Sep 15 10:30:59.211519 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:59.211360    2579 scope.go:117] "RemoveContainer" containerID="6b1e1b05bd9eef41b786fd42e54d6939f08ec2a1e287b71da0e9c6db5c616d30"
Sep 15 10:30:59.226258 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:59.226236    2579 scope.go:117] "RemoveContainer" containerID="6b1e1b05bd9eef41b786fd42e54d6939f08ec2a1e287b71da0e9c6db5c616d30"
Sep 15 10:30:59.226607 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:30:59.226583    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b1e1b05bd9eef41b786fd42e54d6939f08ec2a1e287b71da0e9c6db5c616d30\": container with ID starting with 6b1e1b05bd9eef41b786fd42e54d6939f08ec2a1e287b71da0e9c6db5c616d30 not found: ID does not exist" containerID="6b1e1b05bd9eef41b786fd42e54d6939f08ec2a1e287b71da0e9c6db5c616d30"
Sep 15 10:30:59.226685 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:59.226616    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b1e1b05bd9eef41b786fd42e54d6939f08ec2a1e287b71da0e9c6db5c616d30"} err="failed to get container status \"6b1e1b05bd9eef41b786fd42e54d6939f08ec2a1e287b71da0e9c6db5c616d30\": rpc error: code = NotFound desc = could not find container \"6b1e1b05bd9eef41b786fd42e54d6939f08ec2a1e287b71da0e9c6db5c616d30\": container with ID starting with 6b1e1b05bd9eef41b786fd42e54d6939f08ec2a1e287b71da0e9c6db5c616d30 not found: ID does not exist"
Sep 15 10:30:59.229027 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:59.228994    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54231eed-bd4c-4cc9-8197-8bef8f8d5d28-plugins-config-volume\") pod \"54231eed-bd4c-4cc9-8197-8bef8f8d5d28\" (UID: \"54231eed-bd4c-4cc9-8197-8bef8f8d5d28\") "
Sep 15 10:30:59.229157 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:59.229117    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fm8xz\" (UniqueName: \"kubernetes.io/projected/54231eed-bd4c-4cc9-8197-8bef8f8d5d28-kube-api-access-fm8xz\") pod \"54231eed-bd4c-4cc9-8197-8bef8f8d5d28\" (UID: \"54231eed-bd4c-4cc9-8197-8bef8f8d5d28\") "
Sep 15 10:30:59.230002 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:59.229973    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54231eed-bd4c-4cc9-8197-8bef8f8d5d28-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "54231eed-bd4c-4cc9-8197-8bef8f8d5d28" (UID: "54231eed-bd4c-4cc9-8197-8bef8f8d5d28"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:30:59.233222 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:59.233197    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54231eed-bd4c-4cc9-8197-8bef8f8d5d28-kube-api-access-fm8xz" (OuterVolumeSpecName: "kube-api-access-fm8xz") pod "54231eed-bd4c-4cc9-8197-8bef8f8d5d28" (UID: "54231eed-bd4c-4cc9-8197-8bef8f8d5d28"). InnerVolumeSpecName "kube-api-access-fm8xz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:30:59.330883 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:59.330849    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54231eed-bd4c-4cc9-8197-8bef8f8d5d28-plugins-config-volume\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:30:59.330883 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:59.330879    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fm8xz\" (UniqueName: \"kubernetes.io/projected/54231eed-bd4c-4cc9-8197-8bef8f8d5d28-kube-api-access-fm8xz\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:30:59.541622 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:59.541590    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-b8e8c34b-6b4f85fbcc-whqvx"]
Sep 15 10:30:59.547127 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:30:59.547095    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-b8e8c34b-6b4f85fbcc-whqvx"]
Sep 15 10:31:00.052188 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:00.052155    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2"]
Sep 15 10:31:00.052837 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:00.052815    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54231eed-bd4c-4cc9-8197-8bef8f8d5d28" containerName="payload-processing"
Sep 15 10:31:00.052981 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:00.052921    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="54231eed-bd4c-4cc9-8197-8bef8f8d5d28" containerName="payload-processing"
Sep 15 10:31:00.053053 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:00.052989    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddea4fa8-1786-47a0-89d7-9bf47c48c4ce" containerName="revoke-keys"
Sep 15 10:31:00.053053 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:00.053001    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddea4fa8-1786-47a0-89d7-9bf47c48c4ce" containerName="revoke-keys"
Sep 15 10:31:00.053174 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:00.053159    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddea4fa8-1786-47a0-89d7-9bf47c48c4ce" containerName="revoke-keys"
Sep 15 10:31:00.053225 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:00.053183    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="54231eed-bd4c-4cc9-8197-8bef8f8d5d28" containerName="payload-processing"
Sep 15 10:31:00.056404 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:00.056385    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2"
Sep 15 10:31:00.060702 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:00.060682    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-b797d492-gw-openshift-default-dockercfg-ln4nm\""
Sep 15 10:31:00.077181 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:00.077148    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2"]
Sep 15 10:31:00.139752 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:00.138965    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2gjx\" (UniqueName: \"kubernetes.io/projected/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6-kube-api-access-n2gjx\") pod \"e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2\" (UID: \"d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6\") " pod="openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2"
Sep 15 10:31:00.139752 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:00.139022    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6-istio-token\") pod \"e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2\" (UID: \"d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6\") " pod="openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2"
Sep 15 10:31:00.139752 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:00.139059    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6-credential-socket\") pod \"e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2\" (UID: \"d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6\") " pod="openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2"
Sep 15 10:31:00.139752 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:00.139106    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6-workload-socket\") pod \"e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2\" (UID: \"d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6\") " pod="openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2"
Sep 15 10:31:00.139752 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:00.139145    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6-workload-certs\") pod \"e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2\" (UID: \"d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6\") " pod="openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2"
Sep 15 10:31:00.139752 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:00.139175    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6-istio-podinfo\") pod \"e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2\" (UID: \"d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6\") " pod="openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2"
Sep 15 10:31:00.139752 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:00.139234    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6-istio-data\") pod \"e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2\" (UID: \"d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6\") " pod="openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2"
Sep 15 10:31:00.139752 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:00.139257    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6-istio-envoy\") pod \"e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2\" (UID: \"d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6\") " pod="openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2"
Sep 15 10:31:00.139752 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:00.139308    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6-istiod-ca-cert\") pod \"e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2\" (UID: \"d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6\") " pod="openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2"
Sep 15 10:31:00.224679 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:00.224635    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn" event={"ID":"b2d1b95b-f48e-4672-9be4-311309e7476c","Type":"ContainerStarted","Data":"82bc51a02f78d70fbf094d25204d83cfa14396c945ffd4a64cf82f2a4e123552"}
Sep 15 10:31:00.240095 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:00.240057    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6-workload-certs\") pod \"e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2\" (UID: \"d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6\") " pod="openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2"
Sep 15 10:31:00.240346 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:00.240330    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6-istio-podinfo\") pod \"e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2\" (UID: \"d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6\") " pod="openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2"
Sep 15 10:31:00.240457 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:00.240445    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6-istio-data\") pod \"e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2\" (UID: \"d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6\") " pod="openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2"
Sep 15 10:31:00.240555 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:00.240543    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6-istio-envoy\") pod \"e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2\" (UID: \"d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6\") " pod="openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2"
Sep 15 10:31:00.240674 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:00.240661    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6-istiod-ca-cert\") pod \"e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2\" (UID: \"d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6\") " pod="openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2"
Sep 15 10:31:00.240842 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:00.240452    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6-workload-certs\") pod \"e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2\" (UID: \"d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6\") " pod="openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2"
Sep 15 10:31:00.240911 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:00.240684    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6-istio-data\") pod \"e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2\" (UID: \"d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6\") " pod="openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2"
Sep 15 10:31:00.241412 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:00.241316    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6-istiod-ca-cert\") pod \"e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2\" (UID: \"d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6\") " pod="openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2"
Sep 15 10:31:00.241535 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:00.241518    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2gjx\" (UniqueName: \"kubernetes.io/projected/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6-kube-api-access-n2gjx\") pod \"e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2\" (UID: \"d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6\") " pod="openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2"
Sep 15 10:31:00.241658 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:00.241644    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6-istio-token\") pod \"e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2\" (UID: \"d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6\") " pod="openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2"
Sep 15 10:31:00.241794 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:00.241779    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6-credential-socket\") pod \"e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2\" (UID: \"d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6\") " pod="openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2"
Sep 15 10:31:00.241922 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:00.241908    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6-workload-socket\") pod \"e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2\" (UID: \"d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6\") " pod="openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2"
Sep 15 10:31:00.242200 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:00.242161    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6-credential-socket\") pod \"e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2\" (UID: \"d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6\") " pod="openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2"
Sep 15 10:31:00.242265 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:00.242180    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6-workload-socket\") pod \"e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2\" (UID: \"d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6\") " pod="openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2"
Sep 15 10:31:00.243080 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:00.243063    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6-istio-envoy\") pod \"e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2\" (UID: \"d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6\") " pod="openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2"
Sep 15 10:31:00.243361 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:00.243341    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6-istio-podinfo\") pod \"e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2\" (UID: \"d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6\") " pod="openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2"
Sep 15 10:31:00.255040 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:00.255012    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2gjx\" (UniqueName: \"kubernetes.io/projected/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6-kube-api-access-n2gjx\") pod \"e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2\" (UID: \"d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6\") " pod="openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2"
Sep 15 10:31:00.255210 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:00.255106    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6-istio-token\") pod \"e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2\" (UID: \"d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6\") " pod="openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2"
Sep 15 10:31:00.367718 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:00.367631    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2"
Sep 15 10:31:00.519758 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:00.516924    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn"
Sep 15 10:31:00.519758 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:00.517052    2579 patch_prober.go:28] interesting pod/e2e-inf-b-234840-openshift-default-689549674-dxdtn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 15 10:31:00.519758 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:00.517106    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn" podUID="b2d1b95b-f48e-4672-9be4-311309e7476c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 15 10:31:00.706842 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:00.706750    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2"]
Sep 15 10:31:00.730506 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:00.730453    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:31:00.730641 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:00.730555    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:31:00.730641 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:00.730599    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:31:01.150609 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:01.150571    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54231eed-bd4c-4cc9-8197-8bef8f8d5d28" path="/var/lib/kubelet/pods/54231eed-bd4c-4cc9-8197-8bef8f8d5d28/volumes"
Sep 15 10:31:01.236179 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:01.236128    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2" event={"ID":"d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6","Type":"ContainerStarted","Data":"e9790e4abf425de6c52a2284da588d749f6d4b4f764951a0ef17762f9d5eee9c"}
Sep 15 10:31:01.236336 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:01.236199    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2" event={"ID":"d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6","Type":"ContainerStarted","Data":"10103160f65aabd0670630aceb140d6d52c348d6ec28114c9e85044ba38cbc9d"}
Sep 15 10:31:01.259243 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:01.259193    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2" podStartSLOduration=1.259173837 podStartE2EDuration="1.259173837s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:31:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:31:01.25634591 +0000 UTC m=+794.652437997" watchObservedRunningTime="2026-09-15 10:31:01.259173837 +0000 UTC m=+794.655265927"
Sep 15 10:31:01.368089 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:01.368051    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2"
Sep 15 10:31:01.381208 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:01.381176    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2"
Sep 15 10:31:01.509070 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:01.508974    2579 patch_prober.go:28] interesting pod/e2e-inf-b-234840-openshift-default-689549674-dxdtn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 15 10:31:01.509070 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:01.509055    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn" podUID="b2d1b95b-f48e-4672-9be4-311309e7476c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 15 10:31:02.243275 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:02.243226    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2"
Sep 15 10:31:02.244310 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:02.244288    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2"
Sep 15 10:31:02.509230 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:02.509140    2579 patch_prober.go:28] interesting pod/e2e-inf-b-234840-openshift-default-689549674-dxdtn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 15 10:31:02.509599 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:02.509567    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn" podUID="b2d1b95b-f48e-4672-9be4-311309e7476c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 15 10:31:03.508831 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:03.508793    2579 patch_prober.go:28] interesting pod/e2e-inf-b-234840-openshift-default-689549674-dxdtn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 15 10:31:03.510368 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:03.510334    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn" podUID="b2d1b95b-f48e-4672-9be4-311309e7476c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 15 10:31:04.522752 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:04.519121    2579 patch_prober.go:28] interesting pod/e2e-inf-b-234840-openshift-default-689549674-dxdtn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 15 10:31:04.522752 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:04.519186    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn" podUID="b2d1b95b-f48e-4672-9be4-311309e7476c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 15 10:31:04.536786 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:04.536760    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r"
Sep 15 10:31:04.591683 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:04.591595    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86adc1ce-70c4-4ed5-9593-0b5f3c886626-istiod-ca-cert\") pod \"86adc1ce-70c4-4ed5-9593-0b5f3c886626\" (UID: \"86adc1ce-70c4-4ed5-9593-0b5f3c886626\") "
Sep 15 10:31:04.591683 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:04.591643    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86adc1ce-70c4-4ed5-9593-0b5f3c886626-istio-podinfo\") pod \"86adc1ce-70c4-4ed5-9593-0b5f3c886626\" (UID: \"86adc1ce-70c4-4ed5-9593-0b5f3c886626\") "
Sep 15 10:31:04.591683 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:04.591677    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86adc1ce-70c4-4ed5-9593-0b5f3c886626-istio-envoy\") pod \"86adc1ce-70c4-4ed5-9593-0b5f3c886626\" (UID: \"86adc1ce-70c4-4ed5-9593-0b5f3c886626\") "
Sep 15 10:31:04.591984 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:04.591754    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hkpzm\" (UniqueName: \"kubernetes.io/projected/86adc1ce-70c4-4ed5-9593-0b5f3c886626-kube-api-access-hkpzm\") pod \"86adc1ce-70c4-4ed5-9593-0b5f3c886626\" (UID: \"86adc1ce-70c4-4ed5-9593-0b5f3c886626\") "
Sep 15 10:31:04.591984 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:04.591832    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86adc1ce-70c4-4ed5-9593-0b5f3c886626-istio-data\") pod \"86adc1ce-70c4-4ed5-9593-0b5f3c886626\" (UID: \"86adc1ce-70c4-4ed5-9593-0b5f3c886626\") "
Sep 15 10:31:04.591984 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:04.591861    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86adc1ce-70c4-4ed5-9593-0b5f3c886626-workload-socket\") pod \"86adc1ce-70c4-4ed5-9593-0b5f3c886626\" (UID: \"86adc1ce-70c4-4ed5-9593-0b5f3c886626\") "
Sep 15 10:31:04.591984 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:04.591893    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86adc1ce-70c4-4ed5-9593-0b5f3c886626-workload-certs\") pod \"86adc1ce-70c4-4ed5-9593-0b5f3c886626\" (UID: \"86adc1ce-70c4-4ed5-9593-0b5f3c886626\") "
Sep 15 10:31:04.591984 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:04.591917    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86adc1ce-70c4-4ed5-9593-0b5f3c886626-istio-token\") pod \"86adc1ce-70c4-4ed5-9593-0b5f3c886626\" (UID: \"86adc1ce-70c4-4ed5-9593-0b5f3c886626\") "
Sep 15 10:31:04.591984 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:04.591966    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86adc1ce-70c4-4ed5-9593-0b5f3c886626-credential-socket\") pod \"86adc1ce-70c4-4ed5-9593-0b5f3c886626\" (UID: \"86adc1ce-70c4-4ed5-9593-0b5f3c886626\") "
Sep 15 10:31:04.592349 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:04.592075    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86adc1ce-70c4-4ed5-9593-0b5f3c886626-istio-data" (OuterVolumeSpecName: "istio-data") pod "86adc1ce-70c4-4ed5-9593-0b5f3c886626" (UID: "86adc1ce-70c4-4ed5-9593-0b5f3c886626"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:31:04.592349 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:04.592025    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86adc1ce-70c4-4ed5-9593-0b5f3c886626-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "86adc1ce-70c4-4ed5-9593-0b5f3c886626" (UID: "86adc1ce-70c4-4ed5-9593-0b5f3c886626"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:31:04.592349 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:04.592255    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86adc1ce-70c4-4ed5-9593-0b5f3c886626-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "86adc1ce-70c4-4ed5-9593-0b5f3c886626" (UID: "86adc1ce-70c4-4ed5-9593-0b5f3c886626"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:31:04.592349 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:04.592302    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86adc1ce-70c4-4ed5-9593-0b5f3c886626-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "86adc1ce-70c4-4ed5-9593-0b5f3c886626" (UID: "86adc1ce-70c4-4ed5-9593-0b5f3c886626"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:31:04.592562 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:04.592377    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86adc1ce-70c4-4ed5-9593-0b5f3c886626-istiod-ca-cert\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:31:04.592562 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:04.592394    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86adc1ce-70c4-4ed5-9593-0b5f3c886626-istio-data\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:31:04.592562 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:04.592407    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86adc1ce-70c4-4ed5-9593-0b5f3c886626-workload-certs\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:31:04.592562 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:04.592418    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86adc1ce-70c4-4ed5-9593-0b5f3c886626-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "86adc1ce-70c4-4ed5-9593-0b5f3c886626" (UID: "86adc1ce-70c4-4ed5-9593-0b5f3c886626"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:31:04.592562 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:04.592421    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86adc1ce-70c4-4ed5-9593-0b5f3c886626-credential-socket\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:31:04.594174 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:04.594145    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86adc1ce-70c4-4ed5-9593-0b5f3c886626-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "86adc1ce-70c4-4ed5-9593-0b5f3c886626" (UID: "86adc1ce-70c4-4ed5-9593-0b5f3c886626"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:31:04.594286 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:04.594171    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/86adc1ce-70c4-4ed5-9593-0b5f3c886626-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "86adc1ce-70c4-4ed5-9593-0b5f3c886626" (UID: "86adc1ce-70c4-4ed5-9593-0b5f3c886626"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 10:31:04.594286 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:04.594262    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86adc1ce-70c4-4ed5-9593-0b5f3c886626-istio-token" (OuterVolumeSpecName: "istio-token") pod "86adc1ce-70c4-4ed5-9593-0b5f3c886626" (UID: "86adc1ce-70c4-4ed5-9593-0b5f3c886626"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:31:04.594363 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:04.594331    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86adc1ce-70c4-4ed5-9593-0b5f3c886626-kube-api-access-hkpzm" (OuterVolumeSpecName: "kube-api-access-hkpzm") pod "86adc1ce-70c4-4ed5-9593-0b5f3c886626" (UID: "86adc1ce-70c4-4ed5-9593-0b5f3c886626"). InnerVolumeSpecName "kube-api-access-hkpzm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:31:04.693145 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:04.693048    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86adc1ce-70c4-4ed5-9593-0b5f3c886626-workload-socket\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:31:04.693145 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:04.693084    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86adc1ce-70c4-4ed5-9593-0b5f3c886626-istio-token\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:31:04.693145 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:04.693099    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86adc1ce-70c4-4ed5-9593-0b5f3c886626-istio-podinfo\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:31:04.693145 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:04.693110    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86adc1ce-70c4-4ed5-9593-0b5f3c886626-istio-envoy\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:31:04.693145 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:04.693122    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkpzm\" (UniqueName: \"kubernetes.io/projected/86adc1ce-70c4-4ed5-9593-0b5f3c886626-kube-api-access-hkpzm\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:31:05.261367 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:05.261330    2579 generic.go:356] "Generic (PLEG): container finished" podID="86adc1ce-70c4-4ed5-9593-0b5f3c886626" containerID="959a54b0e99a2aba62410f0fb0ab414789d218bc510ca4b08450d9e8f283c495" exitCode=0
Sep 15 10:31:05.261535 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:05.261380    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r"
Sep 15 10:31:05.261535 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:05.261411    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r" event={"ID":"86adc1ce-70c4-4ed5-9593-0b5f3c886626","Type":"ContainerDied","Data":"959a54b0e99a2aba62410f0fb0ab414789d218bc510ca4b08450d9e8f283c495"}
Sep 15 10:31:05.261535 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:05.261469    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r" event={"ID":"86adc1ce-70c4-4ed5-9593-0b5f3c886626","Type":"ContainerDied","Data":"1e859ca52153d15b161819914aab5b6303149b87b21b62f41e8d7a7de443136b"}
Sep 15 10:31:05.261535 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:05.261500    2579 scope.go:117] "RemoveContainer" containerID="959a54b0e99a2aba62410f0fb0ab414789d218bc510ca4b08450d9e8f283c495"
Sep 15 10:31:05.270996 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:05.270976    2579 scope.go:117] "RemoveContainer" containerID="56db6b27ad150845feafca05bc7a706a9b964ee3f1f0a6fcc3054ed23a4b7fc0"
Sep 15 10:31:05.278970 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:05.278942    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r"]
Sep 15 10:31:05.280003 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:05.279985    2579 scope.go:117] "RemoveContainer" containerID="959a54b0e99a2aba62410f0fb0ab414789d218bc510ca4b08450d9e8f283c495"
Sep 15 10:31:05.280327 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:31:05.280307    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"959a54b0e99a2aba62410f0fb0ab414789d218bc510ca4b08450d9e8f283c495\": container with ID starting with 959a54b0e99a2aba62410f0fb0ab414789d218bc510ca4b08450d9e8f283c495 not found: ID does not exist" containerID="959a54b0e99a2aba62410f0fb0ab414789d218bc510ca4b08450d9e8f283c495"
Sep 15 10:31:05.280372 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:05.280336    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"959a54b0e99a2aba62410f0fb0ab414789d218bc510ca4b08450d9e8f283c495"} err="failed to get container status \"959a54b0e99a2aba62410f0fb0ab414789d218bc510ca4b08450d9e8f283c495\": rpc error: code = NotFound desc = could not find container \"959a54b0e99a2aba62410f0fb0ab414789d218bc510ca4b08450d9e8f283c495\": container with ID starting with 959a54b0e99a2aba62410f0fb0ab414789d218bc510ca4b08450d9e8f283c495 not found: ID does not exist"
Sep 15 10:31:05.280372 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:05.280354    2579 scope.go:117] "RemoveContainer" containerID="56db6b27ad150845feafca05bc7a706a9b964ee3f1f0a6fcc3054ed23a4b7fc0"
Sep 15 10:31:05.280603 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:31:05.280588    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56db6b27ad150845feafca05bc7a706a9b964ee3f1f0a6fcc3054ed23a4b7fc0\": container with ID starting with 56db6b27ad150845feafca05bc7a706a9b964ee3f1f0a6fcc3054ed23a4b7fc0 not found: ID does not exist" containerID="56db6b27ad150845feafca05bc7a706a9b964ee3f1f0a6fcc3054ed23a4b7fc0"
Sep 15 10:31:05.280643 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:05.280606    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56db6b27ad150845feafca05bc7a706a9b964ee3f1f0a6fcc3054ed23a4b7fc0"} err="failed to get container status \"56db6b27ad150845feafca05bc7a706a9b964ee3f1f0a6fcc3054ed23a4b7fc0\": rpc error: code = NotFound desc = could not find container \"56db6b27ad150845feafca05bc7a706a9b964ee3f1f0a6fcc3054ed23a4b7fc0\": container with ID starting with 56db6b27ad150845feafca05bc7a706a9b964ee3f1f0a6fcc3054ed23a4b7fc0 not found: ID does not exist"
Sep 15 10:31:05.284673 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:05.284650    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-b8e8c34b-openshift-default-6585d6d446-xsb8r"]
Sep 15 10:31:05.509268 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:05.509165    2579 patch_prober.go:28] interesting pod/e2e-inf-b-234840-openshift-default-689549674-dxdtn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 15 10:31:05.509268 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:05.509246    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn" podUID="b2d1b95b-f48e-4672-9be4-311309e7476c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 15 10:31:05.957875 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:05.957839    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn"
Sep 15 10:31:06.194517 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:06.194482    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-b797d492-577d5b4ccd-gmrvm"]
Sep 15 10:31:06.194999 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:06.194983    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86adc1ce-70c4-4ed5-9593-0b5f3c886626" containerName="istio-proxy"
Sep 15 10:31:06.195055 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:06.195000    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="86adc1ce-70c4-4ed5-9593-0b5f3c886626" containerName="istio-proxy"
Sep 15 10:31:06.195088 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:06.195082    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="86adc1ce-70c4-4ed5-9593-0b5f3c886626" containerName="istio-proxy"
Sep 15 10:31:06.195128 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:06.195093    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="86adc1ce-70c4-4ed5-9593-0b5f3c886626" containerName="istio-proxy"
Sep 15 10:31:06.200083 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:06.200056    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-b797d492-577d5b4ccd-gmrvm"
Sep 15 10:31:06.202875 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:06.202851    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-b797d492\""
Sep 15 10:31:06.202993 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:06.202976    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-b797d492-dockercfg-skgw7\""
Sep 15 10:31:06.208550 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:06.208518    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-b797d492-577d5b4ccd-gmrvm"]
Sep 15 10:31:06.318499 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:06.318460    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e330e9ca-bf68-4f00-b4b1-d4fc92ee210e-plugins-config-volume\") pod \"payload-processing-e2e-migrate-b797d492-577d5b4ccd-gmrvm\" (UID: \"e330e9ca-bf68-4f00-b4b1-d4fc92ee210e\") " pod="openshift-ingress/payload-processing-e2e-migrate-b797d492-577d5b4ccd-gmrvm"
Sep 15 10:31:06.318666 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:06.318529    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x594q\" (UniqueName: \"kubernetes.io/projected/e330e9ca-bf68-4f00-b4b1-d4fc92ee210e-kube-api-access-x594q\") pod \"payload-processing-e2e-migrate-b797d492-577d5b4ccd-gmrvm\" (UID: \"e330e9ca-bf68-4f00-b4b1-d4fc92ee210e\") " pod="openshift-ingress/payload-processing-e2e-migrate-b797d492-577d5b4ccd-gmrvm"
Sep 15 10:31:06.419607 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:06.419570    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e330e9ca-bf68-4f00-b4b1-d4fc92ee210e-plugins-config-volume\") pod \"payload-processing-e2e-migrate-b797d492-577d5b4ccd-gmrvm\" (UID: \"e330e9ca-bf68-4f00-b4b1-d4fc92ee210e\") " pod="openshift-ingress/payload-processing-e2e-migrate-b797d492-577d5b4ccd-gmrvm"
Sep 15 10:31:06.419788 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:06.419669    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x594q\" (UniqueName: \"kubernetes.io/projected/e330e9ca-bf68-4f00-b4b1-d4fc92ee210e-kube-api-access-x594q\") pod \"payload-processing-e2e-migrate-b797d492-577d5b4ccd-gmrvm\" (UID: \"e330e9ca-bf68-4f00-b4b1-d4fc92ee210e\") " pod="openshift-ingress/payload-processing-e2e-migrate-b797d492-577d5b4ccd-gmrvm"
Sep 15 10:31:06.420393 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:06.420370    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e330e9ca-bf68-4f00-b4b1-d4fc92ee210e-plugins-config-volume\") pod \"payload-processing-e2e-migrate-b797d492-577d5b4ccd-gmrvm\" (UID: \"e330e9ca-bf68-4f00-b4b1-d4fc92ee210e\") " pod="openshift-ingress/payload-processing-e2e-migrate-b797d492-577d5b4ccd-gmrvm"
Sep 15 10:31:06.427458 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:06.427431    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x594q\" (UniqueName: \"kubernetes.io/projected/e330e9ca-bf68-4f00-b4b1-d4fc92ee210e-kube-api-access-x594q\") pod \"payload-processing-e2e-migrate-b797d492-577d5b4ccd-gmrvm\" (UID: \"e330e9ca-bf68-4f00-b4b1-d4fc92ee210e\") " pod="openshift-ingress/payload-processing-e2e-migrate-b797d492-577d5b4ccd-gmrvm"
Sep 15 10:31:06.512104 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:06.512029    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-b797d492-577d5b4ccd-gmrvm"
Sep 15 10:31:06.512585 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:06.512565    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn"
Sep 15 10:31:06.513553 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:06.513534    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn"
Sep 15 10:31:06.788671 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:06.788646    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-b797d492-577d5b4ccd-gmrvm"]
Sep 15 10:31:06.790711 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:31:06.790686    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode330e9ca_bf68_4f00_b4b1_d4fc92ee210e.slice/crio-83a3775d64e8d4214ea8f1a63d9b67be19642d24183750abf00a328c3739c938 WatchSource:0}: Error finding container 83a3775d64e8d4214ea8f1a63d9b67be19642d24183750abf00a328c3739c938: Status 404 returned error can't find the container with id 83a3775d64e8d4214ea8f1a63d9b67be19642d24183750abf00a328c3739c938
Sep 15 10:31:07.151564 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:07.151483    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86adc1ce-70c4-4ed5-9593-0b5f3c886626" path="/var/lib/kubelet/pods/86adc1ce-70c4-4ed5-9593-0b5f3c886626/volumes"
Sep 15 10:31:07.284591 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:07.284551    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-b797d492-577d5b4ccd-gmrvm" event={"ID":"e330e9ca-bf68-4f00-b4b1-d4fc92ee210e","Type":"ContainerStarted","Data":"23512104cdd54ddbb4b9d31e1ca81944882ab25b783860958897269bebeaaa02"}
Sep 15 10:31:07.284821 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:07.284610    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-b797d492-577d5b4ccd-gmrvm" event={"ID":"e330e9ca-bf68-4f00-b4b1-d4fc92ee210e","Type":"ContainerStarted","Data":"83a3775d64e8d4214ea8f1a63d9b67be19642d24183750abf00a328c3739c938"}
Sep 15 10:31:07.303371 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:07.303307    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-b797d492-577d5b4ccd-gmrvm" podStartSLOduration=1.303286036 podStartE2EDuration="1.303286036s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:31:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:31:07.301993762 +0000 UTC m=+800.698085850" watchObservedRunningTime="2026-09-15 10:31:07.303286036 +0000 UTC m=+800.699378124"
Sep 15 10:31:08.290983 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:08.290955    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-b797d492-577d5b4ccd-gmrvm"
Sep 15 10:31:19.299976 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:19.299881    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-b797d492-577d5b4ccd-gmrvm"
Sep 15 10:31:23.382427 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:23.382391    2579 generic.go:356] "Generic (PLEG): container finished" podID="d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6" containerID="e9790e4abf425de6c52a2284da588d749f6d4b4f764951a0ef17762f9d5eee9c" exitCode=0
Sep 15 10:31:23.382875 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:23.382464    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2" event={"ID":"d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6","Type":"ContainerDied","Data":"e9790e4abf425de6c52a2284da588d749f6d4b4f764951a0ef17762f9d5eee9c"}
Sep 15 10:31:23.382959 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:23.382943    2579 scope.go:117] "RemoveContainer" containerID="e9790e4abf425de6c52a2284da588d749f6d4b4f764951a0ef17762f9d5eee9c"
Sep 15 10:31:23.384013 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:23.383985    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:31:23.384072 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:23.384053    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:31:23.384108 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:23.384084    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:31:24.390572 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:24.390537    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2" event={"ID":"d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6","Type":"ContainerStarted","Data":"9204afb1794c7c8b801ac42de7223492f7283af384faa49494342c82d5e18d2e"}
Sep 15 10:31:25.368375 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:25.368339    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2"
Sep 15 10:31:25.368573 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:25.368548    2579 patch_prober.go:28] interesting pod/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 15 10:31:25.368642 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:25.368608    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2" podUID="d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 15 10:31:26.368958 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:26.368920    2579 patch_prober.go:28] interesting pod/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 15 10:31:26.369421 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:26.368982    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2" podUID="d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 15 10:31:27.368232 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:27.368194    2579 patch_prober.go:28] interesting pod/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 15 10:31:27.368403 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:27.368249    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2" podUID="d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 15 10:31:28.369045 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:28.369003    2579 patch_prober.go:28] interesting pod/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 15 10:31:28.369440 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:28.369074    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2" podUID="d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 15 10:31:29.368181 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:29.368142    2579 patch_prober.go:28] interesting pod/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 15 10:31:29.368484 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:29.368451    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2" podUID="d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 15 10:31:30.368449 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:30.368417    2579 patch_prober.go:28] interesting pod/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 15 10:31:30.368941 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:30.368909    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2" podUID="d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 15 10:31:31.372051 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:31.372017    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2"
Sep 15 10:31:31.372529 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:31.372405    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2"
Sep 15 10:31:31.373147 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:31.373130    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2"
Sep 15 10:31:34.550831 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:34.550792    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-b797d492-577d5b4ccd-gmrvm"]
Sep 15 10:31:34.551337 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:34.551071    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-b797d492-577d5b4ccd-gmrvm" podUID="e330e9ca-bf68-4f00-b4b1-d4fc92ee210e" containerName="payload-processing" containerID="cri-o://23512104cdd54ddbb4b9d31e1ca81944882ab25b783860958897269bebeaaa02" gracePeriod=30
Sep 15 10:31:34.828208 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:34.828172    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2"]
Sep 15 10:31:34.828413 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:34.828391    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2" podUID="d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6" containerName="istio-proxy" containerID="cri-o://9204afb1794c7c8b801ac42de7223492f7283af384faa49494342c82d5e18d2e" gracePeriod=30
Sep 15 10:31:34.838820 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:34.838793    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-b797d492-577d5b4ccd-gmrvm"
Sep 15 10:31:34.924680 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:34.924644    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e330e9ca-bf68-4f00-b4b1-d4fc92ee210e-plugins-config-volume\") pod \"e330e9ca-bf68-4f00-b4b1-d4fc92ee210e\" (UID: \"e330e9ca-bf68-4f00-b4b1-d4fc92ee210e\") "
Sep 15 10:31:34.924873 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:34.924692    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x594q\" (UniqueName: \"kubernetes.io/projected/e330e9ca-bf68-4f00-b4b1-d4fc92ee210e-kube-api-access-x594q\") pod \"e330e9ca-bf68-4f00-b4b1-d4fc92ee210e\" (UID: \"e330e9ca-bf68-4f00-b4b1-d4fc92ee210e\") "
Sep 15 10:31:34.925067 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:34.925043    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e330e9ca-bf68-4f00-b4b1-d4fc92ee210e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e330e9ca-bf68-4f00-b4b1-d4fc92ee210e" (UID: "e330e9ca-bf68-4f00-b4b1-d4fc92ee210e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:31:34.929860 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:34.928629    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e330e9ca-bf68-4f00-b4b1-d4fc92ee210e-kube-api-access-x594q" (OuterVolumeSpecName: "kube-api-access-x594q") pod "e330e9ca-bf68-4f00-b4b1-d4fc92ee210e" (UID: "e330e9ca-bf68-4f00-b4b1-d4fc92ee210e"). InnerVolumeSpecName "kube-api-access-x594q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:31:35.025785 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:35.025706    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e330e9ca-bf68-4f00-b4b1-d4fc92ee210e-plugins-config-volume\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:31:35.025785 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:35.025780    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x594q\" (UniqueName: \"kubernetes.io/projected/e330e9ca-bf68-4f00-b4b1-d4fc92ee210e-kube-api-access-x594q\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:31:35.468959 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:35.468860    2579 generic.go:356] "Generic (PLEG): container finished" podID="e330e9ca-bf68-4f00-b4b1-d4fc92ee210e" containerID="23512104cdd54ddbb4b9d31e1ca81944882ab25b783860958897269bebeaaa02" exitCode=0
Sep 15 10:31:35.468959 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:35.468911    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-b797d492-577d5b4ccd-gmrvm"
Sep 15 10:31:35.468959 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:35.468942    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-b797d492-577d5b4ccd-gmrvm" event={"ID":"e330e9ca-bf68-4f00-b4b1-d4fc92ee210e","Type":"ContainerDied","Data":"23512104cdd54ddbb4b9d31e1ca81944882ab25b783860958897269bebeaaa02"}
Sep 15 10:31:35.469253 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:35.469005    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-b797d492-577d5b4ccd-gmrvm" event={"ID":"e330e9ca-bf68-4f00-b4b1-d4fc92ee210e","Type":"ContainerDied","Data":"83a3775d64e8d4214ea8f1a63d9b67be19642d24183750abf00a328c3739c938"}
Sep 15 10:31:35.469253 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:35.469030    2579 scope.go:117] "RemoveContainer" containerID="23512104cdd54ddbb4b9d31e1ca81944882ab25b783860958897269bebeaaa02"
Sep 15 10:31:35.478294 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:35.478270    2579 scope.go:117] "RemoveContainer" containerID="23512104cdd54ddbb4b9d31e1ca81944882ab25b783860958897269bebeaaa02"
Sep 15 10:31:35.478565 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:31:35.478546    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23512104cdd54ddbb4b9d31e1ca81944882ab25b783860958897269bebeaaa02\": container with ID starting with 23512104cdd54ddbb4b9d31e1ca81944882ab25b783860958897269bebeaaa02 not found: ID does not exist" containerID="23512104cdd54ddbb4b9d31e1ca81944882ab25b783860958897269bebeaaa02"
Sep 15 10:31:35.478650 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:35.478576    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23512104cdd54ddbb4b9d31e1ca81944882ab25b783860958897269bebeaaa02"} err="failed to get container status \"23512104cdd54ddbb4b9d31e1ca81944882ab25b783860958897269bebeaaa02\": rpc error: code = NotFound desc = could not find container \"23512104cdd54ddbb4b9d31e1ca81944882ab25b783860958897269bebeaaa02\": container with ID starting with 23512104cdd54ddbb4b9d31e1ca81944882ab25b783860958897269bebeaaa02 not found: ID does not exist"
Sep 15 10:31:35.488022 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:35.487987    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-b797d492-577d5b4ccd-gmrvm"]
Sep 15 10:31:35.490190 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:35.490167    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-b797d492-577d5b4ccd-gmrvm"]
Sep 15 10:31:35.538254 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:35.538199    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2"]
Sep 15 10:31:35.539586 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:35.538994    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e330e9ca-bf68-4f00-b4b1-d4fc92ee210e" containerName="payload-processing"
Sep 15 10:31:35.539586 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:35.539035    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e330e9ca-bf68-4f00-b4b1-d4fc92ee210e" containerName="payload-processing"
Sep 15 10:31:35.539586 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:35.539050    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86adc1ce-70c4-4ed5-9593-0b5f3c886626" containerName="istio-proxy"
Sep 15 10:31:35.539586 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:35.539088    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="86adc1ce-70c4-4ed5-9593-0b5f3c886626" containerName="istio-proxy"
Sep 15 10:31:35.539586 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:35.539233    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e330e9ca-bf68-4f00-b4b1-d4fc92ee210e" containerName="payload-processing"
Sep 15 10:31:35.544623 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:35.544602    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2"
Sep 15 10:31:35.547205 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:35.547182    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-68c3a296-openshift-default-dockercfg-98mdz\""
Sep 15 10:31:35.553504 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:35.553479    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2"]
Sep 15 10:31:35.633261 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:35.633220    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914-istio-envoy\") pod \"e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2\" (UID: \"aa851bef-4a2c-4fe5-9fe5-3350d9e9b914\") " pod="openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2"
Sep 15 10:31:35.633448 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:35.633294    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqg6l\" (UniqueName: \"kubernetes.io/projected/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914-kube-api-access-vqg6l\") pod \"e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2\" (UID: \"aa851bef-4a2c-4fe5-9fe5-3350d9e9b914\") " pod="openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2"
Sep 15 10:31:35.633448 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:35.633328    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914-workload-certs\") pod \"e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2\" (UID: \"aa851bef-4a2c-4fe5-9fe5-3350d9e9b914\") " pod="openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2"
Sep 15 10:31:35.633448 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:35.633362    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914-istio-podinfo\") pod \"e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2\" (UID: \"aa851bef-4a2c-4fe5-9fe5-3350d9e9b914\") " pod="openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2"
Sep 15 10:31:35.633448 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:35.633392    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914-istio-data\") pod \"e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2\" (UID: \"aa851bef-4a2c-4fe5-9fe5-3350d9e9b914\") " pod="openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2"
Sep 15 10:31:35.633448 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:35.633440    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914-workload-socket\") pod \"e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2\" (UID: \"aa851bef-4a2c-4fe5-9fe5-3350d9e9b914\") " pod="openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2"
Sep 15 10:31:35.633758 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:35.633465    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914-credential-socket\") pod \"e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2\" (UID: \"aa851bef-4a2c-4fe5-9fe5-3350d9e9b914\") " pod="openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2"
Sep 15 10:31:35.633758 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:35.633501    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914-istiod-ca-cert\") pod \"e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2\" (UID: \"aa851bef-4a2c-4fe5-9fe5-3350d9e9b914\") " pod="openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2"
Sep 15 10:31:35.633758 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:35.633558    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914-istio-token\") pod \"e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2\" (UID: \"aa851bef-4a2c-4fe5-9fe5-3350d9e9b914\") " pod="openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2"
Sep 15 10:31:35.734281 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:35.734192    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914-istio-envoy\") pod \"e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2\" (UID: \"aa851bef-4a2c-4fe5-9fe5-3350d9e9b914\") " pod="openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2"
Sep 15 10:31:35.734281 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:35.734244    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqg6l\" (UniqueName: \"kubernetes.io/projected/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914-kube-api-access-vqg6l\") pod \"e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2\" (UID: \"aa851bef-4a2c-4fe5-9fe5-3350d9e9b914\") " pod="openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2"
Sep 15 10:31:35.734521 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:35.734361    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914-workload-certs\") pod \"e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2\" (UID: \"aa851bef-4a2c-4fe5-9fe5-3350d9e9b914\") " pod="openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2"
Sep 15 10:31:35.734521 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:35.734421    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914-istio-podinfo\") pod \"e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2\" (UID: \"aa851bef-4a2c-4fe5-9fe5-3350d9e9b914\") " pod="openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2"
Sep 15 10:31:35.734521 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:35.734455    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914-istio-data\") pod \"e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2\" (UID: \"aa851bef-4a2c-4fe5-9fe5-3350d9e9b914\") " pod="openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2"
Sep 15 10:31:35.734521 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:35.734513    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914-workload-socket\") pod \"e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2\" (UID: \"aa851bef-4a2c-4fe5-9fe5-3350d9e9b914\") " pod="openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2"
Sep 15 10:31:35.734793 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:35.734541    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914-credential-socket\") pod \"e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2\" (UID: \"aa851bef-4a2c-4fe5-9fe5-3350d9e9b914\") " pod="openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2"
Sep 15 10:31:35.734793 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:35.734583    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914-istiod-ca-cert\") pod \"e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2\" (UID: \"aa851bef-4a2c-4fe5-9fe5-3350d9e9b914\") " pod="openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2"
Sep 15 10:31:35.734793 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:35.734650    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914-istio-token\") pod \"e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2\" (UID: \"aa851bef-4a2c-4fe5-9fe5-3350d9e9b914\") " pod="openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2"
Sep 15 10:31:35.734971 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:35.734839    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914-istio-data\") pod \"e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2\" (UID: \"aa851bef-4a2c-4fe5-9fe5-3350d9e9b914\") " pod="openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2"
Sep 15 10:31:35.735051 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:35.734969    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914-credential-socket\") pod \"e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2\" (UID: \"aa851bef-4a2c-4fe5-9fe5-3350d9e9b914\") " pod="openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2"
Sep 15 10:31:35.735138 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:35.735115    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914-workload-socket\") pod \"e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2\" (UID: \"aa851bef-4a2c-4fe5-9fe5-3350d9e9b914\") " pod="openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2"
Sep 15 10:31:35.735466 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:35.735443    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914-workload-certs\") pod \"e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2\" (UID: \"aa851bef-4a2c-4fe5-9fe5-3350d9e9b914\") " pod="openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2"
Sep 15 10:31:35.735622 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:35.735486    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914-istiod-ca-cert\") pod \"e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2\" (UID: \"aa851bef-4a2c-4fe5-9fe5-3350d9e9b914\") " pod="openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2"
Sep 15 10:31:35.737008 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:35.736989    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914-istio-envoy\") pod \"e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2\" (UID: \"aa851bef-4a2c-4fe5-9fe5-3350d9e9b914\") " pod="openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2"
Sep 15 10:31:35.737513 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:35.737489    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914-istio-podinfo\") pod \"e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2\" (UID: \"aa851bef-4a2c-4fe5-9fe5-3350d9e9b914\") " pod="openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2"
Sep 15 10:31:35.741936 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:35.741916    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914-istio-token\") pod \"e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2\" (UID: \"aa851bef-4a2c-4fe5-9fe5-3350d9e9b914\") " pod="openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2"
Sep 15 10:31:35.742259 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:35.742241    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqg6l\" (UniqueName: \"kubernetes.io/projected/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914-kube-api-access-vqg6l\") pod \"e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2\" (UID: \"aa851bef-4a2c-4fe5-9fe5-3350d9e9b914\") " pod="openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2"
Sep 15 10:31:35.857524 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:35.857489    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2"
Sep 15 10:31:36.142847 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:36.142816    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2"]
Sep 15 10:31:36.145008 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:31:36.144982    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa851bef_4a2c_4fe5_9fe5_3350d9e9b914.slice/crio-c0f2385539c8d87b9024be7180426947da6ce79810428344052db20d2c4358bb WatchSource:0}: Error finding container c0f2385539c8d87b9024be7180426947da6ce79810428344052db20d2c4358bb: Status 404 returned error can't find the container with id c0f2385539c8d87b9024be7180426947da6ce79810428344052db20d2c4358bb
Sep 15 10:31:36.147042 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:36.147012    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:31:36.147115 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:36.147079    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:31:36.147115 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:36.147111    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:31:36.476589 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:36.476495    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2" event={"ID":"aa851bef-4a2c-4fe5-9fe5-3350d9e9b914","Type":"ContainerStarted","Data":"665d7dfe41f0ac5fee17aee2f053267ce921b6f46ba8bd1857c5f425813f0a26"}
Sep 15 10:31:36.476589 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:36.476556    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2" event={"ID":"aa851bef-4a2c-4fe5-9fe5-3350d9e9b914","Type":"ContainerStarted","Data":"c0f2385539c8d87b9024be7180426947da6ce79810428344052db20d2c4358bb"}
Sep 15 10:31:36.499451 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:36.499158    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2" podStartSLOduration=1.499138651 podStartE2EDuration="1.499138651s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:31:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:31:36.496592908 +0000 UTC m=+829.892685008" watchObservedRunningTime="2026-09-15 10:31:36.499138651 +0000 UTC m=+829.895230739"
Sep 15 10:31:36.858049 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:36.858014    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2"
Sep 15 10:31:37.150057 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:37.149978    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e330e9ca-bf68-4f00-b4b1-d4fc92ee210e" path="/var/lib/kubelet/pods/e330e9ca-bf68-4f00-b4b1-d4fc92ee210e/volumes"
Sep 15 10:31:37.863011 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:37.862973    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2"
Sep 15 10:31:38.489541 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:38.489504    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2"
Sep 15 10:31:38.490425 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:38.490406    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2"
Sep 15 10:31:40.093348 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.093283    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2"
Sep 15 10:31:40.177558 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.177505    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6-istio-envoy\") pod \"d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6\" (UID: \"d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6\") "
Sep 15 10:31:40.177558 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.177560    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6-istiod-ca-cert\") pod \"d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6\" (UID: \"d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6\") "
Sep 15 10:31:40.177817 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.177610    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6-workload-socket\") pod \"d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6\" (UID: \"d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6\") "
Sep 15 10:31:40.177817 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.177656    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6-credential-socket\") pod \"d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6\" (UID: \"d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6\") "
Sep 15 10:31:40.177817 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.177738    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6-istio-podinfo\") pod \"d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6\" (UID: \"d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6\") "
Sep 15 10:31:40.177817 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.177770    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6-istio-data\") pod \"d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6\" (UID: \"d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6\") "
Sep 15 10:31:40.178038 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.177986    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6" (UID: "d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:31:40.178105 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.178031    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6" (UID: "d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:31:40.178105 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.178084    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6" (UID: "d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:31:40.178391 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.178366    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6-istio-data" (OuterVolumeSpecName: "istio-data") pod "d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6" (UID: "d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:31:40.178498 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.178405    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2gjx\" (UniqueName: \"kubernetes.io/projected/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6-kube-api-access-n2gjx\") pod \"d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6\" (UID: \"d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6\") "
Sep 15 10:31:40.178498 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.178476    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6-istio-token\") pod \"d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6\" (UID: \"d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6\") "
Sep 15 10:31:40.178614 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.178507    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6-workload-certs\") pod \"d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6\" (UID: \"d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6\") "
Sep 15 10:31:40.178903 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.178885    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6-istiod-ca-cert\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:31:40.179146 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.179125    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6-workload-socket\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:31:40.179146 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.179147    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6-credential-socket\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:31:40.179337 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.179044    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6" (UID: "d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:31:40.179337 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.179189    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6-istio-data\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:31:40.180471 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.180451    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6" (UID: "d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:31:40.180701 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.180435    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6" (UID: "d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 10:31:40.180810 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.180766    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6-kube-api-access-n2gjx" (OuterVolumeSpecName: "kube-api-access-n2gjx") pod "d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6" (UID: "d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6"). InnerVolumeSpecName "kube-api-access-n2gjx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:31:40.181058 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.181036    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6-istio-token" (OuterVolumeSpecName: "istio-token") pod "d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6" (UID: "d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:31:40.259085 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.259053    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-68c3a296-587b9fcdfd-fmlln"]
Sep 15 10:31:40.259556 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.259544    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6" containerName="istio-proxy"
Sep 15 10:31:40.259595 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.259559    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6" containerName="istio-proxy"
Sep 15 10:31:40.259595 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.259567    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6" containerName="istio-proxy"
Sep 15 10:31:40.259595 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.259572    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6" containerName="istio-proxy"
Sep 15 10:31:40.259706 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.259629    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6" containerName="istio-proxy"
Sep 15 10:31:40.259706 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.259639    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6" containerName="istio-proxy"
Sep 15 10:31:40.263051 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.263033    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-68c3a296-587b9fcdfd-fmlln"
Sep 15 10:31:40.266063 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.266043    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-68c3a296\""
Sep 15 10:31:40.266173 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.266043    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-68c3a296-dockercfg-f8tzq\""
Sep 15 10:31:40.272965 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.272938    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-68c3a296-587b9fcdfd-fmlln"]
Sep 15 10:31:40.287971 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.280299    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2gjx\" (UniqueName: \"kubernetes.io/projected/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6-kube-api-access-n2gjx\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:31:40.287971 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.280329    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6-istio-token\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:31:40.287971 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.280344    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6-workload-certs\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:31:40.287971 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.280355    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6-istio-envoy\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:31:40.287971 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.280367    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6-istio-podinfo\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:31:40.382544 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.382418    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5581e835-5d04-45ae-937a-7cb065c2bb72-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-68c3a296-587b9fcdfd-fmlln\" (UID: \"5581e835-5d04-45ae-937a-7cb065c2bb72\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-68c3a296-587b9fcdfd-fmlln"
Sep 15 10:31:40.382544 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.382487    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7k8tj\" (UniqueName: \"kubernetes.io/projected/5581e835-5d04-45ae-937a-7cb065c2bb72-kube-api-access-7k8tj\") pod \"payload-pre-processing-e2e-ait-68c3a296-587b9fcdfd-fmlln\" (UID: \"5581e835-5d04-45ae-937a-7cb065c2bb72\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-68c3a296-587b9fcdfd-fmlln"
Sep 15 10:31:40.484070 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.484030    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5581e835-5d04-45ae-937a-7cb065c2bb72-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-68c3a296-587b9fcdfd-fmlln\" (UID: \"5581e835-5d04-45ae-937a-7cb065c2bb72\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-68c3a296-587b9fcdfd-fmlln"
Sep 15 10:31:40.484070 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.484073    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k8tj\" (UniqueName: \"kubernetes.io/projected/5581e835-5d04-45ae-937a-7cb065c2bb72-kube-api-access-7k8tj\") pod \"payload-pre-processing-e2e-ait-68c3a296-587b9fcdfd-fmlln\" (UID: \"5581e835-5d04-45ae-937a-7cb065c2bb72\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-68c3a296-587b9fcdfd-fmlln"
Sep 15 10:31:40.484787 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.484762    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5581e835-5d04-45ae-937a-7cb065c2bb72-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-68c3a296-587b9fcdfd-fmlln\" (UID: \"5581e835-5d04-45ae-937a-7cb065c2bb72\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-68c3a296-587b9fcdfd-fmlln"
Sep 15 10:31:40.492842 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.492823    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7k8tj\" (UniqueName: \"kubernetes.io/projected/5581e835-5d04-45ae-937a-7cb065c2bb72-kube-api-access-7k8tj\") pod \"payload-pre-processing-e2e-ait-68c3a296-587b9fcdfd-fmlln\" (UID: \"5581e835-5d04-45ae-937a-7cb065c2bb72\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-68c3a296-587b9fcdfd-fmlln"
Sep 15 10:31:40.504954 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.504919    2579 generic.go:356] "Generic (PLEG): container finished" podID="d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6" containerID="9204afb1794c7c8b801ac42de7223492f7283af384faa49494342c82d5e18d2e" exitCode=0
Sep 15 10:31:40.505130 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.504980    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2"
Sep 15 10:31:40.505130 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.505014    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2" event={"ID":"d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6","Type":"ContainerDied","Data":"9204afb1794c7c8b801ac42de7223492f7283af384faa49494342c82d5e18d2e"}
Sep 15 10:31:40.505130 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.505096    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2" event={"ID":"d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6","Type":"ContainerDied","Data":"10103160f65aabd0670630aceb140d6d52c348d6ec28114c9e85044ba38cbc9d"}
Sep 15 10:31:40.505295 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.505133    2579 scope.go:117] "RemoveContainer" containerID="9204afb1794c7c8b801ac42de7223492f7283af384faa49494342c82d5e18d2e"
Sep 15 10:31:40.516487 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.516466    2579 scope.go:117] "RemoveContainer" containerID="e9790e4abf425de6c52a2284da588d749f6d4b4f764951a0ef17762f9d5eee9c"
Sep 15 10:31:40.526082 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.526058    2579 scope.go:117] "RemoveContainer" containerID="9204afb1794c7c8b801ac42de7223492f7283af384faa49494342c82d5e18d2e"
Sep 15 10:31:40.526431 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:31:40.526406    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9204afb1794c7c8b801ac42de7223492f7283af384faa49494342c82d5e18d2e\": container with ID starting with 9204afb1794c7c8b801ac42de7223492f7283af384faa49494342c82d5e18d2e not found: ID does not exist" containerID="9204afb1794c7c8b801ac42de7223492f7283af384faa49494342c82d5e18d2e"
Sep 15 10:31:40.526524 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.526438    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9204afb1794c7c8b801ac42de7223492f7283af384faa49494342c82d5e18d2e"} err="failed to get container status \"9204afb1794c7c8b801ac42de7223492f7283af384faa49494342c82d5e18d2e\": rpc error: code = NotFound desc = could not find container \"9204afb1794c7c8b801ac42de7223492f7283af384faa49494342c82d5e18d2e\": container with ID starting with 9204afb1794c7c8b801ac42de7223492f7283af384faa49494342c82d5e18d2e not found: ID does not exist"
Sep 15 10:31:40.526524 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.526455    2579 scope.go:117] "RemoveContainer" containerID="e9790e4abf425de6c52a2284da588d749f6d4b4f764951a0ef17762f9d5eee9c"
Sep 15 10:31:40.526756 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:31:40.526707    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9790e4abf425de6c52a2284da588d749f6d4b4f764951a0ef17762f9d5eee9c\": container with ID starting with e9790e4abf425de6c52a2284da588d749f6d4b4f764951a0ef17762f9d5eee9c not found: ID does not exist" containerID="e9790e4abf425de6c52a2284da588d749f6d4b4f764951a0ef17762f9d5eee9c"
Sep 15 10:31:40.526809 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.526758    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9790e4abf425de6c52a2284da588d749f6d4b4f764951a0ef17762f9d5eee9c"} err="failed to get container status \"e9790e4abf425de6c52a2284da588d749f6d4b4f764951a0ef17762f9d5eee9c\": rpc error: code = NotFound desc = could not find container \"e9790e4abf425de6c52a2284da588d749f6d4b4f764951a0ef17762f9d5eee9c\": container with ID starting with e9790e4abf425de6c52a2284da588d749f6d4b4f764951a0ef17762f9d5eee9c not found: ID does not exist"
Sep 15 10:31:40.528305 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.528288    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2"]
Sep 15 10:31:40.531651 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.531629    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-b797d492-gw-openshift-default-854dcfb948-s4bm2"]
Sep 15 10:31:40.576457 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.576409    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-68c3a296-587b9fcdfd-fmlln"
Sep 15 10:31:40.852863 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:40.852824    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-68c3a296-587b9fcdfd-fmlln"]
Sep 15 10:31:40.854889 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:31:40.854861    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5581e835_5d04_45ae_937a_7cb065c2bb72.slice/crio-bb7c98a9f3de759309e7435473207b5d2eeab09605ed2e17827618e3fcf0c6fc WatchSource:0}: Error finding container bb7c98a9f3de759309e7435473207b5d2eeab09605ed2e17827618e3fcf0c6fc: Status 404 returned error can't find the container with id bb7c98a9f3de759309e7435473207b5d2eeab09605ed2e17827618e3fcf0c6fc
Sep 15 10:31:41.150354 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:41.150278    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6" path="/var/lib/kubelet/pods/d5ff7ec1-5aef-4bf7-a70a-86fb816d8ff6/volumes"
Sep 15 10:31:41.514073 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:41.513970    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-68c3a296-587b9fcdfd-fmlln" event={"ID":"5581e835-5d04-45ae-937a-7cb065c2bb72","Type":"ContainerStarted","Data":"f204a8637821e3990cbf4605257dec506b7da164bce379c81c9ce9b5dfdc84d3"}
Sep 15 10:31:41.514073 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:41.514048    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-68c3a296-587b9fcdfd-fmlln" event={"ID":"5581e835-5d04-45ae-937a-7cb065c2bb72","Type":"ContainerStarted","Data":"bb7c98a9f3de759309e7435473207b5d2eeab09605ed2e17827618e3fcf0c6fc"}
Sep 15 10:31:41.514304 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:41.514083    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-68c3a296-587b9fcdfd-fmlln"
Sep 15 10:31:41.535394 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:41.535339    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-68c3a296-587b9fcdfd-fmlln" podStartSLOduration=1.535319866 podStartE2EDuration="1.535319866s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:31:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:31:41.534926627 +0000 UTC m=+834.931018714" watchObservedRunningTime="2026-09-15 10:31:41.535319866 +0000 UTC m=+834.931411954"
Sep 15 10:31:52.524415 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:31:52.524385    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-68c3a296-587b9fcdfd-fmlln"
Sep 15 10:32:02.640966 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:02.640934    2579 generic.go:356] "Generic (PLEG): container finished" podID="aa851bef-4a2c-4fe5-9fe5-3350d9e9b914" containerID="665d7dfe41f0ac5fee17aee2f053267ce921b6f46ba8bd1857c5f425813f0a26" exitCode=0
Sep 15 10:32:02.641476 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:02.641013    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2" event={"ID":"aa851bef-4a2c-4fe5-9fe5-3350d9e9b914","Type":"ContainerDied","Data":"665d7dfe41f0ac5fee17aee2f053267ce921b6f46ba8bd1857c5f425813f0a26"}
Sep 15 10:32:02.641547 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:02.641531    2579 scope.go:117] "RemoveContainer" containerID="665d7dfe41f0ac5fee17aee2f053267ce921b6f46ba8bd1857c5f425813f0a26"
Sep 15 10:32:02.643032 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:02.643004    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:32:02.643141 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:02.643071    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:32:02.643141 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:02.643102    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:32:03.553925 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:03.553886    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-68c3a296-rgx2p"]
Sep 15 10:32:03.557307 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:03.557282    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-68c3a296-rgx2p"
Sep 15 10:32:03.559657 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:03.559637    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5jrzm\""
Sep 15 10:32:03.564546 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:03.564508    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-68c3a296-rgx2p"]
Sep 15 10:32:03.624748 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:03.621328    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/508d1dfa-f584-4e5b-81c1-2362ffadbc8b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-68c3a296-rgx2p\" (UID: \"508d1dfa-f584-4e5b-81c1-2362ffadbc8b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-68c3a296-rgx2p"
Sep 15 10:32:03.649557 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:03.649515    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2" event={"ID":"aa851bef-4a2c-4fe5-9fe5-3350d9e9b914","Type":"ContainerStarted","Data":"1125d7251c9b581bd0f9381ffd692c4516ca2cd722c2d056f7bafb138ed53bea"}
Sep 15 10:32:03.722812 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:03.722753    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/508d1dfa-f584-4e5b-81c1-2362ffadbc8b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-68c3a296-rgx2p\" (UID: \"508d1dfa-f584-4e5b-81c1-2362ffadbc8b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-68c3a296-rgx2p"
Sep 15 10:32:03.724216 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:03.724177    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/508d1dfa-f584-4e5b-81c1-2362ffadbc8b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-68c3a296-rgx2p\" (UID: \"508d1dfa-f584-4e5b-81c1-2362ffadbc8b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-68c3a296-rgx2p"
Sep 15 10:32:03.858255 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:03.858174    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2"
Sep 15 10:32:03.859568 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:03.859541    2579 patch_prober.go:28] interesting pod/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 15 10:32:03.859695 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:03.859594    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2" podUID="aa851bef-4a2c-4fe5-9fe5-3350d9e9b914" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 15 10:32:03.870049 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:03.870020    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-68c3a296-rgx2p"
Sep 15 10:32:04.165470 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:04.165444    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-68c3a296-rgx2p"]
Sep 15 10:32:04.167517 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:32:04.167488    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod508d1dfa_f584_4e5b_81c1_2362ffadbc8b.slice/crio-f460e67bfa927f02a953d7f6d9edf70d17ebbb5c1782f8f5e8c9d615dc4ab343 WatchSource:0}: Error finding container f460e67bfa927f02a953d7f6d9edf70d17ebbb5c1782f8f5e8c9d615dc4ab343: Status 404 returned error can't find the container with id f460e67bfa927f02a953d7f6d9edf70d17ebbb5c1782f8f5e8c9d615dc4ab343
Sep 15 10:32:04.656738 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:04.656691    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-68c3a296-rgx2p" event={"ID":"508d1dfa-f584-4e5b-81c1-2362ffadbc8b","Type":"ContainerStarted","Data":"12321ed13c9d13885636cd82d359130a8f0635e3343c17798a97b9d805c3e988"}
Sep 15 10:32:04.657186 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:04.656753    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-68c3a296-rgx2p" event={"ID":"508d1dfa-f584-4e5b-81c1-2362ffadbc8b","Type":"ContainerStarted","Data":"f460e67bfa927f02a953d7f6d9edf70d17ebbb5c1782f8f5e8c9d615dc4ab343"}
Sep 15 10:32:04.674468 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:04.674348    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-68c3a296-rgx2p" podStartSLOduration=1.674332216 podStartE2EDuration="1.674332216s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:32:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:32:04.671469417 +0000 UTC m=+858.067561504" watchObservedRunningTime="2026-09-15 10:32:04.674332216 +0000 UTC m=+858.070424303"
Sep 15 10:32:04.858205 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:04.858164    2579 patch_prober.go:28] interesting pod/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 15 10:32:04.858392 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:04.858261    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2" podUID="aa851bef-4a2c-4fe5-9fe5-3350d9e9b914" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 15 10:32:05.663795 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:05.663760    2579 generic.go:356] "Generic (PLEG): container finished" podID="508d1dfa-f584-4e5b-81c1-2362ffadbc8b" containerID="12321ed13c9d13885636cd82d359130a8f0635e3343c17798a97b9d805c3e988" exitCode=0
Sep 15 10:32:05.664171 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:05.663843    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-68c3a296-rgx2p" event={"ID":"508d1dfa-f584-4e5b-81c1-2362ffadbc8b","Type":"ContainerDied","Data":"12321ed13c9d13885636cd82d359130a8f0635e3343c17798a97b9d805c3e988"}
Sep 15 10:32:05.858368 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:05.858329    2579 patch_prober.go:28] interesting pod/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 15 10:32:05.858570 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:05.858410    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2" podUID="aa851bef-4a2c-4fe5-9fe5-3350d9e9b914" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 15 10:32:06.858207 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:06.858180    2579 patch_prober.go:28] interesting pod/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 15 10:32:06.858515 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:06.858236    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2" podUID="aa851bef-4a2c-4fe5-9fe5-3350d9e9b914" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 15 10:32:06.873969 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:06.873938    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-68c3a296-rgx2p"
Sep 15 10:32:06.956805 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:06.956696    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/508d1dfa-f584-4e5b-81c1-2362ffadbc8b-maas-api-service-ca\") pod \"508d1dfa-f584-4e5b-81c1-2362ffadbc8b\" (UID: \"508d1dfa-f584-4e5b-81c1-2362ffadbc8b\") "
Sep 15 10:32:06.957052 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:06.957026    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/508d1dfa-f584-4e5b-81c1-2362ffadbc8b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "508d1dfa-f584-4e5b-81c1-2362ffadbc8b" (UID: "508d1dfa-f584-4e5b-81c1-2362ffadbc8b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:32:07.058055 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:07.058021    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/508d1dfa-f584-4e5b-81c1-2362ffadbc8b-maas-api-service-ca\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:32:07.676361 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:07.676330    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-68c3a296-rgx2p"
Sep 15 10:32:07.676531 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:07.676372    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-68c3a296-rgx2p" event={"ID":"508d1dfa-f584-4e5b-81c1-2362ffadbc8b","Type":"ContainerDied","Data":"f460e67bfa927f02a953d7f6d9edf70d17ebbb5c1782f8f5e8c9d615dc4ab343"}
Sep 15 10:32:07.676531 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:07.676424    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f460e67bfa927f02a953d7f6d9edf70d17ebbb5c1782f8f5e8c9d615dc4ab343"
Sep 15 10:32:07.858767 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:07.858695    2579 patch_prober.go:28] interesting pod/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 15 10:32:07.859255 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:07.858813    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2" podUID="aa851bef-4a2c-4fe5-9fe5-3350d9e9b914" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 15 10:32:08.490142 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:08.490105    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2"
Sep 15 10:32:08.862812 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:08.862781    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2"
Sep 15 10:32:08.863940 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:08.863920    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2"
Sep 15 10:32:09.337240 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:09.334785    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-68c3a296-587b9fcdfd-fmlln"]
Sep 15 10:32:09.337240 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:09.335110    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-68c3a296-587b9fcdfd-fmlln" podUID="5581e835-5d04-45ae-937a-7cb065c2bb72" containerName="payload-pre-processing" containerID="cri-o://f204a8637821e3990cbf4605257dec506b7da164bce379c81c9ce9b5dfdc84d3" gracePeriod=30
Sep 15 10:32:09.479032 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:09.478965    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-68c3a296-rgx2p"]
Sep 15 10:32:09.482085 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:09.482040    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-68c3a296-rgx2p"]
Sep 15 10:32:09.629396 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:09.629361    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-68c3a296-587b9fcdfd-fmlln"
Sep 15 10:32:09.686956 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:09.686918    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7k8tj\" (UniqueName: \"kubernetes.io/projected/5581e835-5d04-45ae-937a-7cb065c2bb72-kube-api-access-7k8tj\") pod \"5581e835-5d04-45ae-937a-7cb065c2bb72\" (UID: \"5581e835-5d04-45ae-937a-7cb065c2bb72\") "
Sep 15 10:32:09.687148 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:09.687062    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5581e835-5d04-45ae-937a-7cb065c2bb72-plugins-config-volume\") pod \"5581e835-5d04-45ae-937a-7cb065c2bb72\" (UID: \"5581e835-5d04-45ae-937a-7cb065c2bb72\") "
Sep 15 10:32:09.687586 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:09.687554    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5581e835-5d04-45ae-937a-7cb065c2bb72-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5581e835-5d04-45ae-937a-7cb065c2bb72" (UID: "5581e835-5d04-45ae-937a-7cb065c2bb72"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:32:09.689738 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:09.689681    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5581e835-5d04-45ae-937a-7cb065c2bb72-kube-api-access-7k8tj" (OuterVolumeSpecName: "kube-api-access-7k8tj") pod "5581e835-5d04-45ae-937a-7cb065c2bb72" (UID: "5581e835-5d04-45ae-937a-7cb065c2bb72"). InnerVolumeSpecName "kube-api-access-7k8tj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:32:09.691411 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:09.691383    2579 generic.go:356] "Generic (PLEG): container finished" podID="5581e835-5d04-45ae-937a-7cb065c2bb72" containerID="f204a8637821e3990cbf4605257dec506b7da164bce379c81c9ce9b5dfdc84d3" exitCode=0
Sep 15 10:32:09.691531 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:09.691426    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-68c3a296-587b9fcdfd-fmlln"
Sep 15 10:32:09.691531 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:09.691466    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-68c3a296-587b9fcdfd-fmlln" event={"ID":"5581e835-5d04-45ae-937a-7cb065c2bb72","Type":"ContainerDied","Data":"f204a8637821e3990cbf4605257dec506b7da164bce379c81c9ce9b5dfdc84d3"}
Sep 15 10:32:09.691531 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:09.691517    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-68c3a296-587b9fcdfd-fmlln" event={"ID":"5581e835-5d04-45ae-937a-7cb065c2bb72","Type":"ContainerDied","Data":"bb7c98a9f3de759309e7435473207b5d2eeab09605ed2e17827618e3fcf0c6fc"}
Sep 15 10:32:09.691691 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:09.691546    2579 scope.go:117] "RemoveContainer" containerID="f204a8637821e3990cbf4605257dec506b7da164bce379c81c9ce9b5dfdc84d3"
Sep 15 10:32:09.712173 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:09.712144    2579 scope.go:117] "RemoveContainer" containerID="f204a8637821e3990cbf4605257dec506b7da164bce379c81c9ce9b5dfdc84d3"
Sep 15 10:32:09.712980 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:32:09.712936    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f204a8637821e3990cbf4605257dec506b7da164bce379c81c9ce9b5dfdc84d3\": container with ID starting with f204a8637821e3990cbf4605257dec506b7da164bce379c81c9ce9b5dfdc84d3 not found: ID does not exist" containerID="f204a8637821e3990cbf4605257dec506b7da164bce379c81c9ce9b5dfdc84d3"
Sep 15 10:32:09.713092 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:09.713012    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f204a8637821e3990cbf4605257dec506b7da164bce379c81c9ce9b5dfdc84d3"} err="failed to get container status \"f204a8637821e3990cbf4605257dec506b7da164bce379c81c9ce9b5dfdc84d3\": rpc error: code = NotFound desc = could not find container \"f204a8637821e3990cbf4605257dec506b7da164bce379c81c9ce9b5dfdc84d3\": container with ID starting with f204a8637821e3990cbf4605257dec506b7da164bce379c81c9ce9b5dfdc84d3 not found: ID does not exist"
Sep 15 10:32:09.718289 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:09.718259    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-68c3a296-587b9fcdfd-fmlln"]
Sep 15 10:32:09.721760 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:09.721716    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-68c3a296-587b9fcdfd-fmlln"]
Sep 15 10:32:09.788792 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:09.788752    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7k8tj\" (UniqueName: \"kubernetes.io/projected/5581e835-5d04-45ae-937a-7cb065c2bb72-kube-api-access-7k8tj\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:32:09.788792 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:09.788785    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5581e835-5d04-45ae-937a-7cb065c2bb72-plugins-config-volume\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:32:10.591651 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:10.591617    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2"]
Sep 15 10:32:10.712340 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:10.712287    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2" podUID="aa851bef-4a2c-4fe5-9fe5-3350d9e9b914" containerName="istio-proxy" containerID="cri-o://1125d7251c9b581bd0f9381ffd692c4516ca2cd722c2d056f7bafb138ed53bea" gracePeriod=30
Sep 15 10:32:11.149604 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:11.149569    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="508d1dfa-f584-4e5b-81c1-2362ffadbc8b" path="/var/lib/kubelet/pods/508d1dfa-f584-4e5b-81c1-2362ffadbc8b/volumes"
Sep 15 10:32:11.149996 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:11.149979    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5581e835-5d04-45ae-937a-7cb065c2bb72" path="/var/lib/kubelet/pods/5581e835-5d04-45ae-937a-7cb065c2bb72/volumes"
Sep 15 10:32:11.273376 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:11.273280    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf"]
Sep 15 10:32:11.273963 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:11.273939    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="508d1dfa-f584-4e5b-81c1-2362ffadbc8b" containerName="revoke-keys"
Sep 15 10:32:11.273963 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:11.273962    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="508d1dfa-f584-4e5b-81c1-2362ffadbc8b" containerName="revoke-keys"
Sep 15 10:32:11.274142 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:11.273983    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5581e835-5d04-45ae-937a-7cb065c2bb72" containerName="payload-pre-processing"
Sep 15 10:32:11.274142 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:11.273992    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5581e835-5d04-45ae-937a-7cb065c2bb72" containerName="payload-pre-processing"
Sep 15 10:32:11.274142 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:11.274107    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5581e835-5d04-45ae-937a-7cb065c2bb72" containerName="payload-pre-processing"
Sep 15 10:32:11.274142 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:11.274119    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="508d1dfa-f584-4e5b-81c1-2362ffadbc8b" containerName="revoke-keys"
Sep 15 10:32:11.278676 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:11.278657    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf"
Sep 15 10:32:11.281241 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:11.281215    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-7b3aacf5-openshift-default-dockercfg-v4b6v\""
Sep 15 10:32:11.289820 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:11.289787    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf"]
Sep 15 10:32:11.312782 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:11.312708    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eda5cfdc-1207-4b9c-9810-22c490afde67-istio-data\") pod \"e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf\" (UID: \"eda5cfdc-1207-4b9c-9810-22c490afde67\") " pod="openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf"
Sep 15 10:32:11.312970 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:11.312838    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eda5cfdc-1207-4b9c-9810-22c490afde67-istio-podinfo\") pod \"e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf\" (UID: \"eda5cfdc-1207-4b9c-9810-22c490afde67\") " pod="openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf"
Sep 15 10:32:11.312970 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:11.312891    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eda5cfdc-1207-4b9c-9810-22c490afde67-istio-token\") pod \"e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf\" (UID: \"eda5cfdc-1207-4b9c-9810-22c490afde67\") " pod="openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf"
Sep 15 10:32:11.313106 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:11.313000    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eda5cfdc-1207-4b9c-9810-22c490afde67-workload-certs\") pod \"e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf\" (UID: \"eda5cfdc-1207-4b9c-9810-22c490afde67\") " pod="openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf"
Sep 15 10:32:11.313106 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:11.313055    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eda5cfdc-1207-4b9c-9810-22c490afde67-workload-socket\") pod \"e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf\" (UID: \"eda5cfdc-1207-4b9c-9810-22c490afde67\") " pod="openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf"
Sep 15 10:32:11.313106 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:11.313082    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eda5cfdc-1207-4b9c-9810-22c490afde67-istiod-ca-cert\") pod \"e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf\" (UID: \"eda5cfdc-1207-4b9c-9810-22c490afde67\") " pod="openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf"
Sep 15 10:32:11.313278 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:11.313129    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp7c8\" (UniqueName: \"kubernetes.io/projected/eda5cfdc-1207-4b9c-9810-22c490afde67-kube-api-access-jp7c8\") pod \"e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf\" (UID: \"eda5cfdc-1207-4b9c-9810-22c490afde67\") " pod="openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf"
Sep 15 10:32:11.313278 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:11.313172    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eda5cfdc-1207-4b9c-9810-22c490afde67-credential-socket\") pod \"e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf\" (UID: \"eda5cfdc-1207-4b9c-9810-22c490afde67\") " pod="openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf"
Sep 15 10:32:11.313278 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:11.313248    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eda5cfdc-1207-4b9c-9810-22c490afde67-istio-envoy\") pod \"e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf\" (UID: \"eda5cfdc-1207-4b9c-9810-22c490afde67\") " pod="openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf"
Sep 15 10:32:11.414653 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:11.414566    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eda5cfdc-1207-4b9c-9810-22c490afde67-istio-envoy\") pod \"e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf\" (UID: \"eda5cfdc-1207-4b9c-9810-22c490afde67\") " pod="openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf"
Sep 15 10:32:11.414874 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:11.414656    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eda5cfdc-1207-4b9c-9810-22c490afde67-istio-data\") pod \"e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf\" (UID: \"eda5cfdc-1207-4b9c-9810-22c490afde67\") " pod="openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf"
Sep 15 10:32:11.414874 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:11.414750    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eda5cfdc-1207-4b9c-9810-22c490afde67-istio-podinfo\") pod \"e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf\" (UID: \"eda5cfdc-1207-4b9c-9810-22c490afde67\") " pod="openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf"
Sep 15 10:32:11.414874 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:11.414786    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eda5cfdc-1207-4b9c-9810-22c490afde67-istio-token\") pod \"e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf\" (UID: \"eda5cfdc-1207-4b9c-9810-22c490afde67\") " pod="openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf"
Sep 15 10:32:11.414874 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:11.414814    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eda5cfdc-1207-4b9c-9810-22c490afde67-workload-certs\") pod \"e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf\" (UID: \"eda5cfdc-1207-4b9c-9810-22c490afde67\") " pod="openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf"
Sep 15 10:32:11.414874 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:11.414868    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eda5cfdc-1207-4b9c-9810-22c490afde67-workload-socket\") pod \"e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf\" (UID: \"eda5cfdc-1207-4b9c-9810-22c490afde67\") " pod="openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf"
Sep 15 10:32:11.415135 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:11.414894    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eda5cfdc-1207-4b9c-9810-22c490afde67-istiod-ca-cert\") pod \"e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf\" (UID: \"eda5cfdc-1207-4b9c-9810-22c490afde67\") " pod="openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf"
Sep 15 10:32:11.415135 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:11.414940    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jp7c8\" (UniqueName: \"kubernetes.io/projected/eda5cfdc-1207-4b9c-9810-22c490afde67-kube-api-access-jp7c8\") pod \"e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf\" (UID: \"eda5cfdc-1207-4b9c-9810-22c490afde67\") " pod="openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf"
Sep 15 10:32:11.415135 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:11.414970    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eda5cfdc-1207-4b9c-9810-22c490afde67-credential-socket\") pod \"e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf\" (UID: \"eda5cfdc-1207-4b9c-9810-22c490afde67\") " pod="openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf"
Sep 15 10:32:11.415395 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:11.415365    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eda5cfdc-1207-4b9c-9810-22c490afde67-credential-socket\") pod \"e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf\" (UID: \"eda5cfdc-1207-4b9c-9810-22c490afde67\") " pod="openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf"
Sep 15 10:32:11.415623 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:11.415603    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eda5cfdc-1207-4b9c-9810-22c490afde67-istio-data\") pod \"e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf\" (UID: \"eda5cfdc-1207-4b9c-9810-22c490afde67\") " pod="openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf"
Sep 15 10:32:11.417481 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:11.417452    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eda5cfdc-1207-4b9c-9810-22c490afde67-istio-envoy\") pod \"e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf\" (UID: \"eda5cfdc-1207-4b9c-9810-22c490afde67\") " pod="openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf"
Sep 15 10:32:11.417773 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:11.417752    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eda5cfdc-1207-4b9c-9810-22c490afde67-workload-socket\") pod \"e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf\" (UID: \"eda5cfdc-1207-4b9c-9810-22c490afde67\") " pod="openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf"
Sep 15 10:32:11.418079 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:11.418057    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eda5cfdc-1207-4b9c-9810-22c490afde67-workload-certs\") pod \"e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf\" (UID: \"eda5cfdc-1207-4b9c-9810-22c490afde67\") " pod="openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf"
Sep 15 10:32:11.418685 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:11.418633    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eda5cfdc-1207-4b9c-9810-22c490afde67-istiod-ca-cert\") pod \"e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf\" (UID: \"eda5cfdc-1207-4b9c-9810-22c490afde67\") " pod="openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf"
Sep 15 10:32:11.419092 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:11.419072    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eda5cfdc-1207-4b9c-9810-22c490afde67-istio-podinfo\") pod \"e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf\" (UID: \"eda5cfdc-1207-4b9c-9810-22c490afde67\") " pod="openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf"
Sep 15 10:32:11.426570 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:11.426544    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp7c8\" (UniqueName: \"kubernetes.io/projected/eda5cfdc-1207-4b9c-9810-22c490afde67-kube-api-access-jp7c8\") pod \"e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf\" (UID: \"eda5cfdc-1207-4b9c-9810-22c490afde67\") " pod="openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf"
Sep 15 10:32:11.427312 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:11.427287    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eda5cfdc-1207-4b9c-9810-22c490afde67-istio-token\") pod \"e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf\" (UID: \"eda5cfdc-1207-4b9c-9810-22c490afde67\") " pod="openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf"
Sep 15 10:32:11.593384 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:11.593341    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf"
Sep 15 10:32:11.878718 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:11.878682    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf"]
Sep 15 10:32:11.881689 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:32:11.881661    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeda5cfdc_1207_4b9c_9810_22c490afde67.slice/crio-92c2d97a40160df5b3a416d1b861fcbc5ef6f1be15c119fa94733a31e7381edf WatchSource:0}: Error finding container 92c2d97a40160df5b3a416d1b861fcbc5ef6f1be15c119fa94733a31e7381edf: Status 404 returned error can't find the container with id 92c2d97a40160df5b3a416d1b861fcbc5ef6f1be15c119fa94733a31e7381edf
Sep 15 10:32:11.884518 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:11.884483    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:32:11.884608 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:11.884553    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:32:11.884608 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:11.884582    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:32:12.726514 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:12.726473    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf" event={"ID":"eda5cfdc-1207-4b9c-9810-22c490afde67","Type":"ContainerStarted","Data":"241c7c7c424c7200ce9ba6201c43e7c4cfff149210a84c93de66783f3200c7de"}
Sep 15 10:32:12.726967 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:12.726536    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf" event={"ID":"eda5cfdc-1207-4b9c-9810-22c490afde67","Type":"ContainerStarted","Data":"92c2d97a40160df5b3a416d1b861fcbc5ef6f1be15c119fa94733a31e7381edf"}
Sep 15 10:32:12.763572 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:12.763516    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf" podStartSLOduration=1.763498915 podStartE2EDuration="1.763498915s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:32:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:32:12.761807851 +0000 UTC m=+866.157899938" watchObservedRunningTime="2026-09-15 10:32:12.763498915 +0000 UTC m=+866.159591002"
Sep 15 10:32:13.594020 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:13.593984    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf"
Sep 15 10:32:13.599804 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:13.599774    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf"
Sep 15 10:32:13.731955 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:13.731925    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf"
Sep 15 10:32:13.732917 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:13.732887    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf"
Sep 15 10:32:15.987534 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:15.987468    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2"
Sep 15 10:32:16.060776 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:16.060737    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914-workload-certs\") pod \"aa851bef-4a2c-4fe5-9fe5-3350d9e9b914\" (UID: \"aa851bef-4a2c-4fe5-9fe5-3350d9e9b914\") "
Sep 15 10:32:16.060776 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:16.060782    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914-workload-socket\") pod \"aa851bef-4a2c-4fe5-9fe5-3350d9e9b914\" (UID: \"aa851bef-4a2c-4fe5-9fe5-3350d9e9b914\") "
Sep 15 10:32:16.061033 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:16.060810    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914-istio-envoy\") pod \"aa851bef-4a2c-4fe5-9fe5-3350d9e9b914\" (UID: \"aa851bef-4a2c-4fe5-9fe5-3350d9e9b914\") "
Sep 15 10:32:16.061033 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:16.060835    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914-istio-token\") pod \"aa851bef-4a2c-4fe5-9fe5-3350d9e9b914\" (UID: \"aa851bef-4a2c-4fe5-9fe5-3350d9e9b914\") "
Sep 15 10:32:16.061033 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:16.060882    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914-istio-data\") pod \"aa851bef-4a2c-4fe5-9fe5-3350d9e9b914\" (UID: \"aa851bef-4a2c-4fe5-9fe5-3350d9e9b914\") "
Sep 15 10:32:16.061033 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:16.060921    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vqg6l\" (UniqueName: \"kubernetes.io/projected/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914-kube-api-access-vqg6l\") pod \"aa851bef-4a2c-4fe5-9fe5-3350d9e9b914\" (UID: \"aa851bef-4a2c-4fe5-9fe5-3350d9e9b914\") "
Sep 15 10:32:16.061033 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:16.060971    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914-istiod-ca-cert\") pod \"aa851bef-4a2c-4fe5-9fe5-3350d9e9b914\" (UID: \"aa851bef-4a2c-4fe5-9fe5-3350d9e9b914\") "
Sep 15 10:32:16.061033 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:16.061037    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914-credential-socket\") pod \"aa851bef-4a2c-4fe5-9fe5-3350d9e9b914\" (UID: \"aa851bef-4a2c-4fe5-9fe5-3350d9e9b914\") "
Sep 15 10:32:16.061347 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:16.061067    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914-istio-podinfo\") pod \"aa851bef-4a2c-4fe5-9fe5-3350d9e9b914\" (UID: \"aa851bef-4a2c-4fe5-9fe5-3350d9e9b914\") "
Sep 15 10:32:16.061347 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:16.061065    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "aa851bef-4a2c-4fe5-9fe5-3350d9e9b914" (UID: "aa851bef-4a2c-4fe5-9fe5-3350d9e9b914"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:32:16.061347 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:16.061118    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "aa851bef-4a2c-4fe5-9fe5-3350d9e9b914" (UID: "aa851bef-4a2c-4fe5-9fe5-3350d9e9b914"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:32:16.061347 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:16.061202    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914-istio-data" (OuterVolumeSpecName: "istio-data") pod "aa851bef-4a2c-4fe5-9fe5-3350d9e9b914" (UID: "aa851bef-4a2c-4fe5-9fe5-3350d9e9b914"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:32:16.061347 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:16.061302    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "aa851bef-4a2c-4fe5-9fe5-3350d9e9b914" (UID: "aa851bef-4a2c-4fe5-9fe5-3350d9e9b914"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:32:16.061595 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:16.061428    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "aa851bef-4a2c-4fe5-9fe5-3350d9e9b914" (UID: "aa851bef-4a2c-4fe5-9fe5-3350d9e9b914"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:32:16.061595 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:16.061495    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914-istio-data\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:32:16.061595 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:16.061514    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914-credential-socket\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:32:16.061595 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:16.061547    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914-workload-certs\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:32:16.061595 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:16.061559    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914-workload-socket\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:32:16.063433 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:16.063404    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914-istio-token" (OuterVolumeSpecName: "istio-token") pod "aa851bef-4a2c-4fe5-9fe5-3350d9e9b914" (UID: "aa851bef-4a2c-4fe5-9fe5-3350d9e9b914"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:32:16.063683 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:16.063659    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914-kube-api-access-vqg6l" (OuterVolumeSpecName: "kube-api-access-vqg6l") pod "aa851bef-4a2c-4fe5-9fe5-3350d9e9b914" (UID: "aa851bef-4a2c-4fe5-9fe5-3350d9e9b914"). InnerVolumeSpecName "kube-api-access-vqg6l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:32:16.063683 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:16.063674    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "aa851bef-4a2c-4fe5-9fe5-3350d9e9b914" (UID: "aa851bef-4a2c-4fe5-9fe5-3350d9e9b914"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 10:32:16.063844 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:16.063717    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "aa851bef-4a2c-4fe5-9fe5-3350d9e9b914" (UID: "aa851bef-4a2c-4fe5-9fe5-3350d9e9b914"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:32:16.162706 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:16.162668    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914-istio-podinfo\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:32:16.162706 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:16.162701    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914-istio-envoy\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:32:16.162706 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:16.162711    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914-istio-token\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:32:16.162706 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:16.162719    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vqg6l\" (UniqueName: \"kubernetes.io/projected/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914-kube-api-access-vqg6l\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:32:16.163010 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:16.162754    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914-istiod-ca-cert\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:32:16.751102 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:16.751069    2579 generic.go:356] "Generic (PLEG): container finished" podID="aa851bef-4a2c-4fe5-9fe5-3350d9e9b914" containerID="1125d7251c9b581bd0f9381ffd692c4516ca2cd722c2d056f7bafb138ed53bea" exitCode=0
Sep 15 10:32:16.751277 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:16.751124    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2"
Sep 15 10:32:16.751277 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:16.751158    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2" event={"ID":"aa851bef-4a2c-4fe5-9fe5-3350d9e9b914","Type":"ContainerDied","Data":"1125d7251c9b581bd0f9381ffd692c4516ca2cd722c2d056f7bafb138ed53bea"}
Sep 15 10:32:16.751277 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:16.751216    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2" event={"ID":"aa851bef-4a2c-4fe5-9fe5-3350d9e9b914","Type":"ContainerDied","Data":"c0f2385539c8d87b9024be7180426947da6ce79810428344052db20d2c4358bb"}
Sep 15 10:32:16.751277 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:16.751241    2579 scope.go:117] "RemoveContainer" containerID="1125d7251c9b581bd0f9381ffd692c4516ca2cd722c2d056f7bafb138ed53bea"
Sep 15 10:32:16.761523 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:16.761507    2579 scope.go:117] "RemoveContainer" containerID="665d7dfe41f0ac5fee17aee2f053267ce921b6f46ba8bd1857c5f425813f0a26"
Sep 15 10:32:16.770608 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:16.770581    2579 scope.go:117] "RemoveContainer" containerID="1125d7251c9b581bd0f9381ffd692c4516ca2cd722c2d056f7bafb138ed53bea"
Sep 15 10:32:16.770968 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:32:16.770925    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1125d7251c9b581bd0f9381ffd692c4516ca2cd722c2d056f7bafb138ed53bea\": container with ID starting with 1125d7251c9b581bd0f9381ffd692c4516ca2cd722c2d056f7bafb138ed53bea not found: ID does not exist" containerID="1125d7251c9b581bd0f9381ffd692c4516ca2cd722c2d056f7bafb138ed53bea"
Sep 15 10:32:16.771074 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:16.770978    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1125d7251c9b581bd0f9381ffd692c4516ca2cd722c2d056f7bafb138ed53bea"} err="failed to get container status \"1125d7251c9b581bd0f9381ffd692c4516ca2cd722c2d056f7bafb138ed53bea\": rpc error: code = NotFound desc = could not find container \"1125d7251c9b581bd0f9381ffd692c4516ca2cd722c2d056f7bafb138ed53bea\": container with ID starting with 1125d7251c9b581bd0f9381ffd692c4516ca2cd722c2d056f7bafb138ed53bea not found: ID does not exist"
Sep 15 10:32:16.771074 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:16.771002    2579 scope.go:117] "RemoveContainer" containerID="665d7dfe41f0ac5fee17aee2f053267ce921b6f46ba8bd1857c5f425813f0a26"
Sep 15 10:32:16.771431 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:32:16.771373    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"665d7dfe41f0ac5fee17aee2f053267ce921b6f46ba8bd1857c5f425813f0a26\": container with ID starting with 665d7dfe41f0ac5fee17aee2f053267ce921b6f46ba8bd1857c5f425813f0a26 not found: ID does not exist" containerID="665d7dfe41f0ac5fee17aee2f053267ce921b6f46ba8bd1857c5f425813f0a26"
Sep 15 10:32:16.771431 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:16.771407    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"665d7dfe41f0ac5fee17aee2f053267ce921b6f46ba8bd1857c5f425813f0a26"} err="failed to get container status \"665d7dfe41f0ac5fee17aee2f053267ce921b6f46ba8bd1857c5f425813f0a26\": rpc error: code = NotFound desc = could not find container \"665d7dfe41f0ac5fee17aee2f053267ce921b6f46ba8bd1857c5f425813f0a26\": container with ID starting with 665d7dfe41f0ac5fee17aee2f053267ce921b6f46ba8bd1857c5f425813f0a26 not found: ID does not exist"
Sep 15 10:32:16.773896 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:16.773877    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2"]
Sep 15 10:32:16.778302 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:16.778280    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-68c3a296-openshift-default-6b895b9468-ndqw2"]
Sep 15 10:32:17.149879 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:17.149847    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa851bef-4a2c-4fe5-9fe5-3350d9e9b914" path="/var/lib/kubelet/pods/aa851bef-4a2c-4fe5-9fe5-3350d9e9b914/volumes"
Sep 15 10:32:18.645464 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:18.645427    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-7b3aacf5-86d9ff9d-wqrpr"]
Sep 15 10:32:18.645966 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:18.645950    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa851bef-4a2c-4fe5-9fe5-3350d9e9b914" containerName="istio-proxy"
Sep 15 10:32:18.645966 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:18.645967    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa851bef-4a2c-4fe5-9fe5-3350d9e9b914" containerName="istio-proxy"
Sep 15 10:32:18.646045 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:18.645980    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa851bef-4a2c-4fe5-9fe5-3350d9e9b914" containerName="istio-proxy"
Sep 15 10:32:18.646045 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:18.645985    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa851bef-4a2c-4fe5-9fe5-3350d9e9b914" containerName="istio-proxy"
Sep 15 10:32:18.646105 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:18.646086    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa851bef-4a2c-4fe5-9fe5-3350d9e9b914" containerName="istio-proxy"
Sep 15 10:32:18.646105 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:18.646095    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa851bef-4a2c-4fe5-9fe5-3350d9e9b914" containerName="istio-proxy"
Sep 15 10:32:18.651293 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:18.651267    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-7b3aacf5-86d9ff9d-wqrpr"
Sep 15 10:32:18.654236 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:18.654212    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-7b3aacf5-dockercfg-j9m8m\""
Sep 15 10:32:18.654236 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:18.654231    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-7b3aacf5\""
Sep 15 10:32:18.662798 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:18.662770    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-7b3aacf5-86d9ff9d-wqrpr"]
Sep 15 10:32:18.668934 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:18.668906    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-7b3aacf5-7cfcf7dd49-59hrx"]
Sep 15 10:32:18.672618 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:18.672595    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-7b3aacf5-7cfcf7dd49-59hrx"
Sep 15 10:32:18.686052 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:18.686020    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-7b3aacf5-7cfcf7dd49-59hrx"]
Sep 15 10:32:18.687260 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:18.687233    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jj557\" (UniqueName: \"kubernetes.io/projected/6beab128-385f-404b-91cf-667f834dec71-kube-api-access-jj557\") pod \"payload-pre-processing-e2e-derive-7b3aacf5-86d9ff9d-wqrpr\" (UID: \"6beab128-385f-404b-91cf-667f834dec71\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-7b3aacf5-86d9ff9d-wqrpr"
Sep 15 10:32:18.687387 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:18.687322    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6beab128-385f-404b-91cf-667f834dec71-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-7b3aacf5-86d9ff9d-wqrpr\" (UID: \"6beab128-385f-404b-91cf-667f834dec71\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-7b3aacf5-86d9ff9d-wqrpr"
Sep 15 10:32:18.788135 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:18.788097    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jj557\" (UniqueName: \"kubernetes.io/projected/6beab128-385f-404b-91cf-667f834dec71-kube-api-access-jj557\") pod \"payload-pre-processing-e2e-derive-7b3aacf5-86d9ff9d-wqrpr\" (UID: \"6beab128-385f-404b-91cf-667f834dec71\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-7b3aacf5-86d9ff9d-wqrpr"
Sep 15 10:32:18.788135 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:18.788141    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skpml\" (UniqueName: \"kubernetes.io/projected/9ec0c7ce-9214-41b4-939d-b6cc7948eb31-kube-api-access-skpml\") pod \"payload-processing-e2e-derive-7b3aacf5-7cfcf7dd49-59hrx\" (UID: \"9ec0c7ce-9214-41b4-939d-b6cc7948eb31\") " pod="openshift-ingress/payload-processing-e2e-derive-7b3aacf5-7cfcf7dd49-59hrx"
Sep 15 10:32:18.788438 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:18.788175    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ec0c7ce-9214-41b4-939d-b6cc7948eb31-plugins-config-volume\") pod \"payload-processing-e2e-derive-7b3aacf5-7cfcf7dd49-59hrx\" (UID: \"9ec0c7ce-9214-41b4-939d-b6cc7948eb31\") " pod="openshift-ingress/payload-processing-e2e-derive-7b3aacf5-7cfcf7dd49-59hrx"
Sep 15 10:32:18.788438 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:18.788278    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6beab128-385f-404b-91cf-667f834dec71-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-7b3aacf5-86d9ff9d-wqrpr\" (UID: \"6beab128-385f-404b-91cf-667f834dec71\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-7b3aacf5-86d9ff9d-wqrpr"
Sep 15 10:32:18.788985 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:18.788968    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6beab128-385f-404b-91cf-667f834dec71-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-7b3aacf5-86d9ff9d-wqrpr\" (UID: \"6beab128-385f-404b-91cf-667f834dec71\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-7b3aacf5-86d9ff9d-wqrpr"
Sep 15 10:32:18.795997 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:18.795967    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj557\" (UniqueName: \"kubernetes.io/projected/6beab128-385f-404b-91cf-667f834dec71-kube-api-access-jj557\") pod \"payload-pre-processing-e2e-derive-7b3aacf5-86d9ff9d-wqrpr\" (UID: \"6beab128-385f-404b-91cf-667f834dec71\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-7b3aacf5-86d9ff9d-wqrpr"
Sep 15 10:32:18.889474 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:18.889433    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skpml\" (UniqueName: \"kubernetes.io/projected/9ec0c7ce-9214-41b4-939d-b6cc7948eb31-kube-api-access-skpml\") pod \"payload-processing-e2e-derive-7b3aacf5-7cfcf7dd49-59hrx\" (UID: \"9ec0c7ce-9214-41b4-939d-b6cc7948eb31\") " pod="openshift-ingress/payload-processing-e2e-derive-7b3aacf5-7cfcf7dd49-59hrx"
Sep 15 10:32:18.889680 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:18.889492    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ec0c7ce-9214-41b4-939d-b6cc7948eb31-plugins-config-volume\") pod \"payload-processing-e2e-derive-7b3aacf5-7cfcf7dd49-59hrx\" (UID: \"9ec0c7ce-9214-41b4-939d-b6cc7948eb31\") " pod="openshift-ingress/payload-processing-e2e-derive-7b3aacf5-7cfcf7dd49-59hrx"
Sep 15 10:32:18.890234 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:18.890214    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ec0c7ce-9214-41b4-939d-b6cc7948eb31-plugins-config-volume\") pod \"payload-processing-e2e-derive-7b3aacf5-7cfcf7dd49-59hrx\" (UID: \"9ec0c7ce-9214-41b4-939d-b6cc7948eb31\") " pod="openshift-ingress/payload-processing-e2e-derive-7b3aacf5-7cfcf7dd49-59hrx"
Sep 15 10:32:18.899333 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:18.899258    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skpml\" (UniqueName: \"kubernetes.io/projected/9ec0c7ce-9214-41b4-939d-b6cc7948eb31-kube-api-access-skpml\") pod \"payload-processing-e2e-derive-7b3aacf5-7cfcf7dd49-59hrx\" (UID: \"9ec0c7ce-9214-41b4-939d-b6cc7948eb31\") " pod="openshift-ingress/payload-processing-e2e-derive-7b3aacf5-7cfcf7dd49-59hrx"
Sep 15 10:32:18.962520 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:18.962488    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-7b3aacf5-86d9ff9d-wqrpr"
Sep 15 10:32:18.983818 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:18.983789    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-7b3aacf5-7cfcf7dd49-59hrx"
Sep 15 10:32:19.242523 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:19.242499    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-7b3aacf5-86d9ff9d-wqrpr"]
Sep 15 10:32:19.244392 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:32:19.244361    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6beab128_385f_404b_91cf_667f834dec71.slice/crio-d5354b7bff4538caa16043581245baa60765bd814c97c035c57981001e32fc14 WatchSource:0}: Error finding container d5354b7bff4538caa16043581245baa60765bd814c97c035c57981001e32fc14: Status 404 returned error can't find the container with id d5354b7bff4538caa16043581245baa60765bd814c97c035c57981001e32fc14
Sep 15 10:32:19.272769 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:19.272739    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-7b3aacf5-7cfcf7dd49-59hrx"]
Sep 15 10:32:19.283009 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:32:19.282981    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ec0c7ce_9214_41b4_939d_b6cc7948eb31.slice/crio-a4cad733c4658712f36c51df02d353bc3b7054a6852886f57ac0bf763eb84dc6 WatchSource:0}: Error finding container a4cad733c4658712f36c51df02d353bc3b7054a6852886f57ac0bf763eb84dc6: Status 404 returned error can't find the container with id a4cad733c4658712f36c51df02d353bc3b7054a6852886f57ac0bf763eb84dc6
Sep 15 10:32:19.776380 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:19.776328    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-7b3aacf5-86d9ff9d-wqrpr" event={"ID":"6beab128-385f-404b-91cf-667f834dec71","Type":"ContainerStarted","Data":"a74b0d1d0771b34db252b9663db9b17be788f88ccb0fe673197e844e66159eb4"}
Sep 15 10:32:19.776891 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:19.776402    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-7b3aacf5-86d9ff9d-wqrpr"
Sep 15 10:32:19.776891 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:19.776431    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-7b3aacf5-86d9ff9d-wqrpr" event={"ID":"6beab128-385f-404b-91cf-667f834dec71","Type":"ContainerStarted","Data":"d5354b7bff4538caa16043581245baa60765bd814c97c035c57981001e32fc14"}
Sep 15 10:32:19.778050 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:19.778022    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-7b3aacf5-7cfcf7dd49-59hrx" event={"ID":"9ec0c7ce-9214-41b4-939d-b6cc7948eb31","Type":"ContainerStarted","Data":"d62ab24a699700c7528b37c9cd9bb63a7345172d8c65f8d7e0f1318847b6145e"}
Sep 15 10:32:19.778158 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:19.778068    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-7b3aacf5-7cfcf7dd49-59hrx" event={"ID":"9ec0c7ce-9214-41b4-939d-b6cc7948eb31","Type":"ContainerStarted","Data":"a4cad733c4658712f36c51df02d353bc3b7054a6852886f57ac0bf763eb84dc6"}
Sep 15 10:32:19.778158 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:19.778125    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-7b3aacf5-7cfcf7dd49-59hrx"
Sep 15 10:32:19.792083 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:19.792034    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-7b3aacf5-86d9ff9d-wqrpr" podStartSLOduration=1.792018418 podStartE2EDuration="1.792018418s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:32:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:32:19.790177333 +0000 UTC m=+873.186269420" watchObservedRunningTime="2026-09-15 10:32:19.792018418 +0000 UTC m=+873.188110505"
Sep 15 10:32:19.804866 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:19.804810    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-7b3aacf5-7cfcf7dd49-59hrx" podStartSLOduration=1.8047896140000002 podStartE2EDuration="1.804789614s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:32:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:32:19.804403128 +0000 UTC m=+873.200495217" watchObservedRunningTime="2026-09-15 10:32:19.804789614 +0000 UTC m=+873.200881756"
Sep 15 10:32:30.786485 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:30.786453    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-7b3aacf5-7cfcf7dd49-59hrx"
Sep 15 10:32:30.786896 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:30.786522    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-7b3aacf5-86d9ff9d-wqrpr"
Sep 15 10:32:37.887254 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:37.887218    2579 generic.go:356] "Generic (PLEG): container finished" podID="eda5cfdc-1207-4b9c-9810-22c490afde67" containerID="241c7c7c424c7200ce9ba6201c43e7c4cfff149210a84c93de66783f3200c7de" exitCode=0
Sep 15 10:32:37.887661 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:37.887287    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf" event={"ID":"eda5cfdc-1207-4b9c-9810-22c490afde67","Type":"ContainerDied","Data":"241c7c7c424c7200ce9ba6201c43e7c4cfff149210a84c93de66783f3200c7de"}
Sep 15 10:32:37.887704 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:37.887673    2579 scope.go:117] "RemoveContainer" containerID="241c7c7c424c7200ce9ba6201c43e7c4cfff149210a84c93de66783f3200c7de"
Sep 15 10:32:37.888819 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:37.888791    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:32:37.888888 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:37.888857    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:32:37.888929 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:37.888888    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:32:38.894789 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:38.894743    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf" event={"ID":"eda5cfdc-1207-4b9c-9810-22c490afde67","Type":"ContainerStarted","Data":"d38f8512e46b08a37945a9dcab4b335b281e46dcb0fc0ac6913293c61502e7fe"}
Sep 15 10:32:39.593718 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:39.593682    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf"
Sep 15 10:32:39.594788 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:39.594763    2579 patch_prober.go:28] interesting pod/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 15 10:32:39.594896 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:39.594821    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf" podUID="eda5cfdc-1207-4b9c-9810-22c490afde67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 15 10:32:40.594057 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:40.594021    2579 patch_prober.go:28] interesting pod/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 15 10:32:40.594548 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:40.594110    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf" podUID="eda5cfdc-1207-4b9c-9810-22c490afde67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 15 10:32:41.593942 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:41.593902    2579 patch_prober.go:28] interesting pod/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 15 10:32:41.594117 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:41.593987    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf" podUID="eda5cfdc-1207-4b9c-9810-22c490afde67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 15 10:32:42.594582 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:42.594547    2579 patch_prober.go:28] interesting pod/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 15 10:32:42.595021 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:42.594616    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf" podUID="eda5cfdc-1207-4b9c-9810-22c490afde67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 15 10:32:43.594566 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:43.594522    2579 patch_prober.go:28] interesting pod/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 15 10:32:43.594757 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:43.594609    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf" podUID="eda5cfdc-1207-4b9c-9810-22c490afde67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 15 10:32:43.732603 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:43.732556    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf"
Sep 15 10:32:44.058124 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:44.058078    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7b3aacf5-bvfrz"]
Sep 15 10:32:44.061950 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:44.061925    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7b3aacf5-bvfrz"
Sep 15 10:32:44.064328 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:44.064305    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5jrzm\""
Sep 15 10:32:44.068884 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:44.068861    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7b3aacf5-bvfrz"]
Sep 15 10:32:44.152224 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:44.152185    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4919505c-fb51-49c1-986a-5f3196ffd508-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-7b3aacf5-bvfrz\" (UID: \"4919505c-fb51-49c1-986a-5f3196ffd508\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7b3aacf5-bvfrz"
Sep 15 10:32:44.253412 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:44.253370    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4919505c-fb51-49c1-986a-5f3196ffd508-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-7b3aacf5-bvfrz\" (UID: \"4919505c-fb51-49c1-986a-5f3196ffd508\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7b3aacf5-bvfrz"
Sep 15 10:32:44.254091 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:44.254071    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4919505c-fb51-49c1-986a-5f3196ffd508-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-7b3aacf5-bvfrz\" (UID: \"4919505c-fb51-49c1-986a-5f3196ffd508\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7b3aacf5-bvfrz"
Sep 15 10:32:44.375166 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:44.375081    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7b3aacf5-bvfrz"
Sep 15 10:32:44.599089 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:44.599056    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf"
Sep 15 10:32:44.600359 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:44.600334    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf"
Sep 15 10:32:44.654097 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:44.653865    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7b3aacf5-bvfrz"]
Sep 15 10:32:44.945300 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:44.945258    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7b3aacf5-bvfrz" event={"ID":"4919505c-fb51-49c1-986a-5f3196ffd508","Type":"ContainerStarted","Data":"1b6df14edeb9eba1d5c630b89d05a9624ecf7a3a6231101b0dbd88013ecbcf03"}
Sep 15 10:32:44.945462 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:44.945324    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7b3aacf5-bvfrz" event={"ID":"4919505c-fb51-49c1-986a-5f3196ffd508","Type":"ContainerStarted","Data":"57c8bab4f2b07eb39a83b38f8e66487894bf3ab62cbd0b746e615dc4080c3005"}
Sep 15 10:32:44.959864 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:44.959811    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7b3aacf5-bvfrz" podStartSLOduration=0.95978957 podStartE2EDuration="959.78957ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:32:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:32:44.957914876 +0000 UTC m=+898.354006964" watchObservedRunningTime="2026-09-15 10:32:44.95978957 +0000 UTC m=+898.355881669"
Sep 15 10:32:45.953218 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:45.953184    2579 generic.go:356] "Generic (PLEG): container finished" podID="4919505c-fb51-49c1-986a-5f3196ffd508" containerID="1b6df14edeb9eba1d5c630b89d05a9624ecf7a3a6231101b0dbd88013ecbcf03" exitCode=0
Sep 15 10:32:45.953610 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:45.953265    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7b3aacf5-bvfrz" event={"ID":"4919505c-fb51-49c1-986a-5f3196ffd508","Type":"ContainerDied","Data":"1b6df14edeb9eba1d5c630b89d05a9624ecf7a3a6231101b0dbd88013ecbcf03"}
Sep 15 10:32:47.122373 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:47.122344    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7b3aacf5-bvfrz"
Sep 15 10:32:47.182804 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:47.182775    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4919505c-fb51-49c1-986a-5f3196ffd508-maas-api-service-ca\") pod \"4919505c-fb51-49c1-986a-5f3196ffd508\" (UID: \"4919505c-fb51-49c1-986a-5f3196ffd508\") "
Sep 15 10:32:47.183143 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:47.183120    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4919505c-fb51-49c1-986a-5f3196ffd508-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4919505c-fb51-49c1-986a-5f3196ffd508" (UID: "4919505c-fb51-49c1-986a-5f3196ffd508"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:32:47.284157 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:47.284127    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4919505c-fb51-49c1-986a-5f3196ffd508-maas-api-service-ca\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:32:47.966646 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:47.966606    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7b3aacf5-bvfrz" event={"ID":"4919505c-fb51-49c1-986a-5f3196ffd508","Type":"ContainerDied","Data":"57c8bab4f2b07eb39a83b38f8e66487894bf3ab62cbd0b746e615dc4080c3005"}
Sep 15 10:32:47.966646 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:47.966634    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7b3aacf5-bvfrz"
Sep 15 10:32:47.966646 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:47.966653    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="57c8bab4f2b07eb39a83b38f8e66487894bf3ab62cbd0b746e615dc4080c3005"
Sep 15 10:32:56.267622 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:56.267587    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-7b3aacf5-7cfcf7dd49-59hrx"]
Sep 15 10:32:56.268168 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:56.267833    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-7b3aacf5-7cfcf7dd49-59hrx" podUID="9ec0c7ce-9214-41b4-939d-b6cc7948eb31" containerName="payload-processing" containerID="cri-o://d62ab24a699700c7528b37c9cd9bb63a7345172d8c65f8d7e0f1318847b6145e" gracePeriod=30
Sep 15 10:32:56.277054 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:56.277029    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-7b3aacf5-86d9ff9d-wqrpr"]
Sep 15 10:32:56.277243 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:56.277221    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-7b3aacf5-86d9ff9d-wqrpr" podUID="6beab128-385f-404b-91cf-667f834dec71" containerName="payload-pre-processing" containerID="cri-o://a74b0d1d0771b34db252b9663db9b17be788f88ccb0fe673197e844e66159eb4" gracePeriod=30
Sep 15 10:32:56.416209 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:56.416141    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7b3aacf5-bvfrz"]
Sep 15 10:32:56.420515 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:56.420451    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7b3aacf5-bvfrz"]
Sep 15 10:32:56.553593 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:56.553557    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf"]
Sep 15 10:32:56.554053 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:56.554022    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf" podUID="eda5cfdc-1207-4b9c-9810-22c490afde67" containerName="istio-proxy" containerID="cri-o://d38f8512e46b08a37945a9dcab4b335b281e46dcb0fc0ac6913293c61502e7fe" gracePeriod=30
Sep 15 10:32:56.629970 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:56.629931    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-7b3aacf5-7cfcf7dd49-59hrx"
Sep 15 10:32:56.633296 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:56.633275    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-7b3aacf5-86d9ff9d-wqrpr"
Sep 15 10:32:56.677769 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:56.677446    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-skpml\" (UniqueName: \"kubernetes.io/projected/9ec0c7ce-9214-41b4-939d-b6cc7948eb31-kube-api-access-skpml\") pod \"9ec0c7ce-9214-41b4-939d-b6cc7948eb31\" (UID: \"9ec0c7ce-9214-41b4-939d-b6cc7948eb31\") "
Sep 15 10:32:56.677769 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:56.677535    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6beab128-385f-404b-91cf-667f834dec71-plugins-config-volume\") pod \"6beab128-385f-404b-91cf-667f834dec71\" (UID: \"6beab128-385f-404b-91cf-667f834dec71\") "
Sep 15 10:32:56.677769 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:56.677660    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ec0c7ce-9214-41b4-939d-b6cc7948eb31-plugins-config-volume\") pod \"9ec0c7ce-9214-41b4-939d-b6cc7948eb31\" (UID: \"9ec0c7ce-9214-41b4-939d-b6cc7948eb31\") "
Sep 15 10:32:56.677769 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:56.677699    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jj557\" (UniqueName: \"kubernetes.io/projected/6beab128-385f-404b-91cf-667f834dec71-kube-api-access-jj557\") pod \"6beab128-385f-404b-91cf-667f834dec71\" (UID: \"6beab128-385f-404b-91cf-667f834dec71\") "
Sep 15 10:32:56.678407 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:56.678232    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6beab128-385f-404b-91cf-667f834dec71-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6beab128-385f-404b-91cf-667f834dec71" (UID: "6beab128-385f-404b-91cf-667f834dec71"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:32:56.678538 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:56.678500    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6beab128-385f-404b-91cf-667f834dec71-plugins-config-volume\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:32:56.678869 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:56.678831    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ec0c7ce-9214-41b4-939d-b6cc7948eb31-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9ec0c7ce-9214-41b4-939d-b6cc7948eb31" (UID: "9ec0c7ce-9214-41b4-939d-b6cc7948eb31"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:32:56.681486 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:56.681457    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6beab128-385f-404b-91cf-667f834dec71-kube-api-access-jj557" (OuterVolumeSpecName: "kube-api-access-jj557") pod "6beab128-385f-404b-91cf-667f834dec71" (UID: "6beab128-385f-404b-91cf-667f834dec71"). InnerVolumeSpecName "kube-api-access-jj557". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:32:56.681646 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:56.681616    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ec0c7ce-9214-41b4-939d-b6cc7948eb31-kube-api-access-skpml" (OuterVolumeSpecName: "kube-api-access-skpml") pod "9ec0c7ce-9214-41b4-939d-b6cc7948eb31" (UID: "9ec0c7ce-9214-41b4-939d-b6cc7948eb31"). InnerVolumeSpecName "kube-api-access-skpml". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:32:56.779396 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:56.779355    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jj557\" (UniqueName: \"kubernetes.io/projected/6beab128-385f-404b-91cf-667f834dec71-kube-api-access-jj557\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:32:56.779396 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:56.779392    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-skpml\" (UniqueName: \"kubernetes.io/projected/9ec0c7ce-9214-41b4-939d-b6cc7948eb31-kube-api-access-skpml\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:32:56.779396 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:56.779402    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ec0c7ce-9214-41b4-939d-b6cc7948eb31-plugins-config-volume\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:32:57.017232 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:57.017137    2579 generic.go:356] "Generic (PLEG): container finished" podID="9ec0c7ce-9214-41b4-939d-b6cc7948eb31" containerID="d62ab24a699700c7528b37c9cd9bb63a7345172d8c65f8d7e0f1318847b6145e" exitCode=0
Sep 15 10:32:57.017232 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:57.017181    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-7b3aacf5-7cfcf7dd49-59hrx"
Sep 15 10:32:57.017232 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:57.017225    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-7b3aacf5-7cfcf7dd49-59hrx" event={"ID":"9ec0c7ce-9214-41b4-939d-b6cc7948eb31","Type":"ContainerDied","Data":"d62ab24a699700c7528b37c9cd9bb63a7345172d8c65f8d7e0f1318847b6145e"}
Sep 15 10:32:57.017543 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:57.017287    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-7b3aacf5-7cfcf7dd49-59hrx" event={"ID":"9ec0c7ce-9214-41b4-939d-b6cc7948eb31","Type":"ContainerDied","Data":"a4cad733c4658712f36c51df02d353bc3b7054a6852886f57ac0bf763eb84dc6"}
Sep 15 10:32:57.017543 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:57.017316    2579 scope.go:117] "RemoveContainer" containerID="d62ab24a699700c7528b37c9cd9bb63a7345172d8c65f8d7e0f1318847b6145e"
Sep 15 10:32:57.018896 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:57.018872    2579 generic.go:356] "Generic (PLEG): container finished" podID="6beab128-385f-404b-91cf-667f834dec71" containerID="a74b0d1d0771b34db252b9663db9b17be788f88ccb0fe673197e844e66159eb4" exitCode=0
Sep 15 10:32:57.019001 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:57.018914    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-7b3aacf5-86d9ff9d-wqrpr"
Sep 15 10:32:57.019001 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:57.018914    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-7b3aacf5-86d9ff9d-wqrpr" event={"ID":"6beab128-385f-404b-91cf-667f834dec71","Type":"ContainerDied","Data":"a74b0d1d0771b34db252b9663db9b17be788f88ccb0fe673197e844e66159eb4"}
Sep 15 10:32:57.019133 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:57.019006    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-7b3aacf5-86d9ff9d-wqrpr" event={"ID":"6beab128-385f-404b-91cf-667f834dec71","Type":"ContainerDied","Data":"d5354b7bff4538caa16043581245baa60765bd814c97c035c57981001e32fc14"}
Sep 15 10:32:57.027080 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:57.027060    2579 scope.go:117] "RemoveContainer" containerID="d62ab24a699700c7528b37c9cd9bb63a7345172d8c65f8d7e0f1318847b6145e"
Sep 15 10:32:57.027394 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:32:57.027371    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d62ab24a699700c7528b37c9cd9bb63a7345172d8c65f8d7e0f1318847b6145e\": container with ID starting with d62ab24a699700c7528b37c9cd9bb63a7345172d8c65f8d7e0f1318847b6145e not found: ID does not exist" containerID="d62ab24a699700c7528b37c9cd9bb63a7345172d8c65f8d7e0f1318847b6145e"
Sep 15 10:32:57.027510 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:57.027400    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d62ab24a699700c7528b37c9cd9bb63a7345172d8c65f8d7e0f1318847b6145e"} err="failed to get container status \"d62ab24a699700c7528b37c9cd9bb63a7345172d8c65f8d7e0f1318847b6145e\": rpc error: code = NotFound desc = could not find container \"d62ab24a699700c7528b37c9cd9bb63a7345172d8c65f8d7e0f1318847b6145e\": container with ID starting with d62ab24a699700c7528b37c9cd9bb63a7345172d8c65f8d7e0f1318847b6145e not found: ID does not exist"
Sep 15 10:32:57.027510 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:57.027419    2579 scope.go:117] "RemoveContainer" containerID="a74b0d1d0771b34db252b9663db9b17be788f88ccb0fe673197e844e66159eb4"
Sep 15 10:32:57.036134 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:57.036112    2579 scope.go:117] "RemoveContainer" containerID="a74b0d1d0771b34db252b9663db9b17be788f88ccb0fe673197e844e66159eb4"
Sep 15 10:32:57.036435 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:32:57.036412    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a74b0d1d0771b34db252b9663db9b17be788f88ccb0fe673197e844e66159eb4\": container with ID starting with a74b0d1d0771b34db252b9663db9b17be788f88ccb0fe673197e844e66159eb4 not found: ID does not exist" containerID="a74b0d1d0771b34db252b9663db9b17be788f88ccb0fe673197e844e66159eb4"
Sep 15 10:32:57.036509 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:57.036443    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a74b0d1d0771b34db252b9663db9b17be788f88ccb0fe673197e844e66159eb4"} err="failed to get container status \"a74b0d1d0771b34db252b9663db9b17be788f88ccb0fe673197e844e66159eb4\": rpc error: code = NotFound desc = could not find container \"a74b0d1d0771b34db252b9663db9b17be788f88ccb0fe673197e844e66159eb4\": container with ID starting with a74b0d1d0771b34db252b9663db9b17be788f88ccb0fe673197e844e66159eb4 not found: ID does not exist"
Sep 15 10:32:57.044005 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:57.043979    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-7b3aacf5-86d9ff9d-wqrpr"]
Sep 15 10:32:57.048906 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:57.048884    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-7b3aacf5-86d9ff9d-wqrpr"]
Sep 15 10:32:57.058688 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:57.058651    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-7b3aacf5-7cfcf7dd49-59hrx"]
Sep 15 10:32:57.062870 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:57.062838    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-7b3aacf5-7cfcf7dd49-59hrx"]
Sep 15 10:32:57.148913 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:57.148882    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4919505c-fb51-49c1-986a-5f3196ffd508" path="/var/lib/kubelet/pods/4919505c-fb51-49c1-986a-5f3196ffd508/volumes"
Sep 15 10:32:57.149242 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:57.149228    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6beab128-385f-404b-91cf-667f834dec71" path="/var/lib/kubelet/pods/6beab128-385f-404b-91cf-667f834dec71/volumes"
Sep 15 10:32:57.149547 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:57.149535    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ec0c7ce-9214-41b4-939d-b6cc7948eb31" path="/var/lib/kubelet/pods/9ec0c7ce-9214-41b4-939d-b6cc7948eb31/volumes"
Sep 15 10:32:59.602090 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:59.602049    2579 patch_prober.go:28] interesting pod/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 15 10:32:59.602478 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:32:59.602122    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf" podUID="eda5cfdc-1207-4b9c-9810-22c490afde67" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 10:33:01.831673 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:01.831605    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf"
Sep 15 10:33:01.929045 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:01.929004    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eda5cfdc-1207-4b9c-9810-22c490afde67-istio-envoy\") pod \"eda5cfdc-1207-4b9c-9810-22c490afde67\" (UID: \"eda5cfdc-1207-4b9c-9810-22c490afde67\") "
Sep 15 10:33:01.929226 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:01.929078    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eda5cfdc-1207-4b9c-9810-22c490afde67-istiod-ca-cert\") pod \"eda5cfdc-1207-4b9c-9810-22c490afde67\" (UID: \"eda5cfdc-1207-4b9c-9810-22c490afde67\") "
Sep 15 10:33:01.929226 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:01.929102    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eda5cfdc-1207-4b9c-9810-22c490afde67-istio-token\") pod \"eda5cfdc-1207-4b9c-9810-22c490afde67\" (UID: \"eda5cfdc-1207-4b9c-9810-22c490afde67\") "
Sep 15 10:33:01.929226 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:01.929139    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eda5cfdc-1207-4b9c-9810-22c490afde67-workload-certs\") pod \"eda5cfdc-1207-4b9c-9810-22c490afde67\" (UID: \"eda5cfdc-1207-4b9c-9810-22c490afde67\") "
Sep 15 10:33:01.929226 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:01.929164    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eda5cfdc-1207-4b9c-9810-22c490afde67-credential-socket\") pod \"eda5cfdc-1207-4b9c-9810-22c490afde67\" (UID: \"eda5cfdc-1207-4b9c-9810-22c490afde67\") "
Sep 15 10:33:01.929226 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:01.929218    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jp7c8\" (UniqueName: \"kubernetes.io/projected/eda5cfdc-1207-4b9c-9810-22c490afde67-kube-api-access-jp7c8\") pod \"eda5cfdc-1207-4b9c-9810-22c490afde67\" (UID: \"eda5cfdc-1207-4b9c-9810-22c490afde67\") "
Sep 15 10:33:01.929503 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:01.929254    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eda5cfdc-1207-4b9c-9810-22c490afde67-istio-podinfo\") pod \"eda5cfdc-1207-4b9c-9810-22c490afde67\" (UID: \"eda5cfdc-1207-4b9c-9810-22c490afde67\") "
Sep 15 10:33:01.929503 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:01.929282    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eda5cfdc-1207-4b9c-9810-22c490afde67-workload-socket\") pod \"eda5cfdc-1207-4b9c-9810-22c490afde67\" (UID: \"eda5cfdc-1207-4b9c-9810-22c490afde67\") "
Sep 15 10:33:01.929503 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:01.929304    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eda5cfdc-1207-4b9c-9810-22c490afde67-istio-data\") pod \"eda5cfdc-1207-4b9c-9810-22c490afde67\" (UID: \"eda5cfdc-1207-4b9c-9810-22c490afde67\") "
Sep 15 10:33:01.929503 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:01.929438    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eda5cfdc-1207-4b9c-9810-22c490afde67-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "eda5cfdc-1207-4b9c-9810-22c490afde67" (UID: "eda5cfdc-1207-4b9c-9810-22c490afde67"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:33:01.929709 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:01.929519    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eda5cfdc-1207-4b9c-9810-22c490afde67-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "eda5cfdc-1207-4b9c-9810-22c490afde67" (UID: "eda5cfdc-1207-4b9c-9810-22c490afde67"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:33:01.929709 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:01.929663    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eda5cfdc-1207-4b9c-9810-22c490afde67-istio-data" (OuterVolumeSpecName: "istio-data") pod "eda5cfdc-1207-4b9c-9810-22c490afde67" (UID: "eda5cfdc-1207-4b9c-9810-22c490afde67"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:33:01.929709 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:01.929675    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eda5cfdc-1207-4b9c-9810-22c490afde67-workload-certs\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:33:01.929709 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:01.929526    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eda5cfdc-1207-4b9c-9810-22c490afde67-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "eda5cfdc-1207-4b9c-9810-22c490afde67" (UID: "eda5cfdc-1207-4b9c-9810-22c490afde67"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:33:01.929709 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:01.929697    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eda5cfdc-1207-4b9c-9810-22c490afde67-credential-socket\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:33:01.930011 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:01.929710    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eda5cfdc-1207-4b9c-9810-22c490afde67-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "eda5cfdc-1207-4b9c-9810-22c490afde67" (UID: "eda5cfdc-1207-4b9c-9810-22c490afde67"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:33:01.931515 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:01.931485    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eda5cfdc-1207-4b9c-9810-22c490afde67-kube-api-access-jp7c8" (OuterVolumeSpecName: "kube-api-access-jp7c8") pod "eda5cfdc-1207-4b9c-9810-22c490afde67" (UID: "eda5cfdc-1207-4b9c-9810-22c490afde67"). InnerVolumeSpecName "kube-api-access-jp7c8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:33:01.931515 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:01.931504    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eda5cfdc-1207-4b9c-9810-22c490afde67-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "eda5cfdc-1207-4b9c-9810-22c490afde67" (UID: "eda5cfdc-1207-4b9c-9810-22c490afde67"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:33:01.931841 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:01.931826    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eda5cfdc-1207-4b9c-9810-22c490afde67-istio-token" (OuterVolumeSpecName: "istio-token") pod "eda5cfdc-1207-4b9c-9810-22c490afde67" (UID: "eda5cfdc-1207-4b9c-9810-22c490afde67"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:33:01.931841 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:01.931828    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/eda5cfdc-1207-4b9c-9810-22c490afde67-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "eda5cfdc-1207-4b9c-9810-22c490afde67" (UID: "eda5cfdc-1207-4b9c-9810-22c490afde67"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 10:33:02.031114 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:02.031074    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eda5cfdc-1207-4b9c-9810-22c490afde67-istio-token\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:33:02.031114 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:02.031108    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jp7c8\" (UniqueName: \"kubernetes.io/projected/eda5cfdc-1207-4b9c-9810-22c490afde67-kube-api-access-jp7c8\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:33:02.031114 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:02.031119    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eda5cfdc-1207-4b9c-9810-22c490afde67-istio-podinfo\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:33:02.031375 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:02.031128    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eda5cfdc-1207-4b9c-9810-22c490afde67-workload-socket\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:33:02.031375 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:02.031137    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eda5cfdc-1207-4b9c-9810-22c490afde67-istio-data\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:33:02.031375 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:02.031146    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eda5cfdc-1207-4b9c-9810-22c490afde67-istio-envoy\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:33:02.031375 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:02.031153    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eda5cfdc-1207-4b9c-9810-22c490afde67-istiod-ca-cert\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:33:02.056992 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:02.056960    2579 generic.go:356] "Generic (PLEG): container finished" podID="eda5cfdc-1207-4b9c-9810-22c490afde67" containerID="d38f8512e46b08a37945a9dcab4b335b281e46dcb0fc0ac6913293c61502e7fe" exitCode=0
Sep 15 10:33:02.057164 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:02.057022    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf"
Sep 15 10:33:02.057164 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:02.057051    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf" event={"ID":"eda5cfdc-1207-4b9c-9810-22c490afde67","Type":"ContainerDied","Data":"d38f8512e46b08a37945a9dcab4b335b281e46dcb0fc0ac6913293c61502e7fe"}
Sep 15 10:33:02.057164 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:02.057129    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf" event={"ID":"eda5cfdc-1207-4b9c-9810-22c490afde67","Type":"ContainerDied","Data":"92c2d97a40160df5b3a416d1b861fcbc5ef6f1be15c119fa94733a31e7381edf"}
Sep 15 10:33:02.057164 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:02.057153    2579 scope.go:117] "RemoveContainer" containerID="d38f8512e46b08a37945a9dcab4b335b281e46dcb0fc0ac6913293c61502e7fe"
Sep 15 10:33:02.067383 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:02.067360    2579 scope.go:117] "RemoveContainer" containerID="241c7c7c424c7200ce9ba6201c43e7c4cfff149210a84c93de66783f3200c7de"
Sep 15 10:33:02.076230 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:02.076209    2579 scope.go:117] "RemoveContainer" containerID="d38f8512e46b08a37945a9dcab4b335b281e46dcb0fc0ac6913293c61502e7fe"
Sep 15 10:33:02.076549 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:33:02.076528    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d38f8512e46b08a37945a9dcab4b335b281e46dcb0fc0ac6913293c61502e7fe\": container with ID starting with d38f8512e46b08a37945a9dcab4b335b281e46dcb0fc0ac6913293c61502e7fe not found: ID does not exist" containerID="d38f8512e46b08a37945a9dcab4b335b281e46dcb0fc0ac6913293c61502e7fe"
Sep 15 10:33:02.076607 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:02.076559    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d38f8512e46b08a37945a9dcab4b335b281e46dcb0fc0ac6913293c61502e7fe"} err="failed to get container status \"d38f8512e46b08a37945a9dcab4b335b281e46dcb0fc0ac6913293c61502e7fe\": rpc error: code = NotFound desc = could not find container \"d38f8512e46b08a37945a9dcab4b335b281e46dcb0fc0ac6913293c61502e7fe\": container with ID starting with d38f8512e46b08a37945a9dcab4b335b281e46dcb0fc0ac6913293c61502e7fe not found: ID does not exist"
Sep 15 10:33:02.076607 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:02.076577    2579 scope.go:117] "RemoveContainer" containerID="241c7c7c424c7200ce9ba6201c43e7c4cfff149210a84c93de66783f3200c7de"
Sep 15 10:33:02.076928 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:33:02.076906    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"241c7c7c424c7200ce9ba6201c43e7c4cfff149210a84c93de66783f3200c7de\": container with ID starting with 241c7c7c424c7200ce9ba6201c43e7c4cfff149210a84c93de66783f3200c7de not found: ID does not exist" containerID="241c7c7c424c7200ce9ba6201c43e7c4cfff149210a84c93de66783f3200c7de"
Sep 15 10:33:02.077016 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:02.076932    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"241c7c7c424c7200ce9ba6201c43e7c4cfff149210a84c93de66783f3200c7de"} err="failed to get container status \"241c7c7c424c7200ce9ba6201c43e7c4cfff149210a84c93de66783f3200c7de\": rpc error: code = NotFound desc = could not find container \"241c7c7c424c7200ce9ba6201c43e7c4cfff149210a84c93de66783f3200c7de\": container with ID starting with 241c7c7c424c7200ce9ba6201c43e7c4cfff149210a84c93de66783f3200c7de not found: ID does not exist"
Sep 15 10:33:02.080357 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:02.080331    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf"]
Sep 15 10:33:02.083459 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:02.083400    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-7b3aacf5-openshift-default-6b69cdbb8d-2skhf"]
Sep 15 10:33:03.148746 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:03.148698    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eda5cfdc-1207-4b9c-9810-22c490afde67" path="/var/lib/kubelet/pods/eda5cfdc-1207-4b9c-9810-22c490afde67/volumes"
Sep 15 10:33:34.039288 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:34.039257    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-8110bc-ppnvs"]
Sep 15 10:33:34.039691 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:34.039679    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eda5cfdc-1207-4b9c-9810-22c490afde67" containerName="istio-proxy"
Sep 15 10:33:34.039691 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:34.039691    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="eda5cfdc-1207-4b9c-9810-22c490afde67" containerName="istio-proxy"
Sep 15 10:33:34.039790 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:34.039699    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4919505c-fb51-49c1-986a-5f3196ffd508" containerName="revoke-keys"
Sep 15 10:33:34.039790 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:34.039705    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4919505c-fb51-49c1-986a-5f3196ffd508" containerName="revoke-keys"
Sep 15 10:33:34.039790 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:34.039718    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eda5cfdc-1207-4b9c-9810-22c490afde67" containerName="istio-proxy"
Sep 15 10:33:34.039790 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:34.039735    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="eda5cfdc-1207-4b9c-9810-22c490afde67" containerName="istio-proxy"
Sep 15 10:33:34.039790 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:34.039750    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ec0c7ce-9214-41b4-939d-b6cc7948eb31" containerName="payload-processing"
Sep 15 10:33:34.039790 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:34.039755    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ec0c7ce-9214-41b4-939d-b6cc7948eb31" containerName="payload-processing"
Sep 15 10:33:34.039790 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:34.039765    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6beab128-385f-404b-91cf-667f834dec71" containerName="payload-pre-processing"
Sep 15 10:33:34.039790 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:34.039770    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6beab128-385f-404b-91cf-667f834dec71" containerName="payload-pre-processing"
Sep 15 10:33:34.040029 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:34.039830    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4919505c-fb51-49c1-986a-5f3196ffd508" containerName="revoke-keys"
Sep 15 10:33:34.040029 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:34.039837    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6beab128-385f-404b-91cf-667f834dec71" containerName="payload-pre-processing"
Sep 15 10:33:34.040029 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:34.039847    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="eda5cfdc-1207-4b9c-9810-22c490afde67" containerName="istio-proxy"
Sep 15 10:33:34.040029 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:34.039854    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="eda5cfdc-1207-4b9c-9810-22c490afde67" containerName="istio-proxy"
Sep 15 10:33:34.040029 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:34.039862    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ec0c7ce-9214-41b4-939d-b6cc7948eb31" containerName="payload-processing"
Sep 15 10:33:34.042979 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:34.042960    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-8110bc-ppnvs"
Sep 15 10:33:34.045351 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:34.045331    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5jrzm\""
Sep 15 10:33:34.049681 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:34.049656    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-8110bc-ppnvs"]
Sep 15 10:33:34.137440 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:34.137407    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac5a29a3-ea7d-41db-b133-953079b14f28-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-8110bc-ppnvs\" (UID: \"ac5a29a3-ea7d-41db-b133-953079b14f28\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-8110bc-ppnvs"
Sep 15 10:33:34.238219 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:34.238181    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac5a29a3-ea7d-41db-b133-953079b14f28-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-8110bc-ppnvs\" (UID: \"ac5a29a3-ea7d-41db-b133-953079b14f28\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-8110bc-ppnvs"
Sep 15 10:33:34.238964 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:34.238942    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac5a29a3-ea7d-41db-b133-953079b14f28-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-8110bc-ppnvs\" (UID: \"ac5a29a3-ea7d-41db-b133-953079b14f28\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-8110bc-ppnvs"
Sep 15 10:33:34.354772 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:34.354664    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-8110bc-ppnvs"
Sep 15 10:33:34.629811 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:34.629785    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-8110bc-ppnvs"]
Sep 15 10:33:34.631969 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:33:34.631941    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac5a29a3_ea7d_41db_b133_953079b14f28.slice/crio-79bb932694f1e3e7432683191ac3480240efead5455a5a69de4ad49fbb8c18ab WatchSource:0}: Error finding container 79bb932694f1e3e7432683191ac3480240efead5455a5a69de4ad49fbb8c18ab: Status 404 returned error can't find the container with id 79bb932694f1e3e7432683191ac3480240efead5455a5a69de4ad49fbb8c18ab
Sep 15 10:33:35.252138 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:35.252032    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-8110bc-ppnvs" event={"ID":"ac5a29a3-ea7d-41db-b133-953079b14f28","Type":"ContainerStarted","Data":"ecd6f41f8ce097132a669c327b844b5978350290ee8a1b43328bbe4eeb3737a1"}
Sep 15 10:33:35.252778 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:35.252635    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-8110bc-ppnvs" event={"ID":"ac5a29a3-ea7d-41db-b133-953079b14f28","Type":"ContainerStarted","Data":"79bb932694f1e3e7432683191ac3480240efead5455a5a69de4ad49fbb8c18ab"}
Sep 15 10:33:35.268124 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:35.268074    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-8110bc-ppnvs" podStartSLOduration=1.268055889 podStartE2EDuration="1.268055889s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:33:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:33:35.267319989 +0000 UTC m=+948.663412075" watchObservedRunningTime="2026-09-15 10:33:35.268055889 +0000 UTC m=+948.664147977"
Sep 15 10:33:36.259297 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:36.259265    2579 generic.go:356] "Generic (PLEG): container finished" podID="ac5a29a3-ea7d-41db-b133-953079b14f28" containerID="ecd6f41f8ce097132a669c327b844b5978350290ee8a1b43328bbe4eeb3737a1" exitCode=0
Sep 15 10:33:36.259680 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:36.259357    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-8110bc-ppnvs" event={"ID":"ac5a29a3-ea7d-41db-b133-953079b14f28","Type":"ContainerDied","Data":"ecd6f41f8ce097132a669c327b844b5978350290ee8a1b43328bbe4eeb3737a1"}
Sep 15 10:33:37.409154 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:37.409130    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-8110bc-ppnvs"
Sep 15 10:33:37.467614 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:37.467576    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac5a29a3-ea7d-41db-b133-953079b14f28-maas-api-service-ca\") pod \"ac5a29a3-ea7d-41db-b133-953079b14f28\" (UID: \"ac5a29a3-ea7d-41db-b133-953079b14f28\") "
Sep 15 10:33:37.467967 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:37.467943    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac5a29a3-ea7d-41db-b133-953079b14f28-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ac5a29a3-ea7d-41db-b133-953079b14f28" (UID: "ac5a29a3-ea7d-41db-b133-953079b14f28"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:33:37.568710 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:37.568678    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac5a29a3-ea7d-41db-b133-953079b14f28-maas-api-service-ca\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:33:38.271547 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:38.271515    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-8110bc-ppnvs"
Sep 15 10:33:38.271716 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:38.271564    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-8110bc-ppnvs" event={"ID":"ac5a29a3-ea7d-41db-b133-953079b14f28","Type":"ContainerDied","Data":"79bb932694f1e3e7432683191ac3480240efead5455a5a69de4ad49fbb8c18ab"}
Sep 15 10:33:38.271716 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:38.271615    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="79bb932694f1e3e7432683191ac3480240efead5455a5a69de4ad49fbb8c18ab"
Sep 15 10:33:44.623790 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:44.623699    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-8110bc-ppnvs"]
Sep 15 10:33:44.626127 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:44.626097    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-8110bc-ppnvs"]
Sep 15 10:33:45.150627 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:33:45.150589    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac5a29a3-ea7d-41db-b133-953079b14f28" path="/var/lib/kubelet/pods/ac5a29a3-ea7d-41db-b133-953079b14f28/volumes"
Sep 15 10:34:27.579777 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:27.579740    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr"]
Sep 15 10:34:27.580397 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:27.580376    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac5a29a3-ea7d-41db-b133-953079b14f28" containerName="revoke-keys"
Sep 15 10:34:27.580467 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:27.580401    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac5a29a3-ea7d-41db-b133-953079b14f28" containerName="revoke-keys"
Sep 15 10:34:27.580529 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:27.580518    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac5a29a3-ea7d-41db-b133-953079b14f28" containerName="revoke-keys"
Sep 15 10:34:27.583800 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:27.583783    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr"
Sep 15 10:34:27.586135 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:27.586114    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-aeb4e3-openshift-default-dockercfg-bn9gd\""
Sep 15 10:34:27.595384 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:27.595359    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr"]
Sep 15 10:34:27.662154 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:27.662122    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6-istio-podinfo\") pod \"e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr\" (UID: \"8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6\") " pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr"
Sep 15 10:34:27.662333 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:27.662163    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6-workload-certs\") pod \"e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr\" (UID: \"8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6\") " pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr"
Sep 15 10:34:27.662333 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:27.662186    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6-istio-data\") pod \"e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr\" (UID: \"8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6\") " pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr"
Sep 15 10:34:27.662333 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:27.662314    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6-istio-token\") pod \"e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr\" (UID: \"8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6\") " pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr"
Sep 15 10:34:27.662455 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:27.662380    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6-istiod-ca-cert\") pod \"e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr\" (UID: \"8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6\") " pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr"
Sep 15 10:34:27.662492 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:27.662465    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6-workload-socket\") pod \"e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr\" (UID: \"8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6\") " pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr"
Sep 15 10:34:27.662531 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:27.662492    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fk2l9\" (UniqueName: \"kubernetes.io/projected/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6-kube-api-access-fk2l9\") pod \"e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr\" (UID: \"8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6\") " pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr"
Sep 15 10:34:27.662531 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:27.662523    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6-istio-envoy\") pod \"e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr\" (UID: \"8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6\") " pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr"
Sep 15 10:34:27.662615 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:27.662549    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6-credential-socket\") pod \"e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr\" (UID: \"8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6\") " pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr"
Sep 15 10:34:27.763632 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:27.763589    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6-workload-socket\") pod \"e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr\" (UID: \"8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6\") " pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr"
Sep 15 10:34:27.763632 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:27.763630    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fk2l9\" (UniqueName: \"kubernetes.io/projected/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6-kube-api-access-fk2l9\") pod \"e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr\" (UID: \"8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6\") " pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr"
Sep 15 10:34:27.763903 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:27.763648    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6-istio-envoy\") pod \"e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr\" (UID: \"8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6\") " pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr"
Sep 15 10:34:27.763903 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:27.763667    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6-credential-socket\") pod \"e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr\" (UID: \"8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6\") " pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr"
Sep 15 10:34:27.764022 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:27.763901    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6-istio-podinfo\") pod \"e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr\" (UID: \"8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6\") " pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr"
Sep 15 10:34:27.764022 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:27.763969    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6-workload-certs\") pod \"e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr\" (UID: \"8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6\") " pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr"
Sep 15 10:34:27.764022 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:27.764013    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6-istio-data\") pod \"e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr\" (UID: \"8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6\") " pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr"
Sep 15 10:34:27.764177 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:27.764079    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6-istio-token\") pod \"e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr\" (UID: \"8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6\") " pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr"
Sep 15 10:34:27.764177 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:27.764135    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6-workload-socket\") pod \"e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr\" (UID: \"8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6\") " pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr"
Sep 15 10:34:27.764177 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:27.764140    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6-istiod-ca-cert\") pod \"e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr\" (UID: \"8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6\") " pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr"
Sep 15 10:34:27.764177 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:27.764168    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6-credential-socket\") pod \"e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr\" (UID: \"8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6\") " pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr"
Sep 15 10:34:27.764414 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:27.764327    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6-workload-certs\") pod \"e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr\" (UID: \"8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6\") " pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr"
Sep 15 10:34:27.764475 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:27.764413    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6-istio-data\") pod \"e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr\" (UID: \"8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6\") " pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr"
Sep 15 10:34:27.764826 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:27.764805    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6-istiod-ca-cert\") pod \"e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr\" (UID: \"8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6\") " pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr"
Sep 15 10:34:27.766432 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:27.766415    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6-istio-envoy\") pod \"e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr\" (UID: \"8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6\") " pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr"
Sep 15 10:34:27.766637 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:27.766616    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6-istio-podinfo\") pod \"e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr\" (UID: \"8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6\") " pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr"
Sep 15 10:34:27.771868 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:27.771840    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fk2l9\" (UniqueName: \"kubernetes.io/projected/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6-kube-api-access-fk2l9\") pod \"e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr\" (UID: \"8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6\") " pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr"
Sep 15 10:34:27.771868 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:27.771852    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6-istio-token\") pod \"e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr\" (UID: \"8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6\") " pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr"
Sep 15 10:34:27.895868 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:27.895779    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr"
Sep 15 10:34:28.187094 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:28.187069    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr"]
Sep 15 10:34:28.188691 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:34:28.188663    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d8cf972_e6e2_4ea7_bed8_6821f1cc4ec6.slice/crio-82ac6cd5e2339f7d136e311bad2d8b698f61427f26698266b36f2d60fb24e140 WatchSource:0}: Error finding container 82ac6cd5e2339f7d136e311bad2d8b698f61427f26698266b36f2d60fb24e140: Status 404 returned error can't find the container with id 82ac6cd5e2339f7d136e311bad2d8b698f61427f26698266b36f2d60fb24e140
Sep 15 10:34:28.191365 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:28.191333    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:34:28.191438 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:28.191402    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:34:28.191438 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:28.191430    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:34:28.558596 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:28.558561    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr" event={"ID":"8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6","Type":"ContainerStarted","Data":"4970423dbefd31deda95680e947262e1a10320885ea0a5449ea8ea9298fda484"}
Sep 15 10:34:28.558832 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:28.558625    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr" event={"ID":"8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6","Type":"ContainerStarted","Data":"82ac6cd5e2339f7d136e311bad2d8b698f61427f26698266b36f2d60fb24e140"}
Sep 15 10:34:28.578516 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:28.578452    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr" podStartSLOduration=1.578435742 podStartE2EDuration="1.578435742s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:34:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:34:28.576863686 +0000 UTC m=+1001.972955802" watchObservedRunningTime="2026-09-15 10:34:28.578435742 +0000 UTC m=+1001.974527829"
Sep 15 10:34:28.896916 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:28.896821    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr"
Sep 15 10:34:29.902626 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:29.902588    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr"
Sep 15 10:34:30.569641 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:30.569612    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr"
Sep 15 10:34:30.570581 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:30.570564    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr"
Sep 15 10:34:31.943853 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:31.943819    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc"]
Sep 15 10:34:31.948114 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:31.948085    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc"
Sep 15 10:34:31.950396 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:31.950343    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-8f3975b3-openshift-default-dockercfg-slbgw\""
Sep 15 10:34:31.959527 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:31.959503    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc"]
Sep 15 10:34:32.006248 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:32.006218    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cceee774-5cd9-4474-80a7-80a1bd112976-workload-socket\") pod \"e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc\" (UID: \"cceee774-5cd9-4474-80a7-80a1bd112976\") " pod="openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc"
Sep 15 10:34:32.006407 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:32.006254    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cceee774-5cd9-4474-80a7-80a1bd112976-istio-podinfo\") pod \"e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc\" (UID: \"cceee774-5cd9-4474-80a7-80a1bd112976\") " pod="openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc"
Sep 15 10:34:32.006407 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:32.006275    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbdkd\" (UniqueName: \"kubernetes.io/projected/cceee774-5cd9-4474-80a7-80a1bd112976-kube-api-access-jbdkd\") pod \"e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc\" (UID: \"cceee774-5cd9-4474-80a7-80a1bd112976\") " pod="openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc"
Sep 15 10:34:32.006407 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:32.006380    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cceee774-5cd9-4474-80a7-80a1bd112976-credential-socket\") pod \"e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc\" (UID: \"cceee774-5cd9-4474-80a7-80a1bd112976\") " pod="openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc"
Sep 15 10:34:32.006515 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:32.006426    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cceee774-5cd9-4474-80a7-80a1bd112976-istiod-ca-cert\") pod \"e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc\" (UID: \"cceee774-5cd9-4474-80a7-80a1bd112976\") " pod="openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc"
Sep 15 10:34:32.006515 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:32.006501    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cceee774-5cd9-4474-80a7-80a1bd112976-istio-envoy\") pod \"e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc\" (UID: \"cceee774-5cd9-4474-80a7-80a1bd112976\") " pod="openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc"
Sep 15 10:34:32.006583 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:32.006545    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cceee774-5cd9-4474-80a7-80a1bd112976-istio-token\") pod \"e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc\" (UID: \"cceee774-5cd9-4474-80a7-80a1bd112976\") " pod="openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc"
Sep 15 10:34:32.006617 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:32.006583    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cceee774-5cd9-4474-80a7-80a1bd112976-istio-data\") pod \"e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc\" (UID: \"cceee774-5cd9-4474-80a7-80a1bd112976\") " pod="openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc"
Sep 15 10:34:32.006651 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:32.006635    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cceee774-5cd9-4474-80a7-80a1bd112976-workload-certs\") pod \"e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc\" (UID: \"cceee774-5cd9-4474-80a7-80a1bd112976\") " pod="openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc"
Sep 15 10:34:32.107848 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:32.107811    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cceee774-5cd9-4474-80a7-80a1bd112976-credential-socket\") pod \"e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc\" (UID: \"cceee774-5cd9-4474-80a7-80a1bd112976\") " pod="openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc"
Sep 15 10:34:32.108016 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:32.107854    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cceee774-5cd9-4474-80a7-80a1bd112976-istiod-ca-cert\") pod \"e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc\" (UID: \"cceee774-5cd9-4474-80a7-80a1bd112976\") " pod="openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc"
Sep 15 10:34:32.108016 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:32.107892    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cceee774-5cd9-4474-80a7-80a1bd112976-istio-envoy\") pod \"e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc\" (UID: \"cceee774-5cd9-4474-80a7-80a1bd112976\") " pod="openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc"
Sep 15 10:34:32.108016 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:32.107943    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cceee774-5cd9-4474-80a7-80a1bd112976-istio-token\") pod \"e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc\" (UID: \"cceee774-5cd9-4474-80a7-80a1bd112976\") " pod="openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc"
Sep 15 10:34:32.108016 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:32.107984    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cceee774-5cd9-4474-80a7-80a1bd112976-istio-data\") pod \"e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc\" (UID: \"cceee774-5cd9-4474-80a7-80a1bd112976\") " pod="openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc"
Sep 15 10:34:32.108231 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:32.108043    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cceee774-5cd9-4474-80a7-80a1bd112976-workload-certs\") pod \"e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc\" (UID: \"cceee774-5cd9-4474-80a7-80a1bd112976\") " pod="openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc"
Sep 15 10:34:32.108231 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:32.108105    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cceee774-5cd9-4474-80a7-80a1bd112976-workload-socket\") pod \"e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc\" (UID: \"cceee774-5cd9-4474-80a7-80a1bd112976\") " pod="openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc"
Sep 15 10:34:32.108231 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:32.108139    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cceee774-5cd9-4474-80a7-80a1bd112976-istio-podinfo\") pod \"e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc\" (UID: \"cceee774-5cd9-4474-80a7-80a1bd112976\") " pod="openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc"
Sep 15 10:34:32.108231 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:32.108172    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbdkd\" (UniqueName: \"kubernetes.io/projected/cceee774-5cd9-4474-80a7-80a1bd112976-kube-api-access-jbdkd\") pod \"e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc\" (UID: \"cceee774-5cd9-4474-80a7-80a1bd112976\") " pod="openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc"
Sep 15 10:34:32.108437 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:32.108269    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cceee774-5cd9-4474-80a7-80a1bd112976-credential-socket\") pod \"e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc\" (UID: \"cceee774-5cd9-4474-80a7-80a1bd112976\") " pod="openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc"
Sep 15 10:34:32.108570 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:32.108544    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cceee774-5cd9-4474-80a7-80a1bd112976-istio-data\") pod \"e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc\" (UID: \"cceee774-5cd9-4474-80a7-80a1bd112976\") " pod="openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc"
Sep 15 10:34:32.108841 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:32.108810    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cceee774-5cd9-4474-80a7-80a1bd112976-istiod-ca-cert\") pod \"e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc\" (UID: \"cceee774-5cd9-4474-80a7-80a1bd112976\") " pod="openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc"
Sep 15 10:34:32.108940 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:32.108848    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cceee774-5cd9-4474-80a7-80a1bd112976-workload-certs\") pod \"e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc\" (UID: \"cceee774-5cd9-4474-80a7-80a1bd112976\") " pod="openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc"
Sep 15 10:34:32.108940 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:32.108905    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cceee774-5cd9-4474-80a7-80a1bd112976-workload-socket\") pod \"e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc\" (UID: \"cceee774-5cd9-4474-80a7-80a1bd112976\") " pod="openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc"
Sep 15 10:34:32.110794 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:32.110770    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cceee774-5cd9-4474-80a7-80a1bd112976-istio-envoy\") pod \"e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc\" (UID: \"cceee774-5cd9-4474-80a7-80a1bd112976\") " pod="openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc"
Sep 15 10:34:32.110898 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:32.110813    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cceee774-5cd9-4474-80a7-80a1bd112976-istio-podinfo\") pod \"e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc\" (UID: \"cceee774-5cd9-4474-80a7-80a1bd112976\") " pod="openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc"
Sep 15 10:34:32.115962 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:32.115942    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cceee774-5cd9-4474-80a7-80a1bd112976-istio-token\") pod \"e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc\" (UID: \"cceee774-5cd9-4474-80a7-80a1bd112976\") " pod="openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc"
Sep 15 10:34:32.116131 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:32.116111    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbdkd\" (UniqueName: \"kubernetes.io/projected/cceee774-5cd9-4474-80a7-80a1bd112976-kube-api-access-jbdkd\") pod \"e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc\" (UID: \"cceee774-5cd9-4474-80a7-80a1bd112976\") " pod="openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc"
Sep 15 10:34:32.261203 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:32.261108    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc"
Sep 15 10:34:32.593787 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:32.593757    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc"]
Sep 15 10:34:32.595157 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:34:32.595119    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcceee774_5cd9_4474_80a7_80a1bd112976.slice/crio-327e77522b3ca55c90c09af04b56f0894839a14da7c96465385064dbcdead0dd WatchSource:0}: Error finding container 327e77522b3ca55c90c09af04b56f0894839a14da7c96465385064dbcdead0dd: Status 404 returned error can't find the container with id 327e77522b3ca55c90c09af04b56f0894839a14da7c96465385064dbcdead0dd
Sep 15 10:34:32.597818 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:32.597768    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:34:32.597919 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:32.597861    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:34:32.597919 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:32.597907    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:34:33.594158 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:33.594122    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc" event={"ID":"cceee774-5cd9-4474-80a7-80a1bd112976","Type":"ContainerStarted","Data":"e225889afc91a512b41d727abab1ad20814af75fbf02bbfbd68002ad651c0592"}
Sep 15 10:34:33.594520 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:33.594198    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc" event={"ID":"cceee774-5cd9-4474-80a7-80a1bd112976","Type":"ContainerStarted","Data":"327e77522b3ca55c90c09af04b56f0894839a14da7c96465385064dbcdead0dd"}
Sep 15 10:34:33.617756 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:33.617685    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc" podStartSLOduration=2.617668955 podStartE2EDuration="2.617668955s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:34:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:34:33.615696669 +0000 UTC m=+1007.011788758" watchObservedRunningTime="2026-09-15 10:34:33.617668955 +0000 UTC m=+1007.013761042"
Sep 15 10:34:34.261777 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:34.261741    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc"
Sep 15 10:34:34.266660 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:34.266634    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc"
Sep 15 10:34:34.601506 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:34.601472    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc"
Sep 15 10:34:34.602436 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:34.602413    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc"
Sep 15 10:34:34.619846 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:34.619807    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-aeb4e3-57f44d6497-fq85g"]
Sep 15 10:34:34.623855 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:34.623825    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-aeb4e3-57f44d6497-fq85g"
Sep 15 10:34:34.626133 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:34.626109    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-aeb4e3-dockercfg-pwmj6\""
Sep 15 10:34:34.626280 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:34.626264    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-aeb4e3\""
Sep 15 10:34:34.636500 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:34.636449    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-aeb4e3-57f44d6497-fq85g"]
Sep 15 10:34:34.735151 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:34.735113    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wl5c5\" (UniqueName: \"kubernetes.io/projected/51a14207-50fd-4912-bae6-0b4fb55f3efb-kube-api-access-wl5c5\") pod \"payload-processing-e2e-explicit-aeb4e3-57f44d6497-fq85g\" (UID: \"51a14207-50fd-4912-bae6-0b4fb55f3efb\") " pod="openshift-ingress/payload-processing-e2e-explicit-aeb4e3-57f44d6497-fq85g"
Sep 15 10:34:34.735311 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:34.735248    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51a14207-50fd-4912-bae6-0b4fb55f3efb-plugins-config-volume\") pod \"payload-processing-e2e-explicit-aeb4e3-57f44d6497-fq85g\" (UID: \"51a14207-50fd-4912-bae6-0b4fb55f3efb\") " pod="openshift-ingress/payload-processing-e2e-explicit-aeb4e3-57f44d6497-fq85g"
Sep 15 10:34:34.836352 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:34.836317    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51a14207-50fd-4912-bae6-0b4fb55f3efb-plugins-config-volume\") pod \"payload-processing-e2e-explicit-aeb4e3-57f44d6497-fq85g\" (UID: \"51a14207-50fd-4912-bae6-0b4fb55f3efb\") " pod="openshift-ingress/payload-processing-e2e-explicit-aeb4e3-57f44d6497-fq85g"
Sep 15 10:34:34.836551 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:34.836407    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wl5c5\" (UniqueName: \"kubernetes.io/projected/51a14207-50fd-4912-bae6-0b4fb55f3efb-kube-api-access-wl5c5\") pod \"payload-processing-e2e-explicit-aeb4e3-57f44d6497-fq85g\" (UID: \"51a14207-50fd-4912-bae6-0b4fb55f3efb\") " pod="openshift-ingress/payload-processing-e2e-explicit-aeb4e3-57f44d6497-fq85g"
Sep 15 10:34:34.837520 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:34.837491    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51a14207-50fd-4912-bae6-0b4fb55f3efb-plugins-config-volume\") pod \"payload-processing-e2e-explicit-aeb4e3-57f44d6497-fq85g\" (UID: \"51a14207-50fd-4912-bae6-0b4fb55f3efb\") " pod="openshift-ingress/payload-processing-e2e-explicit-aeb4e3-57f44d6497-fq85g"
Sep 15 10:34:34.847520 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:34.847487    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wl5c5\" (UniqueName: \"kubernetes.io/projected/51a14207-50fd-4912-bae6-0b4fb55f3efb-kube-api-access-wl5c5\") pod \"payload-processing-e2e-explicit-aeb4e3-57f44d6497-fq85g\" (UID: \"51a14207-50fd-4912-bae6-0b4fb55f3efb\") " pod="openshift-ingress/payload-processing-e2e-explicit-aeb4e3-57f44d6497-fq85g"
Sep 15 10:34:34.936417 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:34.936321    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-aeb4e3-57f44d6497-fq85g"
Sep 15 10:34:35.207088 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:35.207059    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-aeb4e3-57f44d6497-fq85g"]
Sep 15 10:34:35.208695 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:34:35.208668    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51a14207_50fd_4912_bae6_0b4fb55f3efb.slice/crio-f51ed0dfdcb81401d85864ce528411ba90da8e198994b15180eda0d87a02e062 WatchSource:0}: Error finding container f51ed0dfdcb81401d85864ce528411ba90da8e198994b15180eda0d87a02e062: Status 404 returned error can't find the container with id f51ed0dfdcb81401d85864ce528411ba90da8e198994b15180eda0d87a02e062
Sep 15 10:34:35.608704 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:35.608661    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-aeb4e3-57f44d6497-fq85g" event={"ID":"51a14207-50fd-4912-bae6-0b4fb55f3efb","Type":"ContainerStarted","Data":"07a887dc1834adc05b1462cd317978a30f0202c4eaaa4e57c9a53ada53c68b39"}
Sep 15 10:34:35.609356 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:35.608743    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-aeb4e3-57f44d6497-fq85g" event={"ID":"51a14207-50fd-4912-bae6-0b4fb55f3efb","Type":"ContainerStarted","Data":"f51ed0dfdcb81401d85864ce528411ba90da8e198994b15180eda0d87a02e062"}
Sep 15 10:34:35.609356 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:35.609008    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-aeb4e3-57f44d6497-fq85g"
Sep 15 10:34:35.627059 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:35.627010    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-aeb4e3-57f44d6497-fq85g" podStartSLOduration=1.6269919000000002 podStartE2EDuration="1.6269919s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:34:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:34:35.624290151 +0000 UTC m=+1009.020382241" watchObservedRunningTime="2026-09-15 10:34:35.6269919 +0000 UTC m=+1009.023083987"
Sep 15 10:34:46.620353 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:34:46.620316    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-aeb4e3-57f44d6497-fq85g"
Sep 15 10:35:00.793752 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:00.793695    2579 generic.go:356] "Generic (PLEG): container finished" podID="cceee774-5cd9-4474-80a7-80a1bd112976" containerID="e225889afc91a512b41d727abab1ad20814af75fbf02bbfbd68002ad651c0592" exitCode=0
Sep 15 10:35:00.796163 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:00.793766    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc" event={"ID":"cceee774-5cd9-4474-80a7-80a1bd112976","Type":"ContainerDied","Data":"e225889afc91a512b41d727abab1ad20814af75fbf02bbfbd68002ad651c0592"}
Sep 15 10:35:00.796163 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:00.794297    2579 scope.go:117] "RemoveContainer" containerID="e225889afc91a512b41d727abab1ad20814af75fbf02bbfbd68002ad651c0592"
Sep 15 10:35:00.796163 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:00.795510    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:35:00.796163 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:00.795584    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:35:00.796163 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:00.795612    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:35:00.811466 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:00.811170    2579 patch_prober.go:28] interesting pod/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": read tcp 10.132.0.2:55200->10.132.0.68:15021: read: connection reset by peer" start-of-body=
Sep 15 10:35:00.811466 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:00.811227    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr" podUID="8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": read tcp 10.132.0.2:55200->10.132.0.68:15021: read: connection reset by peer"
Sep 15 10:35:00.845150 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:35:00.845105    2579 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/system.slice/system-systemd\\\\x2dcoredump.slice/systemd-coredump@9-15730-0.service\": RecentStats: unable to find data in memory cache]"
Sep 15 10:35:01.806668 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:01.806624    2579 generic.go:356] "Generic (PLEG): container finished" podID="8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6" containerID="4970423dbefd31deda95680e947262e1a10320885ea0a5449ea8ea9298fda484" exitCode=0
Sep 15 10:35:01.807184 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:01.806764    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr" event={"ID":"8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6","Type":"ContainerDied","Data":"4970423dbefd31deda95680e947262e1a10320885ea0a5449ea8ea9298fda484"}
Sep 15 10:35:01.807350 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:01.807331    2579 scope.go:117] "RemoveContainer" containerID="4970423dbefd31deda95680e947262e1a10320885ea0a5449ea8ea9298fda484"
Sep 15 10:35:01.809152 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:01.809109    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:35:01.809261 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:01.809207    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:35:01.809322 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:01.809256    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:35:01.830415 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:01.830288    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc" event={"ID":"cceee774-5cd9-4474-80a7-80a1bd112976","Type":"ContainerStarted","Data":"6165d2f579287aaa310f99945a0061ad48a018bebf7ce372eb72ac908ddee851"}
Sep 15 10:35:02.261716 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:02.261613    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc"
Sep 15 10:35:02.263016 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:02.262994    2579 patch_prober.go:28] interesting pod/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 15 10:35:02.263081 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:02.263048    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc" podUID="cceee774-5cd9-4474-80a7-80a1bd112976" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 15 10:35:02.843361 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:02.843318    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr" event={"ID":"8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6","Type":"ContainerStarted","Data":"ed84db5ea85cbcc60a3a65dd7e39738dad75b8c4fc7cc415de16ee07fe1718cb"}
Sep 15 10:35:02.896367 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:02.896332    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr"
Sep 15 10:35:02.896633 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:02.896609    2579 patch_prober.go:28] interesting pod/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Sep 15 10:35:02.896683 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:02.896667    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr" podUID="8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Sep 15 10:35:03.261501 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:03.261408    2579 patch_prober.go:28] interesting pod/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 15 10:35:03.261501 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:03.261477    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc" podUID="cceee774-5cd9-4474-80a7-80a1bd112976" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 15 10:35:03.896418 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:03.896384    2579 patch_prober.go:28] interesting pod/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Sep 15 10:35:03.896850 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:03.896437    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr" podUID="8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Sep 15 10:35:04.261551 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:04.261466    2579 patch_prober.go:28] interesting pod/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 15 10:35:04.261698 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:04.261550    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc" podUID="cceee774-5cd9-4474-80a7-80a1bd112976" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 15 10:35:04.601826 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:04.601775    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc"
Sep 15 10:35:04.896673 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:04.896579    2579 patch_prober.go:28] interesting pod/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Sep 15 10:35:04.897178 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:04.896662    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr" podUID="8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Sep 15 10:35:05.262004 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:05.261912    2579 patch_prober.go:28] interesting pod/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 15 10:35:05.262004 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:05.261965    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc" podUID="cceee774-5cd9-4474-80a7-80a1bd112976" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 15 10:35:05.897555 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:05.897099    2579 patch_prober.go:28] interesting pod/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Sep 15 10:35:05.897555 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:05.897177    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr" podUID="8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Sep 15 10:35:06.262059 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:06.261970    2579 patch_prober.go:28] interesting pod/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 15 10:35:06.262059 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:06.262026    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc" podUID="cceee774-5cd9-4474-80a7-80a1bd112976" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 15 10:35:06.896986 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:06.896940    2579 patch_prober.go:28] interesting pod/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Sep 15 10:35:06.897157 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:06.897011    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr" podUID="8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Sep 15 10:35:07.265531 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:07.265453    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc"
Sep 15 10:35:07.266382 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:07.266365    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc"
Sep 15 10:35:07.896826 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:07.896790    2579 patch_prober.go:28] interesting pod/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Sep 15 10:35:07.897094 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:07.897064    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr" podUID="8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Sep 15 10:35:08.901353 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:08.901320    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr"
Sep 15 10:35:08.901799 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:08.901702    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr"
Sep 15 10:35:08.902420 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:08.902399    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr"
Sep 15 10:35:26.793087 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:26.793044    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc"]
Sep 15 10:35:26.793509 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:26.793307    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc" podUID="cceee774-5cd9-4474-80a7-80a1bd112976" containerName="istio-proxy" containerID="cri-o://6165d2f579287aaa310f99945a0061ad48a018bebf7ce372eb72ac908ddee851" gracePeriod=30
Sep 15 10:35:32.021839 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:32.021803    2579 generic.go:356] "Generic (PLEG): container finished" podID="cceee774-5cd9-4474-80a7-80a1bd112976" containerID="6165d2f579287aaa310f99945a0061ad48a018bebf7ce372eb72ac908ddee851" exitCode=0
Sep 15 10:35:32.022297 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:32.021850    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc" event={"ID":"cceee774-5cd9-4474-80a7-80a1bd112976","Type":"ContainerDied","Data":"6165d2f579287aaa310f99945a0061ad48a018bebf7ce372eb72ac908ddee851"}
Sep 15 10:35:32.022297 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:32.021921    2579 scope.go:117] "RemoveContainer" containerID="e225889afc91a512b41d727abab1ad20814af75fbf02bbfbd68002ad651c0592"
Sep 15 10:35:32.061839 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:32.061783    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc"
Sep 15 10:35:32.163319 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:32.163283    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cceee774-5cd9-4474-80a7-80a1bd112976-istio-podinfo\") pod \"cceee774-5cd9-4474-80a7-80a1bd112976\" (UID: \"cceee774-5cd9-4474-80a7-80a1bd112976\") "
Sep 15 10:35:32.163512 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:32.163396    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cceee774-5cd9-4474-80a7-80a1bd112976-istio-data\") pod \"cceee774-5cd9-4474-80a7-80a1bd112976\" (UID: \"cceee774-5cd9-4474-80a7-80a1bd112976\") "
Sep 15 10:35:32.163512 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:32.163428    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cceee774-5cd9-4474-80a7-80a1bd112976-workload-socket\") pod \"cceee774-5cd9-4474-80a7-80a1bd112976\" (UID: \"cceee774-5cd9-4474-80a7-80a1bd112976\") "
Sep 15 10:35:32.163512 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:32.163455    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cceee774-5cd9-4474-80a7-80a1bd112976-istio-token\") pod \"cceee774-5cd9-4474-80a7-80a1bd112976\" (UID: \"cceee774-5cd9-4474-80a7-80a1bd112976\") "
Sep 15 10:35:32.163512 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:32.163493    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cceee774-5cd9-4474-80a7-80a1bd112976-istio-envoy\") pod \"cceee774-5cd9-4474-80a7-80a1bd112976\" (UID: \"cceee774-5cd9-4474-80a7-80a1bd112976\") "
Sep 15 10:35:32.163790 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:32.163522    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbdkd\" (UniqueName: \"kubernetes.io/projected/cceee774-5cd9-4474-80a7-80a1bd112976-kube-api-access-jbdkd\") pod \"cceee774-5cd9-4474-80a7-80a1bd112976\" (UID: \"cceee774-5cd9-4474-80a7-80a1bd112976\") "
Sep 15 10:35:32.163790 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:32.163564    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cceee774-5cd9-4474-80a7-80a1bd112976-workload-certs\") pod \"cceee774-5cd9-4474-80a7-80a1bd112976\" (UID: \"cceee774-5cd9-4474-80a7-80a1bd112976\") "
Sep 15 10:35:32.163790 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:32.163615    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cceee774-5cd9-4474-80a7-80a1bd112976-credential-socket\") pod \"cceee774-5cd9-4474-80a7-80a1bd112976\" (UID: \"cceee774-5cd9-4474-80a7-80a1bd112976\") "
Sep 15 10:35:32.163790 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:32.163668    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cceee774-5cd9-4474-80a7-80a1bd112976-istiod-ca-cert\") pod \"cceee774-5cd9-4474-80a7-80a1bd112976\" (UID: \"cceee774-5cd9-4474-80a7-80a1bd112976\") "
Sep 15 10:35:32.163790 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:32.163662    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cceee774-5cd9-4474-80a7-80a1bd112976-istio-data" (OuterVolumeSpecName: "istio-data") pod "cceee774-5cd9-4474-80a7-80a1bd112976" (UID: "cceee774-5cd9-4474-80a7-80a1bd112976"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:35:32.163790 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:32.163679    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cceee774-5cd9-4474-80a7-80a1bd112976-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cceee774-5cd9-4474-80a7-80a1bd112976" (UID: "cceee774-5cd9-4474-80a7-80a1bd112976"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:35:32.164557 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:32.164011    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cceee774-5cd9-4474-80a7-80a1bd112976-istio-data\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:35:32.164557 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:32.164029    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cceee774-5cd9-4474-80a7-80a1bd112976-workload-socket\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:35:32.164557 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:32.164029    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cceee774-5cd9-4474-80a7-80a1bd112976-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cceee774-5cd9-4474-80a7-80a1bd112976" (UID: "cceee774-5cd9-4474-80a7-80a1bd112976"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:35:32.164557 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:32.164069    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cceee774-5cd9-4474-80a7-80a1bd112976-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cceee774-5cd9-4474-80a7-80a1bd112976" (UID: "cceee774-5cd9-4474-80a7-80a1bd112976"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:35:32.164557 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:32.164170    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cceee774-5cd9-4474-80a7-80a1bd112976-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cceee774-5cd9-4474-80a7-80a1bd112976" (UID: "cceee774-5cd9-4474-80a7-80a1bd112976"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:35:32.165777 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:32.165694    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cceee774-5cd9-4474-80a7-80a1bd112976-istio-token" (OuterVolumeSpecName: "istio-token") pod "cceee774-5cd9-4474-80a7-80a1bd112976" (UID: "cceee774-5cd9-4474-80a7-80a1bd112976"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:35:32.165887 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:32.165866    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cceee774-5cd9-4474-80a7-80a1bd112976-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cceee774-5cd9-4474-80a7-80a1bd112976" (UID: "cceee774-5cd9-4474-80a7-80a1bd112976"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 10:35:32.165887 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:32.165875    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cceee774-5cd9-4474-80a7-80a1bd112976-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cceee774-5cd9-4474-80a7-80a1bd112976" (UID: "cceee774-5cd9-4474-80a7-80a1bd112976"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:35:32.166323 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:32.166300    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cceee774-5cd9-4474-80a7-80a1bd112976-kube-api-access-jbdkd" (OuterVolumeSpecName: "kube-api-access-jbdkd") pod "cceee774-5cd9-4474-80a7-80a1bd112976" (UID: "cceee774-5cd9-4474-80a7-80a1bd112976"). InnerVolumeSpecName "kube-api-access-jbdkd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:35:32.265043 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:32.265005    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cceee774-5cd9-4474-80a7-80a1bd112976-istio-token\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:35:32.265043 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:32.265039    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cceee774-5cd9-4474-80a7-80a1bd112976-istio-envoy\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:35:32.265292 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:32.265053    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbdkd\" (UniqueName: \"kubernetes.io/projected/cceee774-5cd9-4474-80a7-80a1bd112976-kube-api-access-jbdkd\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:35:32.265292 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:32.265068    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cceee774-5cd9-4474-80a7-80a1bd112976-workload-certs\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:35:32.265292 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:32.265082    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cceee774-5cd9-4474-80a7-80a1bd112976-credential-socket\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:35:32.265292 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:32.265094    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cceee774-5cd9-4474-80a7-80a1bd112976-istiod-ca-cert\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:35:32.265292 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:32.265106    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cceee774-5cd9-4474-80a7-80a1bd112976-istio-podinfo\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:35:33.029783 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:33.029749    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc"
Sep 15 10:35:33.029783 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:33.029757    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc" event={"ID":"cceee774-5cd9-4474-80a7-80a1bd112976","Type":"ContainerDied","Data":"327e77522b3ca55c90c09af04b56f0894839a14da7c96465385064dbcdead0dd"}
Sep 15 10:35:33.030280 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:33.029824    2579 scope.go:117] "RemoveContainer" containerID="6165d2f579287aaa310f99945a0061ad48a018bebf7ce372eb72ac908ddee851"
Sep 15 10:35:33.052218 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:33.052183    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc"]
Sep 15 10:35:33.056353 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:33.056329    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-8f3975b3-openshift-default-74f68dc9b4-d2dgc"]
Sep 15 10:35:33.150660 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:33.150629    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cceee774-5cd9-4474-80a7-80a1bd112976" path="/var/lib/kubelet/pods/cceee774-5cd9-4474-80a7-80a1bd112976/volumes"
Sep 15 10:35:48.581788 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:48.581752    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-30651f-6d584c8786-2m7gw"]
Sep 15 10:35:48.582207 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:48.582195    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cceee774-5cd9-4474-80a7-80a1bd112976" containerName="istio-proxy"
Sep 15 10:35:48.582207 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:48.582209    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cceee774-5cd9-4474-80a7-80a1bd112976" containerName="istio-proxy"
Sep 15 10:35:48.582283 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:48.582231    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cceee774-5cd9-4474-80a7-80a1bd112976" containerName="istio-proxy"
Sep 15 10:35:48.582283 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:48.582236    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cceee774-5cd9-4474-80a7-80a1bd112976" containerName="istio-proxy"
Sep 15 10:35:48.582373 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:48.582320    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="cceee774-5cd9-4474-80a7-80a1bd112976" containerName="istio-proxy"
Sep 15 10:35:48.586470 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:48.586452    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-30651f-6d584c8786-2m7gw"
Sep 15 10:35:48.589014 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:48.588993    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-30651f-dockercfg-kzhf6\""
Sep 15 10:35:48.589133 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:48.588997    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-30651f\""
Sep 15 10:35:48.594214 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:48.594187    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-30651f-6d584c8786-2m7gw"]
Sep 15 10:35:48.614752 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:48.614692    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fj244\" (UniqueName: \"kubernetes.io/projected/87ace313-f52e-42f7-b8a5-6ff6fdafa8c2-kube-api-access-fj244\") pod \"payload-pre-processing-e2e-shared-a-w2-30651f-6d584c8786-2m7gw\" (UID: \"87ace313-f52e-42f7-b8a5-6ff6fdafa8c2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-30651f-6d584c8786-2m7gw"
Sep 15 10:35:48.614921 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:48.614789    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87ace313-f52e-42f7-b8a5-6ff6fdafa8c2-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-30651f-6d584c8786-2m7gw\" (UID: \"87ace313-f52e-42f7-b8a5-6ff6fdafa8c2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-30651f-6d584c8786-2m7gw"
Sep 15 10:35:48.616191 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:48.616165    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-30651f-868b7b7bf9-7k22t"]
Sep 15 10:35:48.616684 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:48.616671    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="cceee774-5cd9-4474-80a7-80a1bd112976" containerName="istio-proxy"
Sep 15 10:35:48.619947 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:48.619931    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-30651f-868b7b7bf9-7k22t"
Sep 15 10:35:48.628106 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:48.628083    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-30651f-868b7b7bf9-7k22t"]
Sep 15 10:35:48.715954 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:48.715912    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fj244\" (UniqueName: \"kubernetes.io/projected/87ace313-f52e-42f7-b8a5-6ff6fdafa8c2-kube-api-access-fj244\") pod \"payload-pre-processing-e2e-shared-a-w2-30651f-6d584c8786-2m7gw\" (UID: \"87ace313-f52e-42f7-b8a5-6ff6fdafa8c2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-30651f-6d584c8786-2m7gw"
Sep 15 10:35:48.716138 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:48.715966    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87ace313-f52e-42f7-b8a5-6ff6fdafa8c2-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-30651f-6d584c8786-2m7gw\" (UID: \"87ace313-f52e-42f7-b8a5-6ff6fdafa8c2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-30651f-6d584c8786-2m7gw"
Sep 15 10:35:48.716138 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:48.716054    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r2v8\" (UniqueName: \"kubernetes.io/projected/1ee8ecb1-d072-42cd-a6bf-22b205e46595-kube-api-access-8r2v8\") pod \"payload-processing-e2e-shared-a-w2-30651f-868b7b7bf9-7k22t\" (UID: \"1ee8ecb1-d072-42cd-a6bf-22b205e46595\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-30651f-868b7b7bf9-7k22t"
Sep 15 10:35:48.716138 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:48.716124    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ee8ecb1-d072-42cd-a6bf-22b205e46595-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-30651f-868b7b7bf9-7k22t\" (UID: \"1ee8ecb1-d072-42cd-a6bf-22b205e46595\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-30651f-868b7b7bf9-7k22t"
Sep 15 10:35:48.716965 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:48.716829    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87ace313-f52e-42f7-b8a5-6ff6fdafa8c2-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-30651f-6d584c8786-2m7gw\" (UID: \"87ace313-f52e-42f7-b8a5-6ff6fdafa8c2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-30651f-6d584c8786-2m7gw"
Sep 15 10:35:48.723444 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:48.723412    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fj244\" (UniqueName: \"kubernetes.io/projected/87ace313-f52e-42f7-b8a5-6ff6fdafa8c2-kube-api-access-fj244\") pod \"payload-pre-processing-e2e-shared-a-w2-30651f-6d584c8786-2m7gw\" (UID: \"87ace313-f52e-42f7-b8a5-6ff6fdafa8c2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-30651f-6d584c8786-2m7gw"
Sep 15 10:35:48.817856 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:48.817821    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ee8ecb1-d072-42cd-a6bf-22b205e46595-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-30651f-868b7b7bf9-7k22t\" (UID: \"1ee8ecb1-d072-42cd-a6bf-22b205e46595\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-30651f-868b7b7bf9-7k22t"
Sep 15 10:35:48.818011 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:48.817975    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r2v8\" (UniqueName: \"kubernetes.io/projected/1ee8ecb1-d072-42cd-a6bf-22b205e46595-kube-api-access-8r2v8\") pod \"payload-processing-e2e-shared-a-w2-30651f-868b7b7bf9-7k22t\" (UID: \"1ee8ecb1-d072-42cd-a6bf-22b205e46595\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-30651f-868b7b7bf9-7k22t"
Sep 15 10:35:48.818559 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:48.818539    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ee8ecb1-d072-42cd-a6bf-22b205e46595-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-30651f-868b7b7bf9-7k22t\" (UID: \"1ee8ecb1-d072-42cd-a6bf-22b205e46595\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-30651f-868b7b7bf9-7k22t"
Sep 15 10:35:48.825396 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:48.825371    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r2v8\" (UniqueName: \"kubernetes.io/projected/1ee8ecb1-d072-42cd-a6bf-22b205e46595-kube-api-access-8r2v8\") pod \"payload-processing-e2e-shared-a-w2-30651f-868b7b7bf9-7k22t\" (UID: \"1ee8ecb1-d072-42cd-a6bf-22b205e46595\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-30651f-868b7b7bf9-7k22t"
Sep 15 10:35:48.897424 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:48.897329    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-30651f-6d584c8786-2m7gw"
Sep 15 10:35:48.932143 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:48.932113    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-30651f-868b7b7bf9-7k22t"
Sep 15 10:35:49.176449 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:49.176425    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-30651f-6d584c8786-2m7gw"]
Sep 15 10:35:49.178013 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:35:49.177988    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87ace313_f52e_42f7_b8a5_6ff6fdafa8c2.slice/crio-6532107fe6d2cf8557c07bab4ba68cfe58508dddcc951dd0c66b0823f53353c2 WatchSource:0}: Error finding container 6532107fe6d2cf8557c07bab4ba68cfe58508dddcc951dd0c66b0823f53353c2: Status 404 returned error can't find the container with id 6532107fe6d2cf8557c07bab4ba68cfe58508dddcc951dd0c66b0823f53353c2
Sep 15 10:35:49.217988 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:49.217965    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-30651f-868b7b7bf9-7k22t"]
Sep 15 10:35:49.219964 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:35:49.219940    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ee8ecb1_d072_42cd_a6bf_22b205e46595.slice/crio-34f130ab8b197cd09462f544d0a2932140f4b7fdeba278a3e6dac1a551f53b84 WatchSource:0}: Error finding container 34f130ab8b197cd09462f544d0a2932140f4b7fdeba278a3e6dac1a551f53b84: Status 404 returned error can't find the container with id 34f130ab8b197cd09462f544d0a2932140f4b7fdeba278a3e6dac1a551f53b84
Sep 15 10:35:50.139218 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:50.139178    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-30651f-868b7b7bf9-7k22t" event={"ID":"1ee8ecb1-d072-42cd-a6bf-22b205e46595","Type":"ContainerStarted","Data":"23f9fb8043f03e1527f1d38630c91f8e50992b72ad298b8190a238d63e9754f9"}
Sep 15 10:35:50.139699 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:50.139602    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-30651f-868b7b7bf9-7k22t" event={"ID":"1ee8ecb1-d072-42cd-a6bf-22b205e46595","Type":"ContainerStarted","Data":"34f130ab8b197cd09462f544d0a2932140f4b7fdeba278a3e6dac1a551f53b84"}
Sep 15 10:35:50.139699 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:50.139645    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-30651f-868b7b7bf9-7k22t"
Sep 15 10:35:50.140969 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:50.140946    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-30651f-6d584c8786-2m7gw" event={"ID":"87ace313-f52e-42f7-b8a5-6ff6fdafa8c2","Type":"ContainerStarted","Data":"d9128edaa1f8867ec4a244687803a1253acff486d15f80b12a95bb94e034ef00"}
Sep 15 10:35:50.141085 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:50.140991    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-30651f-6d584c8786-2m7gw" event={"ID":"87ace313-f52e-42f7-b8a5-6ff6fdafa8c2","Type":"ContainerStarted","Data":"6532107fe6d2cf8557c07bab4ba68cfe58508dddcc951dd0c66b0823f53353c2"}
Sep 15 10:35:50.141085 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:50.141053    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-30651f-6d584c8786-2m7gw"
Sep 15 10:35:50.154489 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:50.154430    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-30651f-868b7b7bf9-7k22t" podStartSLOduration=2.154411076 podStartE2EDuration="2.154411076s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:35:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:35:50.153627228 +0000 UTC m=+1083.549719308" watchObservedRunningTime="2026-09-15 10:35:50.154411076 +0000 UTC m=+1083.550503166"
Sep 15 10:35:50.169379 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:35:50.169323    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-30651f-6d584c8786-2m7gw" podStartSLOduration=2.169307195 podStartE2EDuration="2.169307195s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:35:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:35:50.167371841 +0000 UTC m=+1083.563463939" watchObservedRunningTime="2026-09-15 10:35:50.169307195 +0000 UTC m=+1083.565399281"
Sep 15 10:36:01.149777 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:01.149743    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-30651f-6d584c8786-2m7gw"
Sep 15 10:36:02.156782 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:02.156750    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-30651f-868b7b7bf9-7k22t"
Sep 15 10:36:14.386944 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:14.386908    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms"]
Sep 15 10:36:14.392467 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:14.392440    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms"
Sep 15 10:36:14.395160 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:14.395140    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-ecf56f-openshift-default-dockercfg-7f57c\""
Sep 15 10:36:14.405673 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:14.405624    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms"]
Sep 15 10:36:14.587713 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:14.587675    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73956f17-5640-4c22-8023-702639885d74-workload-certs\") pod \"e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms\" (UID: \"73956f17-5640-4c22-8023-702639885d74\") " pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms"
Sep 15 10:36:14.587713 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:14.587711    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73956f17-5640-4c22-8023-702639885d74-istio-data\") pod \"e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms\" (UID: \"73956f17-5640-4c22-8023-702639885d74\") " pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms"
Sep 15 10:36:14.587713 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:14.587752    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p22pq\" (UniqueName: \"kubernetes.io/projected/73956f17-5640-4c22-8023-702639885d74-kube-api-access-p22pq\") pod \"e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms\" (UID: \"73956f17-5640-4c22-8023-702639885d74\") " pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms"
Sep 15 10:36:14.588007 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:14.587806    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73956f17-5640-4c22-8023-702639885d74-istio-envoy\") pod \"e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms\" (UID: \"73956f17-5640-4c22-8023-702639885d74\") " pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms"
Sep 15 10:36:14.588007 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:14.587902    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73956f17-5640-4c22-8023-702639885d74-istio-podinfo\") pod \"e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms\" (UID: \"73956f17-5640-4c22-8023-702639885d74\") " pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms"
Sep 15 10:36:14.588007 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:14.587943    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73956f17-5640-4c22-8023-702639885d74-istio-token\") pod \"e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms\" (UID: \"73956f17-5640-4c22-8023-702639885d74\") " pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms"
Sep 15 10:36:14.588007 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:14.587984    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73956f17-5640-4c22-8023-702639885d74-istiod-ca-cert\") pod \"e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms\" (UID: \"73956f17-5640-4c22-8023-702639885d74\") " pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms"
Sep 15 10:36:14.588007 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:14.588006    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73956f17-5640-4c22-8023-702639885d74-credential-socket\") pod \"e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms\" (UID: \"73956f17-5640-4c22-8023-702639885d74\") " pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms"
Sep 15 10:36:14.588236 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:14.588024    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73956f17-5640-4c22-8023-702639885d74-workload-socket\") pod \"e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms\" (UID: \"73956f17-5640-4c22-8023-702639885d74\") " pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms"
Sep 15 10:36:14.689136 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:14.689041    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73956f17-5640-4c22-8023-702639885d74-workload-certs\") pod \"e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms\" (UID: \"73956f17-5640-4c22-8023-702639885d74\") " pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms"
Sep 15 10:36:14.689136 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:14.689091    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73956f17-5640-4c22-8023-702639885d74-istio-data\") pod \"e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms\" (UID: \"73956f17-5640-4c22-8023-702639885d74\") " pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms"
Sep 15 10:36:14.689136 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:14.689119    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p22pq\" (UniqueName: \"kubernetes.io/projected/73956f17-5640-4c22-8023-702639885d74-kube-api-access-p22pq\") pod \"e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms\" (UID: \"73956f17-5640-4c22-8023-702639885d74\") " pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms"
Sep 15 10:36:14.689429 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:14.689153    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73956f17-5640-4c22-8023-702639885d74-istio-envoy\") pod \"e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms\" (UID: \"73956f17-5640-4c22-8023-702639885d74\") " pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms"
Sep 15 10:36:14.689429 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:14.689279    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73956f17-5640-4c22-8023-702639885d74-istio-podinfo\") pod \"e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms\" (UID: \"73956f17-5640-4c22-8023-702639885d74\") " pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms"
Sep 15 10:36:14.689429 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:14.689312    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73956f17-5640-4c22-8023-702639885d74-istio-token\") pod \"e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms\" (UID: \"73956f17-5640-4c22-8023-702639885d74\") " pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms"
Sep 15 10:36:14.689429 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:14.689341    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73956f17-5640-4c22-8023-702639885d74-istiod-ca-cert\") pod \"e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms\" (UID: \"73956f17-5640-4c22-8023-702639885d74\") " pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms"
Sep 15 10:36:14.689429 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:14.689370    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73956f17-5640-4c22-8023-702639885d74-credential-socket\") pod \"e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms\" (UID: \"73956f17-5640-4c22-8023-702639885d74\") " pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms"
Sep 15 10:36:14.689429 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:14.689400    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73956f17-5640-4c22-8023-702639885d74-workload-socket\") pod \"e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms\" (UID: \"73956f17-5640-4c22-8023-702639885d74\") " pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms"
Sep 15 10:36:14.689704 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:14.689468    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73956f17-5640-4c22-8023-702639885d74-workload-certs\") pod \"e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms\" (UID: \"73956f17-5640-4c22-8023-702639885d74\") " pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms"
Sep 15 10:36:14.689782 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:14.689702    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73956f17-5640-4c22-8023-702639885d74-workload-socket\") pod \"e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms\" (UID: \"73956f17-5640-4c22-8023-702639885d74\") " pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms"
Sep 15 10:36:14.689826 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:14.689798    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73956f17-5640-4c22-8023-702639885d74-istio-data\") pod \"e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms\" (UID: \"73956f17-5640-4c22-8023-702639885d74\") " pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms"
Sep 15 10:36:14.689866 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:14.689799    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73956f17-5640-4c22-8023-702639885d74-credential-socket\") pod \"e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms\" (UID: \"73956f17-5640-4c22-8023-702639885d74\") " pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms"
Sep 15 10:36:14.690171 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:14.690140    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73956f17-5640-4c22-8023-702639885d74-istiod-ca-cert\") pod \"e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms\" (UID: \"73956f17-5640-4c22-8023-702639885d74\") " pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms"
Sep 15 10:36:14.691753 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:14.691712    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73956f17-5640-4c22-8023-702639885d74-istio-envoy\") pod \"e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms\" (UID: \"73956f17-5640-4c22-8023-702639885d74\") " pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms"
Sep 15 10:36:14.692016 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:14.691998    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73956f17-5640-4c22-8023-702639885d74-istio-podinfo\") pod \"e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms\" (UID: \"73956f17-5640-4c22-8023-702639885d74\") " pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms"
Sep 15 10:36:14.696594 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:14.696575    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73956f17-5640-4c22-8023-702639885d74-istio-token\") pod \"e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms\" (UID: \"73956f17-5640-4c22-8023-702639885d74\") " pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms"
Sep 15 10:36:14.697072 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:14.697049    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p22pq\" (UniqueName: \"kubernetes.io/projected/73956f17-5640-4c22-8023-702639885d74-kube-api-access-p22pq\") pod \"e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms\" (UID: \"73956f17-5640-4c22-8023-702639885d74\") " pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms"
Sep 15 10:36:14.706766 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:14.706719    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms"
Sep 15 10:36:14.984516 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:14.984484    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms"]
Sep 15 10:36:14.986374 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:36:14.986344    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73956f17_5640_4c22_8023_702639885d74.slice/crio-18053715047a0e0781f6c9d4c1234bc581b8b66167f65f495a061d1b61f62eca WatchSource:0}: Error finding container 18053715047a0e0781f6c9d4c1234bc581b8b66167f65f495a061d1b61f62eca: Status 404 returned error can't find the container with id 18053715047a0e0781f6c9d4c1234bc581b8b66167f65f495a061d1b61f62eca
Sep 15 10:36:14.989093 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:14.989052    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:36:14.989169 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:14.989150    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:36:14.989218 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:14.989202    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:36:15.298444 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:15.297696    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms" event={"ID":"73956f17-5640-4c22-8023-702639885d74","Type":"ContainerStarted","Data":"85737f23f5cf50dd49f436f0961e5a8dd28639cc13725705ce4b507c445fa7f4"}
Sep 15 10:36:15.298444 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:15.297787    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms" event={"ID":"73956f17-5640-4c22-8023-702639885d74","Type":"ContainerStarted","Data":"18053715047a0e0781f6c9d4c1234bc581b8b66167f65f495a061d1b61f62eca"}
Sep 15 10:36:15.321211 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:15.321156    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms" podStartSLOduration=1.321140961 podStartE2EDuration="1.321140961s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:36:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:36:15.319137644 +0000 UTC m=+1108.715229733" watchObservedRunningTime="2026-09-15 10:36:15.321140961 +0000 UTC m=+1108.717233049"
Sep 15 10:36:15.707309 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:15.707220    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms"
Sep 15 10:36:16.712703 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:16.712666    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms"
Sep 15 10:36:17.311596 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:17.311560    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms"
Sep 15 10:36:17.312453 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:17.312433    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms"
Sep 15 10:36:22.046690 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:22.046654    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-ecf56f-594f84c469-tnzcp"]
Sep 15 10:36:22.051575 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:22.051556    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ecf56f-594f84c469-tnzcp"
Sep 15 10:36:22.054207 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:22.054185    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-ecf56f\""
Sep 15 10:36:22.054322 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:22.054221    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-ecf56f-dockercfg-lvrcv\""
Sep 15 10:36:22.059837 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:22.059811    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-ecf56f-594f84c469-tnzcp"]
Sep 15 10:36:22.162540 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:22.162504    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtfkz\" (UniqueName: \"kubernetes.io/projected/5538db18-e239-44b2-bff5-41211bb1355f-kube-api-access-qtfkz\") pod \"payload-processing-e2e-shared-b-w2-ecf56f-594f84c469-tnzcp\" (UID: \"5538db18-e239-44b2-bff5-41211bb1355f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ecf56f-594f84c469-tnzcp"
Sep 15 10:36:22.162704 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:22.162560    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5538db18-e239-44b2-bff5-41211bb1355f-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-ecf56f-594f84c469-tnzcp\" (UID: \"5538db18-e239-44b2-bff5-41211bb1355f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ecf56f-594f84c469-tnzcp"
Sep 15 10:36:22.263426 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:22.263392    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtfkz\" (UniqueName: \"kubernetes.io/projected/5538db18-e239-44b2-bff5-41211bb1355f-kube-api-access-qtfkz\") pod \"payload-processing-e2e-shared-b-w2-ecf56f-594f84c469-tnzcp\" (UID: \"5538db18-e239-44b2-bff5-41211bb1355f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ecf56f-594f84c469-tnzcp"
Sep 15 10:36:22.263605 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:22.263435    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5538db18-e239-44b2-bff5-41211bb1355f-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-ecf56f-594f84c469-tnzcp\" (UID: \"5538db18-e239-44b2-bff5-41211bb1355f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ecf56f-594f84c469-tnzcp"
Sep 15 10:36:22.264163 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:22.264144    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5538db18-e239-44b2-bff5-41211bb1355f-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-ecf56f-594f84c469-tnzcp\" (UID: \"5538db18-e239-44b2-bff5-41211bb1355f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ecf56f-594f84c469-tnzcp"
Sep 15 10:36:22.270984 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:22.270950    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtfkz\" (UniqueName: \"kubernetes.io/projected/5538db18-e239-44b2-bff5-41211bb1355f-kube-api-access-qtfkz\") pod \"payload-processing-e2e-shared-b-w2-ecf56f-594f84c469-tnzcp\" (UID: \"5538db18-e239-44b2-bff5-41211bb1355f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ecf56f-594f84c469-tnzcp"
Sep 15 10:36:22.364901 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:22.364807    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ecf56f-594f84c469-tnzcp"
Sep 15 10:36:22.649410 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:22.649377    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-ecf56f-594f84c469-tnzcp"]
Sep 15 10:36:22.649678 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:36:22.649652    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5538db18_e239_44b2_bff5_41211bb1355f.slice/crio-0350a9bddc0ddb63495329aea9e7d311f01a8052e4c5361bbcafce8e2efff02f WatchSource:0}: Error finding container 0350a9bddc0ddb63495329aea9e7d311f01a8052e4c5361bbcafce8e2efff02f: Status 404 returned error can't find the container with id 0350a9bddc0ddb63495329aea9e7d311f01a8052e4c5361bbcafce8e2efff02f
Sep 15 10:36:23.348780 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:23.348746    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ecf56f-594f84c469-tnzcp" event={"ID":"5538db18-e239-44b2-bff5-41211bb1355f","Type":"ContainerStarted","Data":"0247eab164199b09ab93e87afbc1126474d89b7a9e585f65d6ba8b1c228c52f3"}
Sep 15 10:36:23.349141 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:23.348800    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ecf56f-594f84c469-tnzcp" event={"ID":"5538db18-e239-44b2-bff5-41211bb1355f","Type":"ContainerStarted","Data":"0350a9bddc0ddb63495329aea9e7d311f01a8052e4c5361bbcafce8e2efff02f"}
Sep 15 10:36:23.349141 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:23.348853    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ecf56f-594f84c469-tnzcp"
Sep 15 10:36:23.365310 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:23.365264    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ecf56f-594f84c469-tnzcp" podStartSLOduration=1.365249585 podStartE2EDuration="1.365249585s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:36:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:36:23.363694023 +0000 UTC m=+1116.759786110" watchObservedRunningTime="2026-09-15 10:36:23.365249585 +0000 UTC m=+1116.761341673"
Sep 15 10:36:27.884078 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:27.884043    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-aeb4e3-v2zh9"]
Sep 15 10:36:27.887965 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:27.887947    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-aeb4e3-v2zh9"
Sep 15 10:36:27.890237 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:27.890216    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5jrzm\""
Sep 15 10:36:27.894527 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:27.894507    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-aeb4e3-v2zh9"]
Sep 15 10:36:28.026291 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:28.026243    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2d75ff8-5c1f-4d00-9305-3c8bf1844604-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-aeb4e3-v2zh9\" (UID: \"e2d75ff8-5c1f-4d00-9305-3c8bf1844604\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-aeb4e3-v2zh9"
Sep 15 10:36:28.127592 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:28.127557    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2d75ff8-5c1f-4d00-9305-3c8bf1844604-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-aeb4e3-v2zh9\" (UID: \"e2d75ff8-5c1f-4d00-9305-3c8bf1844604\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-aeb4e3-v2zh9"
Sep 15 10:36:28.128241 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:28.128217    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2d75ff8-5c1f-4d00-9305-3c8bf1844604-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-aeb4e3-v2zh9\" (UID: \"e2d75ff8-5c1f-4d00-9305-3c8bf1844604\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-aeb4e3-v2zh9"
Sep 15 10:36:28.200371 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:28.200275    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-aeb4e3-v2zh9"
Sep 15 10:36:28.477156 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:28.477126    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-aeb4e3-v2zh9"]
Sep 15 10:36:28.478775 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:36:28.478713    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2d75ff8_5c1f_4d00_9305_3c8bf1844604.slice/crio-1913e83ab241284690c7ab606beb63346d895dce0f76cd3c382cfa418fb4e38d WatchSource:0}: Error finding container 1913e83ab241284690c7ab606beb63346d895dce0f76cd3c382cfa418fb4e38d: Status 404 returned error can't find the container with id 1913e83ab241284690c7ab606beb63346d895dce0f76cd3c382cfa418fb4e38d
Sep 15 10:36:29.387132 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:29.387096    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-aeb4e3-v2zh9" event={"ID":"e2d75ff8-5c1f-4d00-9305-3c8bf1844604","Type":"ContainerStarted","Data":"cfab0540abb0c9768ba5b6ec2f94b178a9c3db083a23ae62cfb73cde7f120546"}
Sep 15 10:36:29.387510 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:29.387154    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-aeb4e3-v2zh9" event={"ID":"e2d75ff8-5c1f-4d00-9305-3c8bf1844604","Type":"ContainerStarted","Data":"1913e83ab241284690c7ab606beb63346d895dce0f76cd3c382cfa418fb4e38d"}
Sep 15 10:36:29.403936 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:29.403892    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-aeb4e3-v2zh9" podStartSLOduration=2.403877747 podStartE2EDuration="2.403877747s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:36:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:36:29.400979202 +0000 UTC m=+1122.797071290" watchObservedRunningTime="2026-09-15 10:36:29.403877747 +0000 UTC m=+1122.799969834"
Sep 15 10:36:30.394412 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:30.394381    2579 generic.go:356] "Generic (PLEG): container finished" podID="e2d75ff8-5c1f-4d00-9305-3c8bf1844604" containerID="cfab0540abb0c9768ba5b6ec2f94b178a9c3db083a23ae62cfb73cde7f120546" exitCode=0
Sep 15 10:36:30.394841 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:30.394467    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-aeb4e3-v2zh9" event={"ID":"e2d75ff8-5c1f-4d00-9305-3c8bf1844604","Type":"ContainerDied","Data":"cfab0540abb0c9768ba5b6ec2f94b178a9c3db083a23ae62cfb73cde7f120546"}
Sep 15 10:36:31.564385 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:31.564350    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-aeb4e3-v2zh9"
Sep 15 10:36:31.665693 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:31.665591    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2d75ff8-5c1f-4d00-9305-3c8bf1844604-maas-api-service-ca\") pod \"e2d75ff8-5c1f-4d00-9305-3c8bf1844604\" (UID: \"e2d75ff8-5c1f-4d00-9305-3c8bf1844604\") "
Sep 15 10:36:31.666002 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:31.665974    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2d75ff8-5c1f-4d00-9305-3c8bf1844604-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e2d75ff8-5c1f-4d00-9305-3c8bf1844604" (UID: "e2d75ff8-5c1f-4d00-9305-3c8bf1844604"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:36:31.766745 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:31.766697    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2d75ff8-5c1f-4d00-9305-3c8bf1844604-maas-api-service-ca\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:36:32.411775 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:32.411716    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-aeb4e3-v2zh9"
Sep 15 10:36:32.411775 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:32.411752    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-aeb4e3-v2zh9" event={"ID":"e2d75ff8-5c1f-4d00-9305-3c8bf1844604","Type":"ContainerDied","Data":"1913e83ab241284690c7ab606beb63346d895dce0f76cd3c382cfa418fb4e38d"}
Sep 15 10:36:32.412067 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:32.411832    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1913e83ab241284690c7ab606beb63346d895dce0f76cd3c382cfa418fb4e38d"
Sep 15 10:36:34.356918 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:34.356889    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ecf56f-594f84c469-tnzcp"
Sep 15 10:36:38.866743 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:38.866690    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-aeb4e3-57f44d6497-fq85g"]
Sep 15 10:36:38.867213 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:38.866936    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-aeb4e3-57f44d6497-fq85g" podUID="51a14207-50fd-4912-bae6-0b4fb55f3efb" containerName="payload-processing" containerID="cri-o://07a887dc1834adc05b1462cd317978a30f0202c4eaaa4e57c9a53ada53c68b39" gracePeriod=30
Sep 15 10:36:39.034579 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:39.034543    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-aeb4e3-v2zh9"]
Sep 15 10:36:39.040323 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:39.040292    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-aeb4e3-v2zh9"]
Sep 15 10:36:39.134212 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:39.134141    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-aeb4e3-57f44d6497-fq85g"
Sep 15 10:36:39.150315 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:39.150280    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2d75ff8-5c1f-4d00-9305-3c8bf1844604" path="/var/lib/kubelet/pods/e2d75ff8-5c1f-4d00-9305-3c8bf1844604/volumes"
Sep 15 10:36:39.243091 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:39.242845    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wl5c5\" (UniqueName: \"kubernetes.io/projected/51a14207-50fd-4912-bae6-0b4fb55f3efb-kube-api-access-wl5c5\") pod \"51a14207-50fd-4912-bae6-0b4fb55f3efb\" (UID: \"51a14207-50fd-4912-bae6-0b4fb55f3efb\") "
Sep 15 10:36:39.243091 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:39.242945    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51a14207-50fd-4912-bae6-0b4fb55f3efb-plugins-config-volume\") pod \"51a14207-50fd-4912-bae6-0b4fb55f3efb\" (UID: \"51a14207-50fd-4912-bae6-0b4fb55f3efb\") "
Sep 15 10:36:39.244951 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:39.244886    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51a14207-50fd-4912-bae6-0b4fb55f3efb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "51a14207-50fd-4912-bae6-0b4fb55f3efb" (UID: "51a14207-50fd-4912-bae6-0b4fb55f3efb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:36:39.246156 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:39.246127    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51a14207-50fd-4912-bae6-0b4fb55f3efb-kube-api-access-wl5c5" (OuterVolumeSpecName: "kube-api-access-wl5c5") pod "51a14207-50fd-4912-bae6-0b4fb55f3efb" (UID: "51a14207-50fd-4912-bae6-0b4fb55f3efb"). InnerVolumeSpecName "kube-api-access-wl5c5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:36:39.344217 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:39.344176    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wl5c5\" (UniqueName: \"kubernetes.io/projected/51a14207-50fd-4912-bae6-0b4fb55f3efb-kube-api-access-wl5c5\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:36:39.344217 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:39.344209    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51a14207-50fd-4912-bae6-0b4fb55f3efb-plugins-config-volume\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:36:39.456694 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:39.456603    2579 generic.go:356] "Generic (PLEG): container finished" podID="51a14207-50fd-4912-bae6-0b4fb55f3efb" containerID="07a887dc1834adc05b1462cd317978a30f0202c4eaaa4e57c9a53ada53c68b39" exitCode=0
Sep 15 10:36:39.456694 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:39.456665    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-aeb4e3-57f44d6497-fq85g" event={"ID":"51a14207-50fd-4912-bae6-0b4fb55f3efb","Type":"ContainerDied","Data":"07a887dc1834adc05b1462cd317978a30f0202c4eaaa4e57c9a53ada53c68b39"}
Sep 15 10:36:39.456965 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:39.456693    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-aeb4e3-57f44d6497-fq85g"
Sep 15 10:36:39.456965 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:39.456760    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-aeb4e3-57f44d6497-fq85g" event={"ID":"51a14207-50fd-4912-bae6-0b4fb55f3efb","Type":"ContainerDied","Data":"f51ed0dfdcb81401d85864ce528411ba90da8e198994b15180eda0d87a02e062"}
Sep 15 10:36:39.456965 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:39.456806    2579 scope.go:117] "RemoveContainer" containerID="07a887dc1834adc05b1462cd317978a30f0202c4eaaa4e57c9a53ada53c68b39"
Sep 15 10:36:39.467978 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:39.467960    2579 scope.go:117] "RemoveContainer" containerID="07a887dc1834adc05b1462cd317978a30f0202c4eaaa4e57c9a53ada53c68b39"
Sep 15 10:36:39.468340 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:36:39.468316    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07a887dc1834adc05b1462cd317978a30f0202c4eaaa4e57c9a53ada53c68b39\": container with ID starting with 07a887dc1834adc05b1462cd317978a30f0202c4eaaa4e57c9a53ada53c68b39 not found: ID does not exist" containerID="07a887dc1834adc05b1462cd317978a30f0202c4eaaa4e57c9a53ada53c68b39"
Sep 15 10:36:39.468459 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:39.468345    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07a887dc1834adc05b1462cd317978a30f0202c4eaaa4e57c9a53ada53c68b39"} err="failed to get container status \"07a887dc1834adc05b1462cd317978a30f0202c4eaaa4e57c9a53ada53c68b39\": rpc error: code = NotFound desc = could not find container \"07a887dc1834adc05b1462cd317978a30f0202c4eaaa4e57c9a53ada53c68b39\": container with ID starting with 07a887dc1834adc05b1462cd317978a30f0202c4eaaa4e57c9a53ada53c68b39 not found: ID does not exist"
Sep 15 10:36:39.479709 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:39.479683    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-aeb4e3-57f44d6497-fq85g"]
Sep 15 10:36:39.483626 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:39.483603    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-aeb4e3-57f44d6497-fq85g"]
Sep 15 10:36:39.556057 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:39.556024    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7879-46360e"]
Sep 15 10:36:39.556517 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:39.556504    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51a14207-50fd-4912-bae6-0b4fb55f3efb" containerName="payload-processing"
Sep 15 10:36:39.556571 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:39.556519    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="51a14207-50fd-4912-bae6-0b4fb55f3efb" containerName="payload-processing"
Sep 15 10:36:39.556571 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:39.556538    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2d75ff8-5c1f-4d00-9305-3c8bf1844604" containerName="revoke-keys"
Sep 15 10:36:39.556571 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:39.556544    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2d75ff8-5c1f-4d00-9305-3c8bf1844604" containerName="revoke-keys"
Sep 15 10:36:39.556675 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:39.556625    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2d75ff8-5c1f-4d00-9305-3c8bf1844604" containerName="revoke-keys"
Sep 15 10:36:39.556675 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:39.556634    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="51a14207-50fd-4912-bae6-0b4fb55f3efb" containerName="payload-processing"
Sep 15 10:36:39.561270 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:39.561244    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7879-46360e"
Sep 15 10:36:39.562552 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:39.562529    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7879-46360e"]
Sep 15 10:36:39.564014 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:39.563995    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-f7bvs\""
Sep 15 10:36:39.646755 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:39.646674    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svg6m\" (UniqueName: \"kubernetes.io/projected/73b7b278-6069-4dc7-80f7-82b1c77b5e09-kube-api-access-svg6m\") pod \"test-curl-7879-46360e\" (UID: \"73b7b278-6069-4dc7-80f7-82b1c77b5e09\") " pod="opendatahub/test-curl-7879-46360e"
Sep 15 10:36:39.748328 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:39.748188    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svg6m\" (UniqueName: \"kubernetes.io/projected/73b7b278-6069-4dc7-80f7-82b1c77b5e09-kube-api-access-svg6m\") pod \"test-curl-7879-46360e\" (UID: \"73b7b278-6069-4dc7-80f7-82b1c77b5e09\") " pod="opendatahub/test-curl-7879-46360e"
Sep 15 10:36:39.757139 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:39.757110    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svg6m\" (UniqueName: \"kubernetes.io/projected/73b7b278-6069-4dc7-80f7-82b1c77b5e09-kube-api-access-svg6m\") pod \"test-curl-7879-46360e\" (UID: \"73b7b278-6069-4dc7-80f7-82b1c77b5e09\") " pod="opendatahub/test-curl-7879-46360e"
Sep 15 10:36:39.870618 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:39.870588    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7879-46360e"
Sep 15 10:36:40.143519 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:40.143492    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7879-46360e"]
Sep 15 10:36:40.145809 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:36:40.145783    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod73b7b278_6069_4dc7_80f7_82b1c77b5e09.slice/crio-5015202b17526665791c80a7efbbe8bd74506781034d75ef660aec449f8341f3 WatchSource:0}: Error finding container 5015202b17526665791c80a7efbbe8bd74506781034d75ef660aec449f8341f3: Status 404 returned error can't find the container with id 5015202b17526665791c80a7efbbe8bd74506781034d75ef660aec449f8341f3
Sep 15 10:36:40.147999 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:40.147982    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 10:36:40.464565 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:40.464470    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7879-46360e" event={"ID":"73b7b278-6069-4dc7-80f7-82b1c77b5e09","Type":"ContainerStarted","Data":"5015202b17526665791c80a7efbbe8bd74506781034d75ef660aec449f8341f3"}
Sep 15 10:36:41.151249 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:41.151210    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51a14207-50fd-4912-bae6-0b4fb55f3efb" path="/var/lib/kubelet/pods/51a14207-50fd-4912-bae6-0b4fb55f3efb/volumes"
Sep 15 10:36:43.486658 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:43.486619    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7879-46360e" event={"ID":"73b7b278-6069-4dc7-80f7-82b1c77b5e09","Type":"ContainerStarted","Data":"2b24d3ee4f17abc94b3a12a8693a104106b7e14dcc70cc366346594504dfaeb2"}
Sep 15 10:36:43.503251 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:43.503175    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7879-46360e" podStartSLOduration=2.172315155 podStartE2EDuration="4.503153403s" totalImagesPullingTime="2.330838248s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:36:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:36:43.500619785 +0000 UTC m=+1136.896711870" watchObservedRunningTime="2026-09-15 10:36:43.503153403 +0000 UTC m=+1136.899245491"
Sep 15 10:36:44.132735 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:44.132629    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7879-46360e"]
Sep 15 10:36:44.137255 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:44.137225    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7879-46360e"]
Sep 15 10:36:44.244353 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:44.244315    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7879-6fee67"]
Sep 15 10:36:44.244805 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:44.244791    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73b7b278-6069-4dc7-80f7-82b1c77b5e09" containerName="test-curl-7879-46360e"
Sep 15 10:36:44.244856 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:44.244806    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="73b7b278-6069-4dc7-80f7-82b1c77b5e09" containerName="test-curl-7879-46360e"
Sep 15 10:36:44.244893 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:44.244886    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="73b7b278-6069-4dc7-80f7-82b1c77b5e09" containerName="test-curl-7879-46360e"
Sep 15 10:36:44.247996 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:44.247978    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7879-6fee67"
Sep 15 10:36:44.251891 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:44.251865    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7879-6fee67"]
Sep 15 10:36:44.404396 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:44.404280    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mz2p5\" (UniqueName: \"kubernetes.io/projected/3c73509f-66da-4943-bb90-2e2fbc7e4d0f-kube-api-access-mz2p5\") pod \"test-curl-7879-6fee67\" (UID: \"3c73509f-66da-4943-bb90-2e2fbc7e4d0f\") " pod="opendatahub/test-curl-7879-6fee67"
Sep 15 10:36:44.493023 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:36:44.492993    2579 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7879-46360e" container="test-curl-7879-46360e"
Sep 15 10:36:44.505122 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:44.505091    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mz2p5\" (UniqueName: \"kubernetes.io/projected/3c73509f-66da-4943-bb90-2e2fbc7e4d0f-kube-api-access-mz2p5\") pod \"test-curl-7879-6fee67\" (UID: \"3c73509f-66da-4943-bb90-2e2fbc7e4d0f\") " pod="opendatahub/test-curl-7879-6fee67"
Sep 15 10:36:44.514403 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:44.514370    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mz2p5\" (UniqueName: \"kubernetes.io/projected/3c73509f-66da-4943-bb90-2e2fbc7e4d0f-kube-api-access-mz2p5\") pod \"test-curl-7879-6fee67\" (UID: \"3c73509f-66da-4943-bb90-2e2fbc7e4d0f\") " pod="opendatahub/test-curl-7879-6fee67"
Sep 15 10:36:44.558369 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:44.558332    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7879-6fee67"
Sep 15 10:36:44.863740 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:44.863700    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7879-6fee67"]
Sep 15 10:36:44.865106 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:36:44.865079    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3c73509f_66da_4943_bb90_2e2fbc7e4d0f.slice/crio-37f8cf739b60594b37ddf776bc3f784be8956a67ffe70b2cc66663513742bfb4 WatchSource:0}: Error finding container 37f8cf739b60594b37ddf776bc3f784be8956a67ffe70b2cc66663513742bfb4: Status 404 returned error can't find the container with id 37f8cf739b60594b37ddf776bc3f784be8956a67ffe70b2cc66663513742bfb4
Sep 15 10:36:45.501284 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:45.501213    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7879-46360e" podUID="73b7b278-6069-4dc7-80f7-82b1c77b5e09" containerName="test-curl-7879-46360e" containerID="cri-o://2b24d3ee4f17abc94b3a12a8693a104106b7e14dcc70cc366346594504dfaeb2" gracePeriod=2
Sep 15 10:36:45.502182 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:45.502149    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7879-6fee67" event={"ID":"3c73509f-66da-4943-bb90-2e2fbc7e4d0f","Type":"ContainerStarted","Data":"457ab0dbe90e17988aa4d18741cef25c13d85b5b13b17ff66a14148aa7fc458d"}
Sep 15 10:36:45.502283 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:45.502200    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7879-6fee67" event={"ID":"3c73509f-66da-4943-bb90-2e2fbc7e4d0f","Type":"ContainerStarted","Data":"37f8cf739b60594b37ddf776bc3f784be8956a67ffe70b2cc66663513742bfb4"}
Sep 15 10:36:45.518002 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:45.517934    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7879-6fee67" podStartSLOduration=1.5179108110000001 podStartE2EDuration="1.517910811s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:36:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:36:45.515365963 +0000 UTC m=+1138.911458050" watchObservedRunningTime="2026-09-15 10:36:45.517910811 +0000 UTC m=+1138.914002898"
Sep 15 10:36:46.089423 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:46.089383    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7879-6fee67"]
Sep 15 10:36:46.095550 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:46.095521    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7879-6fee67"]
Sep 15 10:36:46.510630 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:36:46.510586    2579 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7879-6fee67" container="test-curl-7879-6fee67"
Sep 15 10:36:47.518631 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:47.518585    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7879-6fee67" podUID="3c73509f-66da-4943-bb90-2e2fbc7e4d0f" containerName="test-curl-7879-6fee67" containerID="cri-o://457ab0dbe90e17988aa4d18741cef25c13d85b5b13b17ff66a14148aa7fc458d" gracePeriod=2
Sep 15 10:36:47.730878 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:47.730854    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7879-46360e"
Sep 15 10:36:47.850793 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:47.850701    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-svg6m\" (UniqueName: \"kubernetes.io/projected/73b7b278-6069-4dc7-80f7-82b1c77b5e09-kube-api-access-svg6m\") pod \"73b7b278-6069-4dc7-80f7-82b1c77b5e09\" (UID: \"73b7b278-6069-4dc7-80f7-82b1c77b5e09\") "
Sep 15 10:36:47.852865 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:47.852836    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73b7b278-6069-4dc7-80f7-82b1c77b5e09-kube-api-access-svg6m" (OuterVolumeSpecName: "kube-api-access-svg6m") pod "73b7b278-6069-4dc7-80f7-82b1c77b5e09" (UID: "73b7b278-6069-4dc7-80f7-82b1c77b5e09"). InnerVolumeSpecName "kube-api-access-svg6m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:36:47.952279 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:47.952229    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-svg6m\" (UniqueName: \"kubernetes.io/projected/73b7b278-6069-4dc7-80f7-82b1c77b5e09-kube-api-access-svg6m\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:36:48.353968 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:48.353914    2579 patch_prober.go:28] interesting pod/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 15 10:36:48.354154 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:48.353998    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms" podUID="73956f17-5640-4c22-8023-702639885d74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 15 10:36:48.527667 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:48.527623    2579 generic.go:356] "Generic (PLEG): container finished" podID="73b7b278-6069-4dc7-80f7-82b1c77b5e09" containerID="2b24d3ee4f17abc94b3a12a8693a104106b7e14dcc70cc366346594504dfaeb2" exitCode=137
Sep 15 10:36:48.528148 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:48.527682    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7879-46360e"
Sep 15 10:36:48.528148 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:48.527787    2579 scope.go:117] "RemoveContainer" containerID="2b24d3ee4f17abc94b3a12a8693a104106b7e14dcc70cc366346594504dfaeb2"
Sep 15 10:36:48.540301 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:48.540279    2579 scope.go:117] "RemoveContainer" containerID="2b24d3ee4f17abc94b3a12a8693a104106b7e14dcc70cc366346594504dfaeb2"
Sep 15 10:36:48.540612 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:36:48.540593    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b24d3ee4f17abc94b3a12a8693a104106b7e14dcc70cc366346594504dfaeb2\": container with ID starting with 2b24d3ee4f17abc94b3a12a8693a104106b7e14dcc70cc366346594504dfaeb2 not found: ID does not exist" containerID="2b24d3ee4f17abc94b3a12a8693a104106b7e14dcc70cc366346594504dfaeb2"
Sep 15 10:36:48.540675 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:48.540626    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b24d3ee4f17abc94b3a12a8693a104106b7e14dcc70cc366346594504dfaeb2"} err="failed to get container status \"2b24d3ee4f17abc94b3a12a8693a104106b7e14dcc70cc366346594504dfaeb2\": rpc error: code = NotFound desc = could not find container \"2b24d3ee4f17abc94b3a12a8693a104106b7e14dcc70cc366346594504dfaeb2\": container with ID starting with 2b24d3ee4f17abc94b3a12a8693a104106b7e14dcc70cc366346594504dfaeb2 not found: ID does not exist"
Sep 15 10:36:48.541272 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:36:48.541250    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7879-46360e\" is forbidden: User \"system:node:ip-10-0-135-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-231.ec2.internal' and this object" podUID="73b7b278-6069-4dc7-80f7-82b1c77b5e09" pod="opendatahub/test-curl-7879-46360e"
Sep 15 10:36:49.150304 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:49.150268    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73b7b278-6069-4dc7-80f7-82b1c77b5e09" path="/var/lib/kubelet/pods/73b7b278-6069-4dc7-80f7-82b1c77b5e09/volumes"
Sep 15 10:36:49.722919 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:49.722894    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7879-6fee67"
Sep 15 10:36:49.875035 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:49.874989    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mz2p5\" (UniqueName: \"kubernetes.io/projected/3c73509f-66da-4943-bb90-2e2fbc7e4d0f-kube-api-access-mz2p5\") pod \"3c73509f-66da-4943-bb90-2e2fbc7e4d0f\" (UID: \"3c73509f-66da-4943-bb90-2e2fbc7e4d0f\") "
Sep 15 10:36:49.877150 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:49.877116    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c73509f-66da-4943-bb90-2e2fbc7e4d0f-kube-api-access-mz2p5" (OuterVolumeSpecName: "kube-api-access-mz2p5") pod "3c73509f-66da-4943-bb90-2e2fbc7e4d0f" (UID: "3c73509f-66da-4943-bb90-2e2fbc7e4d0f"). InnerVolumeSpecName "kube-api-access-mz2p5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:36:49.975823 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:49.975781    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mz2p5\" (UniqueName: \"kubernetes.io/projected/3c73509f-66da-4943-bb90-2e2fbc7e4d0f-kube-api-access-mz2p5\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:36:50.542205 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:50.542163    2579 generic.go:356] "Generic (PLEG): container finished" podID="3c73509f-66da-4943-bb90-2e2fbc7e4d0f" containerID="457ab0dbe90e17988aa4d18741cef25c13d85b5b13b17ff66a14148aa7fc458d" exitCode=137
Sep 15 10:36:50.542205 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:50.542204    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7879-6fee67"
Sep 15 10:36:50.542490 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:50.542262    2579 scope.go:117] "RemoveContainer" containerID="457ab0dbe90e17988aa4d18741cef25c13d85b5b13b17ff66a14148aa7fc458d"
Sep 15 10:36:50.544136 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:50.544115    2579 generic.go:356] "Generic (PLEG): container finished" podID="73956f17-5640-4c22-8023-702639885d74" containerID="85737f23f5cf50dd49f436f0961e5a8dd28639cc13725705ce4b507c445fa7f4" exitCode=0
Sep 15 10:36:50.544251 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:50.544167    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms" event={"ID":"73956f17-5640-4c22-8023-702639885d74","Type":"ContainerDied","Data":"85737f23f5cf50dd49f436f0961e5a8dd28639cc13725705ce4b507c445fa7f4"}
Sep 15 10:36:50.544541 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:50.544524    2579 scope.go:117] "RemoveContainer" containerID="85737f23f5cf50dd49f436f0961e5a8dd28639cc13725705ce4b507c445fa7f4"
Sep 15 10:36:50.545952 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:50.545918    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:36:50.546035 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:50.546007    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:36:50.546075 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:50.546053    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:36:50.552468 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:50.552450    2579 scope.go:117] "RemoveContainer" containerID="457ab0dbe90e17988aa4d18741cef25c13d85b5b13b17ff66a14148aa7fc458d"
Sep 15 10:36:50.552810 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:36:50.552780    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"457ab0dbe90e17988aa4d18741cef25c13d85b5b13b17ff66a14148aa7fc458d\": container with ID starting with 457ab0dbe90e17988aa4d18741cef25c13d85b5b13b17ff66a14148aa7fc458d not found: ID does not exist" containerID="457ab0dbe90e17988aa4d18741cef25c13d85b5b13b17ff66a14148aa7fc458d"
Sep 15 10:36:50.552912 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:50.552820    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"457ab0dbe90e17988aa4d18741cef25c13d85b5b13b17ff66a14148aa7fc458d"} err="failed to get container status \"457ab0dbe90e17988aa4d18741cef25c13d85b5b13b17ff66a14148aa7fc458d\": rpc error: code = NotFound desc = could not find container \"457ab0dbe90e17988aa4d18741cef25c13d85b5b13b17ff66a14148aa7fc458d\": container with ID starting with 457ab0dbe90e17988aa4d18741cef25c13d85b5b13b17ff66a14148aa7fc458d not found: ID does not exist"
Sep 15 10:36:50.569683 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:36:50.569646    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7879-6fee67\" is forbidden: User \"system:node:ip-10-0-135-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-231.ec2.internal' and this object" podUID="3c73509f-66da-4943-bb90-2e2fbc7e4d0f" pod="opendatahub/test-curl-7879-6fee67"
Sep 15 10:36:51.151357 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:51.151309    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c73509f-66da-4943-bb90-2e2fbc7e4d0f" path="/var/lib/kubelet/pods/3c73509f-66da-4943-bb90-2e2fbc7e4d0f/volumes"
Sep 15 10:36:51.556128 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:51.555924    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms" event={"ID":"73956f17-5640-4c22-8023-702639885d74","Type":"ContainerStarted","Data":"6bbc0ebc4d6160c62c7c1d9d54b732be2b0e471f35e5a64290e4ba7f6f4de1cc"}
Sep 15 10:36:51.707198 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:51.707162    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms"
Sep 15 10:36:51.707401 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:51.707380    2579 patch_prober.go:28] interesting pod/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Sep 15 10:36:51.707476 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:51.707429    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms" podUID="73956f17-5640-4c22-8023-702639885d74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Sep 15 10:36:52.707160 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:52.707121    2579 patch_prober.go:28] interesting pod/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Sep 15 10:36:52.707739 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:52.707686    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms" podUID="73956f17-5640-4c22-8023-702639885d74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Sep 15 10:36:53.707208 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:53.707160    2579 patch_prober.go:28] interesting pod/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Sep 15 10:36:53.707693 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:53.707238    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms" podUID="73956f17-5640-4c22-8023-702639885d74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Sep 15 10:36:54.707860 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:54.707424    2579 patch_prober.go:28] interesting pod/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Sep 15 10:36:54.707860 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:54.707485    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms" podUID="73956f17-5640-4c22-8023-702639885d74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Sep 15 10:36:55.707816 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:55.707775    2579 patch_prober.go:28] interesting pod/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Sep 15 10:36:55.708068 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:55.708040    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms" podUID="73956f17-5640-4c22-8023-702639885d74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Sep 15 10:36:56.431871 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:56.431795    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6111ecc0-5ff47f44c7-ntg7j"]
Sep 15 10:36:56.432890 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:56.432861    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c73509f-66da-4943-bb90-2e2fbc7e4d0f" containerName="test-curl-7879-6fee67"
Sep 15 10:36:56.433057 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:56.433043    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c73509f-66da-4943-bb90-2e2fbc7e4d0f" containerName="test-curl-7879-6fee67"
Sep 15 10:36:56.433277 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:56.433264    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c73509f-66da-4943-bb90-2e2fbc7e4d0f" containerName="test-curl-7879-6fee67"
Sep 15 10:36:56.438971 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:56.438952    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6111ecc0-5ff47f44c7-ntg7j"]
Sep 15 10:36:56.439100 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:56.439078    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-6111ecc0-5ff47f44c7-ntg7j"
Sep 15 10:36:56.441863 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:56.441841    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-6111ecc0\""
Sep 15 10:36:56.441979 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:56.441897    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-6111ecc0-dockercfg-vmn2w\""
Sep 15 10:36:56.448481 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:56.448452    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63a3f5f4-fc88-4e8b-8765-baea07b7cb86-plugins-config-volume\") pod \"payload-processing-e2e-mt-6111ecc0-5ff47f44c7-ntg7j\" (UID: \"63a3f5f4-fc88-4e8b-8765-baea07b7cb86\") " pod="openshift-ingress/payload-processing-e2e-mt-6111ecc0-5ff47f44c7-ntg7j"
Sep 15 10:36:56.448595 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:56.448560    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn9h9\" (UniqueName: \"kubernetes.io/projected/63a3f5f4-fc88-4e8b-8765-baea07b7cb86-kube-api-access-gn9h9\") pod \"payload-processing-e2e-mt-6111ecc0-5ff47f44c7-ntg7j\" (UID: \"63a3f5f4-fc88-4e8b-8765-baea07b7cb86\") " pod="openshift-ingress/payload-processing-e2e-mt-6111ecc0-5ff47f44c7-ntg7j"
Sep 15 10:36:56.550656 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:56.550613    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn9h9\" (UniqueName: \"kubernetes.io/projected/63a3f5f4-fc88-4e8b-8765-baea07b7cb86-kube-api-access-gn9h9\") pod \"payload-processing-e2e-mt-6111ecc0-5ff47f44c7-ntg7j\" (UID: \"63a3f5f4-fc88-4e8b-8765-baea07b7cb86\") " pod="openshift-ingress/payload-processing-e2e-mt-6111ecc0-5ff47f44c7-ntg7j"
Sep 15 10:36:56.552353 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:56.551349    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63a3f5f4-fc88-4e8b-8765-baea07b7cb86-plugins-config-volume\") pod \"payload-processing-e2e-mt-6111ecc0-5ff47f44c7-ntg7j\" (UID: \"63a3f5f4-fc88-4e8b-8765-baea07b7cb86\") " pod="openshift-ingress/payload-processing-e2e-mt-6111ecc0-5ff47f44c7-ntg7j"
Sep 15 10:36:56.552353 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:56.552306    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63a3f5f4-fc88-4e8b-8765-baea07b7cb86-plugins-config-volume\") pod \"payload-processing-e2e-mt-6111ecc0-5ff47f44c7-ntg7j\" (UID: \"63a3f5f4-fc88-4e8b-8765-baea07b7cb86\") " pod="openshift-ingress/payload-processing-e2e-mt-6111ecc0-5ff47f44c7-ntg7j"
Sep 15 10:36:56.559882 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:56.559852    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn9h9\" (UniqueName: \"kubernetes.io/projected/63a3f5f4-fc88-4e8b-8765-baea07b7cb86-kube-api-access-gn9h9\") pod \"payload-processing-e2e-mt-6111ecc0-5ff47f44c7-ntg7j\" (UID: \"63a3f5f4-fc88-4e8b-8765-baea07b7cb86\") " pod="openshift-ingress/payload-processing-e2e-mt-6111ecc0-5ff47f44c7-ntg7j"
Sep 15 10:36:56.707381 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:56.707288    2579 patch_prober.go:28] interesting pod/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Sep 15 10:36:56.707657 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:56.707624    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms" podUID="73956f17-5640-4c22-8023-702639885d74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Sep 15 10:36:56.749965 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:56.749921    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-6111ecc0-5ff47f44c7-ntg7j"
Sep 15 10:36:57.055823 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:57.055791    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6111ecc0-5ff47f44c7-ntg7j"]
Sep 15 10:36:57.057660 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:36:57.057632    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63a3f5f4_fc88_4e8b_8765_baea07b7cb86.slice/crio-49bed3dad30a6c55a49e915f0a74bd8e78c157af07023d85d8253b104d8c7be0 WatchSource:0}: Error finding container 49bed3dad30a6c55a49e915f0a74bd8e78c157af07023d85d8253b104d8c7be0: Status 404 returned error can't find the container with id 49bed3dad30a6c55a49e915f0a74bd8e78c157af07023d85d8253b104d8c7be0
Sep 15 10:36:57.601518 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:57.601477    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-6111ecc0-5ff47f44c7-ntg7j" event={"ID":"63a3f5f4-fc88-4e8b-8765-baea07b7cb86","Type":"ContainerStarted","Data":"5a9b0a4a6df8838a2dd044524fb70851cda5511ac03c8587396c00a3c4eb2e64"}
Sep 15 10:36:57.601708 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:57.601552    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-6111ecc0-5ff47f44c7-ntg7j" event={"ID":"63a3f5f4-fc88-4e8b-8765-baea07b7cb86","Type":"ContainerStarted","Data":"49bed3dad30a6c55a49e915f0a74bd8e78c157af07023d85d8253b104d8c7be0"}
Sep 15 10:36:57.601806 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:57.601717    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-6111ecc0-5ff47f44c7-ntg7j"
Sep 15 10:36:57.618832 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:57.618783    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-6111ecc0-5ff47f44c7-ntg7j" podStartSLOduration=1.618766195 podStartE2EDuration="1.618766195s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:36:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:36:57.617703067 +0000 UTC m=+1151.013795155" watchObservedRunningTime="2026-09-15 10:36:57.618766195 +0000 UTC m=+1151.014858279"
Sep 15 10:36:57.711453 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:57.711419    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms"
Sep 15 10:36:57.711854 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:57.711833    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms"
Sep 15 10:36:57.712580 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:36:57.712562    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms"
Sep 15 10:37:08.611579 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:08.611542    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-6111ecc0-5ff47f44c7-ntg7j"
Sep 15 10:37:47.239308 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:47.239278    2579 scope.go:117] "RemoveContainer" containerID="638475fc35807a47ca4eef198f5f28d20d3bca917583c047b8224f180652d825"
Sep 15 10:37:53.163400 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:53.163360    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr"]
Sep 15 10:37:53.164007 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:53.163611    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr" podUID="8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6" containerName="istio-proxy" containerID="cri-o://ed84db5ea85cbcc60a3a65dd7e39738dad75b8c4fc7cc415de16ee07fe1718cb" gracePeriod=30
Sep 15 10:37:53.867378 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:53.867344    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx"]
Sep 15 10:37:53.872965 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:53.872938    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx"
Sep 15 10:37:53.875533 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:53.875511    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-948cb7-openshift-default-dockercfg-zlxfv\""
Sep 15 10:37:53.884253 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:53.884216    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx"]
Sep 15 10:37:53.904580 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:53.904403    2579 patch_prober.go:28] interesting pod/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 15 10:37:53.904580 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:53.904467    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr" podUID="8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 10:37:53.963372 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:53.963317    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/537f3419-e6ec-40ed-8e39-0644c50dcc34-workload-socket\") pod \"e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx\" (UID: \"537f3419-e6ec-40ed-8e39-0644c50dcc34\") " pod="openshift-ingress/e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx"
Sep 15 10:37:53.963776 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:53.963756    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/537f3419-e6ec-40ed-8e39-0644c50dcc34-istio-token\") pod \"e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx\" (UID: \"537f3419-e6ec-40ed-8e39-0644c50dcc34\") " pod="openshift-ingress/e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx"
Sep 15 10:37:53.964001 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:53.963983    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/537f3419-e6ec-40ed-8e39-0644c50dcc34-istio-envoy\") pod \"e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx\" (UID: \"537f3419-e6ec-40ed-8e39-0644c50dcc34\") " pod="openshift-ingress/e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx"
Sep 15 10:37:53.964165 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:53.964151    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/537f3419-e6ec-40ed-8e39-0644c50dcc34-istiod-ca-cert\") pod \"e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx\" (UID: \"537f3419-e6ec-40ed-8e39-0644c50dcc34\") " pod="openshift-ingress/e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx"
Sep 15 10:37:53.964381 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:53.964336    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/537f3419-e6ec-40ed-8e39-0644c50dcc34-credential-socket\") pod \"e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx\" (UID: \"537f3419-e6ec-40ed-8e39-0644c50dcc34\") " pod="openshift-ingress/e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx"
Sep 15 10:37:53.964564 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:53.964550    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/537f3419-e6ec-40ed-8e39-0644c50dcc34-workload-certs\") pod \"e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx\" (UID: \"537f3419-e6ec-40ed-8e39-0644c50dcc34\") " pod="openshift-ingress/e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx"
Sep 15 10:37:53.964789 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:53.964718    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/537f3419-e6ec-40ed-8e39-0644c50dcc34-istio-podinfo\") pod \"e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx\" (UID: \"537f3419-e6ec-40ed-8e39-0644c50dcc34\") " pod="openshift-ingress/e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx"
Sep 15 10:37:53.965015 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:53.964967    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/537f3419-e6ec-40ed-8e39-0644c50dcc34-istio-data\") pod \"e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx\" (UID: \"537f3419-e6ec-40ed-8e39-0644c50dcc34\") " pod="openshift-ingress/e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx"
Sep 15 10:37:53.965189 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:53.965174    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d67qg\" (UniqueName: \"kubernetes.io/projected/537f3419-e6ec-40ed-8e39-0644c50dcc34-kube-api-access-d67qg\") pod \"e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx\" (UID: \"537f3419-e6ec-40ed-8e39-0644c50dcc34\") " pod="openshift-ingress/e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx"
Sep 15 10:37:54.066516 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:54.066473    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/537f3419-e6ec-40ed-8e39-0644c50dcc34-workload-certs\") pod \"e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx\" (UID: \"537f3419-e6ec-40ed-8e39-0644c50dcc34\") " pod="openshift-ingress/e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx"
Sep 15 10:37:54.066516 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:54.066524    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/537f3419-e6ec-40ed-8e39-0644c50dcc34-istio-podinfo\") pod \"e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx\" (UID: \"537f3419-e6ec-40ed-8e39-0644c50dcc34\") " pod="openshift-ingress/e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx"
Sep 15 10:37:54.066846 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:54.066555    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/537f3419-e6ec-40ed-8e39-0644c50dcc34-istio-data\") pod \"e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx\" (UID: \"537f3419-e6ec-40ed-8e39-0644c50dcc34\") " pod="openshift-ingress/e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx"
Sep 15 10:37:54.066846 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:54.066599    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d67qg\" (UniqueName: \"kubernetes.io/projected/537f3419-e6ec-40ed-8e39-0644c50dcc34-kube-api-access-d67qg\") pod \"e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx\" (UID: \"537f3419-e6ec-40ed-8e39-0644c50dcc34\") " pod="openshift-ingress/e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx"
Sep 15 10:37:54.066846 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:54.066656    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/537f3419-e6ec-40ed-8e39-0644c50dcc34-workload-socket\") pod \"e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx\" (UID: \"537f3419-e6ec-40ed-8e39-0644c50dcc34\") " pod="openshift-ingress/e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx"
Sep 15 10:37:54.066846 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:54.066700    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/537f3419-e6ec-40ed-8e39-0644c50dcc34-istio-token\") pod \"e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx\" (UID: \"537f3419-e6ec-40ed-8e39-0644c50dcc34\") " pod="openshift-ingress/e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx"
Sep 15 10:37:54.066846 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:54.066794    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/537f3419-e6ec-40ed-8e39-0644c50dcc34-istio-envoy\") pod \"e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx\" (UID: \"537f3419-e6ec-40ed-8e39-0644c50dcc34\") " pod="openshift-ingress/e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx"
Sep 15 10:37:54.066846 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:54.066819    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/537f3419-e6ec-40ed-8e39-0644c50dcc34-istiod-ca-cert\") pod \"e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx\" (UID: \"537f3419-e6ec-40ed-8e39-0644c50dcc34\") " pod="openshift-ingress/e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx"
Sep 15 10:37:54.067173 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:54.066863    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/537f3419-e6ec-40ed-8e39-0644c50dcc34-credential-socket\") pod \"e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx\" (UID: \"537f3419-e6ec-40ed-8e39-0644c50dcc34\") " pod="openshift-ingress/e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx"
Sep 15 10:37:54.067173 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:54.066971    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/537f3419-e6ec-40ed-8e39-0644c50dcc34-workload-certs\") pod \"e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx\" (UID: \"537f3419-e6ec-40ed-8e39-0644c50dcc34\") " pod="openshift-ingress/e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx"
Sep 15 10:37:54.067173 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:54.067045    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/537f3419-e6ec-40ed-8e39-0644c50dcc34-workload-socket\") pod \"e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx\" (UID: \"537f3419-e6ec-40ed-8e39-0644c50dcc34\") " pod="openshift-ingress/e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx"
Sep 15 10:37:54.067322 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:54.067220    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/537f3419-e6ec-40ed-8e39-0644c50dcc34-credential-socket\") pod \"e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx\" (UID: \"537f3419-e6ec-40ed-8e39-0644c50dcc34\") " pod="openshift-ingress/e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx"
Sep 15 10:37:54.067322 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:54.067221    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/537f3419-e6ec-40ed-8e39-0644c50dcc34-istio-data\") pod \"e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx\" (UID: \"537f3419-e6ec-40ed-8e39-0644c50dcc34\") " pod="openshift-ingress/e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx"
Sep 15 10:37:54.067526 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:54.067509    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/537f3419-e6ec-40ed-8e39-0644c50dcc34-istiod-ca-cert\") pod \"e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx\" (UID: \"537f3419-e6ec-40ed-8e39-0644c50dcc34\") " pod="openshift-ingress/e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx"
Sep 15 10:37:54.069016 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:54.068997    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/537f3419-e6ec-40ed-8e39-0644c50dcc34-istio-envoy\") pod \"e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx\" (UID: \"537f3419-e6ec-40ed-8e39-0644c50dcc34\") " pod="openshift-ingress/e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx"
Sep 15 10:37:54.069082 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:54.069068    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/537f3419-e6ec-40ed-8e39-0644c50dcc34-istio-podinfo\") pod \"e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx\" (UID: \"537f3419-e6ec-40ed-8e39-0644c50dcc34\") " pod="openshift-ingress/e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx"
Sep 15 10:37:54.075119 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:54.075091    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/537f3419-e6ec-40ed-8e39-0644c50dcc34-istio-token\") pod \"e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx\" (UID: \"537f3419-e6ec-40ed-8e39-0644c50dcc34\") " pod="openshift-ingress/e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx"
Sep 15 10:37:54.075247 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:54.075229    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d67qg\" (UniqueName: \"kubernetes.io/projected/537f3419-e6ec-40ed-8e39-0644c50dcc34-kube-api-access-d67qg\") pod \"e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx\" (UID: \"537f3419-e6ec-40ed-8e39-0644c50dcc34\") " pod="openshift-ingress/e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx"
Sep 15 10:37:54.187672 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:54.187587    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx"
Sep 15 10:37:54.465801 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:54.465771    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx"]
Sep 15 10:37:54.467825 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:37:54.467800    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod537f3419_e6ec_40ed_8e39_0644c50dcc34.slice/crio-82eceabfa11a6686259ca0e96334765823739865c45ec7f97990c6c8430517b8 WatchSource:0}: Error finding container 82eceabfa11a6686259ca0e96334765823739865c45ec7f97990c6c8430517b8: Status 404 returned error can't find the container with id 82eceabfa11a6686259ca0e96334765823739865c45ec7f97990c6c8430517b8
Sep 15 10:37:54.470215 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:54.470179    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:37:54.470301 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:54.470254    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:37:54.470301 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:54.470286    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:37:54.955477 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:54.955439    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx" event={"ID":"537f3419-e6ec-40ed-8e39-0644c50dcc34","Type":"ContainerStarted","Data":"cdfcd79cec3e96470cd169c4dc5a9d9c10ebf0240a8b88631e85b53c9ef97aa8"}
Sep 15 10:37:54.955692 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:54.955496    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx" event={"ID":"537f3419-e6ec-40ed-8e39-0644c50dcc34","Type":"ContainerStarted","Data":"82eceabfa11a6686259ca0e96334765823739865c45ec7f97990c6c8430517b8"}
Sep 15 10:37:54.976457 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:54.976393    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx" podStartSLOduration=1.9763746580000001 podStartE2EDuration="1.976374658s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:37:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:37:54.973220305 +0000 UTC m=+1208.369312391" watchObservedRunningTime="2026-09-15 10:37:54.976374658 +0000 UTC m=+1208.372466742"
Sep 15 10:37:55.187814 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:55.187777    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx"
Sep 15 10:37:55.193468 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:55.193440    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx"
Sep 15 10:37:55.961507 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:55.961475    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx"
Sep 15 10:37:55.962555 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:55.962536    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx"
Sep 15 10:37:58.424254 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:58.424172    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr"
Sep 15 10:37:58.616835 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:58.616802    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6-workload-certs\") pod \"8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6\" (UID: \"8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6\") "
Sep 15 10:37:58.617130 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:58.616847    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6-istio-data\") pod \"8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6\" (UID: \"8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6\") "
Sep 15 10:37:58.617130 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:58.616867    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6-workload-socket\") pod \"8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6\" (UID: \"8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6\") "
Sep 15 10:37:58.617130 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:58.616885    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6-credential-socket\") pod \"8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6\" (UID: \"8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6\") "
Sep 15 10:37:58.617130 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:58.616909    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6-istiod-ca-cert\") pod \"8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6\" (UID: \"8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6\") "
Sep 15 10:37:58.617130 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:58.616988    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fk2l9\" (UniqueName: \"kubernetes.io/projected/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6-kube-api-access-fk2l9\") pod \"8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6\" (UID: \"8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6\") "
Sep 15 10:37:58.617130 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:58.617062    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6-istio-token\") pod \"8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6\" (UID: \"8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6\") "
Sep 15 10:37:58.617130 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:58.617102    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6-istio-envoy\") pod \"8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6\" (UID: \"8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6\") "
Sep 15 10:37:58.617523 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:58.617152    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6-istio-podinfo\") pod \"8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6\" (UID: \"8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6\") "
Sep 15 10:37:58.617523 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:58.617154    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6" (UID: "8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:37:58.617523 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:58.617210    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6" (UID: "8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:37:58.617523 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:58.617226    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6" (UID: "8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:37:58.617523 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:58.617130    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6-istio-data" (OuterVolumeSpecName: "istio-data") pod "8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6" (UID: "8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:37:58.617523 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:58.617452    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6" (UID: "8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:37:58.617523 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:58.617466    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6-workload-certs\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:37:58.617523 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:58.617491    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6-workload-socket\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:37:58.617523 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:58.617505    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6-credential-socket\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:37:58.619272 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:58.619245    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6" (UID: "8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 10:37:58.619407 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:58.619296    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6-istio-token" (OuterVolumeSpecName: "istio-token") pod "8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6" (UID: "8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:37:58.619660 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:58.619636    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6" (UID: "8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:37:58.619660 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:58.619642    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6-kube-api-access-fk2l9" (OuterVolumeSpecName: "kube-api-access-fk2l9") pod "8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6" (UID: "8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6"). InnerVolumeSpecName "kube-api-access-fk2l9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:37:58.718414 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:58.718330    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6-istio-token\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:37:58.718414 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:58.718361    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6-istio-envoy\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:37:58.718414 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:58.718370    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6-istio-podinfo\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:37:58.718414 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:58.718378    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6-istio-data\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:37:58.718414 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:58.718386    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6-istiod-ca-cert\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:37:58.718414 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:58.718394    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fk2l9\" (UniqueName: \"kubernetes.io/projected/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6-kube-api-access-fk2l9\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:37:58.981770 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:58.981681    2579 generic.go:356] "Generic (PLEG): container finished" podID="8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6" containerID="ed84db5ea85cbcc60a3a65dd7e39738dad75b8c4fc7cc415de16ee07fe1718cb" exitCode=0
Sep 15 10:37:58.981770 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:58.981746    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr"
Sep 15 10:37:58.981953 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:58.981766    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr" event={"ID":"8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6","Type":"ContainerDied","Data":"ed84db5ea85cbcc60a3a65dd7e39738dad75b8c4fc7cc415de16ee07fe1718cb"}
Sep 15 10:37:58.981953 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:58.981829    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr" event={"ID":"8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6","Type":"ContainerDied","Data":"82ac6cd5e2339f7d136e311bad2d8b698f61427f26698266b36f2d60fb24e140"}
Sep 15 10:37:58.981953 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:58.981859    2579 scope.go:117] "RemoveContainer" containerID="ed84db5ea85cbcc60a3a65dd7e39738dad75b8c4fc7cc415de16ee07fe1718cb"
Sep 15 10:37:58.994473 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:58.994453    2579 scope.go:117] "RemoveContainer" containerID="4970423dbefd31deda95680e947262e1a10320885ea0a5449ea8ea9298fda484"
Sep 15 10:37:59.003748 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:59.003664    2579 scope.go:117] "RemoveContainer" containerID="ed84db5ea85cbcc60a3a65dd7e39738dad75b8c4fc7cc415de16ee07fe1718cb"
Sep 15 10:37:59.004210 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:37:59.004177    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed84db5ea85cbcc60a3a65dd7e39738dad75b8c4fc7cc415de16ee07fe1718cb\": container with ID starting with ed84db5ea85cbcc60a3a65dd7e39738dad75b8c4fc7cc415de16ee07fe1718cb not found: ID does not exist" containerID="ed84db5ea85cbcc60a3a65dd7e39738dad75b8c4fc7cc415de16ee07fe1718cb"
Sep 15 10:37:59.004316 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:59.004224    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed84db5ea85cbcc60a3a65dd7e39738dad75b8c4fc7cc415de16ee07fe1718cb"} err="failed to get container status \"ed84db5ea85cbcc60a3a65dd7e39738dad75b8c4fc7cc415de16ee07fe1718cb\": rpc error: code = NotFound desc = could not find container \"ed84db5ea85cbcc60a3a65dd7e39738dad75b8c4fc7cc415de16ee07fe1718cb\": container with ID starting with ed84db5ea85cbcc60a3a65dd7e39738dad75b8c4fc7cc415de16ee07fe1718cb not found: ID does not exist"
Sep 15 10:37:59.004316 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:59.004251    2579 scope.go:117] "RemoveContainer" containerID="4970423dbefd31deda95680e947262e1a10320885ea0a5449ea8ea9298fda484"
Sep 15 10:37:59.004577 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:37:59.004553    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4970423dbefd31deda95680e947262e1a10320885ea0a5449ea8ea9298fda484\": container with ID starting with 4970423dbefd31deda95680e947262e1a10320885ea0a5449ea8ea9298fda484 not found: ID does not exist" containerID="4970423dbefd31deda95680e947262e1a10320885ea0a5449ea8ea9298fda484"
Sep 15 10:37:59.004642 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:59.004586    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4970423dbefd31deda95680e947262e1a10320885ea0a5449ea8ea9298fda484"} err="failed to get container status \"4970423dbefd31deda95680e947262e1a10320885ea0a5449ea8ea9298fda484\": rpc error: code = NotFound desc = could not find container \"4970423dbefd31deda95680e947262e1a10320885ea0a5449ea8ea9298fda484\": container with ID starting with 4970423dbefd31deda95680e947262e1a10320885ea0a5449ea8ea9298fda484 not found: ID does not exist"
Sep 15 10:37:59.006462 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:59.006436    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr"]
Sep 15 10:37:59.012879 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:59.012857    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-aeb4e3-openshift-default-855cf5fb64-mkgrr"]
Sep 15 10:37:59.149771 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:37:59.149714    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6" path="/var/lib/kubelet/pods/8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6/volumes"
Sep 15 10:38:29.078324 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:29.078285    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-86a8f5-nfcjh"]
Sep 15 10:38:29.078838 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:29.078820    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6" containerName="istio-proxy"
Sep 15 10:38:29.078888 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:29.078839    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6" containerName="istio-proxy"
Sep 15 10:38:29.078888 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:29.078860    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6" containerName="istio-proxy"
Sep 15 10:38:29.078888 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:29.078866    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6" containerName="istio-proxy"
Sep 15 10:38:29.078987 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:29.078957    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6" containerName="istio-proxy"
Sep 15 10:38:29.082251 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:29.082232    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-86a8f5-nfcjh"
Sep 15 10:38:29.084572 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:29.084553    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5jrzm\""
Sep 15 10:38:29.088705 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:29.088679    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-86a8f5-nfcjh"]
Sep 15 10:38:29.230791 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:29.230714    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9df337c6-09f9-4f5f-9ed0-3f622f55be34-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-86a8f5-nfcjh\" (UID: \"9df337c6-09f9-4f5f-9ed0-3f622f55be34\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-86a8f5-nfcjh"
Sep 15 10:38:29.331907 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:29.331818    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9df337c6-09f9-4f5f-9ed0-3f622f55be34-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-86a8f5-nfcjh\" (UID: \"9df337c6-09f9-4f5f-9ed0-3f622f55be34\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-86a8f5-nfcjh"
Sep 15 10:38:29.332524 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:29.332501    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9df337c6-09f9-4f5f-9ed0-3f622f55be34-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-86a8f5-nfcjh\" (UID: \"9df337c6-09f9-4f5f-9ed0-3f622f55be34\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-86a8f5-nfcjh"
Sep 15 10:38:29.395474 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:29.395436    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-86a8f5-nfcjh"
Sep 15 10:38:29.674444 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:29.673976    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-86a8f5-nfcjh"]
Sep 15 10:38:30.172015 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:30.171980    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-86a8f5-nfcjh" event={"ID":"9df337c6-09f9-4f5f-9ed0-3f622f55be34","Type":"ContainerStarted","Data":"d2deed61df4d68d9de32c4ff843429ea1aad796caa0a58236c2e6ce6574ded93"}
Sep 15 10:38:30.172421 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:30.172034    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-86a8f5-nfcjh" event={"ID":"9df337c6-09f9-4f5f-9ed0-3f622f55be34","Type":"ContainerStarted","Data":"43d2f024170c34722012354dd46ad0f633c32cf1d3efd6f8f9d2561012a31c31"}
Sep 15 10:38:30.188982 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:30.188917    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-86a8f5-nfcjh" podStartSLOduration=1.188895334 podStartE2EDuration="1.188895334s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:38:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:38:30.186891462 +0000 UTC m=+1243.582983550" watchObservedRunningTime="2026-09-15 10:38:30.188895334 +0000 UTC m=+1243.584987432"
Sep 15 10:38:31.179016 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:31.178977    2579 generic.go:356] "Generic (PLEG): container finished" podID="9df337c6-09f9-4f5f-9ed0-3f622f55be34" containerID="d2deed61df4d68d9de32c4ff843429ea1aad796caa0a58236c2e6ce6574ded93" exitCode=0
Sep 15 10:38:31.179420 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:31.179014    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-86a8f5-nfcjh" event={"ID":"9df337c6-09f9-4f5f-9ed0-3f622f55be34","Type":"ContainerDied","Data":"d2deed61df4d68d9de32c4ff843429ea1aad796caa0a58236c2e6ce6574ded93"}
Sep 15 10:38:32.331832 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:32.331808    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-86a8f5-nfcjh"
Sep 15 10:38:32.464837 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:32.464695    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9df337c6-09f9-4f5f-9ed0-3f622f55be34-maas-api-service-ca\") pod \"9df337c6-09f9-4f5f-9ed0-3f622f55be34\" (UID: \"9df337c6-09f9-4f5f-9ed0-3f622f55be34\") "
Sep 15 10:38:32.465098 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:32.465072    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9df337c6-09f9-4f5f-9ed0-3f622f55be34-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9df337c6-09f9-4f5f-9ed0-3f622f55be34" (UID: "9df337c6-09f9-4f5f-9ed0-3f622f55be34"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:38:32.566461 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:32.566418    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9df337c6-09f9-4f5f-9ed0-3f622f55be34-maas-api-service-ca\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:38:33.191965 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:33.191936    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-86a8f5-nfcjh"
Sep 15 10:38:33.192123 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:33.191974    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-86a8f5-nfcjh" event={"ID":"9df337c6-09f9-4f5f-9ed0-3f622f55be34","Type":"ContainerDied","Data":"43d2f024170c34722012354dd46ad0f633c32cf1d3efd6f8f9d2561012a31c31"}
Sep 15 10:38:33.192123 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:33.192026    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="43d2f024170c34722012354dd46ad0f633c32cf1d3efd6f8f9d2561012a31c31"
Sep 15 10:38:39.493297 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:39.493202    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-86a8f5-6bdb75c5f8-jhfrz"]
Sep 15 10:38:39.494166 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:39.494094    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-86a8f5-6bdb75c5f8-jhfrz" podUID="23631531-c363-46a5-9067-613569676471" containerName="payload-pre-processing" containerID="cri-o://43ae100b6dd4923a269349566cff7adab63e3dbf8a4016af12a2cff25044565a" gracePeriod=30
Sep 15 10:38:39.640431 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:39.640378    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-86a8f5-nfcjh"]
Sep 15 10:38:39.644559 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:39.644522    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-86a8f5-nfcjh"]
Sep 15 10:38:39.799100 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:39.799070    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-86a8f5-6bdb75c5f8-jhfrz"
Sep 15 10:38:39.832034 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:39.832003    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23631531-c363-46a5-9067-613569676471-plugins-config-volume\") pod \"23631531-c363-46a5-9067-613569676471\" (UID: \"23631531-c363-46a5-9067-613569676471\") "
Sep 15 10:38:39.832204 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:39.832117    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kr8l8\" (UniqueName: \"kubernetes.io/projected/23631531-c363-46a5-9067-613569676471-kube-api-access-kr8l8\") pod \"23631531-c363-46a5-9067-613569676471\" (UID: \"23631531-c363-46a5-9067-613569676471\") "
Sep 15 10:38:39.832467 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:39.832438    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23631531-c363-46a5-9067-613569676471-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "23631531-c363-46a5-9067-613569676471" (UID: "23631531-c363-46a5-9067-613569676471"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:38:39.834203 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:39.834176    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23631531-c363-46a5-9067-613569676471-kube-api-access-kr8l8" (OuterVolumeSpecName: "kube-api-access-kr8l8") pod "23631531-c363-46a5-9067-613569676471" (UID: "23631531-c363-46a5-9067-613569676471"). InnerVolumeSpecName "kube-api-access-kr8l8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:38:39.933106 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:39.933072    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23631531-c363-46a5-9067-613569676471-plugins-config-volume\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:38:39.933106 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:39.933102    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kr8l8\" (UniqueName: \"kubernetes.io/projected/23631531-c363-46a5-9067-613569676471-kube-api-access-kr8l8\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:38:40.237342 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:40.237306    2579 generic.go:356] "Generic (PLEG): container finished" podID="23631531-c363-46a5-9067-613569676471" containerID="43ae100b6dd4923a269349566cff7adab63e3dbf8a4016af12a2cff25044565a" exitCode=0
Sep 15 10:38:40.237657 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:40.237347    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-86a8f5-6bdb75c5f8-jhfrz"
Sep 15 10:38:40.237657 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:40.237391    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-86a8f5-6bdb75c5f8-jhfrz" event={"ID":"23631531-c363-46a5-9067-613569676471","Type":"ContainerDied","Data":"43ae100b6dd4923a269349566cff7adab63e3dbf8a4016af12a2cff25044565a"}
Sep 15 10:38:40.237657 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:40.237452    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-86a8f5-6bdb75c5f8-jhfrz" event={"ID":"23631531-c363-46a5-9067-613569676471","Type":"ContainerDied","Data":"63716ca4ed05794e4d139e486e0858d73c206c00e63426252f7fbb28e3635828"}
Sep 15 10:38:40.237657 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:40.237483    2579 scope.go:117] "RemoveContainer" containerID="43ae100b6dd4923a269349566cff7adab63e3dbf8a4016af12a2cff25044565a"
Sep 15 10:38:40.247895 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:40.247875    2579 scope.go:117] "RemoveContainer" containerID="43ae100b6dd4923a269349566cff7adab63e3dbf8a4016af12a2cff25044565a"
Sep 15 10:38:40.248234 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:38:40.248215    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43ae100b6dd4923a269349566cff7adab63e3dbf8a4016af12a2cff25044565a\": container with ID starting with 43ae100b6dd4923a269349566cff7adab63e3dbf8a4016af12a2cff25044565a not found: ID does not exist" containerID="43ae100b6dd4923a269349566cff7adab63e3dbf8a4016af12a2cff25044565a"
Sep 15 10:38:40.248283 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:40.248242    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43ae100b6dd4923a269349566cff7adab63e3dbf8a4016af12a2cff25044565a"} err="failed to get container status \"43ae100b6dd4923a269349566cff7adab63e3dbf8a4016af12a2cff25044565a\": rpc error: code = NotFound desc = could not find container \"43ae100b6dd4923a269349566cff7adab63e3dbf8a4016af12a2cff25044565a\": container with ID starting with 43ae100b6dd4923a269349566cff7adab63e3dbf8a4016af12a2cff25044565a not found: ID does not exist"
Sep 15 10:38:40.260264 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:40.260229    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-86a8f5-6bdb75c5f8-jhfrz"]
Sep 15 10:38:40.264155 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:40.264130    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-86a8f5-6bdb75c5f8-jhfrz"]
Sep 15 10:38:41.151094 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:41.151059    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23631531-c363-46a5-9067-613569676471" path="/var/lib/kubelet/pods/23631531-c363-46a5-9067-613569676471/volumes"
Sep 15 10:38:41.151468 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:41.151420    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9df337c6-09f9-4f5f-9ed0-3f622f55be34" path="/var/lib/kubelet/pods/9df337c6-09f9-4f5f-9ed0-3f622f55be34/volumes"
Sep 15 10:38:47.273645 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:47.273611    2579 scope.go:117] "RemoveContainer" containerID="1b6df14edeb9eba1d5c630b89d05a9624ecf7a3a6231101b0dbd88013ecbcf03"
Sep 15 10:38:47.282419 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:47.282396    2579 scope.go:117] "RemoveContainer" containerID="12321ed13c9d13885636cd82d359130a8f0635e3343c17798a97b9d805c3e988"
Sep 15 10:38:59.956245 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:59.956196    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-234840-b58ks"]
Sep 15 10:38:59.956808 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:59.956764    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23631531-c363-46a5-9067-613569676471" containerName="payload-pre-processing"
Sep 15 10:38:59.956808 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:59.956779    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="23631531-c363-46a5-9067-613569676471" containerName="payload-pre-processing"
Sep 15 10:38:59.956808 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:59.956787    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9df337c6-09f9-4f5f-9ed0-3f622f55be34" containerName="revoke-keys"
Sep 15 10:38:59.956808 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:59.956793    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9df337c6-09f9-4f5f-9ed0-3f622f55be34" containerName="revoke-keys"
Sep 15 10:38:59.957048 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:59.956880    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9df337c6-09f9-4f5f-9ed0-3f622f55be34" containerName="revoke-keys"
Sep 15 10:38:59.957048 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:59.956890    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="23631531-c363-46a5-9067-613569676471" containerName="payload-pre-processing"
Sep 15 10:38:59.957048 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:59.956897    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d8cf972-e6e2-4ea7-bed8-6821f1cc4ec6" containerName="istio-proxy"
Sep 15 10:38:59.961686 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:59.961665    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-234840-b58ks"
Sep 15 10:38:59.964451 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:59.964424    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5jrzm\""
Sep 15 10:38:59.967256 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:38:59.967227    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-234840-b58ks"]
Sep 15 10:39:00.034510 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:00.034465    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e20724d5-2e37-4d6f-94ff-3430c68cfcbf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-234840-b58ks\" (UID: \"e20724d5-2e37-4d6f-94ff-3430c68cfcbf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-234840-b58ks"
Sep 15 10:39:00.135897 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:00.135858    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e20724d5-2e37-4d6f-94ff-3430c68cfcbf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-234840-b58ks\" (UID: \"e20724d5-2e37-4d6f-94ff-3430c68cfcbf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-234840-b58ks"
Sep 15 10:39:00.136439 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:00.136418    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e20724d5-2e37-4d6f-94ff-3430c68cfcbf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-234840-b58ks\" (UID: \"e20724d5-2e37-4d6f-94ff-3430c68cfcbf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-234840-b58ks"
Sep 15 10:39:00.275024 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:00.274924    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-234840-b58ks"
Sep 15 10:39:00.549060 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:00.549032    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-234840-b58ks"]
Sep 15 10:39:00.550685 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:39:00.550659    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode20724d5_2e37_4d6f_94ff_3430c68cfcbf.slice/crio-35d9536315d9aeed70ae0d7635fd77e79fffc856d532eb5573fdab079b6b7a28 WatchSource:0}: Error finding container 35d9536315d9aeed70ae0d7635fd77e79fffc856d532eb5573fdab079b6b7a28: Status 404 returned error can't find the container with id 35d9536315d9aeed70ae0d7635fd77e79fffc856d532eb5573fdab079b6b7a28
Sep 15 10:39:01.379064 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:01.379023    2579 generic.go:356] "Generic (PLEG): container finished" podID="e20724d5-2e37-4d6f-94ff-3430c68cfcbf" containerID="828847c3281d0173f79f69fcbe8bf910411c1bbb81d61e39eb99dac1868fc5e6" exitCode=0
Sep 15 10:39:01.379490 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:01.379118    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-234840-b58ks" event={"ID":"e20724d5-2e37-4d6f-94ff-3430c68cfcbf","Type":"ContainerDied","Data":"828847c3281d0173f79f69fcbe8bf910411c1bbb81d61e39eb99dac1868fc5e6"}
Sep 15 10:39:01.379490 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:01.379179    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-234840-b58ks" event={"ID":"e20724d5-2e37-4d6f-94ff-3430c68cfcbf","Type":"ContainerStarted","Data":"35d9536315d9aeed70ae0d7635fd77e79fffc856d532eb5573fdab079b6b7a28"}
Sep 15 10:39:02.533902 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:02.533871    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-234840-b58ks"
Sep 15 10:39:02.664062 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:02.663990    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e20724d5-2e37-4d6f-94ff-3430c68cfcbf-maas-api-service-ca\") pod \"e20724d5-2e37-4d6f-94ff-3430c68cfcbf\" (UID: \"e20724d5-2e37-4d6f-94ff-3430c68cfcbf\") "
Sep 15 10:39:02.664340 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:02.664315    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e20724d5-2e37-4d6f-94ff-3430c68cfcbf-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e20724d5-2e37-4d6f-94ff-3430c68cfcbf" (UID: "e20724d5-2e37-4d6f-94ff-3430c68cfcbf"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:39:02.765809 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:02.765767    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e20724d5-2e37-4d6f-94ff-3430c68cfcbf-maas-api-service-ca\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:39:03.391904 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:03.391873    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-234840-b58ks"
Sep 15 10:39:03.392098 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:03.391912    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-234840-b58ks" event={"ID":"e20724d5-2e37-4d6f-94ff-3430c68cfcbf","Type":"ContainerDied","Data":"35d9536315d9aeed70ae0d7635fd77e79fffc856d532eb5573fdab079b6b7a28"}
Sep 15 10:39:03.392098 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:03.391958    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="35d9536315d9aeed70ae0d7635fd77e79fffc856d532eb5573fdab079b6b7a28"
Sep 15 10:39:10.564117 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:10.564071    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-234840-b58ks"]
Sep 15 10:39:10.567164 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:10.567130    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-234840-b58ks"]
Sep 15 10:39:11.149443 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:11.149401    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e20724d5-2e37-4d6f-94ff-3430c68cfcbf" path="/var/lib/kubelet/pods/e20724d5-2e37-4d6f-94ff-3430c68cfcbf/volumes"
Sep 15 10:39:22.081686 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:22.081641    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn"]
Sep 15 10:39:22.082295 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:22.081887    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn" podUID="b2d1b95b-f48e-4672-9be4-311309e7476c" containerName="istio-proxy" containerID="cri-o://82bc51a02f78d70fbf094d25204d83cfa14396c945ffd4a64cf82f2a4e123552" gracePeriod=30
Sep 15 10:39:27.360403 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:27.360339    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn"
Sep 15 10:39:27.445517 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:27.441333    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2d1b95b-f48e-4672-9be4-311309e7476c-istio-envoy\") pod \"b2d1b95b-f48e-4672-9be4-311309e7476c\" (UID: \"b2d1b95b-f48e-4672-9be4-311309e7476c\") "
Sep 15 10:39:27.445517 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:27.441386    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2d1b95b-f48e-4672-9be4-311309e7476c-workload-certs\") pod \"b2d1b95b-f48e-4672-9be4-311309e7476c\" (UID: \"b2d1b95b-f48e-4672-9be4-311309e7476c\") "
Sep 15 10:39:27.445517 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:27.441440    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2d1b95b-f48e-4672-9be4-311309e7476c-workload-socket\") pod \"b2d1b95b-f48e-4672-9be4-311309e7476c\" (UID: \"b2d1b95b-f48e-4672-9be4-311309e7476c\") "
Sep 15 10:39:27.445517 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:27.441471    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2d1b95b-f48e-4672-9be4-311309e7476c-istio-data\") pod \"b2d1b95b-f48e-4672-9be4-311309e7476c\" (UID: \"b2d1b95b-f48e-4672-9be4-311309e7476c\") "
Sep 15 10:39:27.445517 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:27.441495    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2d1b95b-f48e-4672-9be4-311309e7476c-credential-socket\") pod \"b2d1b95b-f48e-4672-9be4-311309e7476c\" (UID: \"b2d1b95b-f48e-4672-9be4-311309e7476c\") "
Sep 15 10:39:27.445517 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:27.441542    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2d1b95b-f48e-4672-9be4-311309e7476c-istio-podinfo\") pod \"b2d1b95b-f48e-4672-9be4-311309e7476c\" (UID: \"b2d1b95b-f48e-4672-9be4-311309e7476c\") "
Sep 15 10:39:27.445517 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:27.441573    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2d1b95b-f48e-4672-9be4-311309e7476c-istio-token\") pod \"b2d1b95b-f48e-4672-9be4-311309e7476c\" (UID: \"b2d1b95b-f48e-4672-9be4-311309e7476c\") "
Sep 15 10:39:27.445517 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:27.441643    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jp4tt\" (UniqueName: \"kubernetes.io/projected/b2d1b95b-f48e-4672-9be4-311309e7476c-kube-api-access-jp4tt\") pod \"b2d1b95b-f48e-4672-9be4-311309e7476c\" (UID: \"b2d1b95b-f48e-4672-9be4-311309e7476c\") "
Sep 15 10:39:27.445517 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:27.441695    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2d1b95b-f48e-4672-9be4-311309e7476c-istiod-ca-cert\") pod \"b2d1b95b-f48e-4672-9be4-311309e7476c\" (UID: \"b2d1b95b-f48e-4672-9be4-311309e7476c\") "
Sep 15 10:39:27.445517 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:27.442470    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2d1b95b-f48e-4672-9be4-311309e7476c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b2d1b95b-f48e-4672-9be4-311309e7476c" (UID: "b2d1b95b-f48e-4672-9be4-311309e7476c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:39:27.445517 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:27.442966    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2d1b95b-f48e-4672-9be4-311309e7476c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b2d1b95b-f48e-4672-9be4-311309e7476c" (UID: "b2d1b95b-f48e-4672-9be4-311309e7476c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:39:27.445517 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:27.443994    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2d1b95b-f48e-4672-9be4-311309e7476c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b2d1b95b-f48e-4672-9be4-311309e7476c" (UID: "b2d1b95b-f48e-4672-9be4-311309e7476c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:39:27.445517 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:27.444213    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2d1b95b-f48e-4672-9be4-311309e7476c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b2d1b95b-f48e-4672-9be4-311309e7476c" (UID: "b2d1b95b-f48e-4672-9be4-311309e7476c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:39:27.445517 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:27.444360    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2d1b95b-f48e-4672-9be4-311309e7476c-istio-data" (OuterVolumeSpecName: "istio-data") pod "b2d1b95b-f48e-4672-9be4-311309e7476c" (UID: "b2d1b95b-f48e-4672-9be4-311309e7476c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:39:27.446438 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:27.446304    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2d1b95b-f48e-4672-9be4-311309e7476c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b2d1b95b-f48e-4672-9be4-311309e7476c" (UID: "b2d1b95b-f48e-4672-9be4-311309e7476c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:39:27.447292 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:27.447265    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b2d1b95b-f48e-4672-9be4-311309e7476c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b2d1b95b-f48e-4672-9be4-311309e7476c" (UID: "b2d1b95b-f48e-4672-9be4-311309e7476c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 10:39:27.447422 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:27.447393    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2d1b95b-f48e-4672-9be4-311309e7476c-istio-token" (OuterVolumeSpecName: "istio-token") pod "b2d1b95b-f48e-4672-9be4-311309e7476c" (UID: "b2d1b95b-f48e-4672-9be4-311309e7476c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:39:27.448226 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:27.448199    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2d1b95b-f48e-4672-9be4-311309e7476c-kube-api-access-jp4tt" (OuterVolumeSpecName: "kube-api-access-jp4tt") pod "b2d1b95b-f48e-4672-9be4-311309e7476c" (UID: "b2d1b95b-f48e-4672-9be4-311309e7476c"). InnerVolumeSpecName "kube-api-access-jp4tt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:39:27.536609 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:27.536573    2579 generic.go:356] "Generic (PLEG): container finished" podID="b2d1b95b-f48e-4672-9be4-311309e7476c" containerID="82bc51a02f78d70fbf094d25204d83cfa14396c945ffd4a64cf82f2a4e123552" exitCode=0
Sep 15 10:39:27.536799 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:27.536619    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn" event={"ID":"b2d1b95b-f48e-4672-9be4-311309e7476c","Type":"ContainerDied","Data":"82bc51a02f78d70fbf094d25204d83cfa14396c945ffd4a64cf82f2a4e123552"}
Sep 15 10:39:27.536799 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:27.536624    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn"
Sep 15 10:39:27.536799 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:27.536661    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn" event={"ID":"b2d1b95b-f48e-4672-9be4-311309e7476c","Type":"ContainerDied","Data":"aeea6a15468901edd261a5e8627e747640e430e1dd287c25b8ab2370b4055ba0"}
Sep 15 10:39:27.536799 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:27.536683    2579 scope.go:117] "RemoveContainer" containerID="82bc51a02f78d70fbf094d25204d83cfa14396c945ffd4a64cf82f2a4e123552"
Sep 15 10:39:27.543031 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:27.543010    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2d1b95b-f48e-4672-9be4-311309e7476c-workload-socket\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:39:27.543031 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:27.543033    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2d1b95b-f48e-4672-9be4-311309e7476c-istio-data\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:39:27.543177 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:27.543043    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2d1b95b-f48e-4672-9be4-311309e7476c-credential-socket\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:39:27.543177 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:27.543054    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2d1b95b-f48e-4672-9be4-311309e7476c-istio-podinfo\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:39:27.543177 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:27.543062    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2d1b95b-f48e-4672-9be4-311309e7476c-istio-token\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:39:27.543177 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:27.543070    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jp4tt\" (UniqueName: \"kubernetes.io/projected/b2d1b95b-f48e-4672-9be4-311309e7476c-kube-api-access-jp4tt\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:39:27.543177 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:27.543079    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2d1b95b-f48e-4672-9be4-311309e7476c-istiod-ca-cert\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:39:27.543177 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:27.543087    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2d1b95b-f48e-4672-9be4-311309e7476c-istio-envoy\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:39:27.543177 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:27.543094    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2d1b95b-f48e-4672-9be4-311309e7476c-workload-certs\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:39:27.546982 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:27.546966    2579 scope.go:117] "RemoveContainer" containerID="00f5c41361e36b521ecb61a47d952317a925ff00484cddccaf1523cf2a4820a9"
Sep 15 10:39:27.555953 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:27.555920    2579 scope.go:117] "RemoveContainer" containerID="82bc51a02f78d70fbf094d25204d83cfa14396c945ffd4a64cf82f2a4e123552"
Sep 15 10:39:27.556294 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:39:27.556269    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82bc51a02f78d70fbf094d25204d83cfa14396c945ffd4a64cf82f2a4e123552\": container with ID starting with 82bc51a02f78d70fbf094d25204d83cfa14396c945ffd4a64cf82f2a4e123552 not found: ID does not exist" containerID="82bc51a02f78d70fbf094d25204d83cfa14396c945ffd4a64cf82f2a4e123552"
Sep 15 10:39:27.556436 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:27.556404    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82bc51a02f78d70fbf094d25204d83cfa14396c945ffd4a64cf82f2a4e123552"} err="failed to get container status \"82bc51a02f78d70fbf094d25204d83cfa14396c945ffd4a64cf82f2a4e123552\": rpc error: code = NotFound desc = could not find container \"82bc51a02f78d70fbf094d25204d83cfa14396c945ffd4a64cf82f2a4e123552\": container with ID starting with 82bc51a02f78d70fbf094d25204d83cfa14396c945ffd4a64cf82f2a4e123552 not found: ID does not exist"
Sep 15 10:39:27.556436 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:27.556435    2579 scope.go:117] "RemoveContainer" containerID="00f5c41361e36b521ecb61a47d952317a925ff00484cddccaf1523cf2a4820a9"
Sep 15 10:39:27.556701 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:39:27.556684    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00f5c41361e36b521ecb61a47d952317a925ff00484cddccaf1523cf2a4820a9\": container with ID starting with 00f5c41361e36b521ecb61a47d952317a925ff00484cddccaf1523cf2a4820a9 not found: ID does not exist" containerID="00f5c41361e36b521ecb61a47d952317a925ff00484cddccaf1523cf2a4820a9"
Sep 15 10:39:27.556787 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:27.556707    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00f5c41361e36b521ecb61a47d952317a925ff00484cddccaf1523cf2a4820a9"} err="failed to get container status \"00f5c41361e36b521ecb61a47d952317a925ff00484cddccaf1523cf2a4820a9\": rpc error: code = NotFound desc = could not find container \"00f5c41361e36b521ecb61a47d952317a925ff00484cddccaf1523cf2a4820a9\": container with ID starting with 00f5c41361e36b521ecb61a47d952317a925ff00484cddccaf1523cf2a4820a9 not found: ID does not exist"
Sep 15 10:39:27.558766 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:27.558713    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn"]
Sep 15 10:39:27.562297 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:27.562275    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-234840-openshift-default-689549674-dxdtn"]
Sep 15 10:39:29.150325 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:29.150293    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2d1b95b-f48e-4672-9be4-311309e7476c" path="/var/lib/kubelet/pods/b2d1b95b-f48e-4672-9be4-311309e7476c/volumes"
Sep 15 10:39:30.919937 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:30.919901    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-83e814-5c85f7cf98-864qt"]
Sep 15 10:39:30.920434 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:30.920420    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e20724d5-2e37-4d6f-94ff-3430c68cfcbf" containerName="revoke-keys"
Sep 15 10:39:30.920434 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:30.920435    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e20724d5-2e37-4d6f-94ff-3430c68cfcbf" containerName="revoke-keys"
Sep 15 10:39:30.920509 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:30.920444    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2d1b95b-f48e-4672-9be4-311309e7476c" containerName="istio-proxy"
Sep 15 10:39:30.920509 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:30.920449    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2d1b95b-f48e-4672-9be4-311309e7476c" containerName="istio-proxy"
Sep 15 10:39:30.920572 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:30.920531    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e20724d5-2e37-4d6f-94ff-3430c68cfcbf" containerName="revoke-keys"
Sep 15 10:39:30.920572 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:30.920543    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2d1b95b-f48e-4672-9be4-311309e7476c" containerName="istio-proxy"
Sep 15 10:39:30.920572 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:30.920550    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2d1b95b-f48e-4672-9be4-311309e7476c" containerName="istio-proxy"
Sep 15 10:39:30.925340 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:30.925323    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-83e814-5c85f7cf98-864qt"
Sep 15 10:39:30.927840 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:30.927816    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-83e814\""
Sep 15 10:39:30.927949 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:30.927886    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-83e814-dockercfg-mxcn4\""
Sep 15 10:39:30.931955 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:30.931929    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-83e814-5c85f7cf98-864qt"]
Sep 15 10:39:31.082428 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:31.082390    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fds68\" (UniqueName: \"kubernetes.io/projected/a5799485-0215-4c88-bcaa-843408dbbcb0-kube-api-access-fds68\") pod \"payload-pre-processing-e2e-shared-a-w3-83e814-5c85f7cf98-864qt\" (UID: \"a5799485-0215-4c88-bcaa-843408dbbcb0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-83e814-5c85f7cf98-864qt"
Sep 15 10:39:31.082594 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:31.082559    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a5799485-0215-4c88-bcaa-843408dbbcb0-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-83e814-5c85f7cf98-864qt\" (UID: \"a5799485-0215-4c88-bcaa-843408dbbcb0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-83e814-5c85f7cf98-864qt"
Sep 15 10:39:31.183709 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:31.183623    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fds68\" (UniqueName: \"kubernetes.io/projected/a5799485-0215-4c88-bcaa-843408dbbcb0-kube-api-access-fds68\") pod \"payload-pre-processing-e2e-shared-a-w3-83e814-5c85f7cf98-864qt\" (UID: \"a5799485-0215-4c88-bcaa-843408dbbcb0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-83e814-5c85f7cf98-864qt"
Sep 15 10:39:31.183709 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:31.183700    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a5799485-0215-4c88-bcaa-843408dbbcb0-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-83e814-5c85f7cf98-864qt\" (UID: \"a5799485-0215-4c88-bcaa-843408dbbcb0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-83e814-5c85f7cf98-864qt"
Sep 15 10:39:31.184385 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:31.184364    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a5799485-0215-4c88-bcaa-843408dbbcb0-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-83e814-5c85f7cf98-864qt\" (UID: \"a5799485-0215-4c88-bcaa-843408dbbcb0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-83e814-5c85f7cf98-864qt"
Sep 15 10:39:31.192206 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:31.192181    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fds68\" (UniqueName: \"kubernetes.io/projected/a5799485-0215-4c88-bcaa-843408dbbcb0-kube-api-access-fds68\") pod \"payload-pre-processing-e2e-shared-a-w3-83e814-5c85f7cf98-864qt\" (UID: \"a5799485-0215-4c88-bcaa-843408dbbcb0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-83e814-5c85f7cf98-864qt"
Sep 15 10:39:31.237547 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:31.237515    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-83e814-5c85f7cf98-864qt"
Sep 15 10:39:31.514262 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:31.514052    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-83e814-5c85f7cf98-864qt"]
Sep 15 10:39:31.517263 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:39:31.517238    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5799485_0215_4c88_bcaa_843408dbbcb0.slice/crio-2280699f5bea77aa887bf9a920fd597a6dffc41b432b111a3983e850e9ff3448 WatchSource:0}: Error finding container 2280699f5bea77aa887bf9a920fd597a6dffc41b432b111a3983e850e9ff3448: Status 404 returned error can't find the container with id 2280699f5bea77aa887bf9a920fd597a6dffc41b432b111a3983e850e9ff3448
Sep 15 10:39:31.567303 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:31.567156    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-83e814-5c85f7cf98-864qt" event={"ID":"a5799485-0215-4c88-bcaa-843408dbbcb0","Type":"ContainerStarted","Data":"2280699f5bea77aa887bf9a920fd597a6dffc41b432b111a3983e850e9ff3448"}
Sep 15 10:39:32.574122 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:32.574087    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-83e814-5c85f7cf98-864qt" event={"ID":"a5799485-0215-4c88-bcaa-843408dbbcb0","Type":"ContainerStarted","Data":"0fe4056ca87792d45eac170a25218e004a4ea7a23496ce982a8524ee13287ed1"}
Sep 15 10:39:32.574477 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:32.574223    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-83e814-5c85f7cf98-864qt"
Sep 15 10:39:32.610046 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:32.609984    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-83e814-5c85f7cf98-864qt" podStartSLOduration=2.60996639 podStartE2EDuration="2.60996639s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:39:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:39:32.607362831 +0000 UTC m=+1306.003454917" watchObservedRunningTime="2026-09-15 10:39:32.60996639 +0000 UTC m=+1306.006058478"
Sep 15 10:39:33.434957 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:33.434906    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx"]
Sep 15 10:39:33.435706 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:33.435677    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx" podUID="537f3419-e6ec-40ed-8e39-0644c50dcc34" containerName="istio-proxy" containerID="cri-o://cdfcd79cec3e96470cd169c4dc5a9d9c10ebf0240a8b88631e85b53c9ef97aa8" gracePeriod=30
Sep 15 10:39:38.610283 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:38.610252    2579 generic.go:356] "Generic (PLEG): container finished" podID="537f3419-e6ec-40ed-8e39-0644c50dcc34" containerID="cdfcd79cec3e96470cd169c4dc5a9d9c10ebf0240a8b88631e85b53c9ef97aa8" exitCode=0
Sep 15 10:39:38.610620 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:38.610332    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx" event={"ID":"537f3419-e6ec-40ed-8e39-0644c50dcc34","Type":"ContainerDied","Data":"cdfcd79cec3e96470cd169c4dc5a9d9c10ebf0240a8b88631e85b53c9ef97aa8"}
Sep 15 10:39:38.705946 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:38.705881    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx"
Sep 15 10:39:38.860878 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:38.860842    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/537f3419-e6ec-40ed-8e39-0644c50dcc34-istio-data\") pod \"537f3419-e6ec-40ed-8e39-0644c50dcc34\" (UID: \"537f3419-e6ec-40ed-8e39-0644c50dcc34\") "
Sep 15 10:39:38.861032 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:38.860930    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/537f3419-e6ec-40ed-8e39-0644c50dcc34-istio-token\") pod \"537f3419-e6ec-40ed-8e39-0644c50dcc34\" (UID: \"537f3419-e6ec-40ed-8e39-0644c50dcc34\") "
Sep 15 10:39:38.861032 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:38.860948    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/537f3419-e6ec-40ed-8e39-0644c50dcc34-credential-socket\") pod \"537f3419-e6ec-40ed-8e39-0644c50dcc34\" (UID: \"537f3419-e6ec-40ed-8e39-0644c50dcc34\") "
Sep 15 10:39:38.861032 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:38.861001    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d67qg\" (UniqueName: \"kubernetes.io/projected/537f3419-e6ec-40ed-8e39-0644c50dcc34-kube-api-access-d67qg\") pod \"537f3419-e6ec-40ed-8e39-0644c50dcc34\" (UID: \"537f3419-e6ec-40ed-8e39-0644c50dcc34\") "
Sep 15 10:39:38.861217 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:38.861032    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/537f3419-e6ec-40ed-8e39-0644c50dcc34-istiod-ca-cert\") pod \"537f3419-e6ec-40ed-8e39-0644c50dcc34\" (UID: \"537f3419-e6ec-40ed-8e39-0644c50dcc34\") "
Sep 15 10:39:38.861217 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:38.861068    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/537f3419-e6ec-40ed-8e39-0644c50dcc34-workload-socket\") pod \"537f3419-e6ec-40ed-8e39-0644c50dcc34\" (UID: \"537f3419-e6ec-40ed-8e39-0644c50dcc34\") "
Sep 15 10:39:38.861217 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:38.861094    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/537f3419-e6ec-40ed-8e39-0644c50dcc34-istio-envoy\") pod \"537f3419-e6ec-40ed-8e39-0644c50dcc34\" (UID: \"537f3419-e6ec-40ed-8e39-0644c50dcc34\") "
Sep 15 10:39:38.861217 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:38.861146    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/537f3419-e6ec-40ed-8e39-0644c50dcc34-istio-podinfo\") pod \"537f3419-e6ec-40ed-8e39-0644c50dcc34\" (UID: \"537f3419-e6ec-40ed-8e39-0644c50dcc34\") "
Sep 15 10:39:38.861217 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:38.861152    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/537f3419-e6ec-40ed-8e39-0644c50dcc34-istio-data" (OuterVolumeSpecName: "istio-data") pod "537f3419-e6ec-40ed-8e39-0644c50dcc34" (UID: "537f3419-e6ec-40ed-8e39-0644c50dcc34"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:39:38.861217 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:38.861187    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/537f3419-e6ec-40ed-8e39-0644c50dcc34-workload-certs\") pod \"537f3419-e6ec-40ed-8e39-0644c50dcc34\" (UID: \"537f3419-e6ec-40ed-8e39-0644c50dcc34\") "
Sep 15 10:39:38.861521 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:38.861317    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/537f3419-e6ec-40ed-8e39-0644c50dcc34-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "537f3419-e6ec-40ed-8e39-0644c50dcc34" (UID: "537f3419-e6ec-40ed-8e39-0644c50dcc34"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:39:38.861521 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:38.861329    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/537f3419-e6ec-40ed-8e39-0644c50dcc34-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "537f3419-e6ec-40ed-8e39-0644c50dcc34" (UID: "537f3419-e6ec-40ed-8e39-0644c50dcc34"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:39:38.861521 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:38.861498    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/537f3419-e6ec-40ed-8e39-0644c50dcc34-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "537f3419-e6ec-40ed-8e39-0644c50dcc34" (UID: "537f3419-e6ec-40ed-8e39-0644c50dcc34"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:39:38.861685 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:38.861549    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/537f3419-e6ec-40ed-8e39-0644c50dcc34-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "537f3419-e6ec-40ed-8e39-0644c50dcc34" (UID: "537f3419-e6ec-40ed-8e39-0644c50dcc34"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:39:38.861685 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:38.861562    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/537f3419-e6ec-40ed-8e39-0644c50dcc34-workload-certs\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:39:38.861685 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:38.861596    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/537f3419-e6ec-40ed-8e39-0644c50dcc34-istio-data\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:39:38.861685 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:38.861612    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/537f3419-e6ec-40ed-8e39-0644c50dcc34-credential-socket\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:39:38.861685 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:38.861625    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/537f3419-e6ec-40ed-8e39-0644c50dcc34-workload-socket\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:39:38.863434 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:38.863398    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/537f3419-e6ec-40ed-8e39-0644c50dcc34-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "537f3419-e6ec-40ed-8e39-0644c50dcc34" (UID: "537f3419-e6ec-40ed-8e39-0644c50dcc34"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:39:38.863535 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:38.863476    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/537f3419-e6ec-40ed-8e39-0644c50dcc34-kube-api-access-d67qg" (OuterVolumeSpecName: "kube-api-access-d67qg") pod "537f3419-e6ec-40ed-8e39-0644c50dcc34" (UID: "537f3419-e6ec-40ed-8e39-0644c50dcc34"). InnerVolumeSpecName "kube-api-access-d67qg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:39:38.863535 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:38.863482    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/537f3419-e6ec-40ed-8e39-0644c50dcc34-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "537f3419-e6ec-40ed-8e39-0644c50dcc34" (UID: "537f3419-e6ec-40ed-8e39-0644c50dcc34"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 10:39:38.863611 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:38.863541    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/537f3419-e6ec-40ed-8e39-0644c50dcc34-istio-token" (OuterVolumeSpecName: "istio-token") pod "537f3419-e6ec-40ed-8e39-0644c50dcc34" (UID: "537f3419-e6ec-40ed-8e39-0644c50dcc34"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:39:38.962813 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:38.962681    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/537f3419-e6ec-40ed-8e39-0644c50dcc34-istio-token\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:39:38.962813 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:38.962716    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d67qg\" (UniqueName: \"kubernetes.io/projected/537f3419-e6ec-40ed-8e39-0644c50dcc34-kube-api-access-d67qg\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:39:38.962813 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:38.962769    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/537f3419-e6ec-40ed-8e39-0644c50dcc34-istiod-ca-cert\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:39:38.962813 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:38.962782    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/537f3419-e6ec-40ed-8e39-0644c50dcc34-istio-envoy\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:39:38.962813 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:38.962793    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/537f3419-e6ec-40ed-8e39-0644c50dcc34-istio-podinfo\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:39:39.617303 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:39.617274    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx"
Sep 15 10:39:39.617703 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:39.617321    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx" event={"ID":"537f3419-e6ec-40ed-8e39-0644c50dcc34","Type":"ContainerDied","Data":"82eceabfa11a6686259ca0e96334765823739865c45ec7f97990c6c8430517b8"}
Sep 15 10:39:39.617703 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:39.617386    2579 scope.go:117] "RemoveContainer" containerID="cdfcd79cec3e96470cd169c4dc5a9d9c10ebf0240a8b88631e85b53c9ef97aa8"
Sep 15 10:39:39.636325 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:39.636299    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx"]
Sep 15 10:39:39.640148 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:39.640126    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-948cb7-openshift-default-5cd984d5fd-v4mvx"]
Sep 15 10:39:41.150717 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:41.150684    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="537f3419-e6ec-40ed-8e39-0644c50dcc34" path="/var/lib/kubelet/pods/537f3419-e6ec-40ed-8e39-0644c50dcc34/volumes"
Sep 15 10:39:43.582459 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:43.582422    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-83e814-5c85f7cf98-864qt"
Sep 15 10:39:47.320676 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:47.320641    2579 scope.go:117] "RemoveContainer" containerID="ecd6f41f8ce097132a669c327b844b5978350290ee8a1b43328bbe4eeb3737a1"
Sep 15 10:39:57.123716 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:57.123682    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw"]
Sep 15 10:39:57.124331 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:57.124178    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2d1b95b-f48e-4672-9be4-311309e7476c" containerName="istio-proxy"
Sep 15 10:39:57.124331 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:57.124191    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2d1b95b-f48e-4672-9be4-311309e7476c" containerName="istio-proxy"
Sep 15 10:39:57.124331 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:57.124208    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="537f3419-e6ec-40ed-8e39-0644c50dcc34" containerName="istio-proxy"
Sep 15 10:39:57.124331 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:57.124213    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="537f3419-e6ec-40ed-8e39-0644c50dcc34" containerName="istio-proxy"
Sep 15 10:39:57.124331 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:57.124290    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="537f3419-e6ec-40ed-8e39-0644c50dcc34" containerName="istio-proxy"
Sep 15 10:39:57.129139 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:57.129118    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw"
Sep 15 10:39:57.131755 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:57.131712    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-44134e-openshift-default-dockercfg-swh5f\""
Sep 15 10:39:57.139106 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:57.139083    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw"]
Sep 15 10:39:57.249315 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:57.249276    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61734c1a-5952-4196-af16-412530218079-workload-socket\") pod \"e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw\" (UID: \"61734c1a-5952-4196-af16-412530218079\") " pod="openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw"
Sep 15 10:39:57.249628 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:57.249597    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61734c1a-5952-4196-af16-412530218079-istiod-ca-cert\") pod \"e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw\" (UID: \"61734c1a-5952-4196-af16-412530218079\") " pod="openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw"
Sep 15 10:39:57.249768 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:57.249638    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61734c1a-5952-4196-af16-412530218079-istio-envoy\") pod \"e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw\" (UID: \"61734c1a-5952-4196-af16-412530218079\") " pod="openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw"
Sep 15 10:39:57.249768 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:57.249666    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zjgp\" (UniqueName: \"kubernetes.io/projected/61734c1a-5952-4196-af16-412530218079-kube-api-access-4zjgp\") pod \"e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw\" (UID: \"61734c1a-5952-4196-af16-412530218079\") " pod="openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw"
Sep 15 10:39:57.249881 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:57.249787    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61734c1a-5952-4196-af16-412530218079-credential-socket\") pod \"e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw\" (UID: \"61734c1a-5952-4196-af16-412530218079\") " pod="openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw"
Sep 15 10:39:57.249932 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:57.249880    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61734c1a-5952-4196-af16-412530218079-workload-certs\") pod \"e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw\" (UID: \"61734c1a-5952-4196-af16-412530218079\") " pod="openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw"
Sep 15 10:39:57.249983 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:57.249931    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61734c1a-5952-4196-af16-412530218079-istio-token\") pod \"e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw\" (UID: \"61734c1a-5952-4196-af16-412530218079\") " pod="openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw"
Sep 15 10:39:57.250032 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:57.249973    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61734c1a-5952-4196-af16-412530218079-istio-data\") pod \"e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw\" (UID: \"61734c1a-5952-4196-af16-412530218079\") " pod="openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw"
Sep 15 10:39:57.250137 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:57.250118    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61734c1a-5952-4196-af16-412530218079-istio-podinfo\") pod \"e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw\" (UID: \"61734c1a-5952-4196-af16-412530218079\") " pod="openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw"
Sep 15 10:39:57.351375 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:57.351344    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61734c1a-5952-4196-af16-412530218079-workload-socket\") pod \"e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw\" (UID: \"61734c1a-5952-4196-af16-412530218079\") " pod="openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw"
Sep 15 10:39:57.351560 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:57.351386    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61734c1a-5952-4196-af16-412530218079-istiod-ca-cert\") pod \"e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw\" (UID: \"61734c1a-5952-4196-af16-412530218079\") " pod="openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw"
Sep 15 10:39:57.351560 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:57.351426    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61734c1a-5952-4196-af16-412530218079-istio-envoy\") pod \"e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw\" (UID: \"61734c1a-5952-4196-af16-412530218079\") " pod="openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw"
Sep 15 10:39:57.351560 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:57.351443    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zjgp\" (UniqueName: \"kubernetes.io/projected/61734c1a-5952-4196-af16-412530218079-kube-api-access-4zjgp\") pod \"e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw\" (UID: \"61734c1a-5952-4196-af16-412530218079\") " pod="openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw"
Sep 15 10:39:57.351560 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:57.351466    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61734c1a-5952-4196-af16-412530218079-credential-socket\") pod \"e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw\" (UID: \"61734c1a-5952-4196-af16-412530218079\") " pod="openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw"
Sep 15 10:39:57.351800 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:57.351640    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61734c1a-5952-4196-af16-412530218079-workload-certs\") pod \"e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw\" (UID: \"61734c1a-5952-4196-af16-412530218079\") " pod="openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw"
Sep 15 10:39:57.351800 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:57.351705    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61734c1a-5952-4196-af16-412530218079-istio-token\") pod \"e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw\" (UID: \"61734c1a-5952-4196-af16-412530218079\") " pod="openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw"
Sep 15 10:39:57.351913 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:57.351798    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61734c1a-5952-4196-af16-412530218079-istio-data\") pod \"e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw\" (UID: \"61734c1a-5952-4196-af16-412530218079\") " pod="openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw"
Sep 15 10:39:57.351913 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:57.351836    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61734c1a-5952-4196-af16-412530218079-workload-socket\") pod \"e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw\" (UID: \"61734c1a-5952-4196-af16-412530218079\") " pod="openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw"
Sep 15 10:39:57.351913 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:57.351847    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61734c1a-5952-4196-af16-412530218079-istio-podinfo\") pod \"e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw\" (UID: \"61734c1a-5952-4196-af16-412530218079\") " pod="openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw"
Sep 15 10:39:57.352072 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:57.351937    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61734c1a-5952-4196-af16-412530218079-credential-socket\") pod \"e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw\" (UID: \"61734c1a-5952-4196-af16-412530218079\") " pod="openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw"
Sep 15 10:39:57.352163 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:57.352138    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61734c1a-5952-4196-af16-412530218079-istiod-ca-cert\") pod \"e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw\" (UID: \"61734c1a-5952-4196-af16-412530218079\") " pod="openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw"
Sep 15 10:39:57.352276 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:57.352193    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61734c1a-5952-4196-af16-412530218079-istio-data\") pod \"e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw\" (UID: \"61734c1a-5952-4196-af16-412530218079\") " pod="openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw"
Sep 15 10:39:57.352276 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:57.352251    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61734c1a-5952-4196-af16-412530218079-workload-certs\") pod \"e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw\" (UID: \"61734c1a-5952-4196-af16-412530218079\") " pod="openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw"
Sep 15 10:39:57.353779 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:57.353756    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61734c1a-5952-4196-af16-412530218079-istio-envoy\") pod \"e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw\" (UID: \"61734c1a-5952-4196-af16-412530218079\") " pod="openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw"
Sep 15 10:39:57.354049 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:57.354032    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61734c1a-5952-4196-af16-412530218079-istio-podinfo\") pod \"e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw\" (UID: \"61734c1a-5952-4196-af16-412530218079\") " pod="openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw"
Sep 15 10:39:57.359114 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:57.359087    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61734c1a-5952-4196-af16-412530218079-istio-token\") pod \"e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw\" (UID: \"61734c1a-5952-4196-af16-412530218079\") " pod="openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw"
Sep 15 10:39:57.359212 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:57.359166    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zjgp\" (UniqueName: \"kubernetes.io/projected/61734c1a-5952-4196-af16-412530218079-kube-api-access-4zjgp\") pod \"e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw\" (UID: \"61734c1a-5952-4196-af16-412530218079\") " pod="openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw"
Sep 15 10:39:57.443201 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:57.443120    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw"
Sep 15 10:39:57.725273 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:57.725247    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw"]
Sep 15 10:39:57.726807 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:39:57.726779    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61734c1a_5952_4196_af16_412530218079.slice/crio-8a61077cf1066b69705f39e675d3f5d8941cab07075418157e0b12f400186fa8 WatchSource:0}: Error finding container 8a61077cf1066b69705f39e675d3f5d8941cab07075418157e0b12f400186fa8: Status 404 returned error can't find the container with id 8a61077cf1066b69705f39e675d3f5d8941cab07075418157e0b12f400186fa8
Sep 15 10:39:57.730585 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:57.729378    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:39:57.730585 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:57.729529    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:39:57.730585 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:57.729619    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:39:58.727518 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:58.727477    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw" event={"ID":"61734c1a-5952-4196-af16-412530218079","Type":"ContainerStarted","Data":"8c154b80c02f4b145cad2b7376dfd85aebf140fae94e75a45c937df55c5d7b87"}
Sep 15 10:39:58.727940 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:58.727566    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw" event={"ID":"61734c1a-5952-4196-af16-412530218079","Type":"ContainerStarted","Data":"8a61077cf1066b69705f39e675d3f5d8941cab07075418157e0b12f400186fa8"}
Sep 15 10:39:58.751200 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:58.751156    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw" podStartSLOduration=1.75114297 podStartE2EDuration="1.75114297s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:39:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:39:58.749954468 +0000 UTC m=+1332.146046555" watchObservedRunningTime="2026-09-15 10:39:58.75114297 +0000 UTC m=+1332.147235057"
Sep 15 10:39:59.443535 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:59.443503    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw"
Sep 15 10:39:59.448359 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:59.448334    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw"
Sep 15 10:39:59.554231 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:59.554197    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6111ecc0-2njb9"]
Sep 15 10:39:59.558113 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:59.558095    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6111ecc0-2njb9"
Sep 15 10:39:59.560586 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:59.560566    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5jrzm\""
Sep 15 10:39:59.564003 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:59.563978    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6111ecc0-2njb9"]
Sep 15 10:39:59.674540 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:59.674505    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8502875b-53d1-4d62-bd0e-3ecd28d03845-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-6111ecc0-2njb9\" (UID: \"8502875b-53d1-4d62-bd0e-3ecd28d03845\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6111ecc0-2njb9"
Sep 15 10:39:59.734002 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:59.733911    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw"
Sep 15 10:39:59.734968 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:59.734946    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw"
Sep 15 10:39:59.775597 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:59.775561    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8502875b-53d1-4d62-bd0e-3ecd28d03845-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-6111ecc0-2njb9\" (UID: \"8502875b-53d1-4d62-bd0e-3ecd28d03845\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6111ecc0-2njb9"
Sep 15 10:39:59.776248 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:59.776227    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8502875b-53d1-4d62-bd0e-3ecd28d03845-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-6111ecc0-2njb9\" (UID: \"8502875b-53d1-4d62-bd0e-3ecd28d03845\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6111ecc0-2njb9"
Sep 15 10:39:59.871530 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:39:59.871496    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6111ecc0-2njb9"
Sep 15 10:40:00.147137 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:00.147101    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6111ecc0-2njb9"]
Sep 15 10:40:00.149209 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:40:00.149181    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8502875b_53d1_4d62_bd0e_3ecd28d03845.slice/crio-1e38aeb66dd57ea5332a58b811385b2eb5c548b64533ffab7a004d36f81d0d4b WatchSource:0}: Error finding container 1e38aeb66dd57ea5332a58b811385b2eb5c548b64533ffab7a004d36f81d0d4b: Status 404 returned error can't find the container with id 1e38aeb66dd57ea5332a58b811385b2eb5c548b64533ffab7a004d36f81d0d4b
Sep 15 10:40:00.741585 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:00.741492    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6111ecc0-2njb9" event={"ID":"8502875b-53d1-4d62-bd0e-3ecd28d03845","Type":"ContainerStarted","Data":"d88aee40d69b440e2b139a42b5a6c40584455ed091034bd0b8779e145cefb36e"}
Sep 15 10:40:00.741585 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:00.741550    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6111ecc0-2njb9" event={"ID":"8502875b-53d1-4d62-bd0e-3ecd28d03845","Type":"ContainerStarted","Data":"1e38aeb66dd57ea5332a58b811385b2eb5c548b64533ffab7a004d36f81d0d4b"}
Sep 15 10:40:00.757059 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:00.757012    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6111ecc0-2njb9" podStartSLOduration=1.756995963 podStartE2EDuration="1.756995963s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:39:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:40:00.755440313 +0000 UTC m=+1334.151532401" watchObservedRunningTime="2026-09-15 10:40:00.756995963 +0000 UTC m=+1334.153088049"
Sep 15 10:40:01.748668 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:01.748634    2579 generic.go:356] "Generic (PLEG): container finished" podID="8502875b-53d1-4d62-bd0e-3ecd28d03845" containerID="d88aee40d69b440e2b139a42b5a6c40584455ed091034bd0b8779e145cefb36e" exitCode=0
Sep 15 10:40:01.749093 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:01.748756    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6111ecc0-2njb9" event={"ID":"8502875b-53d1-4d62-bd0e-3ecd28d03845","Type":"ContainerDied","Data":"d88aee40d69b440e2b139a42b5a6c40584455ed091034bd0b8779e145cefb36e"}
Sep 15 10:40:02.908625 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:02.908594    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6111ecc0-2njb9"
Sep 15 10:40:03.009358 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:03.009271    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8502875b-53d1-4d62-bd0e-3ecd28d03845-maas-api-service-ca\") pod \"8502875b-53d1-4d62-bd0e-3ecd28d03845\" (UID: \"8502875b-53d1-4d62-bd0e-3ecd28d03845\") "
Sep 15 10:40:03.009695 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:03.009671    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8502875b-53d1-4d62-bd0e-3ecd28d03845-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8502875b-53d1-4d62-bd0e-3ecd28d03845" (UID: "8502875b-53d1-4d62-bd0e-3ecd28d03845"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:40:03.110808 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:03.110716    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8502875b-53d1-4d62-bd0e-3ecd28d03845-maas-api-service-ca\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:40:03.762305 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:03.762275    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6111ecc0-2njb9"
Sep 15 10:40:03.762495 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:03.762312    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6111ecc0-2njb9" event={"ID":"8502875b-53d1-4d62-bd0e-3ecd28d03845","Type":"ContainerDied","Data":"1e38aeb66dd57ea5332a58b811385b2eb5c548b64533ffab7a004d36f81d0d4b"}
Sep 15 10:40:03.762495 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:03.762372    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1e38aeb66dd57ea5332a58b811385b2eb5c548b64533ffab7a004d36f81d0d4b"
Sep 15 10:40:06.055271 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:06.055229    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-44134e-5cd878fc74-dfzfg"]
Sep 15 10:40:06.055740 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:06.055713    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8502875b-53d1-4d62-bd0e-3ecd28d03845" containerName="revoke-keys"
Sep 15 10:40:06.055740 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:06.055739    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8502875b-53d1-4d62-bd0e-3ecd28d03845" containerName="revoke-keys"
Sep 15 10:40:06.055833 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:06.055817    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8502875b-53d1-4d62-bd0e-3ecd28d03845" containerName="revoke-keys"
Sep 15 10:40:06.059317 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:06.059295    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-44134e-5cd878fc74-dfzfg"
Sep 15 10:40:06.061920 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:06.061899    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-44134e\""
Sep 15 10:40:06.062047 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:06.061899    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-44134e-5cd878fc74-dfzfg"]
Sep 15 10:40:06.142645 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:06.142608    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbg6n\" (UniqueName: \"kubernetes.io/projected/8a7c6101-5e8f-43d1-8359-9d502cd63bff-kube-api-access-wbg6n\") pod \"payload-pre-processing-e2e-shared-b-w3-44134e-5cd878fc74-dfzfg\" (UID: \"8a7c6101-5e8f-43d1-8359-9d502cd63bff\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-44134e-5cd878fc74-dfzfg"
Sep 15 10:40:06.142823 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:06.142687    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a7c6101-5e8f-43d1-8359-9d502cd63bff-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-44134e-5cd878fc74-dfzfg\" (UID: \"8a7c6101-5e8f-43d1-8359-9d502cd63bff\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-44134e-5cd878fc74-dfzfg"
Sep 15 10:40:06.243835 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:06.243794    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a7c6101-5e8f-43d1-8359-9d502cd63bff-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-44134e-5cd878fc74-dfzfg\" (UID: \"8a7c6101-5e8f-43d1-8359-9d502cd63bff\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-44134e-5cd878fc74-dfzfg"
Sep 15 10:40:06.244039 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:06.243968    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbg6n\" (UniqueName: \"kubernetes.io/projected/8a7c6101-5e8f-43d1-8359-9d502cd63bff-kube-api-access-wbg6n\") pod \"payload-pre-processing-e2e-shared-b-w3-44134e-5cd878fc74-dfzfg\" (UID: \"8a7c6101-5e8f-43d1-8359-9d502cd63bff\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-44134e-5cd878fc74-dfzfg"
Sep 15 10:40:06.244583 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:06.244562    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a7c6101-5e8f-43d1-8359-9d502cd63bff-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-44134e-5cd878fc74-dfzfg\" (UID: \"8a7c6101-5e8f-43d1-8359-9d502cd63bff\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-44134e-5cd878fc74-dfzfg"
Sep 15 10:40:06.251631 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:06.251607    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbg6n\" (UniqueName: \"kubernetes.io/projected/8a7c6101-5e8f-43d1-8359-9d502cd63bff-kube-api-access-wbg6n\") pod \"payload-pre-processing-e2e-shared-b-w3-44134e-5cd878fc74-dfzfg\" (UID: \"8a7c6101-5e8f-43d1-8359-9d502cd63bff\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-44134e-5cd878fc74-dfzfg"
Sep 15 10:40:06.371161 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:06.371065    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-44134e-5cd878fc74-dfzfg"
Sep 15 10:40:06.655883 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:06.655846    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-44134e-5cd878fc74-dfzfg"]
Sep 15 10:40:06.658579 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:40:06.658544    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a7c6101_5e8f_43d1_8359_9d502cd63bff.slice/crio-e360e0238e989d9457a255f687717e5c68ab10f0df9447b9367d37ca4154d724 WatchSource:0}: Error finding container e360e0238e989d9457a255f687717e5c68ab10f0df9447b9367d37ca4154d724: Status 404 returned error can't find the container with id e360e0238e989d9457a255f687717e5c68ab10f0df9447b9367d37ca4154d724
Sep 15 10:40:06.781715 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:06.781678    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-44134e-5cd878fc74-dfzfg" event={"ID":"8a7c6101-5e8f-43d1-8359-9d502cd63bff","Type":"ContainerStarted","Data":"072f74fdf07b45ab4f249bc3a6fc9900d2c9d6568b87bfd3c468fc2928216207"}
Sep 15 10:40:06.781904 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:06.781757    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-44134e-5cd878fc74-dfzfg" event={"ID":"8a7c6101-5e8f-43d1-8359-9d502cd63bff","Type":"ContainerStarted","Data":"e360e0238e989d9457a255f687717e5c68ab10f0df9447b9367d37ca4154d724"}
Sep 15 10:40:06.781904 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:06.781786    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-44134e-5cd878fc74-dfzfg"
Sep 15 10:40:06.800295 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:06.800236    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-44134e-5cd878fc74-dfzfg" podStartSLOduration=0.800213982 podStartE2EDuration="800.213982ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:40:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:40:06.797932542 +0000 UTC m=+1340.194024631" watchObservedRunningTime="2026-09-15 10:40:06.800213982 +0000 UTC m=+1340.196306071"
Sep 15 10:40:15.256412 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:15.256300    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6111ecc0-5ff47f44c7-ntg7j"]
Sep 15 10:40:15.257072 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:15.256672    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-6111ecc0-5ff47f44c7-ntg7j" podUID="63a3f5f4-fc88-4e8b-8765-baea07b7cb86" containerName="payload-processing" containerID="cri-o://5a9b0a4a6df8838a2dd044524fb70851cda5511ac03c8587396c00a3c4eb2e64" gracePeriod=30
Sep 15 10:40:15.391178 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:15.391098    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6111ecc0-2njb9"]
Sep 15 10:40:15.395112 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:15.395082    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6111ecc0-2njb9"]
Sep 15 10:40:15.547916 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:15.547889    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-6111ecc0-5ff47f44c7-ntg7j"
Sep 15 10:40:15.647371 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:15.647344    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gn9h9\" (UniqueName: \"kubernetes.io/projected/63a3f5f4-fc88-4e8b-8765-baea07b7cb86-kube-api-access-gn9h9\") pod \"63a3f5f4-fc88-4e8b-8765-baea07b7cb86\" (UID: \"63a3f5f4-fc88-4e8b-8765-baea07b7cb86\") "
Sep 15 10:40:15.647629 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:15.647394    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63a3f5f4-fc88-4e8b-8765-baea07b7cb86-plugins-config-volume\") pod \"63a3f5f4-fc88-4e8b-8765-baea07b7cb86\" (UID: \"63a3f5f4-fc88-4e8b-8765-baea07b7cb86\") "
Sep 15 10:40:15.647868 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:15.647841    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63a3f5f4-fc88-4e8b-8765-baea07b7cb86-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "63a3f5f4-fc88-4e8b-8765-baea07b7cb86" (UID: "63a3f5f4-fc88-4e8b-8765-baea07b7cb86"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:40:15.649487 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:15.649464    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63a3f5f4-fc88-4e8b-8765-baea07b7cb86-kube-api-access-gn9h9" (OuterVolumeSpecName: "kube-api-access-gn9h9") pod "63a3f5f4-fc88-4e8b-8765-baea07b7cb86" (UID: "63a3f5f4-fc88-4e8b-8765-baea07b7cb86"). InnerVolumeSpecName "kube-api-access-gn9h9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:40:15.748644 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:15.748605    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gn9h9\" (UniqueName: \"kubernetes.io/projected/63a3f5f4-fc88-4e8b-8765-baea07b7cb86-kube-api-access-gn9h9\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:40:15.748644 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:15.748637    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63a3f5f4-fc88-4e8b-8765-baea07b7cb86-plugins-config-volume\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:40:15.837129 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:15.837091    2579 generic.go:356] "Generic (PLEG): container finished" podID="63a3f5f4-fc88-4e8b-8765-baea07b7cb86" containerID="5a9b0a4a6df8838a2dd044524fb70851cda5511ac03c8587396c00a3c4eb2e64" exitCode=0
Sep 15 10:40:15.837277 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:15.837140    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-6111ecc0-5ff47f44c7-ntg7j"
Sep 15 10:40:15.837277 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:15.837183    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-6111ecc0-5ff47f44c7-ntg7j" event={"ID":"63a3f5f4-fc88-4e8b-8765-baea07b7cb86","Type":"ContainerDied","Data":"5a9b0a4a6df8838a2dd044524fb70851cda5511ac03c8587396c00a3c4eb2e64"}
Sep 15 10:40:15.837277 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:15.837240    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-6111ecc0-5ff47f44c7-ntg7j" event={"ID":"63a3f5f4-fc88-4e8b-8765-baea07b7cb86","Type":"ContainerDied","Data":"49bed3dad30a6c55a49e915f0a74bd8e78c157af07023d85d8253b104d8c7be0"}
Sep 15 10:40:15.837277 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:15.837270    2579 scope.go:117] "RemoveContainer" containerID="5a9b0a4a6df8838a2dd044524fb70851cda5511ac03c8587396c00a3c4eb2e64"
Sep 15 10:40:15.847312 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:15.847290    2579 scope.go:117] "RemoveContainer" containerID="5a9b0a4a6df8838a2dd044524fb70851cda5511ac03c8587396c00a3c4eb2e64"
Sep 15 10:40:15.847609 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:40:15.847580    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a9b0a4a6df8838a2dd044524fb70851cda5511ac03c8587396c00a3c4eb2e64\": container with ID starting with 5a9b0a4a6df8838a2dd044524fb70851cda5511ac03c8587396c00a3c4eb2e64 not found: ID does not exist" containerID="5a9b0a4a6df8838a2dd044524fb70851cda5511ac03c8587396c00a3c4eb2e64"
Sep 15 10:40:15.847679 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:15.847617    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a9b0a4a6df8838a2dd044524fb70851cda5511ac03c8587396c00a3c4eb2e64"} err="failed to get container status \"5a9b0a4a6df8838a2dd044524fb70851cda5511ac03c8587396c00a3c4eb2e64\": rpc error: code = NotFound desc = could not find container \"5a9b0a4a6df8838a2dd044524fb70851cda5511ac03c8587396c00a3c4eb2e64\": container with ID starting with 5a9b0a4a6df8838a2dd044524fb70851cda5511ac03c8587396c00a3c4eb2e64 not found: ID does not exist"
Sep 15 10:40:15.860846 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:15.860815    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6111ecc0-5ff47f44c7-ntg7j"]
Sep 15 10:40:15.873239 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:15.873202    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6111ecc0-5ff47f44c7-ntg7j"]
Sep 15 10:40:17.149777 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:17.149745    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63a3f5f4-fc88-4e8b-8765-baea07b7cb86" path="/var/lib/kubelet/pods/63a3f5f4-fc88-4e8b-8765-baea07b7cb86/volumes"
Sep 15 10:40:17.150164 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:17.150124    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8502875b-53d1-4d62-bd0e-3ecd28d03845" path="/var/lib/kubelet/pods/8502875b-53d1-4d62-bd0e-3ecd28d03845/volumes"
Sep 15 10:40:17.791690 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:17.791653    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-44134e-5cd878fc74-dfzfg"
Sep 15 10:40:37.982767 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:37.982708    2579 generic.go:356] "Generic (PLEG): container finished" podID="61734c1a-5952-4196-af16-412530218079" containerID="8c154b80c02f4b145cad2b7376dfd85aebf140fae94e75a45c937df55c5d7b87" exitCode=0
Sep 15 10:40:37.983183 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:37.982789    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw" event={"ID":"61734c1a-5952-4196-af16-412530218079","Type":"ContainerDied","Data":"8c154b80c02f4b145cad2b7376dfd85aebf140fae94e75a45c937df55c5d7b87"}
Sep 15 10:40:37.983226 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:37.983186    2579 scope.go:117] "RemoveContainer" containerID="8c154b80c02f4b145cad2b7376dfd85aebf140fae94e75a45c937df55c5d7b87"
Sep 15 10:40:37.984337 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:37.984307    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:40:37.984403 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:37.984373    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:40:37.984444 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:37.984403    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:40:38.990516 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:38.990482    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw" event={"ID":"61734c1a-5952-4196-af16-412530218079","Type":"ContainerStarted","Data":"d27285d8efd3f8030b30ef2594014076301135d5817e914d68b08d4e4ef9943d"}
Sep 15 10:40:39.443400 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:39.443368    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw"
Sep 15 10:40:39.443577 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:39.443553    2579 patch_prober.go:28] interesting pod/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Sep 15 10:40:39.443637 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:39.443604    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw" podUID="61734c1a-5952-4196-af16-412530218079" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Sep 15 10:40:40.443700 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:40.443658    2579 patch_prober.go:28] interesting pod/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Sep 15 10:40:40.444126 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:40.443759    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw" podUID="61734c1a-5952-4196-af16-412530218079" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Sep 15 10:40:41.443601 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:41.443566    2579 patch_prober.go:28] interesting pod/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Sep 15 10:40:41.443804 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:41.443616    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw" podUID="61734c1a-5952-4196-af16-412530218079" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Sep 15 10:40:42.443488 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:42.443446    2579 patch_prober.go:28] interesting pod/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Sep 15 10:40:42.443658 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:42.443503    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw" podUID="61734c1a-5952-4196-af16-412530218079" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Sep 15 10:40:43.443707 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:43.443672    2579 patch_prober.go:28] interesting pod/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Sep 15 10:40:43.444133 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:43.443743    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw" podUID="61734c1a-5952-4196-af16-412530218079" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Sep 15 10:40:44.448220 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:44.448184    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw"
Sep 15 10:40:44.448674 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:44.448598    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw"
Sep 15 10:40:44.449214 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:40:44.449198    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw"
Sep 15 10:42:40.647996 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:40.647963    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9"]
Sep 15 10:42:40.648575 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:40.648459    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63a3f5f4-fc88-4e8b-8765-baea07b7cb86" containerName="payload-processing"
Sep 15 10:42:40.648575 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:40.648471    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="63a3f5f4-fc88-4e8b-8765-baea07b7cb86" containerName="payload-processing"
Sep 15 10:42:40.648575 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:40.648569    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="63a3f5f4-fc88-4e8b-8765-baea07b7cb86" containerName="payload-processing"
Sep 15 10:42:40.651960 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:40.651938    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9"
Sep 15 10:42:40.654335 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:40.654317    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-a81e8d-openshift-default-dockercfg-2t2ds\""
Sep 15 10:42:40.663830 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:40.663761    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9"]
Sep 15 10:42:40.830806 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:40.830758    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c881fc81-8936-49a1-abfc-16f7b8dd6a09-workload-socket\") pod \"e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9\" (UID: \"c881fc81-8936-49a1-abfc-16f7b8dd6a09\") " pod="openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9"
Sep 15 10:42:40.831009 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:40.830840    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c881fc81-8936-49a1-abfc-16f7b8dd6a09-istio-podinfo\") pod \"e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9\" (UID: \"c881fc81-8936-49a1-abfc-16f7b8dd6a09\") " pod="openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9"
Sep 15 10:42:40.831009 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:40.830861    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcmwx\" (UniqueName: \"kubernetes.io/projected/c881fc81-8936-49a1-abfc-16f7b8dd6a09-kube-api-access-jcmwx\") pod \"e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9\" (UID: \"c881fc81-8936-49a1-abfc-16f7b8dd6a09\") " pod="openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9"
Sep 15 10:42:40.831009 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:40.830878    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c881fc81-8936-49a1-abfc-16f7b8dd6a09-workload-certs\") pod \"e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9\" (UID: \"c881fc81-8936-49a1-abfc-16f7b8dd6a09\") " pod="openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9"
Sep 15 10:42:40.831009 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:40.830958    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c881fc81-8936-49a1-abfc-16f7b8dd6a09-istiod-ca-cert\") pod \"e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9\" (UID: \"c881fc81-8936-49a1-abfc-16f7b8dd6a09\") " pod="openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9"
Sep 15 10:42:40.831009 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:40.830981    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c881fc81-8936-49a1-abfc-16f7b8dd6a09-istio-data\") pod \"e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9\" (UID: \"c881fc81-8936-49a1-abfc-16f7b8dd6a09\") " pod="openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9"
Sep 15 10:42:40.831009 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:40.830999    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c881fc81-8936-49a1-abfc-16f7b8dd6a09-istio-envoy\") pod \"e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9\" (UID: \"c881fc81-8936-49a1-abfc-16f7b8dd6a09\") " pod="openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9"
Sep 15 10:42:40.831223 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:40.831059    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c881fc81-8936-49a1-abfc-16f7b8dd6a09-istio-token\") pod \"e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9\" (UID: \"c881fc81-8936-49a1-abfc-16f7b8dd6a09\") " pod="openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9"
Sep 15 10:42:40.831223 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:40.831074    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c881fc81-8936-49a1-abfc-16f7b8dd6a09-credential-socket\") pod \"e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9\" (UID: \"c881fc81-8936-49a1-abfc-16f7b8dd6a09\") " pod="openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9"
Sep 15 10:42:40.932109 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:40.932013    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c881fc81-8936-49a1-abfc-16f7b8dd6a09-istio-token\") pod \"e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9\" (UID: \"c881fc81-8936-49a1-abfc-16f7b8dd6a09\") " pod="openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9"
Sep 15 10:42:40.932109 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:40.932058    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c881fc81-8936-49a1-abfc-16f7b8dd6a09-credential-socket\") pod \"e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9\" (UID: \"c881fc81-8936-49a1-abfc-16f7b8dd6a09\") " pod="openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9"
Sep 15 10:42:40.932109 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:40.932110    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c881fc81-8936-49a1-abfc-16f7b8dd6a09-workload-socket\") pod \"e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9\" (UID: \"c881fc81-8936-49a1-abfc-16f7b8dd6a09\") " pod="openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9"
Sep 15 10:42:40.932416 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:40.932169    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c881fc81-8936-49a1-abfc-16f7b8dd6a09-istio-podinfo\") pod \"e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9\" (UID: \"c881fc81-8936-49a1-abfc-16f7b8dd6a09\") " pod="openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9"
Sep 15 10:42:40.932416 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:40.932199    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcmwx\" (UniqueName: \"kubernetes.io/projected/c881fc81-8936-49a1-abfc-16f7b8dd6a09-kube-api-access-jcmwx\") pod \"e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9\" (UID: \"c881fc81-8936-49a1-abfc-16f7b8dd6a09\") " pod="openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9"
Sep 15 10:42:40.932416 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:40.932224    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c881fc81-8936-49a1-abfc-16f7b8dd6a09-workload-certs\") pod \"e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9\" (UID: \"c881fc81-8936-49a1-abfc-16f7b8dd6a09\") " pod="openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9"
Sep 15 10:42:40.932416 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:40.932273    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c881fc81-8936-49a1-abfc-16f7b8dd6a09-istiod-ca-cert\") pod \"e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9\" (UID: \"c881fc81-8936-49a1-abfc-16f7b8dd6a09\") " pod="openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9"
Sep 15 10:42:40.932416 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:40.932306    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c881fc81-8936-49a1-abfc-16f7b8dd6a09-istio-data\") pod \"e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9\" (UID: \"c881fc81-8936-49a1-abfc-16f7b8dd6a09\") " pod="openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9"
Sep 15 10:42:40.932670 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:40.932435    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c881fc81-8936-49a1-abfc-16f7b8dd6a09-istio-envoy\") pod \"e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9\" (UID: \"c881fc81-8936-49a1-abfc-16f7b8dd6a09\") " pod="openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9"
Sep 15 10:42:40.932670 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:40.932582    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c881fc81-8936-49a1-abfc-16f7b8dd6a09-workload-socket\") pod \"e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9\" (UID: \"c881fc81-8936-49a1-abfc-16f7b8dd6a09\") " pod="openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9"
Sep 15 10:42:40.932670 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:40.932629    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c881fc81-8936-49a1-abfc-16f7b8dd6a09-credential-socket\") pod \"e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9\" (UID: \"c881fc81-8936-49a1-abfc-16f7b8dd6a09\") " pod="openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9"
Sep 15 10:42:40.932823 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:40.932770    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c881fc81-8936-49a1-abfc-16f7b8dd6a09-workload-certs\") pod \"e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9\" (UID: \"c881fc81-8936-49a1-abfc-16f7b8dd6a09\") " pod="openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9"
Sep 15 10:42:40.932989 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:40.932967    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c881fc81-8936-49a1-abfc-16f7b8dd6a09-istio-data\") pod \"e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9\" (UID: \"c881fc81-8936-49a1-abfc-16f7b8dd6a09\") " pod="openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9"
Sep 15 10:42:40.933065 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:40.933046    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c881fc81-8936-49a1-abfc-16f7b8dd6a09-istiod-ca-cert\") pod \"e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9\" (UID: \"c881fc81-8936-49a1-abfc-16f7b8dd6a09\") " pod="openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9"
Sep 15 10:42:40.934697 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:40.934676    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c881fc81-8936-49a1-abfc-16f7b8dd6a09-istio-envoy\") pod \"e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9\" (UID: \"c881fc81-8936-49a1-abfc-16f7b8dd6a09\") " pod="openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9"
Sep 15 10:42:40.934871 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:40.934852    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c881fc81-8936-49a1-abfc-16f7b8dd6a09-istio-podinfo\") pod \"e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9\" (UID: \"c881fc81-8936-49a1-abfc-16f7b8dd6a09\") " pod="openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9"
Sep 15 10:42:40.939690 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:40.939667    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c881fc81-8936-49a1-abfc-16f7b8dd6a09-istio-token\") pod \"e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9\" (UID: \"c881fc81-8936-49a1-abfc-16f7b8dd6a09\") " pod="openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9"
Sep 15 10:42:40.939802 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:40.939782    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcmwx\" (UniqueName: \"kubernetes.io/projected/c881fc81-8936-49a1-abfc-16f7b8dd6a09-kube-api-access-jcmwx\") pod \"e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9\" (UID: \"c881fc81-8936-49a1-abfc-16f7b8dd6a09\") " pod="openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9"
Sep 15 10:42:40.963935 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:40.963902    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9"
Sep 15 10:42:41.245968 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:41.245916    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9"]
Sep 15 10:42:41.248266 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:42:41.248240    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc881fc81_8936_49a1_abfc_16f7b8dd6a09.slice/crio-e0ce96be22eb73cd29014293e54e5234bfc429af5287e6a0ac5bc89ad8c8dec7 WatchSource:0}: Error finding container e0ce96be22eb73cd29014293e54e5234bfc429af5287e6a0ac5bc89ad8c8dec7: Status 404 returned error can't find the container with id e0ce96be22eb73cd29014293e54e5234bfc429af5287e6a0ac5bc89ad8c8dec7
Sep 15 10:42:41.250532 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:41.250500    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:42:41.250599 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:41.250566    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:42:41.250599 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:41.250594    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:42:41.736277 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:41.736241    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9" event={"ID":"c881fc81-8936-49a1-abfc-16f7b8dd6a09","Type":"ContainerStarted","Data":"4d3eebc088c41b669c9933039d782fd35abd27192693d0155c5fb578258ecb9e"}
Sep 15 10:42:41.736656 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:41.736306    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9" event={"ID":"c881fc81-8936-49a1-abfc-16f7b8dd6a09","Type":"ContainerStarted","Data":"e0ce96be22eb73cd29014293e54e5234bfc429af5287e6a0ac5bc89ad8c8dec7"}
Sep 15 10:42:41.758170 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:41.758118    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9" podStartSLOduration=1.758102761 podStartE2EDuration="1.758102761s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:42:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:42:41.756560495 +0000 UTC m=+1495.152652582" watchObservedRunningTime="2026-09-15 10:42:41.758102761 +0000 UTC m=+1495.154194849"
Sep 15 10:42:41.964735 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:41.964698    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9"
Sep 15 10:42:42.970166 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:42.970137    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9"
Sep 15 10:42:43.748246 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:43.748215    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9"
Sep 15 10:42:43.749193 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:43.749167    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9"
Sep 15 10:42:47.382739 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:47.382699    2579 scope.go:117] "RemoveContainer" containerID="cfab0540abb0c9768ba5b6ec2f94b178a9c3db083a23ae62cfb73cde7f120546"
Sep 15 10:42:48.571859 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:48.571822    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-a81e8d-7f9c897fdb-m59sm"]
Sep 15 10:42:48.576702 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:48.576684    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a81e8d-7f9c897fdb-m59sm"
Sep 15 10:42:48.580109 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:48.580088    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-a81e8d-dockercfg-phmxj\""
Sep 15 10:42:48.580224 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:48.580161    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-a81e8d\""
Sep 15 10:42:48.594223 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:48.589439    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-a81e8d-7f9c897fdb-m59sm"]
Sep 15 10:42:48.603993 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:48.603943    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a81e8d-7f884665b9-tz2q9"]
Sep 15 10:42:48.607786 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:48.607756    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-a81e8d-7f884665b9-tz2q9"
Sep 15 10:42:48.611637 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:48.611599    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vwpz\" (UniqueName: \"kubernetes.io/projected/f1c82067-fca8-41db-a972-6234e383848f-kube-api-access-8vwpz\") pod \"payload-pre-processing-e2e-api-a-a81e8d-7f9c897fdb-m59sm\" (UID: \"f1c82067-fca8-41db-a972-6234e383848f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-a81e8d-7f9c897fdb-m59sm"
Sep 15 10:42:48.611804 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:48.611712    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1c82067-fca8-41db-a972-6234e383848f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-a81e8d-7f9c897fdb-m59sm\" (UID: \"f1c82067-fca8-41db-a972-6234e383848f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-a81e8d-7f9c897fdb-m59sm"
Sep 15 10:42:48.617226 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:48.617197    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a81e8d-7f884665b9-tz2q9"]
Sep 15 10:42:48.713410 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:48.713362    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1c82067-fca8-41db-a972-6234e383848f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-a81e8d-7f9c897fdb-m59sm\" (UID: \"f1c82067-fca8-41db-a972-6234e383848f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-a81e8d-7f9c897fdb-m59sm"
Sep 15 10:42:48.713410 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:48.713417    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbd9w\" (UniqueName: \"kubernetes.io/projected/4800676e-1f98-43aa-a374-5147d6a2632a-kube-api-access-jbd9w\") pod \"payload-processing-e2e-api-a-a81e8d-7f884665b9-tz2q9\" (UID: \"4800676e-1f98-43aa-a374-5147d6a2632a\") " pod="openshift-ingress/payload-processing-e2e-api-a-a81e8d-7f884665b9-tz2q9"
Sep 15 10:42:48.713662 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:48.713447    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4800676e-1f98-43aa-a374-5147d6a2632a-plugins-config-volume\") pod \"payload-processing-e2e-api-a-a81e8d-7f884665b9-tz2q9\" (UID: \"4800676e-1f98-43aa-a374-5147d6a2632a\") " pod="openshift-ingress/payload-processing-e2e-api-a-a81e8d-7f884665b9-tz2q9"
Sep 15 10:42:48.713662 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:48.713570    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vwpz\" (UniqueName: \"kubernetes.io/projected/f1c82067-fca8-41db-a972-6234e383848f-kube-api-access-8vwpz\") pod \"payload-pre-processing-e2e-api-a-a81e8d-7f9c897fdb-m59sm\" (UID: \"f1c82067-fca8-41db-a972-6234e383848f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-a81e8d-7f9c897fdb-m59sm"
Sep 15 10:42:48.714115 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:48.714094    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1c82067-fca8-41db-a972-6234e383848f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-a81e8d-7f9c897fdb-m59sm\" (UID: \"f1c82067-fca8-41db-a972-6234e383848f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-a81e8d-7f9c897fdb-m59sm"
Sep 15 10:42:48.722452 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:48.722428    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vwpz\" (UniqueName: \"kubernetes.io/projected/f1c82067-fca8-41db-a972-6234e383848f-kube-api-access-8vwpz\") pod \"payload-pre-processing-e2e-api-a-a81e8d-7f9c897fdb-m59sm\" (UID: \"f1c82067-fca8-41db-a972-6234e383848f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-a81e8d-7f9c897fdb-m59sm"
Sep 15 10:42:48.815064 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:48.815023    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbd9w\" (UniqueName: \"kubernetes.io/projected/4800676e-1f98-43aa-a374-5147d6a2632a-kube-api-access-jbd9w\") pod \"payload-processing-e2e-api-a-a81e8d-7f884665b9-tz2q9\" (UID: \"4800676e-1f98-43aa-a374-5147d6a2632a\") " pod="openshift-ingress/payload-processing-e2e-api-a-a81e8d-7f884665b9-tz2q9"
Sep 15 10:42:48.815241 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:48.815073    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4800676e-1f98-43aa-a374-5147d6a2632a-plugins-config-volume\") pod \"payload-processing-e2e-api-a-a81e8d-7f884665b9-tz2q9\" (UID: \"4800676e-1f98-43aa-a374-5147d6a2632a\") " pod="openshift-ingress/payload-processing-e2e-api-a-a81e8d-7f884665b9-tz2q9"
Sep 15 10:42:48.815818 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:48.815798    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4800676e-1f98-43aa-a374-5147d6a2632a-plugins-config-volume\") pod \"payload-processing-e2e-api-a-a81e8d-7f884665b9-tz2q9\" (UID: \"4800676e-1f98-43aa-a374-5147d6a2632a\") " pod="openshift-ingress/payload-processing-e2e-api-a-a81e8d-7f884665b9-tz2q9"
Sep 15 10:42:48.824941 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:48.824868    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbd9w\" (UniqueName: \"kubernetes.io/projected/4800676e-1f98-43aa-a374-5147d6a2632a-kube-api-access-jbd9w\") pod \"payload-processing-e2e-api-a-a81e8d-7f884665b9-tz2q9\" (UID: \"4800676e-1f98-43aa-a374-5147d6a2632a\") " pod="openshift-ingress/payload-processing-e2e-api-a-a81e8d-7f884665b9-tz2q9"
Sep 15 10:42:48.896652 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:48.896602    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a81e8d-7f9c897fdb-m59sm"
Sep 15 10:42:48.920365 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:48.920329    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-a81e8d-7f884665b9-tz2q9"
Sep 15 10:42:49.172472 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:49.172443    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-a81e8d-7f9c897fdb-m59sm"]
Sep 15 10:42:49.173529 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:42:49.173505    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1c82067_fca8_41db_a972_6234e383848f.slice/crio-695bd794b01a4442d492017b3e8ddea709060c016c38c44a0dffd9cf441fd614 WatchSource:0}: Error finding container 695bd794b01a4442d492017b3e8ddea709060c016c38c44a0dffd9cf441fd614: Status 404 returned error can't find the container with id 695bd794b01a4442d492017b3e8ddea709060c016c38c44a0dffd9cf441fd614
Sep 15 10:42:49.210796 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:49.210757    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a81e8d-7f884665b9-tz2q9"]
Sep 15 10:42:49.213840 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:42:49.213808    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4800676e_1f98_43aa_a374_5147d6a2632a.slice/crio-ec0fa4ac9e3495b186576c3a5cd43e9dc5c17d4fc6201d885e30bb4e23cd528b WatchSource:0}: Error finding container ec0fa4ac9e3495b186576c3a5cd43e9dc5c17d4fc6201d885e30bb4e23cd528b: Status 404 returned error can't find the container with id ec0fa4ac9e3495b186576c3a5cd43e9dc5c17d4fc6201d885e30bb4e23cd528b
Sep 15 10:42:49.786793 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:49.786747    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a81e8d-7f9c897fdb-m59sm" event={"ID":"f1c82067-fca8-41db-a972-6234e383848f","Type":"ContainerStarted","Data":"32319e1e85904b662dba4171a125608c205f3d64bf8a66f09ea8d52b11dfcbea"}
Sep 15 10:42:49.787280 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:49.786822    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a81e8d-7f9c897fdb-m59sm" event={"ID":"f1c82067-fca8-41db-a972-6234e383848f","Type":"ContainerStarted","Data":"695bd794b01a4442d492017b3e8ddea709060c016c38c44a0dffd9cf441fd614"}
Sep 15 10:42:49.787280 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:49.786871    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a81e8d-7f9c897fdb-m59sm"
Sep 15 10:42:49.788424 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:49.788399    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-a81e8d-7f884665b9-tz2q9" event={"ID":"4800676e-1f98-43aa-a374-5147d6a2632a","Type":"ContainerStarted","Data":"ce1841b60d4218bd465b78cd9bc3b42dc840ead09e3736b15fc288257b4478bf"}
Sep 15 10:42:49.788532 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:49.788439    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-a81e8d-7f884665b9-tz2q9" event={"ID":"4800676e-1f98-43aa-a374-5147d6a2632a","Type":"ContainerStarted","Data":"ec0fa4ac9e3495b186576c3a5cd43e9dc5c17d4fc6201d885e30bb4e23cd528b"}
Sep 15 10:42:49.788532 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:49.788459    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-a81e8d-7f884665b9-tz2q9"
Sep 15 10:42:49.803305 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:49.803253    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a81e8d-7f9c897fdb-m59sm" podStartSLOduration=1.803239708 podStartE2EDuration="1.803239708s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:42:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:42:49.800974394 +0000 UTC m=+1503.197066482" watchObservedRunningTime="2026-09-15 10:42:49.803239708 +0000 UTC m=+1503.199331795"
Sep 15 10:42:49.816827 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:42:49.816772    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-a81e8d-7f884665b9-tz2q9" podStartSLOduration=1.816753839 podStartE2EDuration="1.816753839s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:42:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:42:49.81583 +0000 UTC m=+1503.211922089" watchObservedRunningTime="2026-09-15 10:42:49.816753839 +0000 UTC m=+1503.212845922"
Sep 15 10:43:00.796324 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:43:00.796288    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-a81e8d-7f884665b9-tz2q9"
Sep 15 10:43:00.796913 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:43:00.796684    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a81e8d-7f9c897fdb-m59sm"
Sep 15 10:43:29.284443 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:43:29.283930    2579 patch_prober.go:28] interesting pod/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": read tcp 10.132.0.2:48540->10.132.0.86:15021: read: connection reset by peer" start-of-body=
Sep 15 10:43:29.284443 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:43:29.284014    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9" podUID="c881fc81-8936-49a1-abfc-16f7b8dd6a09" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": read tcp 10.132.0.2:48540->10.132.0.86:15021: read: connection reset by peer"
Sep 15 10:43:30.049903 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:43:30.049869    2579 generic.go:356] "Generic (PLEG): container finished" podID="c881fc81-8936-49a1-abfc-16f7b8dd6a09" containerID="4d3eebc088c41b669c9933039d782fd35abd27192693d0155c5fb578258ecb9e" exitCode=0
Sep 15 10:43:30.050088 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:43:30.049940    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9" event={"ID":"c881fc81-8936-49a1-abfc-16f7b8dd6a09","Type":"ContainerDied","Data":"4d3eebc088c41b669c9933039d782fd35abd27192693d0155c5fb578258ecb9e"}
Sep 15 10:43:30.050446 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:43:30.050427    2579 scope.go:117] "RemoveContainer" containerID="4d3eebc088c41b669c9933039d782fd35abd27192693d0155c5fb578258ecb9e"
Sep 15 10:43:30.051605 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:43:30.051575    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:43:30.051658 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:43:30.051644    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:43:30.051693 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:43:30.051675    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:43:31.061093 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:43:31.061059    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9" event={"ID":"c881fc81-8936-49a1-abfc-16f7b8dd6a09","Type":"ContainerStarted","Data":"301bede5e6bd31af7d0cc8fc848b59b57dee867210fbf1f5ec1fd6d652849b27"}
Sep 15 10:43:31.964333 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:43:31.964291    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9"
Sep 15 10:43:31.964564 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:43:31.964540    2579 patch_prober.go:28] interesting pod/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Sep 15 10:43:31.964650 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:43:31.964595    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9" podUID="c881fc81-8936-49a1-abfc-16f7b8dd6a09" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Sep 15 10:43:32.964688 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:43:32.964650    2579 patch_prober.go:28] interesting pod/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Sep 15 10:43:32.965088 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:43:32.964752    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9" podUID="c881fc81-8936-49a1-abfc-16f7b8dd6a09" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Sep 15 10:43:33.965145 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:43:33.965105    2579 patch_prober.go:28] interesting pod/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Sep 15 10:43:33.965532 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:43:33.965160    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9" podUID="c881fc81-8936-49a1-abfc-16f7b8dd6a09" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Sep 15 10:43:34.964525 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:43:34.964485    2579 patch_prober.go:28] interesting pod/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Sep 15 10:43:34.964708 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:43:34.964555    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9" podUID="c881fc81-8936-49a1-abfc-16f7b8dd6a09" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Sep 15 10:43:35.965020 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:43:35.964983    2579 patch_prober.go:28] interesting pod/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Sep 15 10:43:35.965433 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:43:35.965039    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9" podUID="c881fc81-8936-49a1-abfc-16f7b8dd6a09" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Sep 15 10:43:36.968593 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:43:36.968560    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9"
Sep 15 10:43:36.969051 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:43:36.968917    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9"
Sep 15 10:43:36.969602 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:43:36.969582    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9"
Sep 15 10:43:50.464613 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:43:50.464576    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a81e8d-49llh"]
Sep 15 10:43:50.468532 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:43:50.468516    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a81e8d-49llh"
Sep 15 10:43:50.471471 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:43:50.471450    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5jrzm\""
Sep 15 10:43:50.474372 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:43:50.474346    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a81e8d-49llh"]
Sep 15 10:43:50.642611 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:43:50.642573    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43611131-faf9-4ffb-8e57-28264568f4a1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-a81e8d-49llh\" (UID: \"43611131-faf9-4ffb-8e57-28264568f4a1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a81e8d-49llh"
Sep 15 10:43:50.744238 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:43:50.744156    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43611131-faf9-4ffb-8e57-28264568f4a1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-a81e8d-49llh\" (UID: \"43611131-faf9-4ffb-8e57-28264568f4a1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a81e8d-49llh"
Sep 15 10:43:50.744826 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:43:50.744804    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43611131-faf9-4ffb-8e57-28264568f4a1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-a81e8d-49llh\" (UID: \"43611131-faf9-4ffb-8e57-28264568f4a1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a81e8d-49llh"
Sep 15 10:43:50.781053 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:43:50.781024    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a81e8d-49llh"
Sep 15 10:43:51.056563 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:43:51.056523    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a81e8d-49llh"]
Sep 15 10:43:51.058748 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:43:51.058705    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43611131_faf9_4ffb_8e57_28264568f4a1.slice/crio-ae6462e4a297157f1a2a1f73262c368a458b51560a36890d7db609a42c0b7f9b WatchSource:0}: Error finding container ae6462e4a297157f1a2a1f73262c368a458b51560a36890d7db609a42c0b7f9b: Status 404 returned error can't find the container with id ae6462e4a297157f1a2a1f73262c368a458b51560a36890d7db609a42c0b7f9b
Sep 15 10:43:51.190949 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:43:51.190912    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a81e8d-49llh" event={"ID":"43611131-faf9-4ffb-8e57-28264568f4a1","Type":"ContainerStarted","Data":"ae6462e4a297157f1a2a1f73262c368a458b51560a36890d7db609a42c0b7f9b"}
Sep 15 10:43:52.198974 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:43:52.198881    2579 generic.go:356] "Generic (PLEG): container finished" podID="43611131-faf9-4ffb-8e57-28264568f4a1" containerID="d72041e707ef1e59014975e9f0ec7d98702b8fa01a9caccc346112e860b852aa" exitCode=0
Sep 15 10:43:52.199419 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:43:52.198963    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a81e8d-49llh" event={"ID":"43611131-faf9-4ffb-8e57-28264568f4a1","Type":"ContainerDied","Data":"d72041e707ef1e59014975e9f0ec7d98702b8fa01a9caccc346112e860b852aa"}
Sep 15 10:43:53.362014 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:43:53.361988    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a81e8d-49llh"
Sep 15 10:43:53.474323 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:43:53.474239    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43611131-faf9-4ffb-8e57-28264568f4a1-maas-api-service-ca\") pod \"43611131-faf9-4ffb-8e57-28264568f4a1\" (UID: \"43611131-faf9-4ffb-8e57-28264568f4a1\") "
Sep 15 10:43:53.474591 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:43:53.474563    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43611131-faf9-4ffb-8e57-28264568f4a1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "43611131-faf9-4ffb-8e57-28264568f4a1" (UID: "43611131-faf9-4ffb-8e57-28264568f4a1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:43:53.575806 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:43:53.575775    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43611131-faf9-4ffb-8e57-28264568f4a1-maas-api-service-ca\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:43:54.214702 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:43:54.214673    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a81e8d-49llh"
Sep 15 10:43:54.214889 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:43:54.214666    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a81e8d-49llh" event={"ID":"43611131-faf9-4ffb-8e57-28264568f4a1","Type":"ContainerDied","Data":"ae6462e4a297157f1a2a1f73262c368a458b51560a36890d7db609a42c0b7f9b"}
Sep 15 10:43:54.214889 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:43:54.214805    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ae6462e4a297157f1a2a1f73262c368a458b51560a36890d7db609a42c0b7f9b"
Sep 15 10:44:06.116183 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:06.116135    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a81e8d-7f884665b9-tz2q9"]
Sep 15 10:44:06.116857 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:06.116766    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-a81e8d-7f884665b9-tz2q9" podUID="4800676e-1f98-43aa-a374-5147d6a2632a" containerName="payload-processing" containerID="cri-o://ce1841b60d4218bd465b78cd9bc3b42dc840ead09e3736b15fc288257b4478bf" gracePeriod=30
Sep 15 10:44:06.124412 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:06.124373    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-a81e8d-7f9c897fdb-m59sm"]
Sep 15 10:44:06.127514 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:06.125027    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a81e8d-7f9c897fdb-m59sm" podUID="f1c82067-fca8-41db-a972-6234e383848f" containerName="payload-pre-processing" containerID="cri-o://32319e1e85904b662dba4171a125608c205f3d64bf8a66f09ea8d52b11dfcbea" gracePeriod=30
Sep 15 10:44:06.260171 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:06.260139    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a81e8d-49llh"]
Sep 15 10:44:06.262834 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:06.262798    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a81e8d-49llh"]
Sep 15 10:44:06.288247 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:06.288214    2579 generic.go:356] "Generic (PLEG): container finished" podID="4800676e-1f98-43aa-a374-5147d6a2632a" containerID="ce1841b60d4218bd465b78cd9bc3b42dc840ead09e3736b15fc288257b4478bf" exitCode=0
Sep 15 10:44:06.288447 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:06.288283    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-a81e8d-7f884665b9-tz2q9" event={"ID":"4800676e-1f98-43aa-a374-5147d6a2632a","Type":"ContainerDied","Data":"ce1841b60d4218bd465b78cd9bc3b42dc840ead09e3736b15fc288257b4478bf"}
Sep 15 10:44:06.290281 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:06.290251    2579 generic.go:356] "Generic (PLEG): container finished" podID="f1c82067-fca8-41db-a972-6234e383848f" containerID="32319e1e85904b662dba4171a125608c205f3d64bf8a66f09ea8d52b11dfcbea" exitCode=0
Sep 15 10:44:06.290394 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:06.290288    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a81e8d-7f9c897fdb-m59sm" event={"ID":"f1c82067-fca8-41db-a972-6234e383848f","Type":"ContainerDied","Data":"32319e1e85904b662dba4171a125608c205f3d64bf8a66f09ea8d52b11dfcbea"}
Sep 15 10:44:06.478993 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:06.478958    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-a81e8d-7f884665b9-tz2q9"
Sep 15 10:44:06.482306 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:06.482286    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a81e8d-7f9c897fdb-m59sm"
Sep 15 10:44:06.487234 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:06.487215    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4800676e-1f98-43aa-a374-5147d6a2632a-plugins-config-volume\") pod \"4800676e-1f98-43aa-a374-5147d6a2632a\" (UID: \"4800676e-1f98-43aa-a374-5147d6a2632a\") "
Sep 15 10:44:06.487336 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:06.487246    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbd9w\" (UniqueName: \"kubernetes.io/projected/4800676e-1f98-43aa-a374-5147d6a2632a-kube-api-access-jbd9w\") pod \"4800676e-1f98-43aa-a374-5147d6a2632a\" (UID: \"4800676e-1f98-43aa-a374-5147d6a2632a\") "
Sep 15 10:44:06.487336 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:06.487272    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1c82067-fca8-41db-a972-6234e383848f-plugins-config-volume\") pod \"f1c82067-fca8-41db-a972-6234e383848f\" (UID: \"f1c82067-fca8-41db-a972-6234e383848f\") "
Sep 15 10:44:06.487452 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:06.487354    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8vwpz\" (UniqueName: \"kubernetes.io/projected/f1c82067-fca8-41db-a972-6234e383848f-kube-api-access-8vwpz\") pod \"f1c82067-fca8-41db-a972-6234e383848f\" (UID: \"f1c82067-fca8-41db-a972-6234e383848f\") "
Sep 15 10:44:06.487639 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:06.487613    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4800676e-1f98-43aa-a374-5147d6a2632a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4800676e-1f98-43aa-a374-5147d6a2632a" (UID: "4800676e-1f98-43aa-a374-5147d6a2632a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:44:06.487750 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:06.487653    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1c82067-fca8-41db-a972-6234e383848f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f1c82067-fca8-41db-a972-6234e383848f" (UID: "f1c82067-fca8-41db-a972-6234e383848f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:44:06.487827 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:06.487795    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4800676e-1f98-43aa-a374-5147d6a2632a-plugins-config-volume\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:44:06.487827 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:06.487808    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1c82067-fca8-41db-a972-6234e383848f-plugins-config-volume\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:44:06.489388 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:06.489368    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4800676e-1f98-43aa-a374-5147d6a2632a-kube-api-access-jbd9w" (OuterVolumeSpecName: "kube-api-access-jbd9w") pod "4800676e-1f98-43aa-a374-5147d6a2632a" (UID: "4800676e-1f98-43aa-a374-5147d6a2632a"). InnerVolumeSpecName "kube-api-access-jbd9w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:44:06.489522 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:06.489497    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1c82067-fca8-41db-a972-6234e383848f-kube-api-access-8vwpz" (OuterVolumeSpecName: "kube-api-access-8vwpz") pod "f1c82067-fca8-41db-a972-6234e383848f" (UID: "f1c82067-fca8-41db-a972-6234e383848f"). InnerVolumeSpecName "kube-api-access-8vwpz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:44:06.588998 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:06.588961    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8vwpz\" (UniqueName: \"kubernetes.io/projected/f1c82067-fca8-41db-a972-6234e383848f-kube-api-access-8vwpz\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:44:06.588998 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:06.588994    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbd9w\" (UniqueName: \"kubernetes.io/projected/4800676e-1f98-43aa-a374-5147d6a2632a-kube-api-access-jbd9w\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:44:07.150834 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:07.150802    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43611131-faf9-4ffb-8e57-28264568f4a1" path="/var/lib/kubelet/pods/43611131-faf9-4ffb-8e57-28264568f4a1/volumes"
Sep 15 10:44:07.298527 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:07.298491    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-a81e8d-7f884665b9-tz2q9"
Sep 15 10:44:07.298693 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:07.298502    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-a81e8d-7f884665b9-tz2q9" event={"ID":"4800676e-1f98-43aa-a374-5147d6a2632a","Type":"ContainerDied","Data":"ec0fa4ac9e3495b186576c3a5cd43e9dc5c17d4fc6201d885e30bb4e23cd528b"}
Sep 15 10:44:07.298693 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:07.298641    2579 scope.go:117] "RemoveContainer" containerID="ce1841b60d4218bd465b78cd9bc3b42dc840ead09e3736b15fc288257b4478bf"
Sep 15 10:44:07.300530 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:07.300118    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a81e8d-7f9c897fdb-m59sm" event={"ID":"f1c82067-fca8-41db-a972-6234e383848f","Type":"ContainerDied","Data":"695bd794b01a4442d492017b3e8ddea709060c016c38c44a0dffd9cf441fd614"}
Sep 15 10:44:07.300530 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:07.300152    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a81e8d-7f9c897fdb-m59sm"
Sep 15 10:44:07.310175 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:07.310153    2579 scope.go:117] "RemoveContainer" containerID="32319e1e85904b662dba4171a125608c205f3d64bf8a66f09ea8d52b11dfcbea"
Sep 15 10:44:07.320886 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:07.320861    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a81e8d-7f884665b9-tz2q9"]
Sep 15 10:44:07.327053 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:07.327030    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a81e8d-7f884665b9-tz2q9"]
Sep 15 10:44:07.340688 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:07.340660    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-a81e8d-7f9c897fdb-m59sm"]
Sep 15 10:44:07.344150 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:07.344128    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-a81e8d-7f9c897fdb-m59sm"]
Sep 15 10:44:09.150091 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:09.150054    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4800676e-1f98-43aa-a374-5147d6a2632a" path="/var/lib/kubelet/pods/4800676e-1f98-43aa-a374-5147d6a2632a/volumes"
Sep 15 10:44:09.150473 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:09.150434    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1c82067-fca8-41db-a972-6234e383848f" path="/var/lib/kubelet/pods/f1c82067-fca8-41db-a972-6234e383848f/volumes"
Sep 15 10:44:12.756782 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:12.756703    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9"]
Sep 15 10:44:12.757199 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:12.756934    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9" podUID="c881fc81-8936-49a1-abfc-16f7b8dd6a09" containerName="istio-proxy" containerID="cri-o://301bede5e6bd31af7d0cc8fc848b59b57dee867210fbf1f5ec1fd6d652849b27" gracePeriod=30
Sep 15 10:44:13.074779 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:13.074740    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-069380-hnc7t"]
Sep 15 10:44:13.075297 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:13.075284    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1c82067-fca8-41db-a972-6234e383848f" containerName="payload-pre-processing"
Sep 15 10:44:13.075344 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:13.075299    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1c82067-fca8-41db-a972-6234e383848f" containerName="payload-pre-processing"
Sep 15 10:44:13.075344 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:13.075313    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43611131-faf9-4ffb-8e57-28264568f4a1" containerName="revoke-keys"
Sep 15 10:44:13.075344 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:13.075319    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="43611131-faf9-4ffb-8e57-28264568f4a1" containerName="revoke-keys"
Sep 15 10:44:13.075344 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:13.075326    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4800676e-1f98-43aa-a374-5147d6a2632a" containerName="payload-processing"
Sep 15 10:44:13.075344 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:13.075331    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4800676e-1f98-43aa-a374-5147d6a2632a" containerName="payload-processing"
Sep 15 10:44:13.075501 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:13.075407    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1c82067-fca8-41db-a972-6234e383848f" containerName="payload-pre-processing"
Sep 15 10:44:13.075501 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:13.075415    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="43611131-faf9-4ffb-8e57-28264568f4a1" containerName="revoke-keys"
Sep 15 10:44:13.075501 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:13.075422    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4800676e-1f98-43aa-a374-5147d6a2632a" containerName="payload-processing"
Sep 15 10:44:13.080019 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:13.080001    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-069380-hnc7t"
Sep 15 10:44:13.082562 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:13.082539    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5jrzm\""
Sep 15 10:44:13.085457 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:13.085430    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-069380-hnc7t"]
Sep 15 10:44:13.151504 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:13.151477    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a986324-1ed5-4c2f-be9d-2f164f6fc329-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-069380-hnc7t\" (UID: \"1a986324-1ed5-4c2f-be9d-2f164f6fc329\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-069380-hnc7t"
Sep 15 10:44:13.253001 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:13.252961    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a986324-1ed5-4c2f-be9d-2f164f6fc329-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-069380-hnc7t\" (UID: \"1a986324-1ed5-4c2f-be9d-2f164f6fc329\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-069380-hnc7t"
Sep 15 10:44:13.253595 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:13.253573    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a986324-1ed5-4c2f-be9d-2f164f6fc329-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-069380-hnc7t\" (UID: \"1a986324-1ed5-4c2f-be9d-2f164f6fc329\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-069380-hnc7t"
Sep 15 10:44:13.393420 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:13.393339    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-069380-hnc7t"
Sep 15 10:44:13.674030 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:13.674003    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-069380-hnc7t"]
Sep 15 10:44:13.675767 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:44:13.675713    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a986324_1ed5_4c2f_be9d_2f164f6fc329.slice/crio-e8b882a367b998404beb5f75a5c3aa74722d228356d8d10c6cf80e80db0d204e WatchSource:0}: Error finding container e8b882a367b998404beb5f75a5c3aa74722d228356d8d10c6cf80e80db0d204e: Status 404 returned error can't find the container with id e8b882a367b998404beb5f75a5c3aa74722d228356d8d10c6cf80e80db0d204e
Sep 15 10:44:14.350965 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:14.350934    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-069380-hnc7t" event={"ID":"1a986324-1ed5-4c2f-be9d-2f164f6fc329","Type":"ContainerStarted","Data":"629922fa0ba4fda928d8c02620cba64a1393c23ffec853603d14c4ff44e92277"}
Sep 15 10:44:14.351376 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:14.350986    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-069380-hnc7t" event={"ID":"1a986324-1ed5-4c2f-be9d-2f164f6fc329","Type":"ContainerStarted","Data":"e8b882a367b998404beb5f75a5c3aa74722d228356d8d10c6cf80e80db0d204e"}
Sep 15 10:44:14.366187 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:14.366140    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-069380-hnc7t" podStartSLOduration=1.36612657 podStartE2EDuration="1.36612657s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:44:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:44:14.363734586 +0000 UTC m=+1587.759826669" watchObservedRunningTime="2026-09-15 10:44:14.36612657 +0000 UTC m=+1587.762218654"
Sep 15 10:44:15.358246 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:15.358203    2579 generic.go:356] "Generic (PLEG): container finished" podID="1a986324-1ed5-4c2f-be9d-2f164f6fc329" containerID="629922fa0ba4fda928d8c02620cba64a1393c23ffec853603d14c4ff44e92277" exitCode=0
Sep 15 10:44:15.358643 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:15.358263    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-069380-hnc7t" event={"ID":"1a986324-1ed5-4c2f-be9d-2f164f6fc329","Type":"ContainerDied","Data":"629922fa0ba4fda928d8c02620cba64a1393c23ffec853603d14c4ff44e92277"}
Sep 15 10:44:16.516331 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:16.516307    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-069380-hnc7t"
Sep 15 10:44:16.586550 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:16.586518    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a986324-1ed5-4c2f-be9d-2f164f6fc329-maas-api-service-ca\") pod \"1a986324-1ed5-4c2f-be9d-2f164f6fc329\" (UID: \"1a986324-1ed5-4c2f-be9d-2f164f6fc329\") "
Sep 15 10:44:16.586913 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:16.586892    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a986324-1ed5-4c2f-be9d-2f164f6fc329-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1a986324-1ed5-4c2f-be9d-2f164f6fc329" (UID: "1a986324-1ed5-4c2f-be9d-2f164f6fc329"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:44:16.687665 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:16.687583    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a986324-1ed5-4c2f-be9d-2f164f6fc329-maas-api-service-ca\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:44:17.370930 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:17.370896    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-069380-hnc7t" event={"ID":"1a986324-1ed5-4c2f-be9d-2f164f6fc329","Type":"ContainerDied","Data":"e8b882a367b998404beb5f75a5c3aa74722d228356d8d10c6cf80e80db0d204e"}
Sep 15 10:44:17.371095 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:17.370933    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-069380-hnc7t"
Sep 15 10:44:17.371095 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:17.370944    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e8b882a367b998404beb5f75a5c3aa74722d228356d8d10c6cf80e80db0d204e"
Sep 15 10:44:18.024952 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:18.024893    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9"
Sep 15 10:44:18.101741 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:18.101682    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c881fc81-8936-49a1-abfc-16f7b8dd6a09-istio-podinfo\") pod \"c881fc81-8936-49a1-abfc-16f7b8dd6a09\" (UID: \"c881fc81-8936-49a1-abfc-16f7b8dd6a09\") "
Sep 15 10:44:18.101918 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:18.101773    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c881fc81-8936-49a1-abfc-16f7b8dd6a09-credential-socket\") pod \"c881fc81-8936-49a1-abfc-16f7b8dd6a09\" (UID: \"c881fc81-8936-49a1-abfc-16f7b8dd6a09\") "
Sep 15 10:44:18.101918 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:18.101829    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c881fc81-8936-49a1-abfc-16f7b8dd6a09-istio-token\") pod \"c881fc81-8936-49a1-abfc-16f7b8dd6a09\" (UID: \"c881fc81-8936-49a1-abfc-16f7b8dd6a09\") "
Sep 15 10:44:18.101918 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:18.101875    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jcmwx\" (UniqueName: \"kubernetes.io/projected/c881fc81-8936-49a1-abfc-16f7b8dd6a09-kube-api-access-jcmwx\") pod \"c881fc81-8936-49a1-abfc-16f7b8dd6a09\" (UID: \"c881fc81-8936-49a1-abfc-16f7b8dd6a09\") "
Sep 15 10:44:18.102159 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:18.102026    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c881fc81-8936-49a1-abfc-16f7b8dd6a09-istiod-ca-cert\") pod \"c881fc81-8936-49a1-abfc-16f7b8dd6a09\" (UID: \"c881fc81-8936-49a1-abfc-16f7b8dd6a09\") "
Sep 15 10:44:18.102159 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:18.102084    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c881fc81-8936-49a1-abfc-16f7b8dd6a09-workload-socket\") pod \"c881fc81-8936-49a1-abfc-16f7b8dd6a09\" (UID: \"c881fc81-8936-49a1-abfc-16f7b8dd6a09\") "
Sep 15 10:44:18.102159 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:18.102135    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c881fc81-8936-49a1-abfc-16f7b8dd6a09-istio-envoy\") pod \"c881fc81-8936-49a1-abfc-16f7b8dd6a09\" (UID: \"c881fc81-8936-49a1-abfc-16f7b8dd6a09\") "
Sep 15 10:44:18.102159 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:18.102135    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c881fc81-8936-49a1-abfc-16f7b8dd6a09-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c881fc81-8936-49a1-abfc-16f7b8dd6a09" (UID: "c881fc81-8936-49a1-abfc-16f7b8dd6a09"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:44:18.102335 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:18.102162    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c881fc81-8936-49a1-abfc-16f7b8dd6a09-workload-certs\") pod \"c881fc81-8936-49a1-abfc-16f7b8dd6a09\" (UID: \"c881fc81-8936-49a1-abfc-16f7b8dd6a09\") "
Sep 15 10:44:18.102335 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:18.102185    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c881fc81-8936-49a1-abfc-16f7b8dd6a09-istio-data\") pod \"c881fc81-8936-49a1-abfc-16f7b8dd6a09\" (UID: \"c881fc81-8936-49a1-abfc-16f7b8dd6a09\") "
Sep 15 10:44:18.102451 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:18.102340    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c881fc81-8936-49a1-abfc-16f7b8dd6a09-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c881fc81-8936-49a1-abfc-16f7b8dd6a09" (UID: "c881fc81-8936-49a1-abfc-16f7b8dd6a09"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:44:18.102451 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:18.102400    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c881fc81-8936-49a1-abfc-16f7b8dd6a09-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c881fc81-8936-49a1-abfc-16f7b8dd6a09" (UID: "c881fc81-8936-49a1-abfc-16f7b8dd6a09"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:44:18.102584 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:18.102563    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c881fc81-8936-49a1-abfc-16f7b8dd6a09-istio-data" (OuterVolumeSpecName: "istio-data") pod "c881fc81-8936-49a1-abfc-16f7b8dd6a09" (UID: "c881fc81-8936-49a1-abfc-16f7b8dd6a09"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:44:18.102644 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:18.102582    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c881fc81-8936-49a1-abfc-16f7b8dd6a09-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c881fc81-8936-49a1-abfc-16f7b8dd6a09" (UID: "c881fc81-8936-49a1-abfc-16f7b8dd6a09"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:44:18.102773 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:18.102753    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c881fc81-8936-49a1-abfc-16f7b8dd6a09-istiod-ca-cert\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:44:18.102931 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:18.102908    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c881fc81-8936-49a1-abfc-16f7b8dd6a09-workload-socket\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:44:18.102931 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:18.102932    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c881fc81-8936-49a1-abfc-16f7b8dd6a09-workload-certs\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:44:18.103121 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:18.102947    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c881fc81-8936-49a1-abfc-16f7b8dd6a09-istio-data\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:44:18.103121 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:18.102961    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c881fc81-8936-49a1-abfc-16f7b8dd6a09-credential-socket\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:44:18.104575 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:18.104549    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c881fc81-8936-49a1-abfc-16f7b8dd6a09-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c881fc81-8936-49a1-abfc-16f7b8dd6a09" (UID: "c881fc81-8936-49a1-abfc-16f7b8dd6a09"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 10:44:18.104670 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:18.104645    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c881fc81-8936-49a1-abfc-16f7b8dd6a09-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c881fc81-8936-49a1-abfc-16f7b8dd6a09" (UID: "c881fc81-8936-49a1-abfc-16f7b8dd6a09"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:44:18.104787 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:18.104764    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c881fc81-8936-49a1-abfc-16f7b8dd6a09-kube-api-access-jcmwx" (OuterVolumeSpecName: "kube-api-access-jcmwx") pod "c881fc81-8936-49a1-abfc-16f7b8dd6a09" (UID: "c881fc81-8936-49a1-abfc-16f7b8dd6a09"). InnerVolumeSpecName "kube-api-access-jcmwx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:44:18.104950 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:18.104930    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c881fc81-8936-49a1-abfc-16f7b8dd6a09-istio-token" (OuterVolumeSpecName: "istio-token") pod "c881fc81-8936-49a1-abfc-16f7b8dd6a09" (UID: "c881fc81-8936-49a1-abfc-16f7b8dd6a09"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:44:18.203596 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:18.203557    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jcmwx\" (UniqueName: \"kubernetes.io/projected/c881fc81-8936-49a1-abfc-16f7b8dd6a09-kube-api-access-jcmwx\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:44:18.203596 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:18.203591    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c881fc81-8936-49a1-abfc-16f7b8dd6a09-istio-envoy\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:44:18.203596 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:18.203604    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c881fc81-8936-49a1-abfc-16f7b8dd6a09-istio-podinfo\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:44:18.203866 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:18.203614    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c881fc81-8936-49a1-abfc-16f7b8dd6a09-istio-token\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:44:18.379398 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:18.379361    2579 generic.go:356] "Generic (PLEG): container finished" podID="c881fc81-8936-49a1-abfc-16f7b8dd6a09" containerID="301bede5e6bd31af7d0cc8fc848b59b57dee867210fbf1f5ec1fd6d652849b27" exitCode=0
Sep 15 10:44:18.379567 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:18.379413    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9"
Sep 15 10:44:18.379567 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:18.379446    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9" event={"ID":"c881fc81-8936-49a1-abfc-16f7b8dd6a09","Type":"ContainerDied","Data":"301bede5e6bd31af7d0cc8fc848b59b57dee867210fbf1f5ec1fd6d652849b27"}
Sep 15 10:44:18.379567 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:18.379506    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9" event={"ID":"c881fc81-8936-49a1-abfc-16f7b8dd6a09","Type":"ContainerDied","Data":"e0ce96be22eb73cd29014293e54e5234bfc429af5287e6a0ac5bc89ad8c8dec7"}
Sep 15 10:44:18.379567 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:18.379532    2579 scope.go:117] "RemoveContainer" containerID="301bede5e6bd31af7d0cc8fc848b59b57dee867210fbf1f5ec1fd6d652849b27"
Sep 15 10:44:18.389660 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:18.389643    2579 scope.go:117] "RemoveContainer" containerID="4d3eebc088c41b669c9933039d782fd35abd27192693d0155c5fb578258ecb9e"
Sep 15 10:44:18.398382 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:18.398363    2579 scope.go:117] "RemoveContainer" containerID="301bede5e6bd31af7d0cc8fc848b59b57dee867210fbf1f5ec1fd6d652849b27"
Sep 15 10:44:18.398904 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:44:18.398865    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"301bede5e6bd31af7d0cc8fc848b59b57dee867210fbf1f5ec1fd6d652849b27\": container with ID starting with 301bede5e6bd31af7d0cc8fc848b59b57dee867210fbf1f5ec1fd6d652849b27 not found: ID does not exist" containerID="301bede5e6bd31af7d0cc8fc848b59b57dee867210fbf1f5ec1fd6d652849b27"
Sep 15 10:44:18.399029 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:18.398913    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"301bede5e6bd31af7d0cc8fc848b59b57dee867210fbf1f5ec1fd6d652849b27"} err="failed to get container status \"301bede5e6bd31af7d0cc8fc848b59b57dee867210fbf1f5ec1fd6d652849b27\": rpc error: code = NotFound desc = could not find container \"301bede5e6bd31af7d0cc8fc848b59b57dee867210fbf1f5ec1fd6d652849b27\": container with ID starting with 301bede5e6bd31af7d0cc8fc848b59b57dee867210fbf1f5ec1fd6d652849b27 not found: ID does not exist"
Sep 15 10:44:18.399029 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:18.398938    2579 scope.go:117] "RemoveContainer" containerID="4d3eebc088c41b669c9933039d782fd35abd27192693d0155c5fb578258ecb9e"
Sep 15 10:44:18.399455 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:44:18.399426    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d3eebc088c41b669c9933039d782fd35abd27192693d0155c5fb578258ecb9e\": container with ID starting with 4d3eebc088c41b669c9933039d782fd35abd27192693d0155c5fb578258ecb9e not found: ID does not exist" containerID="4d3eebc088c41b669c9933039d782fd35abd27192693d0155c5fb578258ecb9e"
Sep 15 10:44:18.399566 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:18.399462    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d3eebc088c41b669c9933039d782fd35abd27192693d0155c5fb578258ecb9e"} err="failed to get container status \"4d3eebc088c41b669c9933039d782fd35abd27192693d0155c5fb578258ecb9e\": rpc error: code = NotFound desc = could not find container \"4d3eebc088c41b669c9933039d782fd35abd27192693d0155c5fb578258ecb9e\": container with ID starting with 4d3eebc088c41b669c9933039d782fd35abd27192693d0155c5fb578258ecb9e not found: ID does not exist"
Sep 15 10:44:18.402050 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:18.402027    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9"]
Sep 15 10:44:18.407022 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:18.406998    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-a81e8d-openshift-default-79bbf96cc4-dkzw9"]
Sep 15 10:44:19.149501 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:19.149464    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c881fc81-8936-49a1-abfc-16f7b8dd6a09" path="/var/lib/kubelet/pods/c881fc81-8936-49a1-abfc-16f7b8dd6a09/volumes"
Sep 15 10:44:25.575544 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:25.575502    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-8c1047-jtzbb"]
Sep 15 10:44:25.576036 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:25.576021    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a986324-1ed5-4c2f-be9d-2f164f6fc329" containerName="revoke-keys"
Sep 15 10:44:25.576080 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:25.576037    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a986324-1ed5-4c2f-be9d-2f164f6fc329" containerName="revoke-keys"
Sep 15 10:44:25.576080 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:25.576061    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c881fc81-8936-49a1-abfc-16f7b8dd6a09" containerName="istio-proxy"
Sep 15 10:44:25.576080 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:25.576067    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c881fc81-8936-49a1-abfc-16f7b8dd6a09" containerName="istio-proxy"
Sep 15 10:44:25.576188 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:25.576084    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c881fc81-8936-49a1-abfc-16f7b8dd6a09" containerName="istio-proxy"
Sep 15 10:44:25.576188 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:25.576090    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c881fc81-8936-49a1-abfc-16f7b8dd6a09" containerName="istio-proxy"
Sep 15 10:44:25.576188 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:25.576154    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a986324-1ed5-4c2f-be9d-2f164f6fc329" containerName="revoke-keys"
Sep 15 10:44:25.576188 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:25.576162    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c881fc81-8936-49a1-abfc-16f7b8dd6a09" containerName="istio-proxy"
Sep 15 10:44:25.580954 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:25.580929    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-8c1047-jtzbb"
Sep 15 10:44:25.584170 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:25.584146    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5jrzm\""
Sep 15 10:44:25.586744 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:25.586695    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-8c1047-jtzbb"]
Sep 15 10:44:25.681002 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:25.680965    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a43b845c-a310-4ef0-8ad3-94dbaae3cf80-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-8c1047-jtzbb\" (UID: \"a43b845c-a310-4ef0-8ad3-94dbaae3cf80\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-8c1047-jtzbb"
Sep 15 10:44:25.782179 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:25.782145    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a43b845c-a310-4ef0-8ad3-94dbaae3cf80-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-8c1047-jtzbb\" (UID: \"a43b845c-a310-4ef0-8ad3-94dbaae3cf80\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-8c1047-jtzbb"
Sep 15 10:44:25.782758 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:25.782717    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a43b845c-a310-4ef0-8ad3-94dbaae3cf80-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-8c1047-jtzbb\" (UID: \"a43b845c-a310-4ef0-8ad3-94dbaae3cf80\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-8c1047-jtzbb"
Sep 15 10:44:25.894207 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:25.894116    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-8c1047-jtzbb"
Sep 15 10:44:26.167332 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:26.167302    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-8c1047-jtzbb"]
Sep 15 10:44:26.169039 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:44:26.169016    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda43b845c_a310_4ef0_8ad3_94dbaae3cf80.slice/crio-54a7d14085d3a7382bab811d4ca348afe84626779797604bddaca00b645ddb18 WatchSource:0}: Error finding container 54a7d14085d3a7382bab811d4ca348afe84626779797604bddaca00b645ddb18: Status 404 returned error can't find the container with id 54a7d14085d3a7382bab811d4ca348afe84626779797604bddaca00b645ddb18
Sep 15 10:44:26.430609 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:26.430528    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-8c1047-jtzbb" event={"ID":"a43b845c-a310-4ef0-8ad3-94dbaae3cf80","Type":"ContainerStarted","Data":"54a7d14085d3a7382bab811d4ca348afe84626779797604bddaca00b645ddb18"}
Sep 15 10:44:27.438414 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:27.438382    2579 generic.go:356] "Generic (PLEG): container finished" podID="a43b845c-a310-4ef0-8ad3-94dbaae3cf80" containerID="accae6d3153dfb8dec4f0b090b67bad926fbd19b93711f58322c4420bdd8d7b5" exitCode=0
Sep 15 10:44:27.438825 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:27.438460    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-8c1047-jtzbb" event={"ID":"a43b845c-a310-4ef0-8ad3-94dbaae3cf80","Type":"ContainerDied","Data":"accae6d3153dfb8dec4f0b090b67bad926fbd19b93711f58322c4420bdd8d7b5"}
Sep 15 10:44:27.954978 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:27.954942    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-069380-hnc7t"]
Sep 15 10:44:27.957158 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:27.957129    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-069380-hnc7t"]
Sep 15 10:44:28.584735 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:28.584697    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-8c1047-jtzbb"
Sep 15 10:44:28.712697 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:28.712610    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a43b845c-a310-4ef0-8ad3-94dbaae3cf80-maas-api-service-ca\") pod \"a43b845c-a310-4ef0-8ad3-94dbaae3cf80\" (UID: \"a43b845c-a310-4ef0-8ad3-94dbaae3cf80\") "
Sep 15 10:44:28.713021 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:28.712993    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a43b845c-a310-4ef0-8ad3-94dbaae3cf80-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a43b845c-a310-4ef0-8ad3-94dbaae3cf80" (UID: "a43b845c-a310-4ef0-8ad3-94dbaae3cf80"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:44:28.813800 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:28.813768    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a43b845c-a310-4ef0-8ad3-94dbaae3cf80-maas-api-service-ca\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:44:29.150879 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:29.150846    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a986324-1ed5-4c2f-be9d-2f164f6fc329" path="/var/lib/kubelet/pods/1a986324-1ed5-4c2f-be9d-2f164f6fc329/volumes"
Sep 15 10:44:29.452539 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:29.452443    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-8c1047-jtzbb"
Sep 15 10:44:29.452539 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:29.452465    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-8c1047-jtzbb" event={"ID":"a43b845c-a310-4ef0-8ad3-94dbaae3cf80","Type":"ContainerDied","Data":"54a7d14085d3a7382bab811d4ca348afe84626779797604bddaca00b645ddb18"}
Sep 15 10:44:29.452539 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:29.452526    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="54a7d14085d3a7382bab811d4ca348afe84626779797604bddaca00b645ddb18"
Sep 15 10:44:34.736125 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:34.736088    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-30651f-jmhzq"]
Sep 15 10:44:34.736775 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:34.736757    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a43b845c-a310-4ef0-8ad3-94dbaae3cf80" containerName="revoke-keys"
Sep 15 10:44:34.736886 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:34.736777    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a43b845c-a310-4ef0-8ad3-94dbaae3cf80" containerName="revoke-keys"
Sep 15 10:44:34.736886 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:34.736880    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c881fc81-8936-49a1-abfc-16f7b8dd6a09" containerName="istio-proxy"
Sep 15 10:44:34.736992 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:34.736895    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a43b845c-a310-4ef0-8ad3-94dbaae3cf80" containerName="revoke-keys"
Sep 15 10:44:34.740410 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:34.740385    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-30651f-jmhzq"
Sep 15 10:44:34.743347 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:34.743322    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5jrzm\""
Sep 15 10:44:34.745475 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:34.745447    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-30651f-jmhzq"]
Sep 15 10:44:34.876713 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:34.876675    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad9676de-aa62-484a-84d0-5cc9cc5933a2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-30651f-jmhzq\" (UID: \"ad9676de-aa62-484a-84d0-5cc9cc5933a2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-30651f-jmhzq"
Sep 15 10:44:34.978109 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:34.978076    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad9676de-aa62-484a-84d0-5cc9cc5933a2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-30651f-jmhzq\" (UID: \"ad9676de-aa62-484a-84d0-5cc9cc5933a2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-30651f-jmhzq"
Sep 15 10:44:34.978790 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:34.978764    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad9676de-aa62-484a-84d0-5cc9cc5933a2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-30651f-jmhzq\" (UID: \"ad9676de-aa62-484a-84d0-5cc9cc5933a2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-30651f-jmhzq"
Sep 15 10:44:35.055393 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:35.055347    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-30651f-jmhzq"
Sep 15 10:44:35.329253 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:35.329228    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-30651f-jmhzq"]
Sep 15 10:44:35.331060 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:44:35.331033    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad9676de_aa62_484a_84d0_5cc9cc5933a2.slice/crio-2b833f3b2dede59180c82a33b26406175db5af641d49a332c77ba8c2512c313d WatchSource:0}: Error finding container 2b833f3b2dede59180c82a33b26406175db5af641d49a332c77ba8c2512c313d: Status 404 returned error can't find the container with id 2b833f3b2dede59180c82a33b26406175db5af641d49a332c77ba8c2512c313d
Sep 15 10:44:35.493841 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:35.493806    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-30651f-jmhzq" event={"ID":"ad9676de-aa62-484a-84d0-5cc9cc5933a2","Type":"ContainerStarted","Data":"2b833f3b2dede59180c82a33b26406175db5af641d49a332c77ba8c2512c313d"}
Sep 15 10:44:36.505613 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:36.502653    2579 generic.go:356] "Generic (PLEG): container finished" podID="ad9676de-aa62-484a-84d0-5cc9cc5933a2" containerID="eceda7d06f641395237504fcc0380aa0098ec5b050ce42084bc2ecaf5483dad2" exitCode=0
Sep 15 10:44:36.505613 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:36.502855    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-30651f-jmhzq" event={"ID":"ad9676de-aa62-484a-84d0-5cc9cc5933a2","Type":"ContainerDied","Data":"eceda7d06f641395237504fcc0380aa0098ec5b050ce42084bc2ecaf5483dad2"}
Sep 15 10:44:37.677535 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:37.677506    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-30651f-jmhzq"
Sep 15 10:44:37.808008 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:37.807976    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad9676de-aa62-484a-84d0-5cc9cc5933a2-maas-api-service-ca\") pod \"ad9676de-aa62-484a-84d0-5cc9cc5933a2\" (UID: \"ad9676de-aa62-484a-84d0-5cc9cc5933a2\") "
Sep 15 10:44:37.808345 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:37.808323    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad9676de-aa62-484a-84d0-5cc9cc5933a2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ad9676de-aa62-484a-84d0-5cc9cc5933a2" (UID: "ad9676de-aa62-484a-84d0-5cc9cc5933a2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:44:37.909176 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:37.909139    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad9676de-aa62-484a-84d0-5cc9cc5933a2-maas-api-service-ca\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:44:38.516524 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:38.516484    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-30651f-jmhzq" event={"ID":"ad9676de-aa62-484a-84d0-5cc9cc5933a2","Type":"ContainerDied","Data":"2b833f3b2dede59180c82a33b26406175db5af641d49a332c77ba8c2512c313d"}
Sep 15 10:44:38.516524 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:38.516501    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-30651f-jmhzq"
Sep 15 10:44:38.516739 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:38.516536    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2b833f3b2dede59180c82a33b26406175db5af641d49a332c77ba8c2512c313d"
Sep 15 10:44:43.393624 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:43.393521    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-8c1047-5c884df8b9-8gbtl"]
Sep 15 10:44:43.404628 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:43.404593    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-8c1047-f868c84f8-kvbvz"]
Sep 15 10:44:43.405480 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:43.405427    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-8c1047-f868c84f8-kvbvz" podUID="41b86081-62bf-4b69-ad77-557580df292d" containerName="payload-pre-processing" containerID="cri-o://c763f4c1914fb98472534ad0cdede2ae9e355230bfd7aa29fab587f964c63b8e" gracePeriod=30
Sep 15 10:44:43.548714 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:43.548678    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-8c1047-jtzbb"]
Sep 15 10:44:43.551534 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:43.551507    2579 generic.go:356] "Generic (PLEG): container finished" podID="41b86081-62bf-4b69-ad77-557580df292d" containerID="c763f4c1914fb98472534ad0cdede2ae9e355230bfd7aa29fab587f964c63b8e" exitCode=0
Sep 15 10:44:43.551712 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:43.551585    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-8c1047-f868c84f8-kvbvz" event={"ID":"41b86081-62bf-4b69-ad77-557580df292d","Type":"ContainerDied","Data":"c763f4c1914fb98472534ad0cdede2ae9e355230bfd7aa29fab587f964c63b8e"}
Sep 15 10:44:43.551824 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:43.551795    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w0-8c1047-5c884df8b9-8gbtl" podUID="4da162e6-e931-4af8-af3f-f23f543afc4c" containerName="payload-processing" containerID="cri-o://a5c12df5f024865657bd3c518c7e2c380d13c6090db3dff3afc044001bcd862a" gracePeriod=30
Sep 15 10:44:43.551884 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:43.551834    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-8c1047-jtzbb"]
Sep 15 10:44:43.711030 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:43.710994    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-8c1047-f868c84f8-kvbvz"
Sep 15 10:44:43.766198 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:43.766170    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fcjtt\" (UniqueName: \"kubernetes.io/projected/41b86081-62bf-4b69-ad77-557580df292d-kube-api-access-fcjtt\") pod \"41b86081-62bf-4b69-ad77-557580df292d\" (UID: \"41b86081-62bf-4b69-ad77-557580df292d\") "
Sep 15 10:44:43.766375 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:43.766285    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41b86081-62bf-4b69-ad77-557580df292d-plugins-config-volume\") pod \"41b86081-62bf-4b69-ad77-557580df292d\" (UID: \"41b86081-62bf-4b69-ad77-557580df292d\") "
Sep 15 10:44:43.766780 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:43.766750    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41b86081-62bf-4b69-ad77-557580df292d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "41b86081-62bf-4b69-ad77-557580df292d" (UID: "41b86081-62bf-4b69-ad77-557580df292d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:44:43.768432 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:43.768402    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41b86081-62bf-4b69-ad77-557580df292d-kube-api-access-fcjtt" (OuterVolumeSpecName: "kube-api-access-fcjtt") pod "41b86081-62bf-4b69-ad77-557580df292d" (UID: "41b86081-62bf-4b69-ad77-557580df292d"). InnerVolumeSpecName "kube-api-access-fcjtt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:44:43.830584 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:43.830560    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-8c1047-5c884df8b9-8gbtl"
Sep 15 10:44:43.867626 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:43.867590    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4da162e6-e931-4af8-af3f-f23f543afc4c-plugins-config-volume\") pod \"4da162e6-e931-4af8-af3f-f23f543afc4c\" (UID: \"4da162e6-e931-4af8-af3f-f23f543afc4c\") "
Sep 15 10:44:43.867850 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:43.867646    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w27nf\" (UniqueName: \"kubernetes.io/projected/4da162e6-e931-4af8-af3f-f23f543afc4c-kube-api-access-w27nf\") pod \"4da162e6-e931-4af8-af3f-f23f543afc4c\" (UID: \"4da162e6-e931-4af8-af3f-f23f543afc4c\") "
Sep 15 10:44:43.867997 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:43.867970    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4da162e6-e931-4af8-af3f-f23f543afc4c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4da162e6-e931-4af8-af3f-f23f543afc4c" (UID: "4da162e6-e931-4af8-af3f-f23f543afc4c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:44:43.868081 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:43.868066    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41b86081-62bf-4b69-ad77-557580df292d-plugins-config-volume\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:44:43.868146 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:43.868082    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4da162e6-e931-4af8-af3f-f23f543afc4c-plugins-config-volume\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:44:43.868146 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:43.868092    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fcjtt\" (UniqueName: \"kubernetes.io/projected/41b86081-62bf-4b69-ad77-557580df292d-kube-api-access-fcjtt\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:44:43.869860 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:43.869830    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4da162e6-e931-4af8-af3f-f23f543afc4c-kube-api-access-w27nf" (OuterVolumeSpecName: "kube-api-access-w27nf") pod "4da162e6-e931-4af8-af3f-f23f543afc4c" (UID: "4da162e6-e931-4af8-af3f-f23f543afc4c"). InnerVolumeSpecName "kube-api-access-w27nf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:44:43.969048 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:43.968971    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w27nf\" (UniqueName: \"kubernetes.io/projected/4da162e6-e931-4af8-af3f-f23f543afc4c-kube-api-access-w27nf\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:44:44.559297 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:44.559261    2579 generic.go:356] "Generic (PLEG): container finished" podID="4da162e6-e931-4af8-af3f-f23f543afc4c" containerID="a5c12df5f024865657bd3c518c7e2c380d13c6090db3dff3afc044001bcd862a" exitCode=0
Sep 15 10:44:44.559778 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:44.559314    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-8c1047-5c884df8b9-8gbtl"
Sep 15 10:44:44.559778 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:44.559351    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-8c1047-5c884df8b9-8gbtl" event={"ID":"4da162e6-e931-4af8-af3f-f23f543afc4c","Type":"ContainerDied","Data":"a5c12df5f024865657bd3c518c7e2c380d13c6090db3dff3afc044001bcd862a"}
Sep 15 10:44:44.559778 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:44.559406    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-8c1047-5c884df8b9-8gbtl" event={"ID":"4da162e6-e931-4af8-af3f-f23f543afc4c","Type":"ContainerDied","Data":"8d26ae216fadc916a5969b61622000b1bc971c5bcfadd105236cabe648ea58bf"}
Sep 15 10:44:44.559778 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:44.559435    2579 scope.go:117] "RemoveContainer" containerID="a5c12df5f024865657bd3c518c7e2c380d13c6090db3dff3afc044001bcd862a"
Sep 15 10:44:44.560900 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:44.560882    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-8c1047-f868c84f8-kvbvz"
Sep 15 10:44:44.560976 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:44.560915    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-8c1047-f868c84f8-kvbvz" event={"ID":"41b86081-62bf-4b69-ad77-557580df292d","Type":"ContainerDied","Data":"e4132a0491d4697370e8074b65d512c8dddf14cefdbbd957802946403d41bcde"}
Sep 15 10:44:44.571464 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:44.571443    2579 scope.go:117] "RemoveContainer" containerID="a5c12df5f024865657bd3c518c7e2c380d13c6090db3dff3afc044001bcd862a"
Sep 15 10:44:44.571824 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:44:44.571800    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5c12df5f024865657bd3c518c7e2c380d13c6090db3dff3afc044001bcd862a\": container with ID starting with a5c12df5f024865657bd3c518c7e2c380d13c6090db3dff3afc044001bcd862a not found: ID does not exist" containerID="a5c12df5f024865657bd3c518c7e2c380d13c6090db3dff3afc044001bcd862a"
Sep 15 10:44:44.571930 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:44.571836    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5c12df5f024865657bd3c518c7e2c380d13c6090db3dff3afc044001bcd862a"} err="failed to get container status \"a5c12df5f024865657bd3c518c7e2c380d13c6090db3dff3afc044001bcd862a\": rpc error: code = NotFound desc = could not find container \"a5c12df5f024865657bd3c518c7e2c380d13c6090db3dff3afc044001bcd862a\": container with ID starting with a5c12df5f024865657bd3c518c7e2c380d13c6090db3dff3afc044001bcd862a not found: ID does not exist"
Sep 15 10:44:44.571930 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:44.571858    2579 scope.go:117] "RemoveContainer" containerID="c763f4c1914fb98472534ad0cdede2ae9e355230bfd7aa29fab587f964c63b8e"
Sep 15 10:44:44.588470 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:44.588444    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-8c1047-f868c84f8-kvbvz"]
Sep 15 10:44:44.590601 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:44.590580    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-8c1047-f868c84f8-kvbvz"]
Sep 15 10:44:44.600403 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:44.600345    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-8c1047-5c884df8b9-8gbtl"]
Sep 15 10:44:44.603163 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:44.603139    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-8c1047-5c884df8b9-8gbtl"]
Sep 15 10:44:45.150797 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:45.150748    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41b86081-62bf-4b69-ad77-557580df292d" path="/var/lib/kubelet/pods/41b86081-62bf-4b69-ad77-557580df292d/volumes"
Sep 15 10:44:45.151199 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:45.151184    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4da162e6-e931-4af8-af3f-f23f543afc4c" path="/var/lib/kubelet/pods/4da162e6-e931-4af8-af3f-f23f543afc4c/volumes"
Sep 15 10:44:45.151507 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:45.151471    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a43b845c-a310-4ef0-8ad3-94dbaae3cf80" path="/var/lib/kubelet/pods/a43b845c-a310-4ef0-8ad3-94dbaae3cf80/volumes"
Sep 15 10:44:46.026698 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:46.026667    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-30651f-868b7b7bf9-7k22t"]
Sep 15 10:44:46.027209 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:46.026915    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-30651f-868b7b7bf9-7k22t" podUID="1ee8ecb1-d072-42cd-a6bf-22b205e46595" containerName="payload-processing" containerID="cri-o://23f9fb8043f03e1527f1d38630c91f8e50992b72ad298b8190a238d63e9754f9" gracePeriod=30
Sep 15 10:44:46.039925 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:46.039893    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-30651f-6d584c8786-2m7gw"]
Sep 15 10:44:46.040179 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:46.040147    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-30651f-6d584c8786-2m7gw" podUID="87ace313-f52e-42f7-b8a5-6ff6fdafa8c2" containerName="payload-pre-processing" containerID="cri-o://d9128edaa1f8867ec4a244687803a1253acff486d15f80b12a95bb94e034ef00" gracePeriod=30
Sep 15 10:44:46.164552 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:46.164514    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-30651f-jmhzq"]
Sep 15 10:44:46.169202 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:46.169174    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-30651f-jmhzq"]
Sep 15 10:44:46.340266 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:46.340241    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-30651f-6d584c8786-2m7gw"
Sep 15 10:44:46.343516 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:46.343490    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-30651f-868b7b7bf9-7k22t"
Sep 15 10:44:46.392753 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:46.392698    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fj244\" (UniqueName: \"kubernetes.io/projected/87ace313-f52e-42f7-b8a5-6ff6fdafa8c2-kube-api-access-fj244\") pod \"87ace313-f52e-42f7-b8a5-6ff6fdafa8c2\" (UID: \"87ace313-f52e-42f7-b8a5-6ff6fdafa8c2\") "
Sep 15 10:44:46.392954 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:46.392759    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ee8ecb1-d072-42cd-a6bf-22b205e46595-plugins-config-volume\") pod \"1ee8ecb1-d072-42cd-a6bf-22b205e46595\" (UID: \"1ee8ecb1-d072-42cd-a6bf-22b205e46595\") "
Sep 15 10:44:46.392954 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:46.392850    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87ace313-f52e-42f7-b8a5-6ff6fdafa8c2-plugins-config-volume\") pod \"87ace313-f52e-42f7-b8a5-6ff6fdafa8c2\" (UID: \"87ace313-f52e-42f7-b8a5-6ff6fdafa8c2\") "
Sep 15 10:44:46.392954 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:46.392885    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8r2v8\" (UniqueName: \"kubernetes.io/projected/1ee8ecb1-d072-42cd-a6bf-22b205e46595-kube-api-access-8r2v8\") pod \"1ee8ecb1-d072-42cd-a6bf-22b205e46595\" (UID: \"1ee8ecb1-d072-42cd-a6bf-22b205e46595\") "
Sep 15 10:44:46.393166 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:46.393140    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ee8ecb1-d072-42cd-a6bf-22b205e46595-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1ee8ecb1-d072-42cd-a6bf-22b205e46595" (UID: "1ee8ecb1-d072-42cd-a6bf-22b205e46595"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:44:46.393762 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:46.393616    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87ace313-f52e-42f7-b8a5-6ff6fdafa8c2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "87ace313-f52e-42f7-b8a5-6ff6fdafa8c2" (UID: "87ace313-f52e-42f7-b8a5-6ff6fdafa8c2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:44:46.395401 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:46.395373    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ee8ecb1-d072-42cd-a6bf-22b205e46595-kube-api-access-8r2v8" (OuterVolumeSpecName: "kube-api-access-8r2v8") pod "1ee8ecb1-d072-42cd-a6bf-22b205e46595" (UID: "1ee8ecb1-d072-42cd-a6bf-22b205e46595"). InnerVolumeSpecName "kube-api-access-8r2v8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:44:46.395532 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:46.395518    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87ace313-f52e-42f7-b8a5-6ff6fdafa8c2-kube-api-access-fj244" (OuterVolumeSpecName: "kube-api-access-fj244") pod "87ace313-f52e-42f7-b8a5-6ff6fdafa8c2" (UID: "87ace313-f52e-42f7-b8a5-6ff6fdafa8c2"). InnerVolumeSpecName "kube-api-access-fj244". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:44:46.494015 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:46.493976    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87ace313-f52e-42f7-b8a5-6ff6fdafa8c2-plugins-config-volume\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:44:46.494015 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:46.494008    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8r2v8\" (UniqueName: \"kubernetes.io/projected/1ee8ecb1-d072-42cd-a6bf-22b205e46595-kube-api-access-8r2v8\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:44:46.494015 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:46.494021    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fj244\" (UniqueName: \"kubernetes.io/projected/87ace313-f52e-42f7-b8a5-6ff6fdafa8c2-kube-api-access-fj244\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:44:46.494260 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:46.494030    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ee8ecb1-d072-42cd-a6bf-22b205e46595-plugins-config-volume\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:44:46.576142 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:46.576049    2579 generic.go:356] "Generic (PLEG): container finished" podID="87ace313-f52e-42f7-b8a5-6ff6fdafa8c2" containerID="d9128edaa1f8867ec4a244687803a1253acff486d15f80b12a95bb94e034ef00" exitCode=0
Sep 15 10:44:46.576142 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:46.576096    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-30651f-6d584c8786-2m7gw"
Sep 15 10:44:46.576378 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:46.576136    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-30651f-6d584c8786-2m7gw" event={"ID":"87ace313-f52e-42f7-b8a5-6ff6fdafa8c2","Type":"ContainerDied","Data":"d9128edaa1f8867ec4a244687803a1253acff486d15f80b12a95bb94e034ef00"}
Sep 15 10:44:46.576378 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:46.576203    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-30651f-6d584c8786-2m7gw" event={"ID":"87ace313-f52e-42f7-b8a5-6ff6fdafa8c2","Type":"ContainerDied","Data":"6532107fe6d2cf8557c07bab4ba68cfe58508dddcc951dd0c66b0823f53353c2"}
Sep 15 10:44:46.576378 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:46.576231    2579 scope.go:117] "RemoveContainer" containerID="d9128edaa1f8867ec4a244687803a1253acff486d15f80b12a95bb94e034ef00"
Sep 15 10:44:46.577641 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:46.577615    2579 generic.go:356] "Generic (PLEG): container finished" podID="1ee8ecb1-d072-42cd-a6bf-22b205e46595" containerID="23f9fb8043f03e1527f1d38630c91f8e50992b72ad298b8190a238d63e9754f9" exitCode=0
Sep 15 10:44:46.577767 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:46.577643    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-30651f-868b7b7bf9-7k22t" event={"ID":"1ee8ecb1-d072-42cd-a6bf-22b205e46595","Type":"ContainerDied","Data":"23f9fb8043f03e1527f1d38630c91f8e50992b72ad298b8190a238d63e9754f9"}
Sep 15 10:44:46.577767 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:46.577674    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-30651f-868b7b7bf9-7k22t"
Sep 15 10:44:46.577767 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:46.577695    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-30651f-868b7b7bf9-7k22t" event={"ID":"1ee8ecb1-d072-42cd-a6bf-22b205e46595","Type":"ContainerDied","Data":"34f130ab8b197cd09462f544d0a2932140f4b7fdeba278a3e6dac1a551f53b84"}
Sep 15 10:44:46.588633 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:46.588610    2579 scope.go:117] "RemoveContainer" containerID="d9128edaa1f8867ec4a244687803a1253acff486d15f80b12a95bb94e034ef00"
Sep 15 10:44:46.588977 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:44:46.588957    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9128edaa1f8867ec4a244687803a1253acff486d15f80b12a95bb94e034ef00\": container with ID starting with d9128edaa1f8867ec4a244687803a1253acff486d15f80b12a95bb94e034ef00 not found: ID does not exist" containerID="d9128edaa1f8867ec4a244687803a1253acff486d15f80b12a95bb94e034ef00"
Sep 15 10:44:46.589050 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:46.588991    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9128edaa1f8867ec4a244687803a1253acff486d15f80b12a95bb94e034ef00"} err="failed to get container status \"d9128edaa1f8867ec4a244687803a1253acff486d15f80b12a95bb94e034ef00\": rpc error: code = NotFound desc = could not find container \"d9128edaa1f8867ec4a244687803a1253acff486d15f80b12a95bb94e034ef00\": container with ID starting with d9128edaa1f8867ec4a244687803a1253acff486d15f80b12a95bb94e034ef00 not found: ID does not exist"
Sep 15 10:44:46.589050 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:46.589014    2579 scope.go:117] "RemoveContainer" containerID="23f9fb8043f03e1527f1d38630c91f8e50992b72ad298b8190a238d63e9754f9"
Sep 15 10:44:46.598836 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:46.598794    2579 scope.go:117] "RemoveContainer" containerID="23f9fb8043f03e1527f1d38630c91f8e50992b72ad298b8190a238d63e9754f9"
Sep 15 10:44:46.599188 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:44:46.599153    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23f9fb8043f03e1527f1d38630c91f8e50992b72ad298b8190a238d63e9754f9\": container with ID starting with 23f9fb8043f03e1527f1d38630c91f8e50992b72ad298b8190a238d63e9754f9 not found: ID does not exist" containerID="23f9fb8043f03e1527f1d38630c91f8e50992b72ad298b8190a238d63e9754f9"
Sep 15 10:44:46.599272 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:46.599188    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23f9fb8043f03e1527f1d38630c91f8e50992b72ad298b8190a238d63e9754f9"} err="failed to get container status \"23f9fb8043f03e1527f1d38630c91f8e50992b72ad298b8190a238d63e9754f9\": rpc error: code = NotFound desc = could not find container \"23f9fb8043f03e1527f1d38630c91f8e50992b72ad298b8190a238d63e9754f9\": container with ID starting with 23f9fb8043f03e1527f1d38630c91f8e50992b72ad298b8190a238d63e9754f9 not found: ID does not exist"
Sep 15 10:44:46.602347 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:46.602325    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-30651f-6d584c8786-2m7gw"]
Sep 15 10:44:46.605863 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:46.605839    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-30651f-6d584c8786-2m7gw"]
Sep 15 10:44:46.612750 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:46.612718    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-30651f-868b7b7bf9-7k22t"]
Sep 15 10:44:46.616204 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:46.616184    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-30651f-868b7b7bf9-7k22t"]
Sep 15 10:44:47.150533 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:47.150498    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ee8ecb1-d072-42cd-a6bf-22b205e46595" path="/var/lib/kubelet/pods/1ee8ecb1-d072-42cd-a6bf-22b205e46595/volumes"
Sep 15 10:44:47.151018 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:47.151000    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87ace313-f52e-42f7-b8a5-6ff6fdafa8c2" path="/var/lib/kubelet/pods/87ace313-f52e-42f7-b8a5-6ff6fdafa8c2/volumes"
Sep 15 10:44:47.151441 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:47.151425    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad9676de-aa62-484a-84d0-5cc9cc5933a2" path="/var/lib/kubelet/pods/ad9676de-aa62-484a-84d0-5cc9cc5933a2/volumes"
Sep 15 10:44:47.418506 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:47.418410    2579 scope.go:117] "RemoveContainer" containerID="d2deed61df4d68d9de32c4ff843429ea1aad796caa0a58236c2e6ce6574ded93"
Sep 15 10:44:50.303790 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:50.303755    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm"]
Sep 15 10:44:50.304261 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:50.303961    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm" podUID="d0d8bd17-2aa5-4895-bdab-7dd375af9a26" containerName="istio-proxy" containerID="cri-o://2c87f337c74043c1cee5d250a432299b05d12ca16d31a29eb7aa8aae25550f4c" gracePeriod=30
Sep 15 10:44:52.893222 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:52.893192    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ecf56f-h4fbn"]
Sep 15 10:44:52.893622 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:52.893608    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87ace313-f52e-42f7-b8a5-6ff6fdafa8c2" containerName="payload-pre-processing"
Sep 15 10:44:52.893671 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:52.893623    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="87ace313-f52e-42f7-b8a5-6ff6fdafa8c2" containerName="payload-pre-processing"
Sep 15 10:44:52.893671 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:52.893631    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad9676de-aa62-484a-84d0-5cc9cc5933a2" containerName="revoke-keys"
Sep 15 10:44:52.893671 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:52.893637    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad9676de-aa62-484a-84d0-5cc9cc5933a2" containerName="revoke-keys"
Sep 15 10:44:52.893671 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:52.893660    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41b86081-62bf-4b69-ad77-557580df292d" containerName="payload-pre-processing"
Sep 15 10:44:52.893671 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:52.893666    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="41b86081-62bf-4b69-ad77-557580df292d" containerName="payload-pre-processing"
Sep 15 10:44:52.893837 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:52.893675    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4da162e6-e931-4af8-af3f-f23f543afc4c" containerName="payload-processing"
Sep 15 10:44:52.893837 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:52.893680    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4da162e6-e931-4af8-af3f-f23f543afc4c" containerName="payload-processing"
Sep 15 10:44:52.893837 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:52.893690    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ee8ecb1-d072-42cd-a6bf-22b205e46595" containerName="payload-processing"
Sep 15 10:44:52.893837 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:52.893697    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ee8ecb1-d072-42cd-a6bf-22b205e46595" containerName="payload-processing"
Sep 15 10:44:52.893837 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:52.893769    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="41b86081-62bf-4b69-ad77-557580df292d" containerName="payload-pre-processing"
Sep 15 10:44:52.893837 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:52.893778    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="87ace313-f52e-42f7-b8a5-6ff6fdafa8c2" containerName="payload-pre-processing"
Sep 15 10:44:52.893837 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:52.893788    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad9676de-aa62-484a-84d0-5cc9cc5933a2" containerName="revoke-keys"
Sep 15 10:44:52.893837 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:52.893794    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ee8ecb1-d072-42cd-a6bf-22b205e46595" containerName="payload-processing"
Sep 15 10:44:52.893837 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:52.893799    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4da162e6-e931-4af8-af3f-f23f543afc4c" containerName="payload-processing"
Sep 15 10:44:52.905840 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:52.905800    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ecf56f-h4fbn"
Sep 15 10:44:52.906765 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:52.906714    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ecf56f-h4fbn"]
Sep 15 10:44:52.908200 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:52.908163    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5jrzm\""
Sep 15 10:44:52.958914 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:52.958882    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/891ffdc4-62e3-4800-8454-4193f73ca0c3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-ecf56f-h4fbn\" (UID: \"891ffdc4-62e3-4800-8454-4193f73ca0c3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ecf56f-h4fbn"
Sep 15 10:44:53.060258 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:53.060214    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/891ffdc4-62e3-4800-8454-4193f73ca0c3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-ecf56f-h4fbn\" (UID: \"891ffdc4-62e3-4800-8454-4193f73ca0c3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ecf56f-h4fbn"
Sep 15 10:44:53.060919 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:53.060894    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/891ffdc4-62e3-4800-8454-4193f73ca0c3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-ecf56f-h4fbn\" (UID: \"891ffdc4-62e3-4800-8454-4193f73ca0c3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ecf56f-h4fbn"
Sep 15 10:44:53.223392 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:53.223309    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ecf56f-h4fbn"
Sep 15 10:44:53.495593 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:53.495561    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ecf56f-h4fbn"]
Sep 15 10:44:53.623670 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:53.623635    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ecf56f-h4fbn" event={"ID":"891ffdc4-62e3-4800-8454-4193f73ca0c3","Type":"ContainerStarted","Data":"d634255fa3b7a911963ed6586892a8824502559c57dcb45a6ff80ad68fa10dff"}
Sep 15 10:44:54.631500 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:54.631413    2579 generic.go:356] "Generic (PLEG): container finished" podID="891ffdc4-62e3-4800-8454-4193f73ca0c3" containerID="02d2f3b441d033e863140c4d35587d4edb0ce45ea734d20b73a750f14ccb0940" exitCode=0
Sep 15 10:44:54.631893 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:54.631499    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ecf56f-h4fbn" event={"ID":"891ffdc4-62e3-4800-8454-4193f73ca0c3","Type":"ContainerDied","Data":"02d2f3b441d033e863140c4d35587d4edb0ce45ea734d20b73a750f14ccb0940"}
Sep 15 10:44:55.571323 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:55.571255    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm"
Sep 15 10:44:55.639002 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:55.638970    2579 generic.go:356] "Generic (PLEG): container finished" podID="d0d8bd17-2aa5-4895-bdab-7dd375af9a26" containerID="2c87f337c74043c1cee5d250a432299b05d12ca16d31a29eb7aa8aae25550f4c" exitCode=0
Sep 15 10:44:55.639419 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:55.639019    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm"
Sep 15 10:44:55.639419 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:55.639062    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm" event={"ID":"d0d8bd17-2aa5-4895-bdab-7dd375af9a26","Type":"ContainerDied","Data":"2c87f337c74043c1cee5d250a432299b05d12ca16d31a29eb7aa8aae25550f4c"}
Sep 15 10:44:55.639419 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:55.639113    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm" event={"ID":"d0d8bd17-2aa5-4895-bdab-7dd375af9a26","Type":"ContainerDied","Data":"297c31016e8a7614bf2364d3e32ae5e2c2e1b19f6a64b59f5c90ffa285d4fa7f"}
Sep 15 10:44:55.639419 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:55.639138    2579 scope.go:117] "RemoveContainer" containerID="2c87f337c74043c1cee5d250a432299b05d12ca16d31a29eb7aa8aae25550f4c"
Sep 15 10:44:55.651513 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:55.651400    2579 scope.go:117] "RemoveContainer" containerID="98f9bd1ed7dacb9a0295b2291f727018285b887bdddfc09f50770244ab4fac17"
Sep 15 10:44:55.663831 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:55.663686    2579 scope.go:117] "RemoveContainer" containerID="2c87f337c74043c1cee5d250a432299b05d12ca16d31a29eb7aa8aae25550f4c"
Sep 15 10:44:55.664067 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:44:55.664045    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c87f337c74043c1cee5d250a432299b05d12ca16d31a29eb7aa8aae25550f4c\": container with ID starting with 2c87f337c74043c1cee5d250a432299b05d12ca16d31a29eb7aa8aae25550f4c not found: ID does not exist" containerID="2c87f337c74043c1cee5d250a432299b05d12ca16d31a29eb7aa8aae25550f4c"
Sep 15 10:44:55.664148 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:55.664075    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c87f337c74043c1cee5d250a432299b05d12ca16d31a29eb7aa8aae25550f4c"} err="failed to get container status \"2c87f337c74043c1cee5d250a432299b05d12ca16d31a29eb7aa8aae25550f4c\": rpc error: code = NotFound desc = could not find container \"2c87f337c74043c1cee5d250a432299b05d12ca16d31a29eb7aa8aae25550f4c\": container with ID starting with 2c87f337c74043c1cee5d250a432299b05d12ca16d31a29eb7aa8aae25550f4c not found: ID does not exist"
Sep 15 10:44:55.664148 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:55.664093    2579 scope.go:117] "RemoveContainer" containerID="98f9bd1ed7dacb9a0295b2291f727018285b887bdddfc09f50770244ab4fac17"
Sep 15 10:44:55.664582 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:44:55.664553    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98f9bd1ed7dacb9a0295b2291f727018285b887bdddfc09f50770244ab4fac17\": container with ID starting with 98f9bd1ed7dacb9a0295b2291f727018285b887bdddfc09f50770244ab4fac17 not found: ID does not exist" containerID="98f9bd1ed7dacb9a0295b2291f727018285b887bdddfc09f50770244ab4fac17"
Sep 15 10:44:55.664665 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:55.664581    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98f9bd1ed7dacb9a0295b2291f727018285b887bdddfc09f50770244ab4fac17"} err="failed to get container status \"98f9bd1ed7dacb9a0295b2291f727018285b887bdddfc09f50770244ab4fac17\": rpc error: code = NotFound desc = could not find container \"98f9bd1ed7dacb9a0295b2291f727018285b887bdddfc09f50770244ab4fac17\": container with ID starting with 98f9bd1ed7dacb9a0295b2291f727018285b887bdddfc09f50770244ab4fac17 not found: ID does not exist"
Sep 15 10:44:55.686901 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:55.686865    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0d8bd17-2aa5-4895-bdab-7dd375af9a26-credential-socket\") pod \"d0d8bd17-2aa5-4895-bdab-7dd375af9a26\" (UID: \"d0d8bd17-2aa5-4895-bdab-7dd375af9a26\") "
Sep 15 10:44:55.686901 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:55.686903    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8hxqx\" (UniqueName: \"kubernetes.io/projected/d0d8bd17-2aa5-4895-bdab-7dd375af9a26-kube-api-access-8hxqx\") pod \"d0d8bd17-2aa5-4895-bdab-7dd375af9a26\" (UID: \"d0d8bd17-2aa5-4895-bdab-7dd375af9a26\") "
Sep 15 10:44:55.687135 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:55.686936    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0d8bd17-2aa5-4895-bdab-7dd375af9a26-workload-socket\") pod \"d0d8bd17-2aa5-4895-bdab-7dd375af9a26\" (UID: \"d0d8bd17-2aa5-4895-bdab-7dd375af9a26\") "
Sep 15 10:44:55.687135 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:55.687054    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0d8bd17-2aa5-4895-bdab-7dd375af9a26-istio-data\") pod \"d0d8bd17-2aa5-4895-bdab-7dd375af9a26\" (UID: \"d0d8bd17-2aa5-4895-bdab-7dd375af9a26\") "
Sep 15 10:44:55.687135 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:55.687110    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0d8bd17-2aa5-4895-bdab-7dd375af9a26-workload-certs\") pod \"d0d8bd17-2aa5-4895-bdab-7dd375af9a26\" (UID: \"d0d8bd17-2aa5-4895-bdab-7dd375af9a26\") "
Sep 15 10:44:55.687301 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:55.687137    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0d8bd17-2aa5-4895-bdab-7dd375af9a26-istio-podinfo\") pod \"d0d8bd17-2aa5-4895-bdab-7dd375af9a26\" (UID: \"d0d8bd17-2aa5-4895-bdab-7dd375af9a26\") "
Sep 15 10:44:55.687301 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:55.687166    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0d8bd17-2aa5-4895-bdab-7dd375af9a26-istio-token\") pod \"d0d8bd17-2aa5-4895-bdab-7dd375af9a26\" (UID: \"d0d8bd17-2aa5-4895-bdab-7dd375af9a26\") "
Sep 15 10:44:55.687301 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:55.687185    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0d8bd17-2aa5-4895-bdab-7dd375af9a26-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d0d8bd17-2aa5-4895-bdab-7dd375af9a26" (UID: "d0d8bd17-2aa5-4895-bdab-7dd375af9a26"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:44:55.687301 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:55.687234    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0d8bd17-2aa5-4895-bdab-7dd375af9a26-istio-envoy\") pod \"d0d8bd17-2aa5-4895-bdab-7dd375af9a26\" (UID: \"d0d8bd17-2aa5-4895-bdab-7dd375af9a26\") "
Sep 15 10:44:55.687510 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:55.687307    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0d8bd17-2aa5-4895-bdab-7dd375af9a26-istiod-ca-cert\") pod \"d0d8bd17-2aa5-4895-bdab-7dd375af9a26\" (UID: \"d0d8bd17-2aa5-4895-bdab-7dd375af9a26\") "
Sep 15 10:44:55.687644 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:55.687628    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0d8bd17-2aa5-4895-bdab-7dd375af9a26-credential-socket\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:44:55.687699 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:55.687309    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0d8bd17-2aa5-4895-bdab-7dd375af9a26-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d0d8bd17-2aa5-4895-bdab-7dd375af9a26" (UID: "d0d8bd17-2aa5-4895-bdab-7dd375af9a26"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:44:55.687699 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:55.687380    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0d8bd17-2aa5-4895-bdab-7dd375af9a26-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d0d8bd17-2aa5-4895-bdab-7dd375af9a26" (UID: "d0d8bd17-2aa5-4895-bdab-7dd375af9a26"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:44:55.687699 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:55.687536    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0d8bd17-2aa5-4895-bdab-7dd375af9a26-istio-data" (OuterVolumeSpecName: "istio-data") pod "d0d8bd17-2aa5-4895-bdab-7dd375af9a26" (UID: "d0d8bd17-2aa5-4895-bdab-7dd375af9a26"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:44:55.687950 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:55.687925    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0d8bd17-2aa5-4895-bdab-7dd375af9a26-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d0d8bd17-2aa5-4895-bdab-7dd375af9a26" (UID: "d0d8bd17-2aa5-4895-bdab-7dd375af9a26"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:44:55.690019 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:55.689990    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0d8bd17-2aa5-4895-bdab-7dd375af9a26-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d0d8bd17-2aa5-4895-bdab-7dd375af9a26" (UID: "d0d8bd17-2aa5-4895-bdab-7dd375af9a26"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:44:55.690269 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:55.690248    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0d8bd17-2aa5-4895-bdab-7dd375af9a26-kube-api-access-8hxqx" (OuterVolumeSpecName: "kube-api-access-8hxqx") pod "d0d8bd17-2aa5-4895-bdab-7dd375af9a26" (UID: "d0d8bd17-2aa5-4895-bdab-7dd375af9a26"). InnerVolumeSpecName "kube-api-access-8hxqx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:44:55.690354 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:55.690313    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d0d8bd17-2aa5-4895-bdab-7dd375af9a26-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d0d8bd17-2aa5-4895-bdab-7dd375af9a26" (UID: "d0d8bd17-2aa5-4895-bdab-7dd375af9a26"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 10:44:55.690551 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:55.690532    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0d8bd17-2aa5-4895-bdab-7dd375af9a26-istio-token" (OuterVolumeSpecName: "istio-token") pod "d0d8bd17-2aa5-4895-bdab-7dd375af9a26" (UID: "d0d8bd17-2aa5-4895-bdab-7dd375af9a26"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:44:55.788041 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:55.788017    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ecf56f-h4fbn"
Sep 15 10:44:55.788179 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:55.788123    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8hxqx\" (UniqueName: \"kubernetes.io/projected/d0d8bd17-2aa5-4895-bdab-7dd375af9a26-kube-api-access-8hxqx\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:44:55.788179 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:55.788144    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0d8bd17-2aa5-4895-bdab-7dd375af9a26-workload-socket\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:44:55.788179 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:55.788153    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0d8bd17-2aa5-4895-bdab-7dd375af9a26-istio-data\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:44:55.788179 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:55.788162    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0d8bd17-2aa5-4895-bdab-7dd375af9a26-workload-certs\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:44:55.788179 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:55.788171    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0d8bd17-2aa5-4895-bdab-7dd375af9a26-istio-podinfo\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:44:55.788179 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:55.788179    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0d8bd17-2aa5-4895-bdab-7dd375af9a26-istio-token\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:44:55.788398 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:55.788187    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0d8bd17-2aa5-4895-bdab-7dd375af9a26-istio-envoy\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:44:55.788398 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:55.788195    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0d8bd17-2aa5-4895-bdab-7dd375af9a26-istiod-ca-cert\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:44:55.888946 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:55.888856    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/891ffdc4-62e3-4800-8454-4193f73ca0c3-maas-api-service-ca\") pod \"891ffdc4-62e3-4800-8454-4193f73ca0c3\" (UID: \"891ffdc4-62e3-4800-8454-4193f73ca0c3\") "
Sep 15 10:44:55.889203 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:55.889177    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/891ffdc4-62e3-4800-8454-4193f73ca0c3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "891ffdc4-62e3-4800-8454-4193f73ca0c3" (UID: "891ffdc4-62e3-4800-8454-4193f73ca0c3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:44:55.960955 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:55.960925    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm"]
Sep 15 10:44:55.966596 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:55.966570    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-8c1047-openshift-default-6c8597fb6-zcxxm"]
Sep 15 10:44:55.989746 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:55.989698    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/891ffdc4-62e3-4800-8454-4193f73ca0c3-maas-api-service-ca\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:44:56.646702 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:56.646623    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ecf56f-h4fbn"
Sep 15 10:44:56.646702 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:56.646637    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ecf56f-h4fbn" event={"ID":"891ffdc4-62e3-4800-8454-4193f73ca0c3","Type":"ContainerDied","Data":"d634255fa3b7a911963ed6586892a8824502559c57dcb45a6ff80ad68fa10dff"}
Sep 15 10:44:56.646702 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:56.646691    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d634255fa3b7a911963ed6586892a8824502559c57dcb45a6ff80ad68fa10dff"
Sep 15 10:44:57.148825 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:44:57.148789    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0d8bd17-2aa5-4895-bdab-7dd375af9a26" path="/var/lib/kubelet/pods/d0d8bd17-2aa5-4895-bdab-7dd375af9a26/volumes"
Sep 15 10:45:00.129549 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:00.129511    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-44134e-29824485-drts6"]
Sep 15 10:45:00.130205 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:00.130181    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="891ffdc4-62e3-4800-8454-4193f73ca0c3" containerName="revoke-keys"
Sep 15 10:45:00.130205 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:00.130203    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="891ffdc4-62e3-4800-8454-4193f73ca0c3" containerName="revoke-keys"
Sep 15 10:45:00.130348 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:00.130221    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0d8bd17-2aa5-4895-bdab-7dd375af9a26" containerName="istio-proxy"
Sep 15 10:45:00.130348 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:00.130228    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0d8bd17-2aa5-4895-bdab-7dd375af9a26" containerName="istio-proxy"
Sep 15 10:45:00.130348 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:00.130241    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0d8bd17-2aa5-4895-bdab-7dd375af9a26" containerName="istio-proxy"
Sep 15 10:45:00.130348 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:00.130248    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0d8bd17-2aa5-4895-bdab-7dd375af9a26" containerName="istio-proxy"
Sep 15 10:45:00.130348 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:00.130324    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="891ffdc4-62e3-4800-8454-4193f73ca0c3" containerName="revoke-keys"
Sep 15 10:45:00.130348 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:00.130335    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0d8bd17-2aa5-4895-bdab-7dd375af9a26" containerName="istio-proxy"
Sep 15 10:45:00.130348 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:00.130342    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0d8bd17-2aa5-4895-bdab-7dd375af9a26" containerName="istio-proxy"
Sep 15 10:45:00.133847 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:00.133827    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29824485-xx4rm"]
Sep 15 10:45:00.134135 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:00.134110    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-44134e-29824485-drts6"
Sep 15 10:45:00.136543 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:00.136515    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5jrzm\""
Sep 15 10:45:00.137530 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:00.137506    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-ff0655-29824485-m2cvd"]
Sep 15 10:45:00.137634 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:00.137623    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824485-xx4rm"
Sep 15 10:45:00.141856 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:00.141829    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-44134e-29824485-drts6"]
Sep 15 10:45:00.141991 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:00.141936    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-ff0655-29824485-m2cvd"
Sep 15 10:45:00.143870 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:00.143186    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29824485-xx4rm"]
Sep 15 10:45:00.150025 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:00.150000    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-ff0655-29824485-m2cvd"]
Sep 15 10:45:00.153528 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:00.153506    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-44134e-29824485-drts6"
Sep 15 10:45:00.164610 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:00.164590    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824485-xx4rm"
Sep 15 10:45:00.203108 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:00.203081    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-ff0655-29824485-m2cvd"
Sep 15 10:45:00.443593 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:00.443395    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-44134e-29824485-drts6"]
Sep 15 10:45:00.446314 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:00.446283    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29824485-xx4rm"]
Sep 15 10:45:00.446827 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:45:00.446797    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod015af010_a13e_4517_a611_8bf41cd48488.slice/crio-9b72e335aa6ab712953cfbd93e3d26b44c67849cdcd9bce21655789a9a8c4a6c WatchSource:0}: Error finding container 9b72e335aa6ab712953cfbd93e3d26b44c67849cdcd9bce21655789a9a8c4a6c: Status 404 returned error can't find the container with id 9b72e335aa6ab712953cfbd93e3d26b44c67849cdcd9bce21655789a9a8c4a6c
Sep 15 10:45:00.447542 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:45:00.447517    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaba8c176_382b_49aa_aee8_b15c7143d8da.slice/crio-617e57bac1a438e5ba0218523067e00d07b04aed557c3e5739d772ea76bb441a WatchSource:0}: Error finding container 617e57bac1a438e5ba0218523067e00d07b04aed557c3e5739d772ea76bb441a: Status 404 returned error can't find the container with id 617e57bac1a438e5ba0218523067e00d07b04aed557c3e5739d772ea76bb441a
Sep 15 10:45:00.505245 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:00.505220    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-ff0655-29824485-m2cvd"]
Sep 15 10:45:00.507129 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:45:00.507093    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bcfe2ce_995a_49fc_b4d7_6217a5de7d40.slice/crio-b1888a5d88acb24b2d761e9f178f1fb7949f36ffd568bc0f523a92b66516ea26 WatchSource:0}: Error finding container b1888a5d88acb24b2d761e9f178f1fb7949f36ffd568bc0f523a92b66516ea26: Status 404 returned error can't find the container with id b1888a5d88acb24b2d761e9f178f1fb7949f36ffd568bc0f523a92b66516ea26
Sep 15 10:45:00.673130 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:00.673098    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824485-xx4rm" event={"ID":"aba8c176-382b-49aa-aee8-b15c7143d8da","Type":"ContainerStarted","Data":"617e57bac1a438e5ba0218523067e00d07b04aed557c3e5739d772ea76bb441a"}
Sep 15 10:45:00.674351 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:00.674323    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-ff0655-29824485-m2cvd" event={"ID":"7bcfe2ce-995a-49fc-b4d7-6217a5de7d40","Type":"ContainerStarted","Data":"b1888a5d88acb24b2d761e9f178f1fb7949f36ffd568bc0f523a92b66516ea26"}
Sep 15 10:45:00.675584 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:00.675564    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-44134e-29824485-drts6" event={"ID":"015af010-a13e-4517-a611-8bf41cd48488","Type":"ContainerStarted","Data":"9b72e335aa6ab712953cfbd93e3d26b44c67849cdcd9bce21655789a9a8c4a6c"}
Sep 15 10:45:01.682667 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:01.682629    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824485-xx4rm" event={"ID":"aba8c176-382b-49aa-aee8-b15c7143d8da","Type":"ContainerStarted","Data":"f87885b5cedeb89c89fe0569fbb73203b4622d662dfb8253060fb11175c1a998"}
Sep 15 10:45:01.684264 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:01.684241    2579 generic.go:356] "Generic (PLEG): container finished" podID="7bcfe2ce-995a-49fc-b4d7-6217a5de7d40" containerID="ce3b68b65bb0534f25f04434e6ee8e6db06a95921c0c1569670ea39226916d3d" exitCode=0
Sep 15 10:45:01.684369 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:01.684307    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-ff0655-29824485-m2cvd" event={"ID":"7bcfe2ce-995a-49fc-b4d7-6217a5de7d40","Type":"ContainerDied","Data":"ce3b68b65bb0534f25f04434e6ee8e6db06a95921c0c1569670ea39226916d3d"}
Sep 15 10:45:01.685692 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:01.685671    2579 generic.go:356] "Generic (PLEG): container finished" podID="015af010-a13e-4517-a611-8bf41cd48488" containerID="fc9e728d9d437558a84f46dfa79bf4b29e70a9a005cb93a01ae62157bb0051d2" exitCode=0
Sep 15 10:45:01.685787 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:01.685757    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-44134e-29824485-drts6" event={"ID":"015af010-a13e-4517-a611-8bf41cd48488","Type":"ContainerDied","Data":"fc9e728d9d437558a84f46dfa79bf4b29e70a9a005cb93a01ae62157bb0051d2"}
Sep 15 10:45:01.699230 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:01.699183    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824485-xx4rm" podStartSLOduration=1.699168598 podStartE2EDuration="1.699168598s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:45:01.697519936 +0000 UTC m=+1635.093612048" watchObservedRunningTime="2026-09-15 10:45:01.699168598 +0000 UTC m=+1635.095260685"
Sep 15 10:45:02.693251 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:02.693219    2579 generic.go:356] "Generic (PLEG): container finished" podID="aba8c176-382b-49aa-aee8-b15c7143d8da" containerID="f87885b5cedeb89c89fe0569fbb73203b4622d662dfb8253060fb11175c1a998" exitCode=0
Sep 15 10:45:02.693669 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:02.693323    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824485-xx4rm" event={"ID":"aba8c176-382b-49aa-aee8-b15c7143d8da","Type":"ContainerDied","Data":"f87885b5cedeb89c89fe0569fbb73203b4622d662dfb8253060fb11175c1a998"}
Sep 15 10:45:02.872997 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:02.872967    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-44134e-29824485-drts6"
Sep 15 10:45:02.875878 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:02.875848    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-ff0655-29824485-m2cvd"
Sep 15 10:45:03.476592 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:03.476503    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-ecf56f-594f84c469-tnzcp"]
Sep 15 10:45:03.476785 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:03.476755    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ecf56f-594f84c469-tnzcp" podUID="5538db18-e239-44b2-bff5-41211bb1355f" containerName="payload-processing" containerID="cri-o://0247eab164199b09ab93e87afbc1126474d89b7a9e585f65d6ba8b1c228c52f3" gracePeriod=30
Sep 15 10:45:03.623692 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:03.623654    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ecf56f-h4fbn"]
Sep 15 10:45:03.626985 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:03.626957    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ecf56f-h4fbn"]
Sep 15 10:45:03.705401 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:03.705372    2579 generic.go:356] "Generic (PLEG): container finished" podID="5538db18-e239-44b2-bff5-41211bb1355f" containerID="0247eab164199b09ab93e87afbc1126474d89b7a9e585f65d6ba8b1c228c52f3" exitCode=0
Sep 15 10:45:03.705882 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:03.705447    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ecf56f-594f84c469-tnzcp" event={"ID":"5538db18-e239-44b2-bff5-41211bb1355f","Type":"ContainerDied","Data":"0247eab164199b09ab93e87afbc1126474d89b7a9e585f65d6ba8b1c228c52f3"}
Sep 15 10:45:03.707553 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:03.707533    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-ff0655-29824485-m2cvd"
Sep 15 10:45:03.707801 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:03.707542    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-ff0655-29824485-m2cvd" event={"ID":"7bcfe2ce-995a-49fc-b4d7-6217a5de7d40","Type":"ContainerDied","Data":"b1888a5d88acb24b2d761e9f178f1fb7949f36ffd568bc0f523a92b66516ea26"}
Sep 15 10:45:03.707983 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:03.707966    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b1888a5d88acb24b2d761e9f178f1fb7949f36ffd568bc0f523a92b66516ea26"
Sep 15 10:45:03.709480 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:03.709460    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-44134e-29824485-drts6"
Sep 15 10:45:03.709596 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:03.709457    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-44134e-29824485-drts6" event={"ID":"015af010-a13e-4517-a611-8bf41cd48488","Type":"ContainerDied","Data":"9b72e335aa6ab712953cfbd93e3d26b44c67849cdcd9bce21655789a9a8c4a6c"}
Sep 15 10:45:03.709648 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:03.709597    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9b72e335aa6ab712953cfbd93e3d26b44c67849cdcd9bce21655789a9a8c4a6c"
Sep 15 10:45:03.767458 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:03.767429    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ecf56f-594f84c469-tnzcp"
Sep 15 10:45:03.869964 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:03.869930    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qtfkz\" (UniqueName: \"kubernetes.io/projected/5538db18-e239-44b2-bff5-41211bb1355f-kube-api-access-qtfkz\") pod \"5538db18-e239-44b2-bff5-41211bb1355f\" (UID: \"5538db18-e239-44b2-bff5-41211bb1355f\") "
Sep 15 10:45:03.870137 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:03.870115    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5538db18-e239-44b2-bff5-41211bb1355f-plugins-config-volume\") pod \"5538db18-e239-44b2-bff5-41211bb1355f\" (UID: \"5538db18-e239-44b2-bff5-41211bb1355f\") "
Sep 15 10:45:03.870449 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:03.870427    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5538db18-e239-44b2-bff5-41211bb1355f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5538db18-e239-44b2-bff5-41211bb1355f" (UID: "5538db18-e239-44b2-bff5-41211bb1355f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:45:03.870577 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:03.870555    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5538db18-e239-44b2-bff5-41211bb1355f-plugins-config-volume\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:45:03.871976 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:03.871955    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5538db18-e239-44b2-bff5-41211bb1355f-kube-api-access-qtfkz" (OuterVolumeSpecName: "kube-api-access-qtfkz") pod "5538db18-e239-44b2-bff5-41211bb1355f" (UID: "5538db18-e239-44b2-bff5-41211bb1355f"). InnerVolumeSpecName "kube-api-access-qtfkz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:45:03.891308 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:03.891284    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824485-xx4rm"
Sep 15 10:45:03.972152 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:03.972104    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qtfkz\" (UniqueName: \"kubernetes.io/projected/5538db18-e239-44b2-bff5-41211bb1355f-kube-api-access-qtfkz\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:45:04.716950 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:04.716917    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ecf56f-594f84c469-tnzcp"
Sep 15 10:45:04.717403 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:04.716958    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ecf56f-594f84c469-tnzcp" event={"ID":"5538db18-e239-44b2-bff5-41211bb1355f","Type":"ContainerDied","Data":"0350a9bddc0ddb63495329aea9e7d311f01a8052e4c5361bbcafce8e2efff02f"}
Sep 15 10:45:04.717403 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:04.717018    2579 scope.go:117] "RemoveContainer" containerID="0247eab164199b09ab93e87afbc1126474d89b7a9e585f65d6ba8b1c228c52f3"
Sep 15 10:45:04.718668 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:04.718639    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824485-xx4rm" event={"ID":"aba8c176-382b-49aa-aee8-b15c7143d8da","Type":"ContainerDied","Data":"617e57bac1a438e5ba0218523067e00d07b04aed557c3e5739d772ea76bb441a"}
Sep 15 10:45:04.718833 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:04.718693    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="617e57bac1a438e5ba0218523067e00d07b04aed557c3e5739d772ea76bb441a"
Sep 15 10:45:04.718833 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:04.718764    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824485-xx4rm"
Sep 15 10:45:04.752536 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:04.752500    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-ecf56f-594f84c469-tnzcp"]
Sep 15 10:45:04.758575 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:04.758550    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-ecf56f-594f84c469-tnzcp"]
Sep 15 10:45:05.149415 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:05.149384    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5538db18-e239-44b2-bff5-41211bb1355f" path="/var/lib/kubelet/pods/5538db18-e239-44b2-bff5-41211bb1355f/volumes"
Sep 15 10:45:05.149719 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:05.149706    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="891ffdc4-62e3-4800-8454-4193f73ca0c3" path="/var/lib/kubelet/pods/891ffdc4-62e3-4800-8454-4193f73ca0c3/volumes"
Sep 15 10:45:10.436033 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:10.435999    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms"]
Sep 15 10:45:10.436578 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:10.436212    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms" podUID="73956f17-5640-4c22-8023-702639885d74" containerName="istio-proxy" containerID="cri-o://6bbc0ebc4d6160c62c7c1d9d54b732be2b0e471f35e5a64290e4ba7f6f4de1cc" gracePeriod=30
Sep 15 10:45:12.714601 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:12.714564    2579 patch_prober.go:28] interesting pod/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 15 10:45:12.714983 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:12.714636    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms" podUID="73956f17-5640-4c22-8023-702639885d74" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 10:45:15.709575 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:15.709509    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms"
Sep 15 10:45:15.787843 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:15.787816    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73956f17-5640-4c22-8023-702639885d74-workload-socket\") pod \"73956f17-5640-4c22-8023-702639885d74\" (UID: \"73956f17-5640-4c22-8023-702639885d74\") "
Sep 15 10:45:15.788031 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:15.787860    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73956f17-5640-4c22-8023-702639885d74-istiod-ca-cert\") pod \"73956f17-5640-4c22-8023-702639885d74\" (UID: \"73956f17-5640-4c22-8023-702639885d74\") "
Sep 15 10:45:15.788031 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:15.787892    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73956f17-5640-4c22-8023-702639885d74-istio-data\") pod \"73956f17-5640-4c22-8023-702639885d74\" (UID: \"73956f17-5640-4c22-8023-702639885d74\") "
Sep 15 10:45:15.788031 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:15.787913    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73956f17-5640-4c22-8023-702639885d74-credential-socket\") pod \"73956f17-5640-4c22-8023-702639885d74\" (UID: \"73956f17-5640-4c22-8023-702639885d74\") "
Sep 15 10:45:15.788031 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:15.787936    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73956f17-5640-4c22-8023-702639885d74-istio-token\") pod \"73956f17-5640-4c22-8023-702639885d74\" (UID: \"73956f17-5640-4c22-8023-702639885d74\") "
Sep 15 10:45:15.788031 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:15.787962    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73956f17-5640-4c22-8023-702639885d74-istio-envoy\") pod \"73956f17-5640-4c22-8023-702639885d74\" (UID: \"73956f17-5640-4c22-8023-702639885d74\") "
Sep 15 10:45:15.788031 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:15.788001    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73956f17-5640-4c22-8023-702639885d74-istio-podinfo\") pod \"73956f17-5640-4c22-8023-702639885d74\" (UID: \"73956f17-5640-4c22-8023-702639885d74\") "
Sep 15 10:45:15.788031 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:15.788032    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p22pq\" (UniqueName: \"kubernetes.io/projected/73956f17-5640-4c22-8023-702639885d74-kube-api-access-p22pq\") pod \"73956f17-5640-4c22-8023-702639885d74\" (UID: \"73956f17-5640-4c22-8023-702639885d74\") "
Sep 15 10:45:15.788453 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:15.788077    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73956f17-5640-4c22-8023-702639885d74-workload-certs\") pod \"73956f17-5640-4c22-8023-702639885d74\" (UID: \"73956f17-5640-4c22-8023-702639885d74\") "
Sep 15 10:45:15.788453 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:15.788176    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73956f17-5640-4c22-8023-702639885d74-istio-data" (OuterVolumeSpecName: "istio-data") pod "73956f17-5640-4c22-8023-702639885d74" (UID: "73956f17-5640-4c22-8023-702639885d74"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:45:15.788453 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:15.788197    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73956f17-5640-4c22-8023-702639885d74-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "73956f17-5640-4c22-8023-702639885d74" (UID: "73956f17-5640-4c22-8023-702639885d74"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:45:15.788453 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:15.788353    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73956f17-5640-4c22-8023-702639885d74-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "73956f17-5640-4c22-8023-702639885d74" (UID: "73956f17-5640-4c22-8023-702639885d74"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:45:15.788453 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:15.788402    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73956f17-5640-4c22-8023-702639885d74-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "73956f17-5640-4c22-8023-702639885d74" (UID: "73956f17-5640-4c22-8023-702639885d74"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:45:15.788737 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:15.788487    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73956f17-5640-4c22-8023-702639885d74-istiod-ca-cert\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:45:15.788737 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:15.788507    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73956f17-5640-4c22-8023-702639885d74-istio-data\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:45:15.788737 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:15.788522    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73956f17-5640-4c22-8023-702639885d74-credential-socket\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:45:15.788894 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:15.788773    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73956f17-5640-4c22-8023-702639885d74-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "73956f17-5640-4c22-8023-702639885d74" (UID: "73956f17-5640-4c22-8023-702639885d74"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:45:15.790408 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:15.790383    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73956f17-5640-4c22-8023-702639885d74-istio-token" (OuterVolumeSpecName: "istio-token") pod "73956f17-5640-4c22-8023-702639885d74" (UID: "73956f17-5640-4c22-8023-702639885d74"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:45:15.790621 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:15.790597    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73956f17-5640-4c22-8023-702639885d74-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "73956f17-5640-4c22-8023-702639885d74" (UID: "73956f17-5640-4c22-8023-702639885d74"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:45:15.790621 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:15.790609    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73956f17-5640-4c22-8023-702639885d74-kube-api-access-p22pq" (OuterVolumeSpecName: "kube-api-access-p22pq") pod "73956f17-5640-4c22-8023-702639885d74" (UID: "73956f17-5640-4c22-8023-702639885d74"). InnerVolumeSpecName "kube-api-access-p22pq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:45:15.790828 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:15.790805    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/73956f17-5640-4c22-8023-702639885d74-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "73956f17-5640-4c22-8023-702639885d74" (UID: "73956f17-5640-4c22-8023-702639885d74"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 10:45:15.793272 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:15.793245    2579 generic.go:356] "Generic (PLEG): container finished" podID="73956f17-5640-4c22-8023-702639885d74" containerID="6bbc0ebc4d6160c62c7c1d9d54b732be2b0e471f35e5a64290e4ba7f6f4de1cc" exitCode=0
Sep 15 10:45:15.793400 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:15.793291    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms"
Sep 15 10:45:15.793400 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:15.793319    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms" event={"ID":"73956f17-5640-4c22-8023-702639885d74","Type":"ContainerDied","Data":"6bbc0ebc4d6160c62c7c1d9d54b732be2b0e471f35e5a64290e4ba7f6f4de1cc"}
Sep 15 10:45:15.793400 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:15.793377    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms" event={"ID":"73956f17-5640-4c22-8023-702639885d74","Type":"ContainerDied","Data":"18053715047a0e0781f6c9d4c1234bc581b8b66167f65f495a061d1b61f62eca"}
Sep 15 10:45:15.793561 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:15.793403    2579 scope.go:117] "RemoveContainer" containerID="6bbc0ebc4d6160c62c7c1d9d54b732be2b0e471f35e5a64290e4ba7f6f4de1cc"
Sep 15 10:45:15.813124 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:15.813100    2579 scope.go:117] "RemoveContainer" containerID="85737f23f5cf50dd49f436f0961e5a8dd28639cc13725705ce4b507c445fa7f4"
Sep 15 10:45:15.822806 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:15.822778    2579 scope.go:117] "RemoveContainer" containerID="6bbc0ebc4d6160c62c7c1d9d54b732be2b0e471f35e5a64290e4ba7f6f4de1cc"
Sep 15 10:45:15.823105 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:45:15.823085    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bbc0ebc4d6160c62c7c1d9d54b732be2b0e471f35e5a64290e4ba7f6f4de1cc\": container with ID starting with 6bbc0ebc4d6160c62c7c1d9d54b732be2b0e471f35e5a64290e4ba7f6f4de1cc not found: ID does not exist" containerID="6bbc0ebc4d6160c62c7c1d9d54b732be2b0e471f35e5a64290e4ba7f6f4de1cc"
Sep 15 10:45:15.823163 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:15.823116    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bbc0ebc4d6160c62c7c1d9d54b732be2b0e471f35e5a64290e4ba7f6f4de1cc"} err="failed to get container status \"6bbc0ebc4d6160c62c7c1d9d54b732be2b0e471f35e5a64290e4ba7f6f4de1cc\": rpc error: code = NotFound desc = could not find container \"6bbc0ebc4d6160c62c7c1d9d54b732be2b0e471f35e5a64290e4ba7f6f4de1cc\": container with ID starting with 6bbc0ebc4d6160c62c7c1d9d54b732be2b0e471f35e5a64290e4ba7f6f4de1cc not found: ID does not exist"
Sep 15 10:45:15.823163 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:15.823134    2579 scope.go:117] "RemoveContainer" containerID="85737f23f5cf50dd49f436f0961e5a8dd28639cc13725705ce4b507c445fa7f4"
Sep 15 10:45:15.823307 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:15.823286    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms"]
Sep 15 10:45:15.823446 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:45:15.823429    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85737f23f5cf50dd49f436f0961e5a8dd28639cc13725705ce4b507c445fa7f4\": container with ID starting with 85737f23f5cf50dd49f436f0961e5a8dd28639cc13725705ce4b507c445fa7f4 not found: ID does not exist" containerID="85737f23f5cf50dd49f436f0961e5a8dd28639cc13725705ce4b507c445fa7f4"
Sep 15 10:45:15.823488 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:15.823453    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85737f23f5cf50dd49f436f0961e5a8dd28639cc13725705ce4b507c445fa7f4"} err="failed to get container status \"85737f23f5cf50dd49f436f0961e5a8dd28639cc13725705ce4b507c445fa7f4\": rpc error: code = NotFound desc = could not find container \"85737f23f5cf50dd49f436f0961e5a8dd28639cc13725705ce4b507c445fa7f4\": container with ID starting with 85737f23f5cf50dd49f436f0961e5a8dd28639cc13725705ce4b507c445fa7f4 not found: ID does not exist"
Sep 15 10:45:15.827698 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:15.827671    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-ecf56f-openshift-default-5fcbb9f6b6-cwrms"]
Sep 15 10:45:15.890034 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:15.890003    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73956f17-5640-4c22-8023-702639885d74-istio-token\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:45:15.890034 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:15.890030    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73956f17-5640-4c22-8023-702639885d74-istio-envoy\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:45:15.890034 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:15.890039    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73956f17-5640-4c22-8023-702639885d74-istio-podinfo\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:45:15.890259 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:15.890047    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p22pq\" (UniqueName: \"kubernetes.io/projected/73956f17-5640-4c22-8023-702639885d74-kube-api-access-p22pq\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:45:15.890259 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:15.890056    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73956f17-5640-4c22-8023-702639885d74-workload-certs\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:45:15.890259 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:15.890065    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73956f17-5640-4c22-8023-702639885d74-workload-socket\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:45:17.150024 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:17.149991    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73956f17-5640-4c22-8023-702639885d74" path="/var/lib/kubelet/pods/73956f17-5640-4c22-8023-702639885d74/volumes"
Sep 15 10:45:47.483258 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:45:47.483219    2579 scope.go:117] "RemoveContainer" containerID="828847c3281d0173f79f69fcbe8bf910411c1bbb81d61e39eb99dac1868fc5e6"
Sep 15 10:46:14.629294 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:14.629215    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7882-0134c4"]
Sep 15 10:46:14.629718 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:14.629664    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="015af010-a13e-4517-a611-8bf41cd48488" containerName="cleanup"
Sep 15 10:46:14.629718 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:14.629677    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="015af010-a13e-4517-a611-8bf41cd48488" containerName="cleanup"
Sep 15 10:46:14.629718 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:14.629686    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bcfe2ce-995a-49fc-b4d7-6217a5de7d40" containerName="cleanup"
Sep 15 10:46:14.629718 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:14.629691    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bcfe2ce-995a-49fc-b4d7-6217a5de7d40" containerName="cleanup"
Sep 15 10:46:14.629718 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:14.629698    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5538db18-e239-44b2-bff5-41211bb1355f" containerName="payload-processing"
Sep 15 10:46:14.629718 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:14.629704    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5538db18-e239-44b2-bff5-41211bb1355f" containerName="payload-processing"
Sep 15 10:46:14.629718 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:14.629719    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73956f17-5640-4c22-8023-702639885d74" containerName="istio-proxy"
Sep 15 10:46:14.629976 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:14.629740    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="73956f17-5640-4c22-8023-702639885d74" containerName="istio-proxy"
Sep 15 10:46:14.629976 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:14.629750    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73956f17-5640-4c22-8023-702639885d74" containerName="istio-proxy"
Sep 15 10:46:14.629976 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:14.629759    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="73956f17-5640-4c22-8023-702639885d74" containerName="istio-proxy"
Sep 15 10:46:14.629976 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:14.629782    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aba8c176-382b-49aa-aee8-b15c7143d8da" containerName="cleanup"
Sep 15 10:46:14.629976 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:14.629790    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="aba8c176-382b-49aa-aee8-b15c7143d8da" containerName="cleanup"
Sep 15 10:46:14.629976 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:14.629866    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="015af010-a13e-4517-a611-8bf41cd48488" containerName="cleanup"
Sep 15 10:46:14.629976 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:14.629873    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="aba8c176-382b-49aa-aee8-b15c7143d8da" containerName="cleanup"
Sep 15 10:46:14.629976 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:14.629879    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bcfe2ce-995a-49fc-b4d7-6217a5de7d40" containerName="cleanup"
Sep 15 10:46:14.629976 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:14.629887    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="73956f17-5640-4c22-8023-702639885d74" containerName="istio-proxy"
Sep 15 10:46:14.629976 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:14.629895    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="73956f17-5640-4c22-8023-702639885d74" containerName="istio-proxy"
Sep 15 10:46:14.629976 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:14.629902    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5538db18-e239-44b2-bff5-41211bb1355f" containerName="payload-processing"
Sep 15 10:46:14.633291 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:14.633266    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7882-0134c4"
Sep 15 10:46:14.636904 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:14.636059    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-f7bvs\""
Sep 15 10:46:14.638201 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:14.638173    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7882-0134c4"]
Sep 15 10:46:14.746969 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:14.746926    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2sxn\" (UniqueName: \"kubernetes.io/projected/2d9268b0-193d-4f61-922e-cdbca008f36d-kube-api-access-x2sxn\") pod \"test-curl-7882-0134c4\" (UID: \"2d9268b0-193d-4f61-922e-cdbca008f36d\") " pod="opendatahub/test-curl-7882-0134c4"
Sep 15 10:46:14.848413 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:14.848358    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2sxn\" (UniqueName: \"kubernetes.io/projected/2d9268b0-193d-4f61-922e-cdbca008f36d-kube-api-access-x2sxn\") pod \"test-curl-7882-0134c4\" (UID: \"2d9268b0-193d-4f61-922e-cdbca008f36d\") " pod="opendatahub/test-curl-7882-0134c4"
Sep 15 10:46:14.855814 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:14.855793    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2sxn\" (UniqueName: \"kubernetes.io/projected/2d9268b0-193d-4f61-922e-cdbca008f36d-kube-api-access-x2sxn\") pod \"test-curl-7882-0134c4\" (UID: \"2d9268b0-193d-4f61-922e-cdbca008f36d\") " pod="opendatahub/test-curl-7882-0134c4"
Sep 15 10:46:14.944553 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:14.944474    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7882-0134c4"
Sep 15 10:46:15.214054 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:15.214028    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7882-0134c4"]
Sep 15 10:46:15.216625 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:46:15.216593    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2d9268b0_193d_4f61_922e_cdbca008f36d.slice/crio-03b3e7dc475503b54f3d5a5307ad97d95c769c7e308075248f119ed3212e2a50 WatchSource:0}: Error finding container 03b3e7dc475503b54f3d5a5307ad97d95c769c7e308075248f119ed3212e2a50: Status 404 returned error can't find the container with id 03b3e7dc475503b54f3d5a5307ad97d95c769c7e308075248f119ed3212e2a50
Sep 15 10:46:16.145761 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:16.145712    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7882-0134c4" event={"ID":"2d9268b0-193d-4f61-922e-cdbca008f36d","Type":"ContainerStarted","Data":"8aa7935ec6b8fc0eeddaecd8f8d693dd1c85f39dd421e84682dedb5bdc5e476c"}
Sep 15 10:46:16.145761 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:16.145766    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7882-0134c4" event={"ID":"2d9268b0-193d-4f61-922e-cdbca008f36d","Type":"ContainerStarted","Data":"03b3e7dc475503b54f3d5a5307ad97d95c769c7e308075248f119ed3212e2a50"}
Sep 15 10:46:16.159673 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:16.159627    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7882-0134c4" podStartSLOduration=2.15961211 podStartE2EDuration="2.15961211s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:46:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:46:16.158369193 +0000 UTC m=+1709.554461281" watchObservedRunningTime="2026-09-15 10:46:16.15961211 +0000 UTC m=+1709.555704199"
Sep 15 10:46:16.737051 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:16.737015    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7882-0134c4"]
Sep 15 10:46:16.741149 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:16.741120    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7882-0134c4"]
Sep 15 10:46:17.150418 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:46:17.150389    2579 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7882-0134c4" container="test-curl-7882-0134c4"
Sep 15 10:46:18.017478 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:18.017440    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-ff0655-5j8tl"]
Sep 15 10:46:18.017909 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:18.017894    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d9268b0-193d-4f61-922e-cdbca008f36d" containerName="test-curl-7882-0134c4"
Sep 15 10:46:18.017994 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:18.017910    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d9268b0-193d-4f61-922e-cdbca008f36d" containerName="test-curl-7882-0134c4"
Sep 15 10:46:18.018043 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:18.018002    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d9268b0-193d-4f61-922e-cdbca008f36d" containerName="test-curl-7882-0134c4"
Sep 15 10:46:18.021946 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:18.021920    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-ff0655-5j8tl"
Sep 15 10:46:18.029669 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:18.026621    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5jrzm\""
Sep 15 10:46:18.034105 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:18.034072    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-ff0655-5j8tl"]
Sep 15 10:46:18.078690 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:18.078655    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/901159ca-2883-473d-836e-c9576b4fff54-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-ff0655-5j8tl\" (UID: \"901159ca-2883-473d-836e-c9576b4fff54\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-ff0655-5j8tl"
Sep 15 10:46:18.157153 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:18.157116    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7882-0134c4" podUID="2d9268b0-193d-4f61-922e-cdbca008f36d" containerName="test-curl-7882-0134c4" containerID="cri-o://8aa7935ec6b8fc0eeddaecd8f8d693dd1c85f39dd421e84682dedb5bdc5e476c" gracePeriod=2
Sep 15 10:46:18.179813 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:18.179779    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/901159ca-2883-473d-836e-c9576b4fff54-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-ff0655-5j8tl\" (UID: \"901159ca-2883-473d-836e-c9576b4fff54\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-ff0655-5j8tl"
Sep 15 10:46:18.180419 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:18.180400    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/901159ca-2883-473d-836e-c9576b4fff54-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-ff0655-5j8tl\" (UID: \"901159ca-2883-473d-836e-c9576b4fff54\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-ff0655-5j8tl"
Sep 15 10:46:18.341923 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:18.341887    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-ff0655-5j8tl"
Sep 15 10:46:18.622173 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:18.622136    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-ff0655-5j8tl"]
Sep 15 10:46:18.623625 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:46:18.623600    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod901159ca_2883_473d_836e_c9576b4fff54.slice/crio-82243f583ea3ed6bf52162000b3bf9ee4d143cbbb764a9e6bc1d798f8f2ad72c WatchSource:0}: Error finding container 82243f583ea3ed6bf52162000b3bf9ee4d143cbbb764a9e6bc1d798f8f2ad72c: Status 404 returned error can't find the container with id 82243f583ea3ed6bf52162000b3bf9ee4d143cbbb764a9e6bc1d798f8f2ad72c
Sep 15 10:46:19.167310 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:19.167218    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-ff0655-5j8tl" event={"ID":"901159ca-2883-473d-836e-c9576b4fff54","Type":"ContainerStarted","Data":"183413cc742cfb38bdfe5fd41cfde6decc6d5fed1181fa1bf872e168ac63eaf7"}
Sep 15 10:46:19.167310 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:19.167273    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-ff0655-5j8tl" event={"ID":"901159ca-2883-473d-836e-c9576b4fff54","Type":"ContainerStarted","Data":"82243f583ea3ed6bf52162000b3bf9ee4d143cbbb764a9e6bc1d798f8f2ad72c"}
Sep 15 10:46:19.182856 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:19.182800    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-ff0655-5j8tl" podStartSLOduration=2.182785818 podStartE2EDuration="2.182785818s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:46:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:46:19.180674126 +0000 UTC m=+1712.576766213" watchObservedRunningTime="2026-09-15 10:46:19.182785818 +0000 UTC m=+1712.578877883"
Sep 15 10:46:20.174854 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:20.174826    2579 generic.go:356] "Generic (PLEG): container finished" podID="901159ca-2883-473d-836e-c9576b4fff54" containerID="183413cc742cfb38bdfe5fd41cfde6decc6d5fed1181fa1bf872e168ac63eaf7" exitCode=0
Sep 15 10:46:20.175229 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:20.174896    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-ff0655-5j8tl" event={"ID":"901159ca-2883-473d-836e-c9576b4fff54","Type":"ContainerDied","Data":"183413cc742cfb38bdfe5fd41cfde6decc6d5fed1181fa1bf872e168ac63eaf7"}
Sep 15 10:46:20.347158 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:20.347124    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7882-0134c4"
Sep 15 10:46:20.401037 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:20.400999    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x2sxn\" (UniqueName: \"kubernetes.io/projected/2d9268b0-193d-4f61-922e-cdbca008f36d-kube-api-access-x2sxn\") pod \"2d9268b0-193d-4f61-922e-cdbca008f36d\" (UID: \"2d9268b0-193d-4f61-922e-cdbca008f36d\") "
Sep 15 10:46:20.403353 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:20.403318    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d9268b0-193d-4f61-922e-cdbca008f36d-kube-api-access-x2sxn" (OuterVolumeSpecName: "kube-api-access-x2sxn") pod "2d9268b0-193d-4f61-922e-cdbca008f36d" (UID: "2d9268b0-193d-4f61-922e-cdbca008f36d"). InnerVolumeSpecName "kube-api-access-x2sxn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:46:20.502531 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:20.502488    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x2sxn\" (UniqueName: \"kubernetes.io/projected/2d9268b0-193d-4f61-922e-cdbca008f36d-kube-api-access-x2sxn\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:46:21.149299 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:21.149271    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d9268b0-193d-4f61-922e-cdbca008f36d" path="/var/lib/kubelet/pods/2d9268b0-193d-4f61-922e-cdbca008f36d/volumes"
Sep 15 10:46:21.181853 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:21.181820    2579 generic.go:356] "Generic (PLEG): container finished" podID="2d9268b0-193d-4f61-922e-cdbca008f36d" containerID="8aa7935ec6b8fc0eeddaecd8f8d693dd1c85f39dd421e84682dedb5bdc5e476c" exitCode=137
Sep 15 10:46:21.182269 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:21.181871    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7882-0134c4"
Sep 15 10:46:21.182269 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:21.181871    2579 scope.go:117] "RemoveContainer" containerID="8aa7935ec6b8fc0eeddaecd8f8d693dd1c85f39dd421e84682dedb5bdc5e476c"
Sep 15 10:46:21.192696 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:21.192663    2579 scope.go:117] "RemoveContainer" containerID="8aa7935ec6b8fc0eeddaecd8f8d693dd1c85f39dd421e84682dedb5bdc5e476c"
Sep 15 10:46:21.193101 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:46:21.193069    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8aa7935ec6b8fc0eeddaecd8f8d693dd1c85f39dd421e84682dedb5bdc5e476c\": container with ID starting with 8aa7935ec6b8fc0eeddaecd8f8d693dd1c85f39dd421e84682dedb5bdc5e476c not found: ID does not exist" containerID="8aa7935ec6b8fc0eeddaecd8f8d693dd1c85f39dd421e84682dedb5bdc5e476c"
Sep 15 10:46:21.193195 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:21.193115    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8aa7935ec6b8fc0eeddaecd8f8d693dd1c85f39dd421e84682dedb5bdc5e476c"} err="failed to get container status \"8aa7935ec6b8fc0eeddaecd8f8d693dd1c85f39dd421e84682dedb5bdc5e476c\": rpc error: code = NotFound desc = could not find container \"8aa7935ec6b8fc0eeddaecd8f8d693dd1c85f39dd421e84682dedb5bdc5e476c\": container with ID starting with 8aa7935ec6b8fc0eeddaecd8f8d693dd1c85f39dd421e84682dedb5bdc5e476c not found: ID does not exist"
Sep 15 10:46:21.325924 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:21.325899    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-ff0655-5j8tl"
Sep 15 10:46:21.411680 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:21.411582    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/901159ca-2883-473d-836e-c9576b4fff54-maas-api-service-ca\") pod \"901159ca-2883-473d-836e-c9576b4fff54\" (UID: \"901159ca-2883-473d-836e-c9576b4fff54\") "
Sep 15 10:46:21.412046 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:21.412013    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/901159ca-2883-473d-836e-c9576b4fff54-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "901159ca-2883-473d-836e-c9576b4fff54" (UID: "901159ca-2883-473d-836e-c9576b4fff54"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:46:21.512573 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:21.512526    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/901159ca-2883-473d-836e-c9576b4fff54-maas-api-service-ca\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:46:22.190159 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:22.190122    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-ff0655-5j8tl" event={"ID":"901159ca-2883-473d-836e-c9576b4fff54","Type":"ContainerDied","Data":"82243f583ea3ed6bf52162000b3bf9ee4d143cbbb764a9e6bc1d798f8f2ad72c"}
Sep 15 10:46:22.190159 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:22.190145    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-ff0655-5j8tl"
Sep 15 10:46:22.190588 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:22.190173    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="82243f583ea3ed6bf52162000b3bf9ee4d143cbbb764a9e6bc1d798f8f2ad72c"
Sep 15 10:46:33.555498 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:33.555464    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-ff0655-29824485-m2cvd"]
Sep 15 10:46:33.557651 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:33.557614    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-ff0655-29824485-m2cvd"]
Sep 15 10:46:33.578624 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:33.578595    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-ff0655-5687dbf867-c4bpj"]
Sep 15 10:46:33.578885 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:33.578842    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w4-ff0655-5687dbf867-c4bpj" podUID="6e592f08-8fd8-4665-b4e1-91ec9e1a7152" containerName="payload-processing" containerID="cri-o://0f68c80a14f7fe98c4f926889001a509f5b117fb01efe459bf368251dd137c24" gracePeriod=30
Sep 15 10:46:33.586761 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:33.586631    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-ff0655-9b677758-djj76"]
Sep 15 10:46:33.586917 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:33.586871    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ff0655-9b677758-djj76" podUID="90d97adf-06bd-498e-8a70-5b89e27baa88" containerName="payload-pre-processing" containerID="cri-o://fc84cd81db54f30254494cd0c35b8f66345e9c6fdfd0ecf3f14838ccc4b76f8e" gracePeriod=30
Sep 15 10:46:33.756964 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:33.756927    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-ff0655-5j8tl"]
Sep 15 10:46:33.760965 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:33.760928    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-ff0655-5j8tl"]
Sep 15 10:46:33.877166 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:33.877136    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-ff0655-5687dbf867-c4bpj"
Sep 15 10:46:33.899101 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:33.899058    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ff0655-9b677758-djj76"
Sep 15 10:46:34.042402 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:34.042367    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gtbgq\" (UniqueName: \"kubernetes.io/projected/90d97adf-06bd-498e-8a70-5b89e27baa88-kube-api-access-gtbgq\") pod \"90d97adf-06bd-498e-8a70-5b89e27baa88\" (UID: \"90d97adf-06bd-498e-8a70-5b89e27baa88\") "
Sep 15 10:46:34.042589 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:34.042445    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90d97adf-06bd-498e-8a70-5b89e27baa88-plugins-config-volume\") pod \"90d97adf-06bd-498e-8a70-5b89e27baa88\" (UID: \"90d97adf-06bd-498e-8a70-5b89e27baa88\") "
Sep 15 10:46:34.042589 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:34.042502    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wx5v7\" (UniqueName: \"kubernetes.io/projected/6e592f08-8fd8-4665-b4e1-91ec9e1a7152-kube-api-access-wx5v7\") pod \"6e592f08-8fd8-4665-b4e1-91ec9e1a7152\" (UID: \"6e592f08-8fd8-4665-b4e1-91ec9e1a7152\") "
Sep 15 10:46:34.042589 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:34.042548    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e592f08-8fd8-4665-b4e1-91ec9e1a7152-plugins-config-volume\") pod \"6e592f08-8fd8-4665-b4e1-91ec9e1a7152\" (UID: \"6e592f08-8fd8-4665-b4e1-91ec9e1a7152\") "
Sep 15 10:46:34.042905 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:34.042879    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90d97adf-06bd-498e-8a70-5b89e27baa88-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "90d97adf-06bd-498e-8a70-5b89e27baa88" (UID: "90d97adf-06bd-498e-8a70-5b89e27baa88"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:46:34.043007 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:34.042988    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e592f08-8fd8-4665-b4e1-91ec9e1a7152-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6e592f08-8fd8-4665-b4e1-91ec9e1a7152" (UID: "6e592f08-8fd8-4665-b4e1-91ec9e1a7152"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:46:34.044464 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:34.044445    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e592f08-8fd8-4665-b4e1-91ec9e1a7152-kube-api-access-wx5v7" (OuterVolumeSpecName: "kube-api-access-wx5v7") pod "6e592f08-8fd8-4665-b4e1-91ec9e1a7152" (UID: "6e592f08-8fd8-4665-b4e1-91ec9e1a7152"). InnerVolumeSpecName "kube-api-access-wx5v7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:46:34.044464 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:34.044457    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90d97adf-06bd-498e-8a70-5b89e27baa88-kube-api-access-gtbgq" (OuterVolumeSpecName: "kube-api-access-gtbgq") pod "90d97adf-06bd-498e-8a70-5b89e27baa88" (UID: "90d97adf-06bd-498e-8a70-5b89e27baa88"). InnerVolumeSpecName "kube-api-access-gtbgq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:46:34.143567 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:34.143484    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90d97adf-06bd-498e-8a70-5b89e27baa88-plugins-config-volume\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:46:34.143567 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:34.143513    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wx5v7\" (UniqueName: \"kubernetes.io/projected/6e592f08-8fd8-4665-b4e1-91ec9e1a7152-kube-api-access-wx5v7\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:46:34.143567 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:34.143525    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e592f08-8fd8-4665-b4e1-91ec9e1a7152-plugins-config-volume\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:46:34.143567 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:34.143533    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gtbgq\" (UniqueName: \"kubernetes.io/projected/90d97adf-06bd-498e-8a70-5b89e27baa88-kube-api-access-gtbgq\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:46:34.261098 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:34.261065    2579 generic.go:356] "Generic (PLEG): container finished" podID="90d97adf-06bd-498e-8a70-5b89e27baa88" containerID="fc84cd81db54f30254494cd0c35b8f66345e9c6fdfd0ecf3f14838ccc4b76f8e" exitCode=0
Sep 15 10:46:34.261297 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:34.261109    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ff0655-9b677758-djj76"
Sep 15 10:46:34.261297 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:34.261143    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ff0655-9b677758-djj76" event={"ID":"90d97adf-06bd-498e-8a70-5b89e27baa88","Type":"ContainerDied","Data":"fc84cd81db54f30254494cd0c35b8f66345e9c6fdfd0ecf3f14838ccc4b76f8e"}
Sep 15 10:46:34.261297 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:34.261196    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ff0655-9b677758-djj76" event={"ID":"90d97adf-06bd-498e-8a70-5b89e27baa88","Type":"ContainerDied","Data":"86e95d4c62a4b2b26269c8813282fe5bb6fa4bec229784538b919662a85f28e4"}
Sep 15 10:46:34.261297 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:34.261219    2579 scope.go:117] "RemoveContainer" containerID="fc84cd81db54f30254494cd0c35b8f66345e9c6fdfd0ecf3f14838ccc4b76f8e"
Sep 15 10:46:34.262580 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:34.262557    2579 generic.go:356] "Generic (PLEG): container finished" podID="6e592f08-8fd8-4665-b4e1-91ec9e1a7152" containerID="0f68c80a14f7fe98c4f926889001a509f5b117fb01efe459bf368251dd137c24" exitCode=0
Sep 15 10:46:34.262691 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:34.262612    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-ff0655-5687dbf867-c4bpj"
Sep 15 10:46:34.262758 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:34.262652    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-ff0655-5687dbf867-c4bpj" event={"ID":"6e592f08-8fd8-4665-b4e1-91ec9e1a7152","Type":"ContainerDied","Data":"0f68c80a14f7fe98c4f926889001a509f5b117fb01efe459bf368251dd137c24"}
Sep 15 10:46:34.262758 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:34.262752    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-ff0655-5687dbf867-c4bpj" event={"ID":"6e592f08-8fd8-4665-b4e1-91ec9e1a7152","Type":"ContainerDied","Data":"30ca9ae9188182b5001212f2f1360c3499a9a11408717f20deb63a9d42550323"}
Sep 15 10:46:34.270971 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:34.270953    2579 scope.go:117] "RemoveContainer" containerID="fc84cd81db54f30254494cd0c35b8f66345e9c6fdfd0ecf3f14838ccc4b76f8e"
Sep 15 10:46:34.271307 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:46:34.271283    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc84cd81db54f30254494cd0c35b8f66345e9c6fdfd0ecf3f14838ccc4b76f8e\": container with ID starting with fc84cd81db54f30254494cd0c35b8f66345e9c6fdfd0ecf3f14838ccc4b76f8e not found: ID does not exist" containerID="fc84cd81db54f30254494cd0c35b8f66345e9c6fdfd0ecf3f14838ccc4b76f8e"
Sep 15 10:46:34.271382 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:34.271320    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc84cd81db54f30254494cd0c35b8f66345e9c6fdfd0ecf3f14838ccc4b76f8e"} err="failed to get container status \"fc84cd81db54f30254494cd0c35b8f66345e9c6fdfd0ecf3f14838ccc4b76f8e\": rpc error: code = NotFound desc = could not find container \"fc84cd81db54f30254494cd0c35b8f66345e9c6fdfd0ecf3f14838ccc4b76f8e\": container with ID starting with fc84cd81db54f30254494cd0c35b8f66345e9c6fdfd0ecf3f14838ccc4b76f8e not found: ID does not exist"
Sep 15 10:46:34.271382 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:34.271344    2579 scope.go:117] "RemoveContainer" containerID="0f68c80a14f7fe98c4f926889001a509f5b117fb01efe459bf368251dd137c24"
Sep 15 10:46:34.280227 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:34.280208    2579 scope.go:117] "RemoveContainer" containerID="0f68c80a14f7fe98c4f926889001a509f5b117fb01efe459bf368251dd137c24"
Sep 15 10:46:34.280484 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:46:34.280468    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f68c80a14f7fe98c4f926889001a509f5b117fb01efe459bf368251dd137c24\": container with ID starting with 0f68c80a14f7fe98c4f926889001a509f5b117fb01efe459bf368251dd137c24 not found: ID does not exist" containerID="0f68c80a14f7fe98c4f926889001a509f5b117fb01efe459bf368251dd137c24"
Sep 15 10:46:34.280532 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:34.280491    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f68c80a14f7fe98c4f926889001a509f5b117fb01efe459bf368251dd137c24"} err="failed to get container status \"0f68c80a14f7fe98c4f926889001a509f5b117fb01efe459bf368251dd137c24\": rpc error: code = NotFound desc = could not find container \"0f68c80a14f7fe98c4f926889001a509f5b117fb01efe459bf368251dd137c24\": container with ID starting with 0f68c80a14f7fe98c4f926889001a509f5b117fb01efe459bf368251dd137c24 not found: ID does not exist"
Sep 15 10:46:34.285742 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:34.285699    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-ff0655-9b677758-djj76"]
Sep 15 10:46:34.289375 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:34.289357    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-ff0655-9b677758-djj76"]
Sep 15 10:46:34.299862 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:34.299835    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-ff0655-5687dbf867-c4bpj"]
Sep 15 10:46:34.303848 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:34.303820    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-ff0655-5687dbf867-c4bpj"]
Sep 15 10:46:34.834289 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:34.834251    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ff0655-9b677758-djj76" podUID="90d97adf-06bd-498e-8a70-5b89e27baa88" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.51:9004: i/o timeout"
Sep 15 10:46:35.160069 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:35.160029    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e592f08-8fd8-4665-b4e1-91ec9e1a7152" path="/var/lib/kubelet/pods/6e592f08-8fd8-4665-b4e1-91ec9e1a7152/volumes"
Sep 15 10:46:35.160369 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:35.160353    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7bcfe2ce-995a-49fc-b4d7-6217a5de7d40" path="/var/lib/kubelet/pods/7bcfe2ce-995a-49fc-b4d7-6217a5de7d40/volumes"
Sep 15 10:46:35.160640 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:35.160625    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="901159ca-2883-473d-836e-c9576b4fff54" path="/var/lib/kubelet/pods/901159ca-2883-473d-836e-c9576b4fff54/volumes"
Sep 15 10:46:35.160982 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:35.160966    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90d97adf-06bd-498e-8a70-5b89e27baa88" path="/var/lib/kubelet/pods/90d97adf-06bd-498e-8a70-5b89e27baa88/volumes"
Sep 15 10:46:40.016231 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:40.016191    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq"]
Sep 15 10:46:40.016830 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:40.016458    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq" podUID="8f82258b-ec03-4785-83f7-13de6b4178a2" containerName="istio-proxy" containerID="cri-o://3ac8be1b251899642188d2d398743c8ee5aa4b05701201373b8c31a4049531e3" gracePeriod=30
Sep 15 10:46:45.275253 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:45.275225    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq"
Sep 15 10:46:45.327973 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:45.327896    2579 generic.go:356] "Generic (PLEG): container finished" podID="8f82258b-ec03-4785-83f7-13de6b4178a2" containerID="3ac8be1b251899642188d2d398743c8ee5aa4b05701201373b8c31a4049531e3" exitCode=0
Sep 15 10:46:45.327973 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:45.327962    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq"
Sep 15 10:46:45.328210 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:45.327991    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq" event={"ID":"8f82258b-ec03-4785-83f7-13de6b4178a2","Type":"ContainerDied","Data":"3ac8be1b251899642188d2d398743c8ee5aa4b05701201373b8c31a4049531e3"}
Sep 15 10:46:45.328210 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:45.328061    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq" event={"ID":"8f82258b-ec03-4785-83f7-13de6b4178a2","Type":"ContainerDied","Data":"d73838a3e96fb32b75b36048440c694db61e939270d964755da281dc4f3f9e64"}
Sep 15 10:46:45.328210 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:45.328091    2579 scope.go:117] "RemoveContainer" containerID="3ac8be1b251899642188d2d398743c8ee5aa4b05701201373b8c31a4049531e3"
Sep 15 10:46:45.337305 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:45.337286    2579 scope.go:117] "RemoveContainer" containerID="c5b826667c05b906c078b2625e95c23703cd80d1381a49d79742765243a8ee44"
Sep 15 10:46:45.345457 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:45.345430    2579 scope.go:117] "RemoveContainer" containerID="3ac8be1b251899642188d2d398743c8ee5aa4b05701201373b8c31a4049531e3"
Sep 15 10:46:45.345645 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:45.345627    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f82258b-ec03-4785-83f7-13de6b4178a2-istio-envoy\") pod \"8f82258b-ec03-4785-83f7-13de6b4178a2\" (UID: \"8f82258b-ec03-4785-83f7-13de6b4178a2\") "
Sep 15 10:46:45.345713 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:45.345657    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f82258b-ec03-4785-83f7-13de6b4178a2-workload-certs\") pod \"8f82258b-ec03-4785-83f7-13de6b4178a2\" (UID: \"8f82258b-ec03-4785-83f7-13de6b4178a2\") "
Sep 15 10:46:45.345713 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:45.345691    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f82258b-ec03-4785-83f7-13de6b4178a2-istiod-ca-cert\") pod \"8f82258b-ec03-4785-83f7-13de6b4178a2\" (UID: \"8f82258b-ec03-4785-83f7-13de6b4178a2\") "
Sep 15 10:46:45.345846 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:45.345799    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f82258b-ec03-4785-83f7-13de6b4178a2-workload-socket\") pod \"8f82258b-ec03-4785-83f7-13de6b4178a2\" (UID: \"8f82258b-ec03-4785-83f7-13de6b4178a2\") "
Sep 15 10:46:45.345846 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:45.345831    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-52tb7\" (UniqueName: \"kubernetes.io/projected/8f82258b-ec03-4785-83f7-13de6b4178a2-kube-api-access-52tb7\") pod \"8f82258b-ec03-4785-83f7-13de6b4178a2\" (UID: \"8f82258b-ec03-4785-83f7-13de6b4178a2\") "
Sep 15 10:46:45.346194 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:45.345856    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f82258b-ec03-4785-83f7-13de6b4178a2-istio-token\") pod \"8f82258b-ec03-4785-83f7-13de6b4178a2\" (UID: \"8f82258b-ec03-4785-83f7-13de6b4178a2\") "
Sep 15 10:46:45.346194 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:45.345889    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f82258b-ec03-4785-83f7-13de6b4178a2-istio-podinfo\") pod \"8f82258b-ec03-4785-83f7-13de6b4178a2\" (UID: \"8f82258b-ec03-4785-83f7-13de6b4178a2\") "
Sep 15 10:46:45.346194 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:45.345916    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f82258b-ec03-4785-83f7-13de6b4178a2-istio-data\") pod \"8f82258b-ec03-4785-83f7-13de6b4178a2\" (UID: \"8f82258b-ec03-4785-83f7-13de6b4178a2\") "
Sep 15 10:46:45.346194 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:45.345917    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f82258b-ec03-4785-83f7-13de6b4178a2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8f82258b-ec03-4785-83f7-13de6b4178a2" (UID: "8f82258b-ec03-4785-83f7-13de6b4178a2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:46:45.346194 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:45.345976    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f82258b-ec03-4785-83f7-13de6b4178a2-credential-socket\") pod \"8f82258b-ec03-4785-83f7-13de6b4178a2\" (UID: \"8f82258b-ec03-4785-83f7-13de6b4178a2\") "
Sep 15 10:46:45.346194 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:46:45.346050    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ac8be1b251899642188d2d398743c8ee5aa4b05701201373b8c31a4049531e3\": container with ID starting with 3ac8be1b251899642188d2d398743c8ee5aa4b05701201373b8c31a4049531e3 not found: ID does not exist" containerID="3ac8be1b251899642188d2d398743c8ee5aa4b05701201373b8c31a4049531e3"
Sep 15 10:46:45.346194 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:45.346132    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ac8be1b251899642188d2d398743c8ee5aa4b05701201373b8c31a4049531e3"} err="failed to get container status \"3ac8be1b251899642188d2d398743c8ee5aa4b05701201373b8c31a4049531e3\": rpc error: code = NotFound desc = could not find container \"3ac8be1b251899642188d2d398743c8ee5aa4b05701201373b8c31a4049531e3\": container with ID starting with 3ac8be1b251899642188d2d398743c8ee5aa4b05701201373b8c31a4049531e3 not found: ID does not exist"
Sep 15 10:46:45.346194 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:45.346159    2579 scope.go:117] "RemoveContainer" containerID="c5b826667c05b906c078b2625e95c23703cd80d1381a49d79742765243a8ee44"
Sep 15 10:46:45.346638 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:45.346274    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f82258b-ec03-4785-83f7-13de6b4178a2-workload-certs\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:46:45.346638 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:46:45.346504    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5b826667c05b906c078b2625e95c23703cd80d1381a49d79742765243a8ee44\": container with ID starting with c5b826667c05b906c078b2625e95c23703cd80d1381a49d79742765243a8ee44 not found: ID does not exist" containerID="c5b826667c05b906c078b2625e95c23703cd80d1381a49d79742765243a8ee44"
Sep 15 10:46:45.346638 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:45.346540    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5b826667c05b906c078b2625e95c23703cd80d1381a49d79742765243a8ee44"} err="failed to get container status \"c5b826667c05b906c078b2625e95c23703cd80d1381a49d79742765243a8ee44\": rpc error: code = NotFound desc = could not find container \"c5b826667c05b906c078b2625e95c23703cd80d1381a49d79742765243a8ee44\": container with ID starting with c5b826667c05b906c078b2625e95c23703cd80d1381a49d79742765243a8ee44 not found: ID does not exist"
Sep 15 10:46:45.346638 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:45.346509    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f82258b-ec03-4785-83f7-13de6b4178a2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8f82258b-ec03-4785-83f7-13de6b4178a2" (UID: "8f82258b-ec03-4785-83f7-13de6b4178a2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:46:45.346638 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:45.346512    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f82258b-ec03-4785-83f7-13de6b4178a2-istio-data" (OuterVolumeSpecName: "istio-data") pod "8f82258b-ec03-4785-83f7-13de6b4178a2" (UID: "8f82258b-ec03-4785-83f7-13de6b4178a2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:46:45.346638 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:45.346594    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f82258b-ec03-4785-83f7-13de6b4178a2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8f82258b-ec03-4785-83f7-13de6b4178a2" (UID: "8f82258b-ec03-4785-83f7-13de6b4178a2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:46:45.347005 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:45.346685    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f82258b-ec03-4785-83f7-13de6b4178a2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8f82258b-ec03-4785-83f7-13de6b4178a2" (UID: "8f82258b-ec03-4785-83f7-13de6b4178a2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:46:45.348049 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:45.348028    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f82258b-ec03-4785-83f7-13de6b4178a2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8f82258b-ec03-4785-83f7-13de6b4178a2" (UID: "8f82258b-ec03-4785-83f7-13de6b4178a2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:46:45.348140 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:45.348071    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f82258b-ec03-4785-83f7-13de6b4178a2-istio-token" (OuterVolumeSpecName: "istio-token") pod "8f82258b-ec03-4785-83f7-13de6b4178a2" (UID: "8f82258b-ec03-4785-83f7-13de6b4178a2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:46:45.348305 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:45.348279    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8f82258b-ec03-4785-83f7-13de6b4178a2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8f82258b-ec03-4785-83f7-13de6b4178a2" (UID: "8f82258b-ec03-4785-83f7-13de6b4178a2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 10:46:45.348403 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:45.348389    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f82258b-ec03-4785-83f7-13de6b4178a2-kube-api-access-52tb7" (OuterVolumeSpecName: "kube-api-access-52tb7") pod "8f82258b-ec03-4785-83f7-13de6b4178a2" (UID: "8f82258b-ec03-4785-83f7-13de6b4178a2"). InnerVolumeSpecName "kube-api-access-52tb7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:46:45.447148 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:45.447116    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f82258b-ec03-4785-83f7-13de6b4178a2-istio-envoy\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:46:45.447148 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:45.447143    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f82258b-ec03-4785-83f7-13de6b4178a2-istiod-ca-cert\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:46:45.447148 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:45.447153    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f82258b-ec03-4785-83f7-13de6b4178a2-workload-socket\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:46:45.447363 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:45.447162    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52tb7\" (UniqueName: \"kubernetes.io/projected/8f82258b-ec03-4785-83f7-13de6b4178a2-kube-api-access-52tb7\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:46:45.447363 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:45.447173    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f82258b-ec03-4785-83f7-13de6b4178a2-istio-token\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:46:45.447363 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:45.447180    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f82258b-ec03-4785-83f7-13de6b4178a2-istio-podinfo\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:46:45.447363 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:45.447188    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f82258b-ec03-4785-83f7-13de6b4178a2-istio-data\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:46:45.447363 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:45.447195    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f82258b-ec03-4785-83f7-13de6b4178a2-credential-socket\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:46:45.652045 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:45.652011    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq"]
Sep 15 10:46:45.655496 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:45.655470    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq"]
Sep 15 10:46:46.217120 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:46.217079    2579 patch_prober.go:28] interesting pod/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 15 10:46:46.217310 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:46.217161    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-ff0655-openshift-default-6f75b6c468-4xgjq" podUID="8f82258b-ec03-4785-83f7-13de6b4178a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 15 10:46:47.154850 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:47.154815    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f82258b-ec03-4785-83f7-13de6b4178a2" path="/var/lib/kubelet/pods/8f82258b-ec03-4785-83f7-13de6b4178a2/volumes"
Sep 15 10:46:47.524472 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:46:47.524375    2579 scope.go:117] "RemoveContainer" containerID="d88aee40d69b440e2b139a42b5a6c40584455ed091034bd0b8779e145cefb36e"
Sep 15 10:48:32.704171 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:32.704130    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7882-e2a124"]
Sep 15 10:48:32.706497 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:32.704553    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90d97adf-06bd-498e-8a70-5b89e27baa88" containerName="payload-pre-processing"
Sep 15 10:48:32.706497 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:32.704566    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="90d97adf-06bd-498e-8a70-5b89e27baa88" containerName="payload-pre-processing"
Sep 15 10:48:32.706497 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:32.704584    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f82258b-ec03-4785-83f7-13de6b4178a2" containerName="istio-proxy"
Sep 15 10:48:32.706497 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:32.704589    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f82258b-ec03-4785-83f7-13de6b4178a2" containerName="istio-proxy"
Sep 15 10:48:32.706497 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:32.704597    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f82258b-ec03-4785-83f7-13de6b4178a2" containerName="istio-proxy"
Sep 15 10:48:32.706497 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:32.704603    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f82258b-ec03-4785-83f7-13de6b4178a2" containerName="istio-proxy"
Sep 15 10:48:32.706497 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:32.704611    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="901159ca-2883-473d-836e-c9576b4fff54" containerName="revoke-keys"
Sep 15 10:48:32.706497 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:32.704618    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="901159ca-2883-473d-836e-c9576b4fff54" containerName="revoke-keys"
Sep 15 10:48:32.706497 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:32.704634    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e592f08-8fd8-4665-b4e1-91ec9e1a7152" containerName="payload-processing"
Sep 15 10:48:32.706497 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:32.704640    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e592f08-8fd8-4665-b4e1-91ec9e1a7152" containerName="payload-processing"
Sep 15 10:48:32.706497 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:32.704709    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f82258b-ec03-4785-83f7-13de6b4178a2" containerName="istio-proxy"
Sep 15 10:48:32.706497 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:32.704718    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e592f08-8fd8-4665-b4e1-91ec9e1a7152" containerName="payload-processing"
Sep 15 10:48:32.706497 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:32.704738    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="90d97adf-06bd-498e-8a70-5b89e27baa88" containerName="payload-pre-processing"
Sep 15 10:48:32.706497 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:32.704745    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f82258b-ec03-4785-83f7-13de6b4178a2" containerName="istio-proxy"
Sep 15 10:48:32.706497 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:32.704752    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="901159ca-2883-473d-836e-c9576b4fff54" containerName="revoke-keys"
Sep 15 10:48:32.707710 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:32.707694    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7882-e2a124"
Sep 15 10:48:32.710032 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:32.710010    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-f7bvs\""
Sep 15 10:48:32.711188 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:32.711159    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7882-e2a124"]
Sep 15 10:48:32.732344 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:32.732310    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnd27\" (UniqueName: \"kubernetes.io/projected/fddc13dd-3c2a-4159-a2bc-39aa7f9b1c7e-kube-api-access-dnd27\") pod \"test-curl-7882-e2a124\" (UID: \"fddc13dd-3c2a-4159-a2bc-39aa7f9b1c7e\") " pod="opendatahub/test-curl-7882-e2a124"
Sep 15 10:48:32.832735 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:32.832693    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnd27\" (UniqueName: \"kubernetes.io/projected/fddc13dd-3c2a-4159-a2bc-39aa7f9b1c7e-kube-api-access-dnd27\") pod \"test-curl-7882-e2a124\" (UID: \"fddc13dd-3c2a-4159-a2bc-39aa7f9b1c7e\") " pod="opendatahub/test-curl-7882-e2a124"
Sep 15 10:48:32.840126 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:32.840096    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnd27\" (UniqueName: \"kubernetes.io/projected/fddc13dd-3c2a-4159-a2bc-39aa7f9b1c7e-kube-api-access-dnd27\") pod \"test-curl-7882-e2a124\" (UID: \"fddc13dd-3c2a-4159-a2bc-39aa7f9b1c7e\") " pod="opendatahub/test-curl-7882-e2a124"
Sep 15 10:48:33.017982 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:33.017896    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7882-e2a124"
Sep 15 10:48:33.287189 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:33.287161    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7882-e2a124"]
Sep 15 10:48:33.289196 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:48:33.289169    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfddc13dd_3c2a_4159_a2bc_39aa7f9b1c7e.slice/crio-21f4562190f043b792cd346ab91cf8ce78a30842cd6a43a861ab3f77a39165cf WatchSource:0}: Error finding container 21f4562190f043b792cd346ab91cf8ce78a30842cd6a43a861ab3f77a39165cf: Status 404 returned error can't find the container with id 21f4562190f043b792cd346ab91cf8ce78a30842cd6a43a861ab3f77a39165cf
Sep 15 10:48:33.935407 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:33.935369    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7882-e2a124" event={"ID":"fddc13dd-3c2a-4159-a2bc-39aa7f9b1c7e","Type":"ContainerStarted","Data":"c258922b5908971fc3f75c4e05c1260748e0ba77ee7e3543433ddd23236d30ce"}
Sep 15 10:48:33.935902 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:33.935420    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7882-e2a124" event={"ID":"fddc13dd-3c2a-4159-a2bc-39aa7f9b1c7e","Type":"ContainerStarted","Data":"21f4562190f043b792cd346ab91cf8ce78a30842cd6a43a861ab3f77a39165cf"}
Sep 15 10:48:33.948589 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:33.948535    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7882-e2a124" podStartSLOduration=1.9485183259999999 podStartE2EDuration="1.948518326s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:48:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:48:33.947449884 +0000 UTC m=+1847.343541971" watchObservedRunningTime="2026-09-15 10:48:33.948518326 +0000 UTC m=+1847.344610449"
Sep 15 10:48:34.544244 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:34.544204    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7882-e2a124"]
Sep 15 10:48:34.548048 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:34.548016    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7882-e2a124"]
Sep 15 10:48:34.662301 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:34.662216    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7882-7c8979"]
Sep 15 10:48:34.662658 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:34.662643    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fddc13dd-3c2a-4159-a2bc-39aa7f9b1c7e" containerName="test-curl-7882-e2a124"
Sep 15 10:48:34.662707 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:34.662660    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fddc13dd-3c2a-4159-a2bc-39aa7f9b1c7e" containerName="test-curl-7882-e2a124"
Sep 15 10:48:34.662788 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:34.662735    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fddc13dd-3c2a-4159-a2bc-39aa7f9b1c7e" containerName="test-curl-7882-e2a124"
Sep 15 10:48:34.665892 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:34.665871    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7882-7c8979"
Sep 15 10:48:34.671513 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:34.671487    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7882-7c8979"]
Sep 15 10:48:34.749432 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:34.749395    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkvxj\" (UniqueName: \"kubernetes.io/projected/53705806-c478-4955-8749-cd5b2cd97e30-kube-api-access-qkvxj\") pod \"test-curl-7882-7c8979\" (UID: \"53705806-c478-4955-8749-cd5b2cd97e30\") " pod="opendatahub/test-curl-7882-7c8979"
Sep 15 10:48:34.850394 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:34.850359    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkvxj\" (UniqueName: \"kubernetes.io/projected/53705806-c478-4955-8749-cd5b2cd97e30-kube-api-access-qkvxj\") pod \"test-curl-7882-7c8979\" (UID: \"53705806-c478-4955-8749-cd5b2cd97e30\") " pod="opendatahub/test-curl-7882-7c8979"
Sep 15 10:48:34.857939 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:34.857912    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkvxj\" (UniqueName: \"kubernetes.io/projected/53705806-c478-4955-8749-cd5b2cd97e30-kube-api-access-qkvxj\") pod \"test-curl-7882-7c8979\" (UID: \"53705806-c478-4955-8749-cd5b2cd97e30\") " pod="opendatahub/test-curl-7882-7c8979"
Sep 15 10:48:34.941245 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:48:34.941169    2579 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7882-e2a124" container="test-curl-7882-e2a124"
Sep 15 10:48:34.975770 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:34.975713    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7882-7c8979"
Sep 15 10:48:35.246127 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:35.246098    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7882-7c8979"]
Sep 15 10:48:35.248227 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:48:35.248197    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod53705806_c478_4955_8749_cd5b2cd97e30.slice/crio-94d3a0578152402d7468c42082619fc49d9b1e119b1787f7d7277660cf72639f WatchSource:0}: Error finding container 94d3a0578152402d7468c42082619fc49d9b1e119b1787f7d7277660cf72639f: Status 404 returned error can't find the container with id 94d3a0578152402d7468c42082619fc49d9b1e119b1787f7d7277660cf72639f
Sep 15 10:48:35.948036 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:35.947998    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7882-7c8979" event={"ID":"53705806-c478-4955-8749-cd5b2cd97e30","Type":"ContainerStarted","Data":"ddb3bd71236a00f1f2729a03e1c4b59df8224769a3a9591b978cf07cee4480d5"}
Sep 15 10:48:35.948036 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:35.948041    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7882-7c8979" event={"ID":"53705806-c478-4955-8749-cd5b2cd97e30","Type":"ContainerStarted","Data":"94d3a0578152402d7468c42082619fc49d9b1e119b1787f7d7277660cf72639f"}
Sep 15 10:48:35.948530 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:35.948124    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7882-e2a124" podUID="fddc13dd-3c2a-4159-a2bc-39aa7f9b1c7e" containerName="test-curl-7882-e2a124" containerID="cri-o://c258922b5908971fc3f75c4e05c1260748e0ba77ee7e3543433ddd23236d30ce" gracePeriod=2
Sep 15 10:48:35.962338 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:35.962280    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7882-7c8979" podStartSLOduration=1.962262286 podStartE2EDuration="1.962262286s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:48:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:48:35.961667793 +0000 UTC m=+1849.357759884" watchObservedRunningTime="2026-09-15 10:48:35.962262286 +0000 UTC m=+1849.358354634"
Sep 15 10:48:36.536137 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:36.536101    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7882-7c8979"]
Sep 15 10:48:36.538410 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:36.538381    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7882-7c8979"]
Sep 15 10:48:36.953461 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:48:36.953429    2579 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7882-7c8979" container="test-curl-7882-7c8979"
Sep 15 10:48:37.959653 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:37.959618    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7882-7c8979" podUID="53705806-c478-4955-8749-cd5b2cd97e30" containerName="test-curl-7882-7c8979" containerID="cri-o://ddb3bd71236a00f1f2729a03e1c4b59df8224769a3a9591b978cf07cee4480d5" gracePeriod=2
Sep 15 10:48:38.142786 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:38.142742    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7882-e2a124"
Sep 15 10:48:38.180323 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:38.180284    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dnd27\" (UniqueName: \"kubernetes.io/projected/fddc13dd-3c2a-4159-a2bc-39aa7f9b1c7e-kube-api-access-dnd27\") pod \"fddc13dd-3c2a-4159-a2bc-39aa7f9b1c7e\" (UID: \"fddc13dd-3c2a-4159-a2bc-39aa7f9b1c7e\") "
Sep 15 10:48:38.182475 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:38.182447    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fddc13dd-3c2a-4159-a2bc-39aa7f9b1c7e-kube-api-access-dnd27" (OuterVolumeSpecName: "kube-api-access-dnd27") pod "fddc13dd-3c2a-4159-a2bc-39aa7f9b1c7e" (UID: "fddc13dd-3c2a-4159-a2bc-39aa7f9b1c7e"). InnerVolumeSpecName "kube-api-access-dnd27". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:48:38.281754 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:38.281639    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dnd27\" (UniqueName: \"kubernetes.io/projected/fddc13dd-3c2a-4159-a2bc-39aa7f9b1c7e-kube-api-access-dnd27\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:48:38.966553 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:38.966517    2579 generic.go:356] "Generic (PLEG): container finished" podID="fddc13dd-3c2a-4159-a2bc-39aa7f9b1c7e" containerID="c258922b5908971fc3f75c4e05c1260748e0ba77ee7e3543433ddd23236d30ce" exitCode=137
Sep 15 10:48:38.967003 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:38.966565    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7882-e2a124"
Sep 15 10:48:38.967003 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:38.966618    2579 scope.go:117] "RemoveContainer" containerID="c258922b5908971fc3f75c4e05c1260748e0ba77ee7e3543433ddd23236d30ce"
Sep 15 10:48:38.976183 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:38.976164    2579 scope.go:117] "RemoveContainer" containerID="c258922b5908971fc3f75c4e05c1260748e0ba77ee7e3543433ddd23236d30ce"
Sep 15 10:48:38.976464 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:48:38.976443    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c258922b5908971fc3f75c4e05c1260748e0ba77ee7e3543433ddd23236d30ce\": container with ID starting with c258922b5908971fc3f75c4e05c1260748e0ba77ee7e3543433ddd23236d30ce not found: ID does not exist" containerID="c258922b5908971fc3f75c4e05c1260748e0ba77ee7e3543433ddd23236d30ce"
Sep 15 10:48:38.976561 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:38.976472    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c258922b5908971fc3f75c4e05c1260748e0ba77ee7e3543433ddd23236d30ce"} err="failed to get container status \"c258922b5908971fc3f75c4e05c1260748e0ba77ee7e3543433ddd23236d30ce\": rpc error: code = NotFound desc = could not find container \"c258922b5908971fc3f75c4e05c1260748e0ba77ee7e3543433ddd23236d30ce\": container with ID starting with c258922b5908971fc3f75c4e05c1260748e0ba77ee7e3543433ddd23236d30ce not found: ID does not exist"
Sep 15 10:48:38.977197 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:48:38.977172    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7882-e2a124\" is forbidden: User \"system:node:ip-10-0-135-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-231.ec2.internal' and this object" podUID="fddc13dd-3c2a-4159-a2bc-39aa7f9b1c7e" pod="opendatahub/test-curl-7882-e2a124"
Sep 15 10:48:39.148926 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:39.148892    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fddc13dd-3c2a-4159-a2bc-39aa7f9b1c7e" path="/var/lib/kubelet/pods/fddc13dd-3c2a-4159-a2bc-39aa7f9b1c7e/volumes"
Sep 15 10:48:40.138446 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:40.138416    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7882-7c8979"
Sep 15 10:48:40.200664 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:40.200630    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qkvxj\" (UniqueName: \"kubernetes.io/projected/53705806-c478-4955-8749-cd5b2cd97e30-kube-api-access-qkvxj\") pod \"53705806-c478-4955-8749-cd5b2cd97e30\" (UID: \"53705806-c478-4955-8749-cd5b2cd97e30\") "
Sep 15 10:48:40.202847 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:40.202818    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53705806-c478-4955-8749-cd5b2cd97e30-kube-api-access-qkvxj" (OuterVolumeSpecName: "kube-api-access-qkvxj") pod "53705806-c478-4955-8749-cd5b2cd97e30" (UID: "53705806-c478-4955-8749-cd5b2cd97e30"). InnerVolumeSpecName "kube-api-access-qkvxj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:48:40.301876 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:40.301838    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qkvxj\" (UniqueName: \"kubernetes.io/projected/53705806-c478-4955-8749-cd5b2cd97e30-kube-api-access-qkvxj\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:48:40.979567 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:40.979534    2579 generic.go:356] "Generic (PLEG): container finished" podID="53705806-c478-4955-8749-cd5b2cd97e30" containerID="ddb3bd71236a00f1f2729a03e1c4b59df8224769a3a9591b978cf07cee4480d5" exitCode=137
Sep 15 10:48:40.979766 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:40.979577    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7882-7c8979"
Sep 15 10:48:40.979766 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:40.979635    2579 scope.go:117] "RemoveContainer" containerID="ddb3bd71236a00f1f2729a03e1c4b59df8224769a3a9591b978cf07cee4480d5"
Sep 15 10:48:40.991014 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:40.990943    2579 scope.go:117] "RemoveContainer" containerID="ddb3bd71236a00f1f2729a03e1c4b59df8224769a3a9591b978cf07cee4480d5"
Sep 15 10:48:40.991147 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:48:40.991122    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7882-7c8979\" is forbidden: User \"system:node:ip-10-0-135-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-231.ec2.internal' and this object" podUID="53705806-c478-4955-8749-cd5b2cd97e30" pod="opendatahub/test-curl-7882-7c8979"
Sep 15 10:48:40.991302 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:48:40.991283    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddb3bd71236a00f1f2729a03e1c4b59df8224769a3a9591b978cf07cee4480d5\": container with ID starting with ddb3bd71236a00f1f2729a03e1c4b59df8224769a3a9591b978cf07cee4480d5 not found: ID does not exist" containerID="ddb3bd71236a00f1f2729a03e1c4b59df8224769a3a9591b978cf07cee4480d5"
Sep 15 10:48:40.991345 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:40.991309    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddb3bd71236a00f1f2729a03e1c4b59df8224769a3a9591b978cf07cee4480d5"} err="failed to get container status \"ddb3bd71236a00f1f2729a03e1c4b59df8224769a3a9591b978cf07cee4480d5\": rpc error: code = NotFound desc = could not find container \"ddb3bd71236a00f1f2729a03e1c4b59df8224769a3a9591b978cf07cee4480d5\": container with ID starting with ddb3bd71236a00f1f2729a03e1c4b59df8224769a3a9591b978cf07cee4480d5 not found: ID does not exist"
Sep 15 10:48:41.148709 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:48:41.148669    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53705806-c478-4955-8749-cd5b2cd97e30" path="/var/lib/kubelet/pods/53705806-c478-4955-8749-cd5b2cd97e30/volumes"
Sep 15 10:50:00.122970 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:00.122932    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6"]
Sep 15 10:50:00.123551 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:00.123535    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53705806-c478-4955-8749-cd5b2cd97e30" containerName="test-curl-7882-7c8979"
Sep 15 10:50:00.123613 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:00.123553    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="53705806-c478-4955-8749-cd5b2cd97e30" containerName="test-curl-7882-7c8979"
Sep 15 10:50:00.123696 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:00.123685    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="53705806-c478-4955-8749-cd5b2cd97e30" containerName="test-curl-7882-7c8979"
Sep 15 10:50:00.127177 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:00.127152    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6"
Sep 15 10:50:00.129481 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:00.129454    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-5ffc6a-openshift-default-dockercfg-j6m58\""
Sep 15 10:50:00.137650 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:00.137620    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6"]
Sep 15 10:50:00.229881 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:00.229843    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5015e69c-4595-4377-9eb6-fc025f3edf49-istio-data\") pod \"e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6\" (UID: \"5015e69c-4595-4377-9eb6-fc025f3edf49\") " pod="openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6"
Sep 15 10:50:00.229881 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:00.229890    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq5gf\" (UniqueName: \"kubernetes.io/projected/5015e69c-4595-4377-9eb6-fc025f3edf49-kube-api-access-pq5gf\") pod \"e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6\" (UID: \"5015e69c-4595-4377-9eb6-fc025f3edf49\") " pod="openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6"
Sep 15 10:50:00.230136 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:00.230010    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5015e69c-4595-4377-9eb6-fc025f3edf49-istio-envoy\") pod \"e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6\" (UID: \"5015e69c-4595-4377-9eb6-fc025f3edf49\") " pod="openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6"
Sep 15 10:50:00.230136 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:00.230066    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5015e69c-4595-4377-9eb6-fc025f3edf49-istio-token\") pod \"e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6\" (UID: \"5015e69c-4595-4377-9eb6-fc025f3edf49\") " pod="openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6"
Sep 15 10:50:00.230136 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:00.230102    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5015e69c-4595-4377-9eb6-fc025f3edf49-workload-certs\") pod \"e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6\" (UID: \"5015e69c-4595-4377-9eb6-fc025f3edf49\") " pod="openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6"
Sep 15 10:50:00.230136 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:00.230131    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5015e69c-4595-4377-9eb6-fc025f3edf49-istiod-ca-cert\") pod \"e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6\" (UID: \"5015e69c-4595-4377-9eb6-fc025f3edf49\") " pod="openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6"
Sep 15 10:50:00.230339 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:00.230215    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5015e69c-4595-4377-9eb6-fc025f3edf49-credential-socket\") pod \"e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6\" (UID: \"5015e69c-4595-4377-9eb6-fc025f3edf49\") " pod="openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6"
Sep 15 10:50:00.230339 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:00.230266    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5015e69c-4595-4377-9eb6-fc025f3edf49-istio-podinfo\") pod \"e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6\" (UID: \"5015e69c-4595-4377-9eb6-fc025f3edf49\") " pod="openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6"
Sep 15 10:50:00.230339 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:00.230302    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5015e69c-4595-4377-9eb6-fc025f3edf49-workload-socket\") pod \"e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6\" (UID: \"5015e69c-4595-4377-9eb6-fc025f3edf49\") " pod="openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6"
Sep 15 10:50:00.330996 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:00.330953    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5015e69c-4595-4377-9eb6-fc025f3edf49-istio-data\") pod \"e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6\" (UID: \"5015e69c-4595-4377-9eb6-fc025f3edf49\") " pod="openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6"
Sep 15 10:50:00.330996 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:00.330997    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq5gf\" (UniqueName: \"kubernetes.io/projected/5015e69c-4595-4377-9eb6-fc025f3edf49-kube-api-access-pq5gf\") pod \"e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6\" (UID: \"5015e69c-4595-4377-9eb6-fc025f3edf49\") " pod="openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6"
Sep 15 10:50:00.331234 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:00.331046    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5015e69c-4595-4377-9eb6-fc025f3edf49-istio-envoy\") pod \"e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6\" (UID: \"5015e69c-4595-4377-9eb6-fc025f3edf49\") " pod="openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6"
Sep 15 10:50:00.331234 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:00.331075    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5015e69c-4595-4377-9eb6-fc025f3edf49-istio-token\") pod \"e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6\" (UID: \"5015e69c-4595-4377-9eb6-fc025f3edf49\") " pod="openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6"
Sep 15 10:50:00.331234 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:00.331106    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5015e69c-4595-4377-9eb6-fc025f3edf49-workload-certs\") pod \"e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6\" (UID: \"5015e69c-4595-4377-9eb6-fc025f3edf49\") " pod="openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6"
Sep 15 10:50:00.331391 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:00.331260    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5015e69c-4595-4377-9eb6-fc025f3edf49-istiod-ca-cert\") pod \"e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6\" (UID: \"5015e69c-4595-4377-9eb6-fc025f3edf49\") " pod="openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6"
Sep 15 10:50:00.331391 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:00.331322    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5015e69c-4595-4377-9eb6-fc025f3edf49-credential-socket\") pod \"e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6\" (UID: \"5015e69c-4595-4377-9eb6-fc025f3edf49\") " pod="openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6"
Sep 15 10:50:00.331391 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:00.331363    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5015e69c-4595-4377-9eb6-fc025f3edf49-istio-podinfo\") pod \"e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6\" (UID: \"5015e69c-4595-4377-9eb6-fc025f3edf49\") " pod="openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6"
Sep 15 10:50:00.331534 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:00.331394    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5015e69c-4595-4377-9eb6-fc025f3edf49-workload-socket\") pod \"e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6\" (UID: \"5015e69c-4595-4377-9eb6-fc025f3edf49\") " pod="openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6"
Sep 15 10:50:00.331534 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:00.331407    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5015e69c-4595-4377-9eb6-fc025f3edf49-istio-data\") pod \"e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6\" (UID: \"5015e69c-4595-4377-9eb6-fc025f3edf49\") " pod="openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6"
Sep 15 10:50:00.331534 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:00.331433    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5015e69c-4595-4377-9eb6-fc025f3edf49-workload-certs\") pod \"e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6\" (UID: \"5015e69c-4595-4377-9eb6-fc025f3edf49\") " pod="openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6"
Sep 15 10:50:00.331681 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:00.331661    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5015e69c-4595-4377-9eb6-fc025f3edf49-workload-socket\") pod \"e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6\" (UID: \"5015e69c-4595-4377-9eb6-fc025f3edf49\") " pod="openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6"
Sep 15 10:50:00.331750 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:00.331714    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5015e69c-4595-4377-9eb6-fc025f3edf49-credential-socket\") pod \"e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6\" (UID: \"5015e69c-4595-4377-9eb6-fc025f3edf49\") " pod="openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6"
Sep 15 10:50:00.331976 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:00.331952    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5015e69c-4595-4377-9eb6-fc025f3edf49-istiod-ca-cert\") pod \"e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6\" (UID: \"5015e69c-4595-4377-9eb6-fc025f3edf49\") " pod="openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6"
Sep 15 10:50:00.333803 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:00.333781    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5015e69c-4595-4377-9eb6-fc025f3edf49-istio-podinfo\") pod \"e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6\" (UID: \"5015e69c-4595-4377-9eb6-fc025f3edf49\") " pod="openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6"
Sep 15 10:50:00.333923 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:00.333903    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5015e69c-4595-4377-9eb6-fc025f3edf49-istio-envoy\") pod \"e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6\" (UID: \"5015e69c-4595-4377-9eb6-fc025f3edf49\") " pod="openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6"
Sep 15 10:50:00.338552 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:00.338525    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq5gf\" (UniqueName: \"kubernetes.io/projected/5015e69c-4595-4377-9eb6-fc025f3edf49-kube-api-access-pq5gf\") pod \"e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6\" (UID: \"5015e69c-4595-4377-9eb6-fc025f3edf49\") " pod="openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6"
Sep 15 10:50:00.338634 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:00.338555    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5015e69c-4595-4377-9eb6-fc025f3edf49-istio-token\") pod \"e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6\" (UID: \"5015e69c-4595-4377-9eb6-fc025f3edf49\") " pod="openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6"
Sep 15 10:50:00.439854 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:00.439771    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6"
Sep 15 10:50:00.717144 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:00.717107    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6"]
Sep 15 10:50:00.719015 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:50:00.718983    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5015e69c_4595_4377_9eb6_fc025f3edf49.slice/crio-56ae63f41b762287434d46f5868952991871e80f9a2033070849750bd36f0459 WatchSource:0}: Error finding container 56ae63f41b762287434d46f5868952991871e80f9a2033070849750bd36f0459: Status 404 returned error can't find the container with id 56ae63f41b762287434d46f5868952991871e80f9a2033070849750bd36f0459
Sep 15 10:50:00.721277 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:00.721246    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:50:00.721347 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:00.721310    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:50:00.721347 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:00.721339    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:50:01.422362 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:01.422326    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6" event={"ID":"5015e69c-4595-4377-9eb6-fc025f3edf49","Type":"ContainerStarted","Data":"28a82ee3920e43b395810f1c2edfdaadc9291bc535aa14e31ce8ae3ec8074ccc"}
Sep 15 10:50:01.422841 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:01.422377    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6" event={"ID":"5015e69c-4595-4377-9eb6-fc025f3edf49","Type":"ContainerStarted","Data":"56ae63f41b762287434d46f5868952991871e80f9a2033070849750bd36f0459"}
Sep 15 10:50:01.440196 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:01.440161    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6"
Sep 15 10:50:01.443393 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:01.443339    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6" podStartSLOduration=1.443320644 podStartE2EDuration="1.443320644s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:50:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:50:01.440396659 +0000 UTC m=+1934.836488746" watchObservedRunningTime="2026-09-15 10:50:01.443320644 +0000 UTC m=+1934.839412732"
Sep 15 10:50:01.446157 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:01.446133    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6"
Sep 15 10:50:02.428487 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:02.428451    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6"
Sep 15 10:50:02.429465 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:02.429439    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6"
Sep 15 10:50:05.415466 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:05.415427    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-5ffc6a-f49c4f7b6-jh95j"]
Sep 15 10:50:05.419435 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:05.419411    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-5ffc6a-f49c4f7b6-jh95j"
Sep 15 10:50:05.422176 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:05.422156    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-5ffc6a-dockercfg-k95ft\""
Sep 15 10:50:05.422265 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:05.422226    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-5ffc6a\""
Sep 15 10:50:05.428550 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:05.428526    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-5ffc6a-f49c4f7b6-jh95j"]
Sep 15 10:50:05.438537 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:05.438506    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-5ffc6a-78d4cf65c9-7mkpp"]
Sep 15 10:50:05.442671 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:05.442643    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-5ffc6a-78d4cf65c9-7mkpp"
Sep 15 10:50:05.449859 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:05.449831    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-5ffc6a-78d4cf65c9-7mkpp"]
Sep 15 10:50:05.481326 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:05.481296    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2qrx\" (UniqueName: \"kubernetes.io/projected/e90944ba-b08f-4ad3-954a-63b1aebc0738-kube-api-access-c2qrx\") pod \"payload-processing-e2e-ipp-a-5ffc6a-78d4cf65c9-7mkpp\" (UID: \"e90944ba-b08f-4ad3-954a-63b1aebc0738\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-5ffc6a-78d4cf65c9-7mkpp"
Sep 15 10:50:05.481495 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:05.481340    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e90944ba-b08f-4ad3-954a-63b1aebc0738-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-5ffc6a-78d4cf65c9-7mkpp\" (UID: \"e90944ba-b08f-4ad3-954a-63b1aebc0738\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-5ffc6a-78d4cf65c9-7mkpp"
Sep 15 10:50:05.481495 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:05.481422    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jm9s4\" (UniqueName: \"kubernetes.io/projected/03e32e2e-f197-41bf-bf27-5c6bab61a085-kube-api-access-jm9s4\") pod \"payload-pre-processing-e2e-ipp-a-5ffc6a-f49c4f7b6-jh95j\" (UID: \"03e32e2e-f197-41bf-bf27-5c6bab61a085\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-5ffc6a-f49c4f7b6-jh95j"
Sep 15 10:50:05.481573 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:05.481488    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03e32e2e-f197-41bf-bf27-5c6bab61a085-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-5ffc6a-f49c4f7b6-jh95j\" (UID: \"03e32e2e-f197-41bf-bf27-5c6bab61a085\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-5ffc6a-f49c4f7b6-jh95j"
Sep 15 10:50:05.582755 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:05.582683    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2qrx\" (UniqueName: \"kubernetes.io/projected/e90944ba-b08f-4ad3-954a-63b1aebc0738-kube-api-access-c2qrx\") pod \"payload-processing-e2e-ipp-a-5ffc6a-78d4cf65c9-7mkpp\" (UID: \"e90944ba-b08f-4ad3-954a-63b1aebc0738\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-5ffc6a-78d4cf65c9-7mkpp"
Sep 15 10:50:05.582755 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:05.582748    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e90944ba-b08f-4ad3-954a-63b1aebc0738-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-5ffc6a-78d4cf65c9-7mkpp\" (UID: \"e90944ba-b08f-4ad3-954a-63b1aebc0738\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-5ffc6a-78d4cf65c9-7mkpp"
Sep 15 10:50:05.583016 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:05.582824    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm9s4\" (UniqueName: \"kubernetes.io/projected/03e32e2e-f197-41bf-bf27-5c6bab61a085-kube-api-access-jm9s4\") pod \"payload-pre-processing-e2e-ipp-a-5ffc6a-f49c4f7b6-jh95j\" (UID: \"03e32e2e-f197-41bf-bf27-5c6bab61a085\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-5ffc6a-f49c4f7b6-jh95j"
Sep 15 10:50:05.583016 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:05.582858    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03e32e2e-f197-41bf-bf27-5c6bab61a085-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-5ffc6a-f49c4f7b6-jh95j\" (UID: \"03e32e2e-f197-41bf-bf27-5c6bab61a085\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-5ffc6a-f49c4f7b6-jh95j"
Sep 15 10:50:05.583564 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:05.583542    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03e32e2e-f197-41bf-bf27-5c6bab61a085-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-5ffc6a-f49c4f7b6-jh95j\" (UID: \"03e32e2e-f197-41bf-bf27-5c6bab61a085\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-5ffc6a-f49c4f7b6-jh95j"
Sep 15 10:50:05.583798 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:05.583774    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e90944ba-b08f-4ad3-954a-63b1aebc0738-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-5ffc6a-78d4cf65c9-7mkpp\" (UID: \"e90944ba-b08f-4ad3-954a-63b1aebc0738\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-5ffc6a-78d4cf65c9-7mkpp"
Sep 15 10:50:05.593359 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:05.593332    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2qrx\" (UniqueName: \"kubernetes.io/projected/e90944ba-b08f-4ad3-954a-63b1aebc0738-kube-api-access-c2qrx\") pod \"payload-processing-e2e-ipp-a-5ffc6a-78d4cf65c9-7mkpp\" (UID: \"e90944ba-b08f-4ad3-954a-63b1aebc0738\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-5ffc6a-78d4cf65c9-7mkpp"
Sep 15 10:50:05.593494 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:05.593371    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm9s4\" (UniqueName: \"kubernetes.io/projected/03e32e2e-f197-41bf-bf27-5c6bab61a085-kube-api-access-jm9s4\") pod \"payload-pre-processing-e2e-ipp-a-5ffc6a-f49c4f7b6-jh95j\" (UID: \"03e32e2e-f197-41bf-bf27-5c6bab61a085\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-5ffc6a-f49c4f7b6-jh95j"
Sep 15 10:50:05.731786 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:05.731676    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-5ffc6a-f49c4f7b6-jh95j"
Sep 15 10:50:05.753959 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:05.753929    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-5ffc6a-78d4cf65c9-7mkpp"
Sep 15 10:50:06.006328 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:06.006305    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-5ffc6a-f49c4f7b6-jh95j"]
Sep 15 10:50:06.007642 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:50:06.007616    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03e32e2e_f197_41bf_bf27_5c6bab61a085.slice/crio-b4955ff4dda12cd04e36e071719ec7e5c99ba9c03ec9d1a992368dab9ca1acf5 WatchSource:0}: Error finding container b4955ff4dda12cd04e36e071719ec7e5c99ba9c03ec9d1a992368dab9ca1acf5: Status 404 returned error can't find the container with id b4955ff4dda12cd04e36e071719ec7e5c99ba9c03ec9d1a992368dab9ca1acf5
Sep 15 10:50:06.038783 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:06.038760    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-5ffc6a-78d4cf65c9-7mkpp"]
Sep 15 10:50:06.042929 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:50:06.042902    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode90944ba_b08f_4ad3_954a_63b1aebc0738.slice/crio-40355aba334c7b664f6fe49ae57a918baaff6b75407778e534639675891066de WatchSource:0}: Error finding container 40355aba334c7b664f6fe49ae57a918baaff6b75407778e534639675891066de: Status 404 returned error can't find the container with id 40355aba334c7b664f6fe49ae57a918baaff6b75407778e534639675891066de
Sep 15 10:50:06.452088 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:06.452047    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-5ffc6a-78d4cf65c9-7mkpp" event={"ID":"e90944ba-b08f-4ad3-954a-63b1aebc0738","Type":"ContainerStarted","Data":"2e6a3beec5c16fb08a749abeda6d9289cd95cf570342441e4bd58474149826d7"}
Sep 15 10:50:06.452541 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:06.452103    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-5ffc6a-78d4cf65c9-7mkpp" event={"ID":"e90944ba-b08f-4ad3-954a-63b1aebc0738","Type":"ContainerStarted","Data":"40355aba334c7b664f6fe49ae57a918baaff6b75407778e534639675891066de"}
Sep 15 10:50:06.452541 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:06.452146    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-5ffc6a-78d4cf65c9-7mkpp"
Sep 15 10:50:06.453776 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:06.453747    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-5ffc6a-f49c4f7b6-jh95j" event={"ID":"03e32e2e-f197-41bf-bf27-5c6bab61a085","Type":"ContainerStarted","Data":"6b994545426b267ee4f8f54ff593d84c88210906bbc3685d5e0066adc160a983"}
Sep 15 10:50:06.454064 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:06.453793    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-5ffc6a-f49c4f7b6-jh95j" event={"ID":"03e32e2e-f197-41bf-bf27-5c6bab61a085","Type":"ContainerStarted","Data":"b4955ff4dda12cd04e36e071719ec7e5c99ba9c03ec9d1a992368dab9ca1acf5"}
Sep 15 10:50:06.454064 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:06.453813    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-5ffc6a-f49c4f7b6-jh95j"
Sep 15 10:50:06.467828 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:06.467783    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-5ffc6a-78d4cf65c9-7mkpp" podStartSLOduration=1.467769294 podStartE2EDuration="1.467769294s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:50:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:50:06.466601708 +0000 UTC m=+1939.862693795" watchObservedRunningTime="2026-09-15 10:50:06.467769294 +0000 UTC m=+1939.863861381"
Sep 15 10:50:06.480964 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:06.480917    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-5ffc6a-f49c4f7b6-jh95j" podStartSLOduration=1.480901113 podStartE2EDuration="1.480901113s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:50:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:50:06.48015957 +0000 UTC m=+1939.876251656" watchObservedRunningTime="2026-09-15 10:50:06.480901113 +0000 UTC m=+1939.876993199"
Sep 15 10:50:17.461480 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:17.461443    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-5ffc6a-f49c4f7b6-jh95j"
Sep 15 10:50:17.461917 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:17.461528    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-5ffc6a-78d4cf65c9-7mkpp"
Sep 15 10:50:18.469885 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:18.469845    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 15 10:50:18.470268 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:18.469921    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6" podUID="5015e69c-4595-4377-9eb6-fc025f3edf49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 15 10:50:19.541240 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:19.541164    2579 generic.go:356] "Generic (PLEG): container finished" podID="5015e69c-4595-4377-9eb6-fc025f3edf49" containerID="28a82ee3920e43b395810f1c2edfdaadc9291bc535aa14e31ce8ae3ec8074ccc" exitCode=0
Sep 15 10:50:19.541651 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:19.541241    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6" event={"ID":"5015e69c-4595-4377-9eb6-fc025f3edf49","Type":"ContainerDied","Data":"28a82ee3920e43b395810f1c2edfdaadc9291bc535aa14e31ce8ae3ec8074ccc"}
Sep 15 10:50:19.541651 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:19.541623    2579 scope.go:117] "RemoveContainer" containerID="28a82ee3920e43b395810f1c2edfdaadc9291bc535aa14e31ce8ae3ec8074ccc"
Sep 15 10:50:19.542614 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:19.542589    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:50:19.542663 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:19.542647    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:50:19.542704 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:19.542677    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:50:20.549554 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:20.549523    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6" event={"ID":"5015e69c-4595-4377-9eb6-fc025f3edf49","Type":"ContainerStarted","Data":"a4fe495f68574a60b927db9bf05e3b2f732094176ab36fa8673982becb2154d3"}
Sep 15 10:50:21.440127 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:21.440096    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6"
Sep 15 10:50:21.440314 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:21.440293    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Sep 15 10:50:21.440364 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:21.440339    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6" podUID="5015e69c-4595-4377-9eb6-fc025f3edf49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Sep 15 10:50:22.440794 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:22.440761    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Sep 15 10:50:22.441188 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:22.440816    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6" podUID="5015e69c-4595-4377-9eb6-fc025f3edf49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Sep 15 10:50:23.440319 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:23.440279    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Sep 15 10:50:23.440487 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:23.440334    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6" podUID="5015e69c-4595-4377-9eb6-fc025f3edf49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Sep 15 10:50:24.440423 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:24.440381    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Sep 15 10:50:24.440872 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:24.440443    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6" podUID="5015e69c-4595-4377-9eb6-fc025f3edf49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Sep 15 10:50:25.440584 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:25.440543    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Sep 15 10:50:25.441020 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:25.440604    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6" podUID="5015e69c-4595-4377-9eb6-fc025f3edf49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Sep 15 10:50:26.444554 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:26.444522    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6"
Sep 15 10:50:26.445056 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:26.444837    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6"
Sep 15 10:50:26.445588 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:26.445569    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6"
Sep 15 10:50:29.547924 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:29.547890    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt"]
Sep 15 10:50:29.552288 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:29.552266    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt"
Sep 15 10:50:29.554667 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:29.554647    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-9f5ea7-openshift-default-dockercfg-klpr7\""
Sep 15 10:50:29.562425 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:29.562392    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt"]
Sep 15 10:50:29.718938 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:29.718897    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9da531c0-1e7c-4508-8069-2424401f67ef-istiod-ca-cert\") pod \"e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt\" (UID: \"9da531c0-1e7c-4508-8069-2424401f67ef\") " pod="openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt"
Sep 15 10:50:29.718938 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:29.718940    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rjpt\" (UniqueName: \"kubernetes.io/projected/9da531c0-1e7c-4508-8069-2424401f67ef-kube-api-access-9rjpt\") pod \"e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt\" (UID: \"9da531c0-1e7c-4508-8069-2424401f67ef\") " pod="openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt"
Sep 15 10:50:29.719192 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:29.719034    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9da531c0-1e7c-4508-8069-2424401f67ef-istio-data\") pod \"e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt\" (UID: \"9da531c0-1e7c-4508-8069-2424401f67ef\") " pod="openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt"
Sep 15 10:50:29.719192 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:29.719074    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9da531c0-1e7c-4508-8069-2424401f67ef-credential-socket\") pod \"e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt\" (UID: \"9da531c0-1e7c-4508-8069-2424401f67ef\") " pod="openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt"
Sep 15 10:50:29.719192 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:29.719158    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9da531c0-1e7c-4508-8069-2424401f67ef-workload-certs\") pod \"e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt\" (UID: \"9da531c0-1e7c-4508-8069-2424401f67ef\") " pod="openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt"
Sep 15 10:50:29.719365 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:29.719194    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9da531c0-1e7c-4508-8069-2424401f67ef-istio-envoy\") pod \"e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt\" (UID: \"9da531c0-1e7c-4508-8069-2424401f67ef\") " pod="openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt"
Sep 15 10:50:29.719365 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:29.719214    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9da531c0-1e7c-4508-8069-2424401f67ef-istio-token\") pod \"e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt\" (UID: \"9da531c0-1e7c-4508-8069-2424401f67ef\") " pod="openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt"
Sep 15 10:50:29.719365 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:29.719271    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9da531c0-1e7c-4508-8069-2424401f67ef-istio-podinfo\") pod \"e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt\" (UID: \"9da531c0-1e7c-4508-8069-2424401f67ef\") " pod="openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt"
Sep 15 10:50:29.719365 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:29.719303    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9da531c0-1e7c-4508-8069-2424401f67ef-workload-socket\") pod \"e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt\" (UID: \"9da531c0-1e7c-4508-8069-2424401f67ef\") " pod="openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt"
Sep 15 10:50:29.820071 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:29.819974    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9da531c0-1e7c-4508-8069-2424401f67ef-workload-certs\") pod \"e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt\" (UID: \"9da531c0-1e7c-4508-8069-2424401f67ef\") " pod="openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt"
Sep 15 10:50:29.820071 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:29.820043    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9da531c0-1e7c-4508-8069-2424401f67ef-istio-envoy\") pod \"e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt\" (UID: \"9da531c0-1e7c-4508-8069-2424401f67ef\") " pod="openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt"
Sep 15 10:50:29.820307 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:29.820077    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9da531c0-1e7c-4508-8069-2424401f67ef-istio-token\") pod \"e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt\" (UID: \"9da531c0-1e7c-4508-8069-2424401f67ef\") " pod="openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt"
Sep 15 10:50:29.820307 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:29.820106    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9da531c0-1e7c-4508-8069-2424401f67ef-istio-podinfo\") pod \"e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt\" (UID: \"9da531c0-1e7c-4508-8069-2424401f67ef\") " pod="openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt"
Sep 15 10:50:29.820307 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:29.820241    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9da531c0-1e7c-4508-8069-2424401f67ef-workload-socket\") pod \"e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt\" (UID: \"9da531c0-1e7c-4508-8069-2424401f67ef\") " pod="openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt"
Sep 15 10:50:29.820307 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:29.820285    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9da531c0-1e7c-4508-8069-2424401f67ef-istiod-ca-cert\") pod \"e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt\" (UID: \"9da531c0-1e7c-4508-8069-2424401f67ef\") " pod="openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt"
Sep 15 10:50:29.820527 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:29.820318    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rjpt\" (UniqueName: \"kubernetes.io/projected/9da531c0-1e7c-4508-8069-2424401f67ef-kube-api-access-9rjpt\") pod \"e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt\" (UID: \"9da531c0-1e7c-4508-8069-2424401f67ef\") " pod="openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt"
Sep 15 10:50:29.820527 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:29.820374    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9da531c0-1e7c-4508-8069-2424401f67ef-istio-data\") pod \"e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt\" (UID: \"9da531c0-1e7c-4508-8069-2424401f67ef\") " pod="openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt"
Sep 15 10:50:29.820527 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:29.820414    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9da531c0-1e7c-4508-8069-2424401f67ef-credential-socket\") pod \"e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt\" (UID: \"9da531c0-1e7c-4508-8069-2424401f67ef\") " pod="openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt"
Sep 15 10:50:29.820527 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:29.820441    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9da531c0-1e7c-4508-8069-2424401f67ef-workload-certs\") pod \"e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt\" (UID: \"9da531c0-1e7c-4508-8069-2424401f67ef\") " pod="openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt"
Sep 15 10:50:29.820839 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:29.820599    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9da531c0-1e7c-4508-8069-2424401f67ef-workload-socket\") pod \"e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt\" (UID: \"9da531c0-1e7c-4508-8069-2424401f67ef\") " pod="openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt"
Sep 15 10:50:29.820900 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:29.820889    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9da531c0-1e7c-4508-8069-2424401f67ef-istio-data\") pod \"e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt\" (UID: \"9da531c0-1e7c-4508-8069-2424401f67ef\") " pod="openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt"
Sep 15 10:50:29.821003 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:29.820980    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9da531c0-1e7c-4508-8069-2424401f67ef-credential-socket\") pod \"e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt\" (UID: \"9da531c0-1e7c-4508-8069-2424401f67ef\") " pod="openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt"
Sep 15 10:50:29.821202 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:29.821180    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9da531c0-1e7c-4508-8069-2424401f67ef-istiod-ca-cert\") pod \"e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt\" (UID: \"9da531c0-1e7c-4508-8069-2424401f67ef\") " pod="openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt"
Sep 15 10:50:29.822461 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:29.822434    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9da531c0-1e7c-4508-8069-2424401f67ef-istio-envoy\") pod \"e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt\" (UID: \"9da531c0-1e7c-4508-8069-2424401f67ef\") " pod="openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt"
Sep 15 10:50:29.822979 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:29.822958    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9da531c0-1e7c-4508-8069-2424401f67ef-istio-podinfo\") pod \"e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt\" (UID: \"9da531c0-1e7c-4508-8069-2424401f67ef\") " pod="openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt"
Sep 15 10:50:29.827434 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:29.827410    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9da531c0-1e7c-4508-8069-2424401f67ef-istio-token\") pod \"e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt\" (UID: \"9da531c0-1e7c-4508-8069-2424401f67ef\") " pod="openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt"
Sep 15 10:50:29.828040 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:29.828022    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rjpt\" (UniqueName: \"kubernetes.io/projected/9da531c0-1e7c-4508-8069-2424401f67ef-kube-api-access-9rjpt\") pod \"e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt\" (UID: \"9da531c0-1e7c-4508-8069-2424401f67ef\") " pod="openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt"
Sep 15 10:50:29.863375 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:29.863342    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt"
Sep 15 10:50:30.146564 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:30.146540    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt"]
Sep 15 10:50:30.148518 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:50:30.148491    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9da531c0_1e7c_4508_8069_2424401f67ef.slice/crio-9404c051efd9591191d94ec7784b5ffcf081fd703b5f7fc8c9862f0f4d814863 WatchSource:0}: Error finding container 9404c051efd9591191d94ec7784b5ffcf081fd703b5f7fc8c9862f0f4d814863: Status 404 returned error can't find the container with id 9404c051efd9591191d94ec7784b5ffcf081fd703b5f7fc8c9862f0f4d814863
Sep 15 10:50:30.150807 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:30.150767    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:50:30.150892 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:30.150852    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:50:30.150943 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:30.150893    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:50:30.607059 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:30.607024    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt" event={"ID":"9da531c0-1e7c-4508-8069-2424401f67ef","Type":"ContainerStarted","Data":"25a3caaad2f8d72cce93cb733da70e82aa22c2882a7b76feadf2210192ed304b"}
Sep 15 10:50:30.607437 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:30.607076    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt" event={"ID":"9da531c0-1e7c-4508-8069-2424401f67ef","Type":"ContainerStarted","Data":"9404c051efd9591191d94ec7784b5ffcf081fd703b5f7fc8c9862f0f4d814863"}
Sep 15 10:50:30.626196 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:30.626149    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt" podStartSLOduration=1.626134085 podStartE2EDuration="1.626134085s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:50:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:50:30.624240395 +0000 UTC m=+1964.020332491" watchObservedRunningTime="2026-09-15 10:50:30.626134085 +0000 UTC m=+1964.022226173"
Sep 15 10:50:30.864205 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:30.864123    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt"
Sep 15 10:50:31.869493 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:31.869463    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt"
Sep 15 10:50:32.620093 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:32.620052    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt"
Sep 15 10:50:32.621118 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:32.621096    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt"
Sep 15 10:50:35.199491 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:35.199455    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-9f5ea7-5f7f67dd54-ddzqk"]
Sep 15 10:50:35.204447 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:35.204422    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9f5ea7-5f7f67dd54-ddzqk"
Sep 15 10:50:35.207136 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:35.207111    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-9f5ea7\""
Sep 15 10:50:35.207136 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:35.207129    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-9f5ea7-dockercfg-5wqbn\""
Sep 15 10:50:35.216312 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:35.215098    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-9f5ea7-5f7f67dd54-ddzqk"]
Sep 15 10:50:35.232584 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:35.232559    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-9f5ea7-5b8956757-fbr52"]
Sep 15 10:50:35.236170 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:35.236154    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-9f5ea7-5b8956757-fbr52"
Sep 15 10:50:35.245287 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:35.245258    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-9f5ea7-5b8956757-fbr52"]
Sep 15 10:50:35.374885 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:35.374842    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/845b9804-29cd-46e4-8978-7bc08994c28a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-9f5ea7-5f7f67dd54-ddzqk\" (UID: \"845b9804-29cd-46e4-8978-7bc08994c28a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9f5ea7-5f7f67dd54-ddzqk"
Sep 15 10:50:35.375071 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:35.374912    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs55h\" (UniqueName: \"kubernetes.io/projected/2cf64c94-3f7e-4872-afdc-298e629e9c63-kube-api-access-fs55h\") pod \"payload-processing-e2e-ipp-b-9f5ea7-5b8956757-fbr52\" (UID: \"2cf64c94-3f7e-4872-afdc-298e629e9c63\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-9f5ea7-5b8956757-fbr52"
Sep 15 10:50:35.375071 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:35.375041    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2cf64c94-3f7e-4872-afdc-298e629e9c63-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-9f5ea7-5b8956757-fbr52\" (UID: \"2cf64c94-3f7e-4872-afdc-298e629e9c63\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-9f5ea7-5b8956757-fbr52"
Sep 15 10:50:35.375168 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:35.375072    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86x22\" (UniqueName: \"kubernetes.io/projected/845b9804-29cd-46e4-8978-7bc08994c28a-kube-api-access-86x22\") pod \"payload-pre-processing-e2e-ipp-b-9f5ea7-5f7f67dd54-ddzqk\" (UID: \"845b9804-29cd-46e4-8978-7bc08994c28a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9f5ea7-5f7f67dd54-ddzqk"
Sep 15 10:50:35.475570 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:35.475488    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs55h\" (UniqueName: \"kubernetes.io/projected/2cf64c94-3f7e-4872-afdc-298e629e9c63-kube-api-access-fs55h\") pod \"payload-processing-e2e-ipp-b-9f5ea7-5b8956757-fbr52\" (UID: \"2cf64c94-3f7e-4872-afdc-298e629e9c63\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-9f5ea7-5b8956757-fbr52"
Sep 15 10:50:35.475735 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:35.475573    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2cf64c94-3f7e-4872-afdc-298e629e9c63-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-9f5ea7-5b8956757-fbr52\" (UID: \"2cf64c94-3f7e-4872-afdc-298e629e9c63\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-9f5ea7-5b8956757-fbr52"
Sep 15 10:50:35.475735 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:35.475601    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86x22\" (UniqueName: \"kubernetes.io/projected/845b9804-29cd-46e4-8978-7bc08994c28a-kube-api-access-86x22\") pod \"payload-pre-processing-e2e-ipp-b-9f5ea7-5f7f67dd54-ddzqk\" (UID: \"845b9804-29cd-46e4-8978-7bc08994c28a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9f5ea7-5f7f67dd54-ddzqk"
Sep 15 10:50:35.475735 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:35.475660    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/845b9804-29cd-46e4-8978-7bc08994c28a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-9f5ea7-5f7f67dd54-ddzqk\" (UID: \"845b9804-29cd-46e4-8978-7bc08994c28a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9f5ea7-5f7f67dd54-ddzqk"
Sep 15 10:50:35.476312 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:35.476293    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2cf64c94-3f7e-4872-afdc-298e629e9c63-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-9f5ea7-5b8956757-fbr52\" (UID: \"2cf64c94-3f7e-4872-afdc-298e629e9c63\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-9f5ea7-5b8956757-fbr52"
Sep 15 10:50:35.476393 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:35.476375    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/845b9804-29cd-46e4-8978-7bc08994c28a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-9f5ea7-5f7f67dd54-ddzqk\" (UID: \"845b9804-29cd-46e4-8978-7bc08994c28a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9f5ea7-5f7f67dd54-ddzqk"
Sep 15 10:50:35.483084 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:35.483057    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs55h\" (UniqueName: \"kubernetes.io/projected/2cf64c94-3f7e-4872-afdc-298e629e9c63-kube-api-access-fs55h\") pod \"payload-processing-e2e-ipp-b-9f5ea7-5b8956757-fbr52\" (UID: \"2cf64c94-3f7e-4872-afdc-298e629e9c63\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-9f5ea7-5b8956757-fbr52"
Sep 15 10:50:35.483199 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:35.483089    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86x22\" (UniqueName: \"kubernetes.io/projected/845b9804-29cd-46e4-8978-7bc08994c28a-kube-api-access-86x22\") pod \"payload-pre-processing-e2e-ipp-b-9f5ea7-5f7f67dd54-ddzqk\" (UID: \"845b9804-29cd-46e4-8978-7bc08994c28a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9f5ea7-5f7f67dd54-ddzqk"
Sep 15 10:50:35.522907 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:35.522870    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9f5ea7-5f7f67dd54-ddzqk"
Sep 15 10:50:35.546881 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:35.546846    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-9f5ea7-5b8956757-fbr52"
Sep 15 10:50:35.795867 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:35.795840    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-9f5ea7-5f7f67dd54-ddzqk"]
Sep 15 10:50:35.797684 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:50:35.797652    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod845b9804_29cd_46e4_8978_7bc08994c28a.slice/crio-e7562d3d653a68ef35d441c29d96f383fbcdc997bd38f5a4a4b87e3ea93866c6 WatchSource:0}: Error finding container e7562d3d653a68ef35d441c29d96f383fbcdc997bd38f5a4a4b87e3ea93866c6: Status 404 returned error can't find the container with id e7562d3d653a68ef35d441c29d96f383fbcdc997bd38f5a4a4b87e3ea93866c6
Sep 15 10:50:35.833298 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:35.833278    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-9f5ea7-5b8956757-fbr52"]
Sep 15 10:50:35.835271 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:50:35.835248    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cf64c94_3f7e_4872_afdc_298e629e9c63.slice/crio-63d563e0d0411815642e7ee3141dad1c947af2a68ee9d065706dd2489f1f0408 WatchSource:0}: Error finding container 63d563e0d0411815642e7ee3141dad1c947af2a68ee9d065706dd2489f1f0408: Status 404 returned error can't find the container with id 63d563e0d0411815642e7ee3141dad1c947af2a68ee9d065706dd2489f1f0408
Sep 15 10:50:36.646981 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:36.646944    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9f5ea7-5f7f67dd54-ddzqk" event={"ID":"845b9804-29cd-46e4-8978-7bc08994c28a","Type":"ContainerStarted","Data":"8a4d1a2296def22f4ff48c2b5a0207e94406249f050bfb39d69603bccf5dddf3"}
Sep 15 10:50:36.647417 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:36.647000    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9f5ea7-5f7f67dd54-ddzqk"
Sep 15 10:50:36.647417 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:36.647023    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9f5ea7-5f7f67dd54-ddzqk" event={"ID":"845b9804-29cd-46e4-8978-7bc08994c28a","Type":"ContainerStarted","Data":"e7562d3d653a68ef35d441c29d96f383fbcdc997bd38f5a4a4b87e3ea93866c6"}
Sep 15 10:50:36.648475 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:36.648453    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-9f5ea7-5b8956757-fbr52" event={"ID":"2cf64c94-3f7e-4872-afdc-298e629e9c63","Type":"ContainerStarted","Data":"adec66c221d3eec631766b1a847fea27e7d834cd88eb091bba9f47fe84907a9e"}
Sep 15 10:50:36.648560 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:36.648496    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-9f5ea7-5b8956757-fbr52"
Sep 15 10:50:36.648560 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:36.648511    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-9f5ea7-5b8956757-fbr52" event={"ID":"2cf64c94-3f7e-4872-afdc-298e629e9c63","Type":"ContainerStarted","Data":"63d563e0d0411815642e7ee3141dad1c947af2a68ee9d065706dd2489f1f0408"}
Sep 15 10:50:36.664884 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:36.664844    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9f5ea7-5f7f67dd54-ddzqk" podStartSLOduration=1.6648295119999998 podStartE2EDuration="1.664829512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:50:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:50:36.662783596 +0000 UTC m=+1970.058875682" watchObservedRunningTime="2026-09-15 10:50:36.664829512 +0000 UTC m=+1970.060921599"
Sep 15 10:50:36.679781 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:36.679709    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-9f5ea7-5b8956757-fbr52" podStartSLOduration=1.679692331 podStartE2EDuration="1.679692331s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:50:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:50:36.678195022 +0000 UTC m=+1970.074287109" watchObservedRunningTime="2026-09-15 10:50:36.679692331 +0000 UTC m=+1970.075784422"
Sep 15 10:50:47.592918 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:47.592883    2579 scope.go:117] "RemoveContainer" containerID="eceda7d06f641395237504fcc0380aa0098ec5b050ce42084bc2ecaf5483dad2"
Sep 15 10:50:47.603701 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:47.603678    2579 scope.go:117] "RemoveContainer" containerID="accae6d3153dfb8dec4f0b090b67bad926fbd19b93711f58322c4420bdd8d7b5"
Sep 15 10:50:47.614331 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:47.614305    2579 scope.go:117] "RemoveContainer" containerID="629922fa0ba4fda928d8c02620cba64a1393c23ffec853603d14c4ff44e92277"
Sep 15 10:50:47.623253 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:47.623230    2579 scope.go:117] "RemoveContainer" containerID="d72041e707ef1e59014975e9f0ec7d98702b8fa01a9caccc346112e860b852aa"
Sep 15 10:50:47.657281 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:47.657253    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9f5ea7-5f7f67dd54-ddzqk"
Sep 15 10:50:47.657415 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:47.657338    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-9f5ea7-5b8956757-fbr52"
Sep 15 10:50:48.661907 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:48.661869    2579 patch_prober.go:28] interesting pod/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 15 10:50:48.662307 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:48.661934    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt" podUID="9da531c0-1e7c-4508-8069-2424401f67ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 15 10:50:49.726076 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:49.725992    2579 generic.go:356] "Generic (PLEG): container finished" podID="9da531c0-1e7c-4508-8069-2424401f67ef" containerID="25a3caaad2f8d72cce93cb733da70e82aa22c2882a7b76feadf2210192ed304b" exitCode=0
Sep 15 10:50:49.726076 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:49.726047    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt" event={"ID":"9da531c0-1e7c-4508-8069-2424401f67ef","Type":"ContainerDied","Data":"25a3caaad2f8d72cce93cb733da70e82aa22c2882a7b76feadf2210192ed304b"}
Sep 15 10:50:49.726551 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:49.726423    2579 scope.go:117] "RemoveContainer" containerID="25a3caaad2f8d72cce93cb733da70e82aa22c2882a7b76feadf2210192ed304b"
Sep 15 10:50:49.727650 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:49.727608    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:50:49.727766 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:49.727706    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:50:49.727833 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:49.727763    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 10:50:50.733781 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:50.733711    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt" event={"ID":"9da531c0-1e7c-4508-8069-2424401f67ef","Type":"ContainerStarted","Data":"40d4f4c483c6c532888e6fa4c64939872530ac17620240d0e5744937dab4fd2d"}
Sep 15 10:50:50.863957 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:50.863921    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt"
Sep 15 10:50:50.864309 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:50.864279    2579 patch_prober.go:28] interesting pod/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Sep 15 10:50:50.864424 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:50.864333    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt" podUID="9da531c0-1e7c-4508-8069-2424401f67ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Sep 15 10:50:51.863749 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:51.863690    2579 patch_prober.go:28] interesting pod/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Sep 15 10:50:51.864141 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:51.863770    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt" podUID="9da531c0-1e7c-4508-8069-2424401f67ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Sep 15 10:50:52.864029 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:52.863983    2579 patch_prober.go:28] interesting pod/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Sep 15 10:50:52.864505 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:52.864050    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt" podUID="9da531c0-1e7c-4508-8069-2424401f67ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Sep 15 10:50:53.864286 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:53.864249    2579 patch_prober.go:28] interesting pod/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Sep 15 10:50:53.864670 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:53.864307    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt" podUID="9da531c0-1e7c-4508-8069-2424401f67ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Sep 15 10:50:54.864149 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:54.864113    2579 patch_prober.go:28] interesting pod/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Sep 15 10:50:54.864358 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:54.864175    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt" podUID="9da531c0-1e7c-4508-8069-2424401f67ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Sep 15 10:50:55.915294 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:55.915257    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt"
Sep 15 10:50:55.915834 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:55.915636    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt"
Sep 15 10:50:55.916579 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:50:55.916560    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt"
Sep 15 10:51:02.661148 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:51:02.661120    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-frx6w_b2e4baf3-a86b-4bc0-9eca-144514bfafa8/payload-processing/0.log"
Sep 15 10:51:02.775121 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:51:02.775087    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-9f5ea7-5b8956757-fbr52_2cf64c94-3f7e-4872-afdc-298e629e9c63/payload-processing/0.log"
Sep 15 10:51:43.618595 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:51:43.618564    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-5ffc6a-78d4cf65c9-7mkpp_e90944ba-b08f-4ad3-954a-63b1aebc0738/payload-processing/0.log"
Sep 15 10:51:43.731742 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:51:43.731688    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-frx6w_b2e4baf3-a86b-4bc0-9eca-144514bfafa8/payload-processing/0.log"
Sep 15 10:51:43.847873 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:51:43.847835    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-9f5ea7-5b8956757-fbr52_2cf64c94-3f7e-4872-afdc-298e629e9c63/payload-processing/0.log"
Sep 15 10:51:47.662635 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:51:47.662606    2579 scope.go:117] "RemoveContainer" containerID="ce3b68b65bb0534f25f04434e6ee8e6db06a95921c0c1569670ea39226916d3d"
Sep 15 10:51:47.671909 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:51:47.671889    2579 scope.go:117] "RemoveContainer" containerID="02d2f3b441d033e863140c4d35587d4edb0ce45ea734d20b73a750f14ccb0940"
Sep 15 10:51:51.258583 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:51:51.258551    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-1b5e28-5bd7dcfcfc-q5q7h"]
Sep 15 10:51:51.262277 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:51:51.262260    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-1b5e28-5bd7dcfcfc-q5q7h"
Sep 15 10:51:51.264455 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:51:51.264432    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-1b5e28-dockercfg-hc5qc\""
Sep 15 10:51:51.264575 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:51:51.264558    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-1b5e28\""
Sep 15 10:51:51.271418 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:51:51.271394    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-1b5e28-5bd7dcfcfc-q5q7h"]
Sep 15 10:51:51.383414 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:51:51.383372    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4h9bs\" (UniqueName: \"kubernetes.io/projected/125cb015-da0e-4b67-adc2-cdabbdb3772d-kube-api-access-4h9bs\") pod \"payload-processing-e2e-ipp-cleanup-1b5e28-5bd7dcfcfc-q5q7h\" (UID: \"125cb015-da0e-4b67-adc2-cdabbdb3772d\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-1b5e28-5bd7dcfcfc-q5q7h"
Sep 15 10:51:51.383585 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:51:51.383529    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/125cb015-da0e-4b67-adc2-cdabbdb3772d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-1b5e28-5bd7dcfcfc-q5q7h\" (UID: \"125cb015-da0e-4b67-adc2-cdabbdb3772d\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-1b5e28-5bd7dcfcfc-q5q7h"
Sep 15 10:51:51.484249 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:51:51.484215    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4h9bs\" (UniqueName: \"kubernetes.io/projected/125cb015-da0e-4b67-adc2-cdabbdb3772d-kube-api-access-4h9bs\") pod \"payload-processing-e2e-ipp-cleanup-1b5e28-5bd7dcfcfc-q5q7h\" (UID: \"125cb015-da0e-4b67-adc2-cdabbdb3772d\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-1b5e28-5bd7dcfcfc-q5q7h"
Sep 15 10:51:51.484421 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:51:51.484344    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/125cb015-da0e-4b67-adc2-cdabbdb3772d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-1b5e28-5bd7dcfcfc-q5q7h\" (UID: \"125cb015-da0e-4b67-adc2-cdabbdb3772d\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-1b5e28-5bd7dcfcfc-q5q7h"
Sep 15 10:51:51.485037 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:51:51.485017    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/125cb015-da0e-4b67-adc2-cdabbdb3772d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-1b5e28-5bd7dcfcfc-q5q7h\" (UID: \"125cb015-da0e-4b67-adc2-cdabbdb3772d\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-1b5e28-5bd7dcfcfc-q5q7h"
Sep 15 10:51:51.491834 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:51:51.491813    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4h9bs\" (UniqueName: \"kubernetes.io/projected/125cb015-da0e-4b67-adc2-cdabbdb3772d-kube-api-access-4h9bs\") pod \"payload-processing-e2e-ipp-cleanup-1b5e28-5bd7dcfcfc-q5q7h\" (UID: \"125cb015-da0e-4b67-adc2-cdabbdb3772d\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-1b5e28-5bd7dcfcfc-q5q7h"
Sep 15 10:51:51.573875 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:51:51.573845    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-1b5e28-5bd7dcfcfc-q5q7h"
Sep 15 10:51:51.848713 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:51:51.848632    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-1b5e28-5bd7dcfcfc-q5q7h"]
Sep 15 10:51:51.851461 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:51:51.851430    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod125cb015_da0e_4b67_adc2_cdabbdb3772d.slice/crio-8194fcd8ee2d28d799b0a9d6b7f2559780b51d436713a1e37614469354fc284e WatchSource:0}: Error finding container 8194fcd8ee2d28d799b0a9d6b7f2559780b51d436713a1e37614469354fc284e: Status 404 returned error can't find the container with id 8194fcd8ee2d28d799b0a9d6b7f2559780b51d436713a1e37614469354fc284e
Sep 15 10:51:52.078741 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:51:52.078701    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-1b5e28-5bd7dcfcfc-q5q7h" event={"ID":"125cb015-da0e-4b67-adc2-cdabbdb3772d","Type":"ContainerStarted","Data":"bf627f381be81bc6661a324bb11eb3f8934438b048a433de6966d7c2cfdb4522"}
Sep 15 10:51:52.078950 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:51:52.078772    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-1b5e28-5bd7dcfcfc-q5q7h" event={"ID":"125cb015-da0e-4b67-adc2-cdabbdb3772d","Type":"ContainerStarted","Data":"8194fcd8ee2d28d799b0a9d6b7f2559780b51d436713a1e37614469354fc284e"}
Sep 15 10:51:52.078950 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:51:52.078885    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-1b5e28-5bd7dcfcfc-q5q7h"
Sep 15 10:51:52.095767 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:51:52.095702    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-1b5e28-5bd7dcfcfc-q5q7h" podStartSLOduration=1.095686441 podStartE2EDuration="1.095686441s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:51:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:51:52.093294609 +0000 UTC m=+2045.489386693" watchObservedRunningTime="2026-09-15 10:51:52.095686441 +0000 UTC m=+2045.491778528"
Sep 15 10:52:03.087412 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:03.087380    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-1b5e28-5bd7dcfcfc-q5q7h"
Sep 15 10:52:13.329134 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:13.329062    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1b5e28-2xsmf"]
Sep 15 10:52:13.332872 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:13.332852    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1b5e28-2xsmf"
Sep 15 10:52:13.335100 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:13.335082    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5jrzm\""
Sep 15 10:52:13.339431 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:13.339405    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1b5e28-2xsmf"]
Sep 15 10:52:13.399848 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:13.399814    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4dd21a1a-2c37-44e3-bd87-cd267ac9ac24-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-1b5e28-2xsmf\" (UID: \"4dd21a1a-2c37-44e3-bd87-cd267ac9ac24\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1b5e28-2xsmf"
Sep 15 10:52:13.500507 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:13.500475    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4dd21a1a-2c37-44e3-bd87-cd267ac9ac24-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-1b5e28-2xsmf\" (UID: \"4dd21a1a-2c37-44e3-bd87-cd267ac9ac24\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1b5e28-2xsmf"
Sep 15 10:52:13.501268 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:13.501248    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4dd21a1a-2c37-44e3-bd87-cd267ac9ac24-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-1b5e28-2xsmf\" (UID: \"4dd21a1a-2c37-44e3-bd87-cd267ac9ac24\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1b5e28-2xsmf"
Sep 15 10:52:13.644807 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:13.644717    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1b5e28-2xsmf"
Sep 15 10:52:13.914536 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:13.914510    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1b5e28-2xsmf"]
Sep 15 10:52:13.916152 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:52:13.916122    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dd21a1a_2c37_44e3_bd87_cd267ac9ac24.slice/crio-a50798208606bbe76579aab5f587cd8e3e374d36167bc327cc98ce3c15611554 WatchSource:0}: Error finding container a50798208606bbe76579aab5f587cd8e3e374d36167bc327cc98ce3c15611554: Status 404 returned error can't find the container with id a50798208606bbe76579aab5f587cd8e3e374d36167bc327cc98ce3c15611554
Sep 15 10:52:14.207080 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:14.207049    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1b5e28-2xsmf" event={"ID":"4dd21a1a-2c37-44e3-bd87-cd267ac9ac24","Type":"ContainerStarted","Data":"a50798208606bbe76579aab5f587cd8e3e374d36167bc327cc98ce3c15611554"}
Sep 15 10:52:15.214108 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:15.214076    2579 generic.go:356] "Generic (PLEG): container finished" podID="4dd21a1a-2c37-44e3-bd87-cd267ac9ac24" containerID="b1960e60fbe993ad9d0d579e132603770784dec8deeeadefcb4901e7f9cfaaa9" exitCode=0
Sep 15 10:52:15.214572 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:15.214170    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1b5e28-2xsmf" event={"ID":"4dd21a1a-2c37-44e3-bd87-cd267ac9ac24","Type":"ContainerDied","Data":"b1960e60fbe993ad9d0d579e132603770784dec8deeeadefcb4901e7f9cfaaa9"}
Sep 15 10:52:16.367358 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:16.367322    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1b5e28-2xsmf"
Sep 15 10:52:16.431856 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:16.431823    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4dd21a1a-2c37-44e3-bd87-cd267ac9ac24-maas-api-service-ca\") pod \"4dd21a1a-2c37-44e3-bd87-cd267ac9ac24\" (UID: \"4dd21a1a-2c37-44e3-bd87-cd267ac9ac24\") "
Sep 15 10:52:16.432228 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:16.432209    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4dd21a1a-2c37-44e3-bd87-cd267ac9ac24-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4dd21a1a-2c37-44e3-bd87-cd267ac9ac24" (UID: "4dd21a1a-2c37-44e3-bd87-cd267ac9ac24"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:52:16.533179 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:16.533149    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4dd21a1a-2c37-44e3-bd87-cd267ac9ac24-maas-api-service-ca\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:52:17.227854 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:17.227823    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1b5e28-2xsmf"
Sep 15 10:52:17.227854 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:17.227834    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1b5e28-2xsmf" event={"ID":"4dd21a1a-2c37-44e3-bd87-cd267ac9ac24","Type":"ContainerDied","Data":"a50798208606bbe76579aab5f587cd8e3e374d36167bc327cc98ce3c15611554"}
Sep 15 10:52:17.228059 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:17.227903    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a50798208606bbe76579aab5f587cd8e3e374d36167bc327cc98ce3c15611554"
Sep 15 10:52:19.692772 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:19.692712    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-1b5e28-5bd7dcfcfc-q5q7h"]
Sep 15 10:52:19.693262 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:19.692997    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-1b5e28-5bd7dcfcfc-q5q7h" podUID="125cb015-da0e-4b67-adc2-cdabbdb3772d" containerName="payload-processing" containerID="cri-o://bf627f381be81bc6661a324bb11eb3f8934438b048a433de6966d7c2cfdb4522" gracePeriod=30
Sep 15 10:52:19.844266 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:19.844231    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1b5e28-2xsmf"]
Sep 15 10:52:19.846523 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:19.846493    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1b5e28-2xsmf"]
Sep 15 10:52:19.969341 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:19.969308    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-1b5e28-5bd7dcfcfc-q5q7h"
Sep 15 10:52:20.069431 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:20.069394    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/125cb015-da0e-4b67-adc2-cdabbdb3772d-plugins-config-volume\") pod \"125cb015-da0e-4b67-adc2-cdabbdb3772d\" (UID: \"125cb015-da0e-4b67-adc2-cdabbdb3772d\") "
Sep 15 10:52:20.069431 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:20.069438    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4h9bs\" (UniqueName: \"kubernetes.io/projected/125cb015-da0e-4b67-adc2-cdabbdb3772d-kube-api-access-4h9bs\") pod \"125cb015-da0e-4b67-adc2-cdabbdb3772d\" (UID: \"125cb015-da0e-4b67-adc2-cdabbdb3772d\") "
Sep 15 10:52:20.069878 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:20.069841    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/125cb015-da0e-4b67-adc2-cdabbdb3772d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "125cb015-da0e-4b67-adc2-cdabbdb3772d" (UID: "125cb015-da0e-4b67-adc2-cdabbdb3772d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:52:20.071547 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:20.071525    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/125cb015-da0e-4b67-adc2-cdabbdb3772d-kube-api-access-4h9bs" (OuterVolumeSpecName: "kube-api-access-4h9bs") pod "125cb015-da0e-4b67-adc2-cdabbdb3772d" (UID: "125cb015-da0e-4b67-adc2-cdabbdb3772d"). InnerVolumeSpecName "kube-api-access-4h9bs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:52:20.170354 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:20.170320    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/125cb015-da0e-4b67-adc2-cdabbdb3772d-plugins-config-volume\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:52:20.170354 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:20.170347    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4h9bs\" (UniqueName: \"kubernetes.io/projected/125cb015-da0e-4b67-adc2-cdabbdb3772d-kube-api-access-4h9bs\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:52:20.247504 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:20.247410    2579 generic.go:356] "Generic (PLEG): container finished" podID="125cb015-da0e-4b67-adc2-cdabbdb3772d" containerID="bf627f381be81bc6661a324bb11eb3f8934438b048a433de6966d7c2cfdb4522" exitCode=0
Sep 15 10:52:20.247504 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:20.247455    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-1b5e28-5bd7dcfcfc-q5q7h"
Sep 15 10:52:20.247681 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:20.247497    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-1b5e28-5bd7dcfcfc-q5q7h" event={"ID":"125cb015-da0e-4b67-adc2-cdabbdb3772d","Type":"ContainerDied","Data":"bf627f381be81bc6661a324bb11eb3f8934438b048a433de6966d7c2cfdb4522"}
Sep 15 10:52:20.247681 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:20.247551    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-1b5e28-5bd7dcfcfc-q5q7h" event={"ID":"125cb015-da0e-4b67-adc2-cdabbdb3772d","Type":"ContainerDied","Data":"8194fcd8ee2d28d799b0a9d6b7f2559780b51d436713a1e37614469354fc284e"}
Sep 15 10:52:20.247681 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:20.247577    2579 scope.go:117] "RemoveContainer" containerID="bf627f381be81bc6661a324bb11eb3f8934438b048a433de6966d7c2cfdb4522"
Sep 15 10:52:20.257216 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:20.257198    2579 scope.go:117] "RemoveContainer" containerID="bf627f381be81bc6661a324bb11eb3f8934438b048a433de6966d7c2cfdb4522"
Sep 15 10:52:20.257485 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:52:20.257465    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf627f381be81bc6661a324bb11eb3f8934438b048a433de6966d7c2cfdb4522\": container with ID starting with bf627f381be81bc6661a324bb11eb3f8934438b048a433de6966d7c2cfdb4522 not found: ID does not exist" containerID="bf627f381be81bc6661a324bb11eb3f8934438b048a433de6966d7c2cfdb4522"
Sep 15 10:52:20.257551 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:20.257499    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf627f381be81bc6661a324bb11eb3f8934438b048a433de6966d7c2cfdb4522"} err="failed to get container status \"bf627f381be81bc6661a324bb11eb3f8934438b048a433de6966d7c2cfdb4522\": rpc error: code = NotFound desc = could not find container \"bf627f381be81bc6661a324bb11eb3f8934438b048a433de6966d7c2cfdb4522\": container with ID starting with bf627f381be81bc6661a324bb11eb3f8934438b048a433de6966d7c2cfdb4522 not found: ID does not exist"
Sep 15 10:52:20.271275 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:20.271244    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-1b5e28-5bd7dcfcfc-q5q7h"]
Sep 15 10:52:20.277395 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:20.277359    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-1b5e28-5bd7dcfcfc-q5q7h"]
Sep 15 10:52:21.152108 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:21.152074    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="125cb015-da0e-4b67-adc2-cdabbdb3772d" path="/var/lib/kubelet/pods/125cb015-da0e-4b67-adc2-cdabbdb3772d/volumes"
Sep 15 10:52:21.152487 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:21.152416    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4dd21a1a-2c37-44e3-bd87-cd267ac9ac24" path="/var/lib/kubelet/pods/4dd21a1a-2c37-44e3-bd87-cd267ac9ac24/volumes"
Sep 15 10:52:29.727698 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:29.727657    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5ffc6a-dl7bq"]
Sep 15 10:52:29.728174 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:29.728157    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="125cb015-da0e-4b67-adc2-cdabbdb3772d" containerName="payload-processing"
Sep 15 10:52:29.728174 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:29.728176    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="125cb015-da0e-4b67-adc2-cdabbdb3772d" containerName="payload-processing"
Sep 15 10:52:29.728310 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:29.728194    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4dd21a1a-2c37-44e3-bd87-cd267ac9ac24" containerName="revoke-keys"
Sep 15 10:52:29.728310 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:29.728200    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4dd21a1a-2c37-44e3-bd87-cd267ac9ac24" containerName="revoke-keys"
Sep 15 10:52:29.728310 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:29.728279    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="125cb015-da0e-4b67-adc2-cdabbdb3772d" containerName="payload-processing"
Sep 15 10:52:29.728310 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:29.728290    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4dd21a1a-2c37-44e3-bd87-cd267ac9ac24" containerName="revoke-keys"
Sep 15 10:52:29.731976 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:29.731955    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5ffc6a-dl7bq"
Sep 15 10:52:29.734288 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:29.734260    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5jrzm\""
Sep 15 10:52:29.739215 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:29.739183    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5ffc6a-dl7bq"]
Sep 15 10:52:29.867850 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:29.867785    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc7d17f1-c72d-41f6-aae5-9a708b28f536-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-5ffc6a-dl7bq\" (UID: \"bc7d17f1-c72d-41f6-aae5-9a708b28f536\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5ffc6a-dl7bq"
Sep 15 10:52:29.969133 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:29.969088    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc7d17f1-c72d-41f6-aae5-9a708b28f536-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-5ffc6a-dl7bq\" (UID: \"bc7d17f1-c72d-41f6-aae5-9a708b28f536\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5ffc6a-dl7bq"
Sep 15 10:52:29.969821 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:29.969801    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc7d17f1-c72d-41f6-aae5-9a708b28f536-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-5ffc6a-dl7bq\" (UID: \"bc7d17f1-c72d-41f6-aae5-9a708b28f536\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5ffc6a-dl7bq"
Sep 15 10:52:30.046297 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:30.046257    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5ffc6a-dl7bq"
Sep 15 10:52:30.319503 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:30.319425    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5ffc6a-dl7bq"]
Sep 15 10:52:30.323393 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:52:30.323361    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc7d17f1_c72d_41f6_aae5_9a708b28f536.slice/crio-f24b6dc747aa312d0417c43c12ec5082decfe3bb6906f136336f7a5cd82421e3 WatchSource:0}: Error finding container f24b6dc747aa312d0417c43c12ec5082decfe3bb6906f136336f7a5cd82421e3: Status 404 returned error can't find the container with id f24b6dc747aa312d0417c43c12ec5082decfe3bb6906f136336f7a5cd82421e3
Sep 15 10:52:31.318512 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:31.318471    2579 generic.go:356] "Generic (PLEG): container finished" podID="bc7d17f1-c72d-41f6-aae5-9a708b28f536" containerID="d446ac045328bd8f25eb3a312070f1535a2943a1cfc2f343da51f95b38e9a05f" exitCode=0
Sep 15 10:52:31.318985 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:31.318556    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5ffc6a-dl7bq" event={"ID":"bc7d17f1-c72d-41f6-aae5-9a708b28f536","Type":"ContainerDied","Data":"d446ac045328bd8f25eb3a312070f1535a2943a1cfc2f343da51f95b38e9a05f"}
Sep 15 10:52:31.318985 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:31.318636    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5ffc6a-dl7bq" event={"ID":"bc7d17f1-c72d-41f6-aae5-9a708b28f536","Type":"ContainerStarted","Data":"f24b6dc747aa312d0417c43c12ec5082decfe3bb6906f136336f7a5cd82421e3"}
Sep 15 10:52:32.460446 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:32.460418    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5ffc6a-dl7bq"
Sep 15 10:52:32.596676 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:32.596588    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc7d17f1-c72d-41f6-aae5-9a708b28f536-maas-api-service-ca\") pod \"bc7d17f1-c72d-41f6-aae5-9a708b28f536\" (UID: \"bc7d17f1-c72d-41f6-aae5-9a708b28f536\") "
Sep 15 10:52:32.597008 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:32.596986    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc7d17f1-c72d-41f6-aae5-9a708b28f536-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bc7d17f1-c72d-41f6-aae5-9a708b28f536" (UID: "bc7d17f1-c72d-41f6-aae5-9a708b28f536"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:52:32.698277 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:32.698243    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc7d17f1-c72d-41f6-aae5-9a708b28f536-maas-api-service-ca\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:52:33.330181 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:33.330154    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5ffc6a-dl7bq"
Sep 15 10:52:33.330344 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:33.330191    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5ffc6a-dl7bq" event={"ID":"bc7d17f1-c72d-41f6-aae5-9a708b28f536","Type":"ContainerDied","Data":"f24b6dc747aa312d0417c43c12ec5082decfe3bb6906f136336f7a5cd82421e3"}
Sep 15 10:52:33.330344 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:33.330247    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f24b6dc747aa312d0417c43c12ec5082decfe3bb6906f136336f7a5cd82421e3"
Sep 15 10:52:45.164144 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:45.164109    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-5ffc6a-78d4cf65c9-7mkpp"]
Sep 15 10:52:45.164635 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:45.164354    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-5ffc6a-78d4cf65c9-7mkpp" podUID="e90944ba-b08f-4ad3-954a-63b1aebc0738" containerName="payload-processing" containerID="cri-o://2e6a3beec5c16fb08a749abeda6d9289cd95cf570342441e4bd58474149826d7" gracePeriod=30
Sep 15 10:52:45.171348 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:45.171314    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-5ffc6a-f49c4f7b6-jh95j"]
Sep 15 10:52:45.171667 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:45.171638    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-5ffc6a-f49c4f7b6-jh95j" podUID="03e32e2e-f197-41bf-bf27-5c6bab61a085" containerName="payload-pre-processing" containerID="cri-o://6b994545426b267ee4f8f54ff593d84c88210906bbc3685d5e0066adc160a983" gracePeriod=30
Sep 15 10:52:45.310182 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:45.310109    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5ffc6a-dl7bq"]
Sep 15 10:52:45.313932 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:45.313388    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5ffc6a-dl7bq"]
Sep 15 10:52:45.425679 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:45.425436    2579 generic.go:356] "Generic (PLEG): container finished" podID="e90944ba-b08f-4ad3-954a-63b1aebc0738" containerID="2e6a3beec5c16fb08a749abeda6d9289cd95cf570342441e4bd58474149826d7" exitCode=0
Sep 15 10:52:45.425679 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:45.425545    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-5ffc6a-78d4cf65c9-7mkpp" event={"ID":"e90944ba-b08f-4ad3-954a-63b1aebc0738","Type":"ContainerDied","Data":"2e6a3beec5c16fb08a749abeda6d9289cd95cf570342441e4bd58474149826d7"}
Sep 15 10:52:45.434032 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:45.432564    2579 generic.go:356] "Generic (PLEG): container finished" podID="03e32e2e-f197-41bf-bf27-5c6bab61a085" containerID="6b994545426b267ee4f8f54ff593d84c88210906bbc3685d5e0066adc160a983" exitCode=0
Sep 15 10:52:45.434032 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:45.432618    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-5ffc6a-f49c4f7b6-jh95j" event={"ID":"03e32e2e-f197-41bf-bf27-5c6bab61a085","Type":"ContainerDied","Data":"6b994545426b267ee4f8f54ff593d84c88210906bbc3685d5e0066adc160a983"}
Sep 15 10:52:45.492734 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:45.492693    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-5ffc6a-78d4cf65c9-7mkpp"
Sep 15 10:52:45.495584 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:45.495566    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-5ffc6a-f49c4f7b6-jh95j"
Sep 15 10:52:45.533011 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:45.532977    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c2qrx\" (UniqueName: \"kubernetes.io/projected/e90944ba-b08f-4ad3-954a-63b1aebc0738-kube-api-access-c2qrx\") pod \"e90944ba-b08f-4ad3-954a-63b1aebc0738\" (UID: \"e90944ba-b08f-4ad3-954a-63b1aebc0738\") "
Sep 15 10:52:45.533178 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:45.533027    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03e32e2e-f197-41bf-bf27-5c6bab61a085-plugins-config-volume\") pod \"03e32e2e-f197-41bf-bf27-5c6bab61a085\" (UID: \"03e32e2e-f197-41bf-bf27-5c6bab61a085\") "
Sep 15 10:52:45.533178 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:45.533062    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jm9s4\" (UniqueName: \"kubernetes.io/projected/03e32e2e-f197-41bf-bf27-5c6bab61a085-kube-api-access-jm9s4\") pod \"03e32e2e-f197-41bf-bf27-5c6bab61a085\" (UID: \"03e32e2e-f197-41bf-bf27-5c6bab61a085\") "
Sep 15 10:52:45.533178 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:45.533095    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e90944ba-b08f-4ad3-954a-63b1aebc0738-plugins-config-volume\") pod \"e90944ba-b08f-4ad3-954a-63b1aebc0738\" (UID: \"e90944ba-b08f-4ad3-954a-63b1aebc0738\") "
Sep 15 10:52:45.533537 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:45.533505    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03e32e2e-f197-41bf-bf27-5c6bab61a085-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "03e32e2e-f197-41bf-bf27-5c6bab61a085" (UID: "03e32e2e-f197-41bf-bf27-5c6bab61a085"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:52:45.533643 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:45.533501    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e90944ba-b08f-4ad3-954a-63b1aebc0738-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e90944ba-b08f-4ad3-954a-63b1aebc0738" (UID: "e90944ba-b08f-4ad3-954a-63b1aebc0738"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:52:45.535212 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:45.535184    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e90944ba-b08f-4ad3-954a-63b1aebc0738-kube-api-access-c2qrx" (OuterVolumeSpecName: "kube-api-access-c2qrx") pod "e90944ba-b08f-4ad3-954a-63b1aebc0738" (UID: "e90944ba-b08f-4ad3-954a-63b1aebc0738"). InnerVolumeSpecName "kube-api-access-c2qrx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:52:45.535311 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:45.535280    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03e32e2e-f197-41bf-bf27-5c6bab61a085-kube-api-access-jm9s4" (OuterVolumeSpecName: "kube-api-access-jm9s4") pod "03e32e2e-f197-41bf-bf27-5c6bab61a085" (UID: "03e32e2e-f197-41bf-bf27-5c6bab61a085"). InnerVolumeSpecName "kube-api-access-jm9s4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:52:45.634101 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:45.634066    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03e32e2e-f197-41bf-bf27-5c6bab61a085-plugins-config-volume\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:52:45.634101 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:45.634095    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jm9s4\" (UniqueName: \"kubernetes.io/projected/03e32e2e-f197-41bf-bf27-5c6bab61a085-kube-api-access-jm9s4\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:52:45.634101 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:45.634105    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e90944ba-b08f-4ad3-954a-63b1aebc0738-plugins-config-volume\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:52:45.634334 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:45.634113    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c2qrx\" (UniqueName: \"kubernetes.io/projected/e90944ba-b08f-4ad3-954a-63b1aebc0738-kube-api-access-c2qrx\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:52:46.440252 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:46.440178    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-5ffc6a-78d4cf65c9-7mkpp"
Sep 15 10:52:46.440778 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:46.440181    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-5ffc6a-78d4cf65c9-7mkpp" event={"ID":"e90944ba-b08f-4ad3-954a-63b1aebc0738","Type":"ContainerDied","Data":"40355aba334c7b664f6fe49ae57a918baaff6b75407778e534639675891066de"}
Sep 15 10:52:46.440778 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:46.440329    2579 scope.go:117] "RemoveContainer" containerID="2e6a3beec5c16fb08a749abeda6d9289cd95cf570342441e4bd58474149826d7"
Sep 15 10:52:46.441942 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:46.441876    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-5ffc6a-f49c4f7b6-jh95j" event={"ID":"03e32e2e-f197-41bf-bf27-5c6bab61a085","Type":"ContainerDied","Data":"b4955ff4dda12cd04e36e071719ec7e5c99ba9c03ec9d1a992368dab9ca1acf5"}
Sep 15 10:52:46.441942 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:46.441885    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-5ffc6a-f49c4f7b6-jh95j"
Sep 15 10:52:46.450822 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:46.450797    2579 scope.go:117] "RemoveContainer" containerID="6b994545426b267ee4f8f54ff593d84c88210906bbc3685d5e0066adc160a983"
Sep 15 10:52:46.466582 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:46.466552    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-5ffc6a-f49c4f7b6-jh95j"]
Sep 15 10:52:46.470047 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:46.470019    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-5ffc6a-f49c4f7b6-jh95j"]
Sep 15 10:52:46.481044 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:46.481013    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-5ffc6a-78d4cf65c9-7mkpp"]
Sep 15 10:52:46.486775 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:46.486748    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-5ffc6a-78d4cf65c9-7mkpp"]
Sep 15 10:52:47.150420 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:47.150388    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03e32e2e-f197-41bf-bf27-5c6bab61a085" path="/var/lib/kubelet/pods/03e32e2e-f197-41bf-bf27-5c6bab61a085/volumes"
Sep 15 10:52:47.150770 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:47.150753    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc7d17f1-c72d-41f6-aae5-9a708b28f536" path="/var/lib/kubelet/pods/bc7d17f1-c72d-41f6-aae5-9a708b28f536/volumes"
Sep 15 10:52:47.151099 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:47.151085    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e90944ba-b08f-4ad3-954a-63b1aebc0738" path="/var/lib/kubelet/pods/e90944ba-b08f-4ad3-954a-63b1aebc0738/volumes"
Sep 15 10:52:47.698850 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:52:47.698814    2579 scope.go:117] "RemoveContainer" containerID="183413cc742cfb38bdfe5fd41cfde6decc6d5fed1181fa1bf872e168ac63eaf7"
Sep 15 10:53:33.468607 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:33.468562    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6"]
Sep 15 10:53:33.469221 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:33.468816    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6" podUID="5015e69c-4595-4377-9eb6-fc025f3edf49" containerName="istio-proxy" containerID="cri-o://a4fe495f68574a60b927db9bf05e3b2f732094176ab36fa8673982becb2154d3" gracePeriod=30
Sep 15 10:53:33.820651 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:33.820605    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9f5ea7-7lmcp"]
Sep 15 10:53:33.821275 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:33.821256    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03e32e2e-f197-41bf-bf27-5c6bab61a085" containerName="payload-pre-processing"
Sep 15 10:53:33.821324 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:33.821280    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="03e32e2e-f197-41bf-bf27-5c6bab61a085" containerName="payload-pre-processing"
Sep 15 10:53:33.821324 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:33.821310    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e90944ba-b08f-4ad3-954a-63b1aebc0738" containerName="payload-processing"
Sep 15 10:53:33.821324 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:33.821319    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e90944ba-b08f-4ad3-954a-63b1aebc0738" containerName="payload-processing"
Sep 15 10:53:33.821419 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:33.821341    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc7d17f1-c72d-41f6-aae5-9a708b28f536" containerName="revoke-keys"
Sep 15 10:53:33.821419 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:33.821349    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc7d17f1-c72d-41f6-aae5-9a708b28f536" containerName="revoke-keys"
Sep 15 10:53:33.821483 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:33.821447    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e90944ba-b08f-4ad3-954a-63b1aebc0738" containerName="payload-processing"
Sep 15 10:53:33.821483 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:33.821461    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="03e32e2e-f197-41bf-bf27-5c6bab61a085" containerName="payload-pre-processing"
Sep 15 10:53:33.821483 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:33.821469    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc7d17f1-c72d-41f6-aae5-9a708b28f536" containerName="revoke-keys"
Sep 15 10:53:33.825090 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:33.825071    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9f5ea7-7lmcp"
Sep 15 10:53:33.827482 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:33.827455    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5jrzm\""
Sep 15 10:53:33.830257 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:33.830229    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9f5ea7-7lmcp"]
Sep 15 10:53:33.902567 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:33.902537    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6c17a6e-b1a3-40e4-acd4-4ffa8783ede5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-9f5ea7-7lmcp\" (UID: \"a6c17a6e-b1a3-40e4-acd4-4ffa8783ede5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9f5ea7-7lmcp"
Sep 15 10:53:34.004042 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:34.004002    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6c17a6e-b1a3-40e4-acd4-4ffa8783ede5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-9f5ea7-7lmcp\" (UID: \"a6c17a6e-b1a3-40e4-acd4-4ffa8783ede5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9f5ea7-7lmcp"
Sep 15 10:53:34.004763 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:34.004716    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6c17a6e-b1a3-40e4-acd4-4ffa8783ede5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-9f5ea7-7lmcp\" (UID: \"a6c17a6e-b1a3-40e4-acd4-4ffa8783ede5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9f5ea7-7lmcp"
Sep 15 10:53:34.138420 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:34.138336    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9f5ea7-7lmcp"
Sep 15 10:53:34.411097 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:34.411065    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9f5ea7-7lmcp"]
Sep 15 10:53:34.412590 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:53:34.412561    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6c17a6e_b1a3_40e4_acd4_4ffa8783ede5.slice/crio-55d572dc0f4883405f98dcf4c03629c34600ddc49b322338561bb1c71066355d WatchSource:0}: Error finding container 55d572dc0f4883405f98dcf4c03629c34600ddc49b322338561bb1c71066355d: Status 404 returned error can't find the container with id 55d572dc0f4883405f98dcf4c03629c34600ddc49b322338561bb1c71066355d
Sep 15 10:53:34.713306 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:34.713274    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9f5ea7-7lmcp" event={"ID":"a6c17a6e-b1a3-40e4-acd4-4ffa8783ede5","Type":"ContainerStarted","Data":"55d572dc0f4883405f98dcf4c03629c34600ddc49b322338561bb1c71066355d"}
Sep 15 10:53:35.721307 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:35.721271    2579 generic.go:356] "Generic (PLEG): container finished" podID="a6c17a6e-b1a3-40e4-acd4-4ffa8783ede5" containerID="861eb91da4f4f7bfbf6a2f70389f720acd17efc70256ed7ca8d0cd513b806266" exitCode=0
Sep 15 10:53:35.721684 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:35.721357    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9f5ea7-7lmcp" event={"ID":"a6c17a6e-b1a3-40e4-acd4-4ffa8783ede5","Type":"ContainerDied","Data":"861eb91da4f4f7bfbf6a2f70389f720acd17efc70256ed7ca8d0cd513b806266"}
Sep 15 10:53:36.863653 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:36.863629    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9f5ea7-7lmcp"
Sep 15 10:53:36.932220 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:36.932189    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6c17a6e-b1a3-40e4-acd4-4ffa8783ede5-maas-api-service-ca\") pod \"a6c17a6e-b1a3-40e4-acd4-4ffa8783ede5\" (UID: \"a6c17a6e-b1a3-40e4-acd4-4ffa8783ede5\") "
Sep 15 10:53:36.932538 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:36.932517    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6c17a6e-b1a3-40e4-acd4-4ffa8783ede5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a6c17a6e-b1a3-40e4-acd4-4ffa8783ede5" (UID: "a6c17a6e-b1a3-40e4-acd4-4ffa8783ede5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:53:37.033923 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:37.033888    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6c17a6e-b1a3-40e4-acd4-4ffa8783ede5-maas-api-service-ca\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:53:37.734037 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:37.734002    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9f5ea7-7lmcp"
Sep 15 10:53:37.734234 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:37.734056    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9f5ea7-7lmcp" event={"ID":"a6c17a6e-b1a3-40e4-acd4-4ffa8783ede5","Type":"ContainerDied","Data":"55d572dc0f4883405f98dcf4c03629c34600ddc49b322338561bb1c71066355d"}
Sep 15 10:53:37.734234 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:37.734142    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="55d572dc0f4883405f98dcf4c03629c34600ddc49b322338561bb1c71066355d"
Sep 15 10:53:38.742089 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:38.742015    2579 generic.go:356] "Generic (PLEG): container finished" podID="5015e69c-4595-4377-9eb6-fc025f3edf49" containerID="a4fe495f68574a60b927db9bf05e3b2f732094176ab36fa8673982becb2154d3" exitCode=0
Sep 15 10:53:38.742388 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:38.742085    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6" event={"ID":"5015e69c-4595-4377-9eb6-fc025f3edf49","Type":"ContainerDied","Data":"a4fe495f68574a60b927db9bf05e3b2f732094176ab36fa8673982becb2154d3"}
Sep 15 10:53:38.742388 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:38.742142    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6" event={"ID":"5015e69c-4595-4377-9eb6-fc025f3edf49","Type":"ContainerDied","Data":"56ae63f41b762287434d46f5868952991871e80f9a2033070849750bd36f0459"}
Sep 15 10:53:38.742388 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:38.742163    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="56ae63f41b762287434d46f5868952991871e80f9a2033070849750bd36f0459"
Sep 15 10:53:38.742388 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:38.742177    2579 scope.go:117] "RemoveContainer" containerID="28a82ee3920e43b395810f1c2edfdaadc9291bc535aa14e31ce8ae3ec8074ccc"
Sep 15 10:53:38.743355 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:38.743335    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6"
Sep 15 10:53:38.848449 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:38.848416    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5015e69c-4595-4377-9eb6-fc025f3edf49-istiod-ca-cert\") pod \"5015e69c-4595-4377-9eb6-fc025f3edf49\" (UID: \"5015e69c-4595-4377-9eb6-fc025f3edf49\") "
Sep 15 10:53:38.848449 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:38.848450    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5015e69c-4595-4377-9eb6-fc025f3edf49-workload-socket\") pod \"5015e69c-4595-4377-9eb6-fc025f3edf49\" (UID: \"5015e69c-4595-4377-9eb6-fc025f3edf49\") "
Sep 15 10:53:38.848693 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:38.848479    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5015e69c-4595-4377-9eb6-fc025f3edf49-istio-token\") pod \"5015e69c-4595-4377-9eb6-fc025f3edf49\" (UID: \"5015e69c-4595-4377-9eb6-fc025f3edf49\") "
Sep 15 10:53:38.848693 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:38.848501    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5015e69c-4595-4377-9eb6-fc025f3edf49-istio-podinfo\") pod \"5015e69c-4595-4377-9eb6-fc025f3edf49\" (UID: \"5015e69c-4595-4377-9eb6-fc025f3edf49\") "
Sep 15 10:53:38.848693 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:38.848552    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pq5gf\" (UniqueName: \"kubernetes.io/projected/5015e69c-4595-4377-9eb6-fc025f3edf49-kube-api-access-pq5gf\") pod \"5015e69c-4595-4377-9eb6-fc025f3edf49\" (UID: \"5015e69c-4595-4377-9eb6-fc025f3edf49\") "
Sep 15 10:53:38.848693 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:38.848622    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5015e69c-4595-4377-9eb6-fc025f3edf49-workload-certs\") pod \"5015e69c-4595-4377-9eb6-fc025f3edf49\" (UID: \"5015e69c-4595-4377-9eb6-fc025f3edf49\") "
Sep 15 10:53:38.848693 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:38.848660    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5015e69c-4595-4377-9eb6-fc025f3edf49-istio-envoy\") pod \"5015e69c-4595-4377-9eb6-fc025f3edf49\" (UID: \"5015e69c-4595-4377-9eb6-fc025f3edf49\") "
Sep 15 10:53:38.849006 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:38.848706    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5015e69c-4595-4377-9eb6-fc025f3edf49-istio-data\") pod \"5015e69c-4595-4377-9eb6-fc025f3edf49\" (UID: \"5015e69c-4595-4377-9eb6-fc025f3edf49\") "
Sep 15 10:53:38.849006 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:38.848757    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5015e69c-4595-4377-9eb6-fc025f3edf49-credential-socket\") pod \"5015e69c-4595-4377-9eb6-fc025f3edf49\" (UID: \"5015e69c-4595-4377-9eb6-fc025f3edf49\") "
Sep 15 10:53:38.849006 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:38.848783    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5015e69c-4595-4377-9eb6-fc025f3edf49-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5015e69c-4595-4377-9eb6-fc025f3edf49" (UID: "5015e69c-4595-4377-9eb6-fc025f3edf49"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:53:38.849006 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:38.848957    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5015e69c-4595-4377-9eb6-fc025f3edf49-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5015e69c-4595-4377-9eb6-fc025f3edf49" (UID: "5015e69c-4595-4377-9eb6-fc025f3edf49"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:53:38.849227 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:38.848954    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5015e69c-4595-4377-9eb6-fc025f3edf49-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5015e69c-4595-4377-9eb6-fc025f3edf49" (UID: "5015e69c-4595-4377-9eb6-fc025f3edf49"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:53:38.849227 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:38.849066    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5015e69c-4595-4377-9eb6-fc025f3edf49-istiod-ca-cert\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:53:38.849227 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:38.849085    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5015e69c-4595-4377-9eb6-fc025f3edf49-workload-socket\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:53:38.849227 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:38.849190    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5015e69c-4595-4377-9eb6-fc025f3edf49-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5015e69c-4595-4377-9eb6-fc025f3edf49" (UID: "5015e69c-4595-4377-9eb6-fc025f3edf49"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:53:38.849439 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:38.849236    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5015e69c-4595-4377-9eb6-fc025f3edf49-istio-data" (OuterVolumeSpecName: "istio-data") pod "5015e69c-4595-4377-9eb6-fc025f3edf49" (UID: "5015e69c-4595-4377-9eb6-fc025f3edf49"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:53:38.850688 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:38.850661    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5015e69c-4595-4377-9eb6-fc025f3edf49-istio-token" (OuterVolumeSpecName: "istio-token") pod "5015e69c-4595-4377-9eb6-fc025f3edf49" (UID: "5015e69c-4595-4377-9eb6-fc025f3edf49"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:53:38.850800 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:38.850773    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5015e69c-4595-4377-9eb6-fc025f3edf49-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5015e69c-4595-4377-9eb6-fc025f3edf49" (UID: "5015e69c-4595-4377-9eb6-fc025f3edf49"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:53:38.851137 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:38.851116    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5015e69c-4595-4377-9eb6-fc025f3edf49-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5015e69c-4595-4377-9eb6-fc025f3edf49" (UID: "5015e69c-4595-4377-9eb6-fc025f3edf49"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 10:53:38.851228 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:38.851144    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5015e69c-4595-4377-9eb6-fc025f3edf49-kube-api-access-pq5gf" (OuterVolumeSpecName: "kube-api-access-pq5gf") pod "5015e69c-4595-4377-9eb6-fc025f3edf49" (UID: "5015e69c-4595-4377-9eb6-fc025f3edf49"). InnerVolumeSpecName "kube-api-access-pq5gf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:53:38.950147 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:38.950116    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5015e69c-4595-4377-9eb6-fc025f3edf49-workload-certs\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:53:38.950147 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:38.950145    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5015e69c-4595-4377-9eb6-fc025f3edf49-istio-envoy\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:53:38.950147 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:38.950154    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5015e69c-4595-4377-9eb6-fc025f3edf49-istio-data\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:53:38.950369 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:38.950162    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5015e69c-4595-4377-9eb6-fc025f3edf49-credential-socket\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:53:38.950369 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:38.950171    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5015e69c-4595-4377-9eb6-fc025f3edf49-istio-token\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:53:38.950369 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:38.950179    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5015e69c-4595-4377-9eb6-fc025f3edf49-istio-podinfo\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:53:38.950369 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:38.950187    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pq5gf\" (UniqueName: \"kubernetes.io/projected/5015e69c-4595-4377-9eb6-fc025f3edf49-kube-api-access-pq5gf\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:53:39.749135 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:39.749099    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6"
Sep 15 10:53:39.783358 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:39.783330    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6"]
Sep 15 10:53:39.785975 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:39.785952    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-5ffc6a-openshift-default-56b5cbdf68-k8qh6"]
Sep 15 10:53:41.149501 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:41.149468    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5015e69c-4595-4377-9eb6-fc025f3edf49" path="/var/lib/kubelet/pods/5015e69c-4595-4377-9eb6-fc025f3edf49/volumes"
Sep 15 10:53:44.264903 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:44.264868    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-9f5ea7-5b8956757-fbr52"]
Sep 15 10:53:44.265417 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:44.265236    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-9f5ea7-5b8956757-fbr52" podUID="2cf64c94-3f7e-4872-afdc-298e629e9c63" containerName="payload-processing" containerID="cri-o://adec66c221d3eec631766b1a847fea27e7d834cd88eb091bba9f47fe84907a9e" gracePeriod=30
Sep 15 10:53:44.268272 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:44.268251    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-9f5ea7-5f7f67dd54-ddzqk"]
Sep 15 10:53:44.268459 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:44.268433    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9f5ea7-5f7f67dd54-ddzqk" podUID="845b9804-29cd-46e4-8978-7bc08994c28a" containerName="payload-pre-processing" containerID="cri-o://8a4d1a2296def22f4ff48c2b5a0207e94406249f050bfb39d69603bccf5dddf3" gracePeriod=30
Sep 15 10:53:44.407268 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:44.407200    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9f5ea7-7lmcp"]
Sep 15 10:53:44.411104 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:44.411059    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9f5ea7-7lmcp"]
Sep 15 10:53:44.572895 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:44.572874    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9f5ea7-5f7f67dd54-ddzqk"
Sep 15 10:53:44.580185 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:44.580159    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-9f5ea7-5b8956757-fbr52"
Sep 15 10:53:44.707498 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:44.707454    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fs55h\" (UniqueName: \"kubernetes.io/projected/2cf64c94-3f7e-4872-afdc-298e629e9c63-kube-api-access-fs55h\") pod \"2cf64c94-3f7e-4872-afdc-298e629e9c63\" (UID: \"2cf64c94-3f7e-4872-afdc-298e629e9c63\") "
Sep 15 10:53:44.707698 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:44.707526    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2cf64c94-3f7e-4872-afdc-298e629e9c63-plugins-config-volume\") pod \"2cf64c94-3f7e-4872-afdc-298e629e9c63\" (UID: \"2cf64c94-3f7e-4872-afdc-298e629e9c63\") "
Sep 15 10:53:44.707698 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:44.707656    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86x22\" (UniqueName: \"kubernetes.io/projected/845b9804-29cd-46e4-8978-7bc08994c28a-kube-api-access-86x22\") pod \"845b9804-29cd-46e4-8978-7bc08994c28a\" (UID: \"845b9804-29cd-46e4-8978-7bc08994c28a\") "
Sep 15 10:53:44.707828 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:44.707770    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/845b9804-29cd-46e4-8978-7bc08994c28a-plugins-config-volume\") pod \"845b9804-29cd-46e4-8978-7bc08994c28a\" (UID: \"845b9804-29cd-46e4-8978-7bc08994c28a\") "
Sep 15 10:53:44.708108 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:44.708060    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2cf64c94-3f7e-4872-afdc-298e629e9c63-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2cf64c94-3f7e-4872-afdc-298e629e9c63" (UID: "2cf64c94-3f7e-4872-afdc-298e629e9c63"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:53:44.708108 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:44.708087    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/845b9804-29cd-46e4-8978-7bc08994c28a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "845b9804-29cd-46e4-8978-7bc08994c28a" (UID: "845b9804-29cd-46e4-8978-7bc08994c28a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:53:44.710223 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:44.710198    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cf64c94-3f7e-4872-afdc-298e629e9c63-kube-api-access-fs55h" (OuterVolumeSpecName: "kube-api-access-fs55h") pod "2cf64c94-3f7e-4872-afdc-298e629e9c63" (UID: "2cf64c94-3f7e-4872-afdc-298e629e9c63"). InnerVolumeSpecName "kube-api-access-fs55h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:53:44.710339 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:44.710234    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/845b9804-29cd-46e4-8978-7bc08994c28a-kube-api-access-86x22" (OuterVolumeSpecName: "kube-api-access-86x22") pod "845b9804-29cd-46e4-8978-7bc08994c28a" (UID: "845b9804-29cd-46e4-8978-7bc08994c28a"). InnerVolumeSpecName "kube-api-access-86x22". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:53:44.781910 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:44.781878    2579 generic.go:356] "Generic (PLEG): container finished" podID="845b9804-29cd-46e4-8978-7bc08994c28a" containerID="8a4d1a2296def22f4ff48c2b5a0207e94406249f050bfb39d69603bccf5dddf3" exitCode=0
Sep 15 10:53:44.782118 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:44.781925    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9f5ea7-5f7f67dd54-ddzqk"
Sep 15 10:53:44.782118 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:44.781962    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9f5ea7-5f7f67dd54-ddzqk" event={"ID":"845b9804-29cd-46e4-8978-7bc08994c28a","Type":"ContainerDied","Data":"8a4d1a2296def22f4ff48c2b5a0207e94406249f050bfb39d69603bccf5dddf3"}
Sep 15 10:53:44.782118 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:44.782022    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9f5ea7-5f7f67dd54-ddzqk" event={"ID":"845b9804-29cd-46e4-8978-7bc08994c28a","Type":"ContainerDied","Data":"e7562d3d653a68ef35d441c29d96f383fbcdc997bd38f5a4a4b87e3ea93866c6"}
Sep 15 10:53:44.782118 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:44.782052    2579 scope.go:117] "RemoveContainer" containerID="8a4d1a2296def22f4ff48c2b5a0207e94406249f050bfb39d69603bccf5dddf3"
Sep 15 10:53:44.783392 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:44.783372    2579 generic.go:356] "Generic (PLEG): container finished" podID="2cf64c94-3f7e-4872-afdc-298e629e9c63" containerID="adec66c221d3eec631766b1a847fea27e7d834cd88eb091bba9f47fe84907a9e" exitCode=0
Sep 15 10:53:44.783498 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:44.783405    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-9f5ea7-5b8956757-fbr52" event={"ID":"2cf64c94-3f7e-4872-afdc-298e629e9c63","Type":"ContainerDied","Data":"adec66c221d3eec631766b1a847fea27e7d834cd88eb091bba9f47fe84907a9e"}
Sep 15 10:53:44.783498 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:44.783434    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-9f5ea7-5b8956757-fbr52"
Sep 15 10:53:44.783498 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:44.783462    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-9f5ea7-5b8956757-fbr52" event={"ID":"2cf64c94-3f7e-4872-afdc-298e629e9c63","Type":"ContainerDied","Data":"63d563e0d0411815642e7ee3141dad1c947af2a68ee9d065706dd2489f1f0408"}
Sep 15 10:53:44.790964 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:44.790944    2579 scope.go:117] "RemoveContainer" containerID="8a4d1a2296def22f4ff48c2b5a0207e94406249f050bfb39d69603bccf5dddf3"
Sep 15 10:53:44.791250 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:53:44.791230    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a4d1a2296def22f4ff48c2b5a0207e94406249f050bfb39d69603bccf5dddf3\": container with ID starting with 8a4d1a2296def22f4ff48c2b5a0207e94406249f050bfb39d69603bccf5dddf3 not found: ID does not exist" containerID="8a4d1a2296def22f4ff48c2b5a0207e94406249f050bfb39d69603bccf5dddf3"
Sep 15 10:53:44.791325 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:44.791258    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a4d1a2296def22f4ff48c2b5a0207e94406249f050bfb39d69603bccf5dddf3"} err="failed to get container status \"8a4d1a2296def22f4ff48c2b5a0207e94406249f050bfb39d69603bccf5dddf3\": rpc error: code = NotFound desc = could not find container \"8a4d1a2296def22f4ff48c2b5a0207e94406249f050bfb39d69603bccf5dddf3\": container with ID starting with 8a4d1a2296def22f4ff48c2b5a0207e94406249f050bfb39d69603bccf5dddf3 not found: ID does not exist"
Sep 15 10:53:44.791325 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:44.791275    2579 scope.go:117] "RemoveContainer" containerID="adec66c221d3eec631766b1a847fea27e7d834cd88eb091bba9f47fe84907a9e"
Sep 15 10:53:44.800080 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:44.800057    2579 scope.go:117] "RemoveContainer" containerID="adec66c221d3eec631766b1a847fea27e7d834cd88eb091bba9f47fe84907a9e"
Sep 15 10:53:44.800385 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:53:44.800366    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"adec66c221d3eec631766b1a847fea27e7d834cd88eb091bba9f47fe84907a9e\": container with ID starting with adec66c221d3eec631766b1a847fea27e7d834cd88eb091bba9f47fe84907a9e not found: ID does not exist" containerID="adec66c221d3eec631766b1a847fea27e7d834cd88eb091bba9f47fe84907a9e"
Sep 15 10:53:44.800480 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:44.800390    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adec66c221d3eec631766b1a847fea27e7d834cd88eb091bba9f47fe84907a9e"} err="failed to get container status \"adec66c221d3eec631766b1a847fea27e7d834cd88eb091bba9f47fe84907a9e\": rpc error: code = NotFound desc = could not find container \"adec66c221d3eec631766b1a847fea27e7d834cd88eb091bba9f47fe84907a9e\": container with ID starting with adec66c221d3eec631766b1a847fea27e7d834cd88eb091bba9f47fe84907a9e not found: ID does not exist"
Sep 15 10:53:44.807351 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:44.807327    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-9f5ea7-5b8956757-fbr52"]
Sep 15 10:53:44.808736 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:44.808706    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86x22\" (UniqueName: \"kubernetes.io/projected/845b9804-29cd-46e4-8978-7bc08994c28a-kube-api-access-86x22\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:53:44.808831 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:44.808757    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/845b9804-29cd-46e4-8978-7bc08994c28a-plugins-config-volume\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:53:44.808831 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:44.808773    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fs55h\" (UniqueName: \"kubernetes.io/projected/2cf64c94-3f7e-4872-afdc-298e629e9c63-kube-api-access-fs55h\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:53:44.808831 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:44.808785    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2cf64c94-3f7e-4872-afdc-298e629e9c63-plugins-config-volume\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:53:44.813190 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:44.813164    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-9f5ea7-5b8956757-fbr52"]
Sep 15 10:53:44.822924 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:44.822900    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-9f5ea7-5f7f67dd54-ddzqk"]
Sep 15 10:53:44.826005 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:44.825986    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-9f5ea7-5f7f67dd54-ddzqk"]
Sep 15 10:53:45.149788 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:45.149700    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2cf64c94-3f7e-4872-afdc-298e629e9c63" path="/var/lib/kubelet/pods/2cf64c94-3f7e-4872-afdc-298e629e9c63/volumes"
Sep 15 10:53:45.150080 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:45.150067    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="845b9804-29cd-46e4-8978-7bc08994c28a" path="/var/lib/kubelet/pods/845b9804-29cd-46e4-8978-7bc08994c28a/volumes"
Sep 15 10:53:45.150359 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:45.150348    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6c17a6e-b1a3-40e4-acd4-4ffa8783ede5" path="/var/lib/kubelet/pods/a6c17a6e-b1a3-40e4-acd4-4ffa8783ede5/volumes"
Sep 15 10:53:50.792208 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:50.792170    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt"]
Sep 15 10:53:50.792653 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:50.792440    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt" podUID="9da531c0-1e7c-4508-8069-2424401f67ef" containerName="istio-proxy" containerID="cri-o://40d4f4c483c6c532888e6fa4c64939872530ac17620240d0e5744937dab4fd2d" gracePeriod=30
Sep 15 10:53:51.138252 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:51.138160    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-83e814-b98jm"]
Sep 15 10:53:51.138662 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:51.138642    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5015e69c-4595-4377-9eb6-fc025f3edf49" containerName="istio-proxy"
Sep 15 10:53:51.138767 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:51.138664    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5015e69c-4595-4377-9eb6-fc025f3edf49" containerName="istio-proxy"
Sep 15 10:53:51.138767 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:51.138675    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="845b9804-29cd-46e4-8978-7bc08994c28a" containerName="payload-pre-processing"
Sep 15 10:53:51.138767 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:51.138683    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="845b9804-29cd-46e4-8978-7bc08994c28a" containerName="payload-pre-processing"
Sep 15 10:53:51.138767 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:51.138694    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cf64c94-3f7e-4872-afdc-298e629e9c63" containerName="payload-processing"
Sep 15 10:53:51.138767 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:51.138703    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cf64c94-3f7e-4872-afdc-298e629e9c63" containerName="payload-processing"
Sep 15 10:53:51.138767 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:51.138713    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6c17a6e-b1a3-40e4-acd4-4ffa8783ede5" containerName="revoke-keys"
Sep 15 10:53:51.138767 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:51.138752    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6c17a6e-b1a3-40e4-acd4-4ffa8783ede5" containerName="revoke-keys"
Sep 15 10:53:51.139135 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:51.138776    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5015e69c-4595-4377-9eb6-fc025f3edf49" containerName="istio-proxy"
Sep 15 10:53:51.139135 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:51.138784    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5015e69c-4595-4377-9eb6-fc025f3edf49" containerName="istio-proxy"
Sep 15 10:53:51.139135 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:51.138897    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5015e69c-4595-4377-9eb6-fc025f3edf49" containerName="istio-proxy"
Sep 15 10:53:51.139135 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:51.138910    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="845b9804-29cd-46e4-8978-7bc08994c28a" containerName="payload-pre-processing"
Sep 15 10:53:51.139135 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:51.138919    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6c17a6e-b1a3-40e4-acd4-4ffa8783ede5" containerName="revoke-keys"
Sep 15 10:53:51.139135 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:51.138932    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5015e69c-4595-4377-9eb6-fc025f3edf49" containerName="istio-proxy"
Sep 15 10:53:51.139135 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:51.138940    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2cf64c94-3f7e-4872-afdc-298e629e9c63" containerName="payload-processing"
Sep 15 10:53:51.143834 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:51.143806    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-83e814-b98jm"
Sep 15 10:53:51.146217 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:51.146185    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5jrzm\""
Sep 15 10:53:51.152122 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:51.152092    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-83e814-b98jm"]
Sep 15 10:53:51.269361 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:51.269322    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9a1cf70-a968-411c-a527-a382707e98b1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-83e814-b98jm\" (UID: \"f9a1cf70-a968-411c-a527-a382707e98b1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-83e814-b98jm"
Sep 15 10:53:51.370734 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:51.370687    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9a1cf70-a968-411c-a527-a382707e98b1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-83e814-b98jm\" (UID: \"f9a1cf70-a968-411c-a527-a382707e98b1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-83e814-b98jm"
Sep 15 10:53:51.371324 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:51.371304    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9a1cf70-a968-411c-a527-a382707e98b1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-83e814-b98jm\" (UID: \"f9a1cf70-a968-411c-a527-a382707e98b1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-83e814-b98jm"
Sep 15 10:53:51.457600 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:51.457509    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-83e814-b98jm"
Sep 15 10:53:51.728608 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:51.728578    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-83e814-b98jm"]
Sep 15 10:53:51.729983 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:53:51.729954    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9a1cf70_a968_411c_a527_a382707e98b1.slice/crio-3b779837f587f1e3899d035468d8eeb93c2a8432e923439f942161b587e22326 WatchSource:0}: Error finding container 3b779837f587f1e3899d035468d8eeb93c2a8432e923439f942161b587e22326: Status 404 returned error can't find the container with id 3b779837f587f1e3899d035468d8eeb93c2a8432e923439f942161b587e22326
Sep 15 10:53:51.825595 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:51.825557    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-83e814-b98jm" event={"ID":"f9a1cf70-a968-411c-a527-a382707e98b1","Type":"ContainerStarted","Data":"3b779837f587f1e3899d035468d8eeb93c2a8432e923439f942161b587e22326"}
Sep 15 10:53:52.833594 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:52.833537    2579 generic.go:356] "Generic (PLEG): container finished" podID="f9a1cf70-a968-411c-a527-a382707e98b1" containerID="6f02094505293f51fc5556ba853508900aa592b9c7d54acc4fd87f6c3412aaeb" exitCode=0
Sep 15 10:53:52.834821 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:52.833985    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-83e814-b98jm" event={"ID":"f9a1cf70-a968-411c-a527-a382707e98b1","Type":"ContainerDied","Data":"6f02094505293f51fc5556ba853508900aa592b9c7d54acc4fd87f6c3412aaeb"}
Sep 15 10:53:53.980915 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:53.980891    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-83e814-b98jm"
Sep 15 10:53:54.095101 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:54.094998    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9a1cf70-a968-411c-a527-a382707e98b1-maas-api-service-ca\") pod \"f9a1cf70-a968-411c-a527-a382707e98b1\" (UID: \"f9a1cf70-a968-411c-a527-a382707e98b1\") "
Sep 15 10:53:54.095371 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:54.095347    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9a1cf70-a968-411c-a527-a382707e98b1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f9a1cf70-a968-411c-a527-a382707e98b1" (UID: "f9a1cf70-a968-411c-a527-a382707e98b1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:53:54.196546 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:54.196512    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9a1cf70-a968-411c-a527-a382707e98b1-maas-api-service-ca\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:53:54.846746 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:54.846692    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-83e814-b98jm"
Sep 15 10:53:54.846989 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:54.846694    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-83e814-b98jm" event={"ID":"f9a1cf70-a968-411c-a527-a382707e98b1","Type":"ContainerDied","Data":"3b779837f587f1e3899d035468d8eeb93c2a8432e923439f942161b587e22326"}
Sep 15 10:53:54.846989 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:54.846828    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b779837f587f1e3899d035468d8eeb93c2a8432e923439f942161b587e22326"
Sep 15 10:53:55.917999 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:55.917968    2579 patch_prober.go:28] interesting pod/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Sep 15 10:53:55.918399 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:55.918024    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt" podUID="9da531c0-1e7c-4508-8069-2424401f67ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Sep 15 10:53:56.078621 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:56.078598    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt"
Sep 15 10:53:56.216169 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:56.216133    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9da531c0-1e7c-4508-8069-2424401f67ef-istio-podinfo\") pod \"9da531c0-1e7c-4508-8069-2424401f67ef\" (UID: \"9da531c0-1e7c-4508-8069-2424401f67ef\") "
Sep 15 10:53:56.216169 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:56.216174    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9da531c0-1e7c-4508-8069-2424401f67ef-istio-data\") pod \"9da531c0-1e7c-4508-8069-2424401f67ef\" (UID: \"9da531c0-1e7c-4508-8069-2424401f67ef\") "
Sep 15 10:53:56.216423 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:56.216199    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9da531c0-1e7c-4508-8069-2424401f67ef-istio-envoy\") pod \"9da531c0-1e7c-4508-8069-2424401f67ef\" (UID: \"9da531c0-1e7c-4508-8069-2424401f67ef\") "
Sep 15 10:53:56.216423 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:56.216236    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9da531c0-1e7c-4508-8069-2424401f67ef-istio-token\") pod \"9da531c0-1e7c-4508-8069-2424401f67ef\" (UID: \"9da531c0-1e7c-4508-8069-2424401f67ef\") "
Sep 15 10:53:56.216423 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:56.216294    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rjpt\" (UniqueName: \"kubernetes.io/projected/9da531c0-1e7c-4508-8069-2424401f67ef-kube-api-access-9rjpt\") pod \"9da531c0-1e7c-4508-8069-2424401f67ef\" (UID: \"9da531c0-1e7c-4508-8069-2424401f67ef\") "
Sep 15 10:53:56.216423 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:56.216329    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9da531c0-1e7c-4508-8069-2424401f67ef-credential-socket\") pod \"9da531c0-1e7c-4508-8069-2424401f67ef\" (UID: \"9da531c0-1e7c-4508-8069-2424401f67ef\") "
Sep 15 10:53:56.216423 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:56.216369    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9da531c0-1e7c-4508-8069-2424401f67ef-workload-socket\") pod \"9da531c0-1e7c-4508-8069-2424401f67ef\" (UID: \"9da531c0-1e7c-4508-8069-2424401f67ef\") "
Sep 15 10:53:56.216423 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:56.216419    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9da531c0-1e7c-4508-8069-2424401f67ef-istiod-ca-cert\") pod \"9da531c0-1e7c-4508-8069-2424401f67ef\" (UID: \"9da531c0-1e7c-4508-8069-2424401f67ef\") "
Sep 15 10:53:56.216770 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:56.216448    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9da531c0-1e7c-4508-8069-2424401f67ef-workload-certs\") pod \"9da531c0-1e7c-4508-8069-2424401f67ef\" (UID: \"9da531c0-1e7c-4508-8069-2424401f67ef\") "
Sep 15 10:53:56.216770 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:56.216460    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9da531c0-1e7c-4508-8069-2424401f67ef-istio-data" (OuterVolumeSpecName: "istio-data") pod "9da531c0-1e7c-4508-8069-2424401f67ef" (UID: "9da531c0-1e7c-4508-8069-2424401f67ef"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:53:56.216770 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:56.216630    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9da531c0-1e7c-4508-8069-2424401f67ef-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9da531c0-1e7c-4508-8069-2424401f67ef" (UID: "9da531c0-1e7c-4508-8069-2424401f67ef"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:53:56.216770 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:56.216666    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9da531c0-1e7c-4508-8069-2424401f67ef-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9da531c0-1e7c-4508-8069-2424401f67ef" (UID: "9da531c0-1e7c-4508-8069-2424401f67ef"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:53:56.216995 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:56.216814    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9da531c0-1e7c-4508-8069-2424401f67ef-workload-socket\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:53:56.216995 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:56.216834    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9da531c0-1e7c-4508-8069-2424401f67ef-istio-data\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:53:56.216995 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:56.216849    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9da531c0-1e7c-4508-8069-2424401f67ef-credential-socket\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:53:56.217245 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:56.217058    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9da531c0-1e7c-4508-8069-2424401f67ef-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9da531c0-1e7c-4508-8069-2424401f67ef" (UID: "9da531c0-1e7c-4508-8069-2424401f67ef"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:53:56.217327 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:56.217311    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9da531c0-1e7c-4508-8069-2424401f67ef-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9da531c0-1e7c-4508-8069-2424401f67ef" (UID: "9da531c0-1e7c-4508-8069-2424401f67ef"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:53:56.218521 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:56.218493    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9da531c0-1e7c-4508-8069-2424401f67ef-kube-api-access-9rjpt" (OuterVolumeSpecName: "kube-api-access-9rjpt") pod "9da531c0-1e7c-4508-8069-2424401f67ef" (UID: "9da531c0-1e7c-4508-8069-2424401f67ef"). InnerVolumeSpecName "kube-api-access-9rjpt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:53:56.218904 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:56.218887    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9da531c0-1e7c-4508-8069-2424401f67ef-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9da531c0-1e7c-4508-8069-2424401f67ef" (UID: "9da531c0-1e7c-4508-8069-2424401f67ef"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:53:56.218972 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:56.218902    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9da531c0-1e7c-4508-8069-2424401f67ef-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9da531c0-1e7c-4508-8069-2424401f67ef" (UID: "9da531c0-1e7c-4508-8069-2424401f67ef"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 10:53:56.219359 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:56.219344    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9da531c0-1e7c-4508-8069-2424401f67ef-istio-token" (OuterVolumeSpecName: "istio-token") pod "9da531c0-1e7c-4508-8069-2424401f67ef" (UID: "9da531c0-1e7c-4508-8069-2424401f67ef"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:53:56.318106 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:56.318020    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rjpt\" (UniqueName: \"kubernetes.io/projected/9da531c0-1e7c-4508-8069-2424401f67ef-kube-api-access-9rjpt\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:53:56.318106 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:56.318053    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9da531c0-1e7c-4508-8069-2424401f67ef-istiod-ca-cert\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:53:56.318106 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:56.318063    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9da531c0-1e7c-4508-8069-2424401f67ef-workload-certs\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:53:56.318106 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:56.318071    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9da531c0-1e7c-4508-8069-2424401f67ef-istio-podinfo\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:53:56.318106 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:56.318079    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9da531c0-1e7c-4508-8069-2424401f67ef-istio-envoy\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:53:56.318106 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:56.318086    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9da531c0-1e7c-4508-8069-2424401f67ef-istio-token\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:53:56.865593 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:56.865558    2579 generic.go:356] "Generic (PLEG): container finished" podID="9da531c0-1e7c-4508-8069-2424401f67ef" containerID="40d4f4c483c6c532888e6fa4c64939872530ac17620240d0e5744937dab4fd2d" exitCode=0
Sep 15 10:53:56.865837 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:56.865619    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt"
Sep 15 10:53:56.865837 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:56.865643    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt" event={"ID":"9da531c0-1e7c-4508-8069-2424401f67ef","Type":"ContainerDied","Data":"40d4f4c483c6c532888e6fa4c64939872530ac17620240d0e5744937dab4fd2d"}
Sep 15 10:53:56.865837 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:56.865751    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt" event={"ID":"9da531c0-1e7c-4508-8069-2424401f67ef","Type":"ContainerDied","Data":"9404c051efd9591191d94ec7784b5ffcf081fd703b5f7fc8c9862f0f4d814863"}
Sep 15 10:53:56.865837 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:56.865782    2579 scope.go:117] "RemoveContainer" containerID="40d4f4c483c6c532888e6fa4c64939872530ac17620240d0e5744937dab4fd2d"
Sep 15 10:53:56.875697 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:56.875677    2579 scope.go:117] "RemoveContainer" containerID="25a3caaad2f8d72cce93cb733da70e82aa22c2882a7b76feadf2210192ed304b"
Sep 15 10:53:56.884265 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:56.884248    2579 scope.go:117] "RemoveContainer" containerID="40d4f4c483c6c532888e6fa4c64939872530ac17620240d0e5744937dab4fd2d"
Sep 15 10:53:56.884535 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:53:56.884518    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40d4f4c483c6c532888e6fa4c64939872530ac17620240d0e5744937dab4fd2d\": container with ID starting with 40d4f4c483c6c532888e6fa4c64939872530ac17620240d0e5744937dab4fd2d not found: ID does not exist" containerID="40d4f4c483c6c532888e6fa4c64939872530ac17620240d0e5744937dab4fd2d"
Sep 15 10:53:56.884586 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:56.884544    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40d4f4c483c6c532888e6fa4c64939872530ac17620240d0e5744937dab4fd2d"} err="failed to get container status \"40d4f4c483c6c532888e6fa4c64939872530ac17620240d0e5744937dab4fd2d\": rpc error: code = NotFound desc = could not find container \"40d4f4c483c6c532888e6fa4c64939872530ac17620240d0e5744937dab4fd2d\": container with ID starting with 40d4f4c483c6c532888e6fa4c64939872530ac17620240d0e5744937dab4fd2d not found: ID does not exist"
Sep 15 10:53:56.884586 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:56.884559    2579 scope.go:117] "RemoveContainer" containerID="25a3caaad2f8d72cce93cb733da70e82aa22c2882a7b76feadf2210192ed304b"
Sep 15 10:53:56.884792 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:53:56.884772    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25a3caaad2f8d72cce93cb733da70e82aa22c2882a7b76feadf2210192ed304b\": container with ID starting with 25a3caaad2f8d72cce93cb733da70e82aa22c2882a7b76feadf2210192ed304b not found: ID does not exist" containerID="25a3caaad2f8d72cce93cb733da70e82aa22c2882a7b76feadf2210192ed304b"
Sep 15 10:53:56.884863 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:56.884801    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25a3caaad2f8d72cce93cb733da70e82aa22c2882a7b76feadf2210192ed304b"} err="failed to get container status \"25a3caaad2f8d72cce93cb733da70e82aa22c2882a7b76feadf2210192ed304b\": rpc error: code = NotFound desc = could not find container \"25a3caaad2f8d72cce93cb733da70e82aa22c2882a7b76feadf2210192ed304b\": container with ID starting with 25a3caaad2f8d72cce93cb733da70e82aa22c2882a7b76feadf2210192ed304b not found: ID does not exist"
Sep 15 10:53:56.888486 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:56.888467    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt"]
Sep 15 10:53:56.893087 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:56.893067    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-9f5ea7-openshift-default-7dffd5f74-g4mlt"]
Sep 15 10:53:57.149035 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:53:57.148940    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9da531c0-1e7c-4508-8069-2424401f67ef" path="/var/lib/kubelet/pods/9da531c0-1e7c-4508-8069-2424401f67ef/volumes"
Sep 15 10:54:01.736693 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:01.736654    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-83e814-5c85f7cf98-864qt"]
Sep 15 10:54:01.737181 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:01.736924    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-83e814-5c85f7cf98-864qt" podUID="a5799485-0215-4c88-bcaa-843408dbbcb0" containerName="payload-pre-processing" containerID="cri-o://0fe4056ca87792d45eac170a25218e004a4ea7a23496ce982a8524ee13287ed1" gracePeriod=30
Sep 15 10:54:01.875532 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:01.875450    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-83e814-b98jm"]
Sep 15 10:54:01.877714 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:01.877684    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-83e814-b98jm"]
Sep 15 10:54:01.894921 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:01.894890    2579 generic.go:356] "Generic (PLEG): container finished" podID="a5799485-0215-4c88-bcaa-843408dbbcb0" containerID="0fe4056ca87792d45eac170a25218e004a4ea7a23496ce982a8524ee13287ed1" exitCode=0
Sep 15 10:54:01.895080 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:01.894948    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-83e814-5c85f7cf98-864qt" event={"ID":"a5799485-0215-4c88-bcaa-843408dbbcb0","Type":"ContainerDied","Data":"0fe4056ca87792d45eac170a25218e004a4ea7a23496ce982a8524ee13287ed1"}
Sep 15 10:54:02.004802 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:02.004767    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-83e814-5c85f7cf98-864qt"
Sep 15 10:54:02.171786 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:02.171745    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a5799485-0215-4c88-bcaa-843408dbbcb0-plugins-config-volume\") pod \"a5799485-0215-4c88-bcaa-843408dbbcb0\" (UID: \"a5799485-0215-4c88-bcaa-843408dbbcb0\") "
Sep 15 10:54:02.171985 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:02.171805    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fds68\" (UniqueName: \"kubernetes.io/projected/a5799485-0215-4c88-bcaa-843408dbbcb0-kube-api-access-fds68\") pod \"a5799485-0215-4c88-bcaa-843408dbbcb0\" (UID: \"a5799485-0215-4c88-bcaa-843408dbbcb0\") "
Sep 15 10:54:02.172140 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:02.172115    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5799485-0215-4c88-bcaa-843408dbbcb0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a5799485-0215-4c88-bcaa-843408dbbcb0" (UID: "a5799485-0215-4c88-bcaa-843408dbbcb0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:54:02.173883 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:02.173850    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5799485-0215-4c88-bcaa-843408dbbcb0-kube-api-access-fds68" (OuterVolumeSpecName: "kube-api-access-fds68") pod "a5799485-0215-4c88-bcaa-843408dbbcb0" (UID: "a5799485-0215-4c88-bcaa-843408dbbcb0"). InnerVolumeSpecName "kube-api-access-fds68". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:54:02.272906 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:02.272813    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fds68\" (UniqueName: \"kubernetes.io/projected/a5799485-0215-4c88-bcaa-843408dbbcb0-kube-api-access-fds68\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:54:02.272906 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:02.272844    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a5799485-0215-4c88-bcaa-843408dbbcb0-plugins-config-volume\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:54:02.903608 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:02.903575    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-83e814-5c85f7cf98-864qt"
Sep 15 10:54:02.903608 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:02.903594    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-83e814-5c85f7cf98-864qt" event={"ID":"a5799485-0215-4c88-bcaa-843408dbbcb0","Type":"ContainerDied","Data":"2280699f5bea77aa887bf9a920fd597a6dffc41b432b111a3983e850e9ff3448"}
Sep 15 10:54:02.904172 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:02.903716    2579 scope.go:117] "RemoveContainer" containerID="0fe4056ca87792d45eac170a25218e004a4ea7a23496ce982a8524ee13287ed1"
Sep 15 10:54:02.925694 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:02.925662    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-83e814-5c85f7cf98-864qt"]
Sep 15 10:54:02.927508 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:02.927487    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-83e814-5c85f7cf98-864qt"]
Sep 15 10:54:03.149738 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:03.149691    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5799485-0215-4c88-bcaa-843408dbbcb0" path="/var/lib/kubelet/pods/a5799485-0215-4c88-bcaa-843408dbbcb0/volumes"
Sep 15 10:54:03.150055 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:03.150042    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9a1cf70-a968-411c-a527-a382707e98b1" path="/var/lib/kubelet/pods/f9a1cf70-a968-411c-a527-a382707e98b1/volumes"
Sep 15 10:54:08.904010 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:08.903975    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-44134e-9fn76"]
Sep 15 10:54:08.904487 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:08.904366    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5799485-0215-4c88-bcaa-843408dbbcb0" containerName="payload-pre-processing"
Sep 15 10:54:08.904487 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:08.904377    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5799485-0215-4c88-bcaa-843408dbbcb0" containerName="payload-pre-processing"
Sep 15 10:54:08.904487 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:08.904387    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9da531c0-1e7c-4508-8069-2424401f67ef" containerName="istio-proxy"
Sep 15 10:54:08.904487 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:08.904402    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9da531c0-1e7c-4508-8069-2424401f67ef" containerName="istio-proxy"
Sep 15 10:54:08.904487 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:08.904420    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9a1cf70-a968-411c-a527-a382707e98b1" containerName="revoke-keys"
Sep 15 10:54:08.904487 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:08.904425    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9a1cf70-a968-411c-a527-a382707e98b1" containerName="revoke-keys"
Sep 15 10:54:08.904487 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:08.904482    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9a1cf70-a968-411c-a527-a382707e98b1" containerName="revoke-keys"
Sep 15 10:54:08.904487 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:08.904492    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9da531c0-1e7c-4508-8069-2424401f67ef" containerName="istio-proxy"
Sep 15 10:54:08.904961 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:08.904500    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9da531c0-1e7c-4508-8069-2424401f67ef" containerName="istio-proxy"
Sep 15 10:54:08.904961 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:08.904506    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5799485-0215-4c88-bcaa-843408dbbcb0" containerName="payload-pre-processing"
Sep 15 10:54:08.908976 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:08.908953    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-44134e-9fn76"
Sep 15 10:54:08.911845 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:08.911819    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5jrzm\""
Sep 15 10:54:08.916897 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:08.916869    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-44134e-9fn76"]
Sep 15 10:54:09.033962 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:09.033926    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4671143b-d94e-4b39-8e28-48a6d4244259-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-44134e-9fn76\" (UID: \"4671143b-d94e-4b39-8e28-48a6d4244259\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-44134e-9fn76"
Sep 15 10:54:09.134918 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:09.134878    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4671143b-d94e-4b39-8e28-48a6d4244259-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-44134e-9fn76\" (UID: \"4671143b-d94e-4b39-8e28-48a6d4244259\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-44134e-9fn76"
Sep 15 10:54:09.135508 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:09.135486    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4671143b-d94e-4b39-8e28-48a6d4244259-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-44134e-9fn76\" (UID: \"4671143b-d94e-4b39-8e28-48a6d4244259\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-44134e-9fn76"
Sep 15 10:54:09.223136 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:09.223045    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-44134e-9fn76"
Sep 15 10:54:09.495524 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:09.495499    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-44134e-9fn76"]
Sep 15 10:54:09.498087 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:54:09.498046    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4671143b_d94e_4b39_8e28_48a6d4244259.slice/crio-e70a261cad3d24692ab2f659c9bebb9d015956abc7d6908e7e2c072a94c24543 WatchSource:0}: Error finding container e70a261cad3d24692ab2f659c9bebb9d015956abc7d6908e7e2c072a94c24543: Status 404 returned error can't find the container with id e70a261cad3d24692ab2f659c9bebb9d015956abc7d6908e7e2c072a94c24543
Sep 15 10:54:09.953113 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:09.953076    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-44134e-9fn76" event={"ID":"4671143b-d94e-4b39-8e28-48a6d4244259","Type":"ContainerStarted","Data":"231429410b3b7e761f80c752c12ebced9ed435f825a801eb23e1381d2fdc4420"}
Sep 15 10:54:09.953575 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:09.953133    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-44134e-9fn76" event={"ID":"4671143b-d94e-4b39-8e28-48a6d4244259","Type":"ContainerStarted","Data":"e70a261cad3d24692ab2f659c9bebb9d015956abc7d6908e7e2c072a94c24543"}
Sep 15 10:54:09.967311 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:09.967262    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-44134e-9fn76" podStartSLOduration=1.967246572 podStartE2EDuration="1.967246572s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:54:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:54:09.96644915 +0000 UTC m=+2183.362541238" watchObservedRunningTime="2026-09-15 10:54:09.967246572 +0000 UTC m=+2183.363338659"
Sep 15 10:54:10.960425 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:10.960390    2579 generic.go:356] "Generic (PLEG): container finished" podID="4671143b-d94e-4b39-8e28-48a6d4244259" containerID="231429410b3b7e761f80c752c12ebced9ed435f825a801eb23e1381d2fdc4420" exitCode=0
Sep 15 10:54:10.960885 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:10.960472    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-44134e-9fn76" event={"ID":"4671143b-d94e-4b39-8e28-48a6d4244259","Type":"ContainerDied","Data":"231429410b3b7e761f80c752c12ebced9ed435f825a801eb23e1381d2fdc4420"}
Sep 15 10:54:12.105278 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:12.105252    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-44134e-9fn76"
Sep 15 10:54:12.159674 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:12.159639    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4671143b-d94e-4b39-8e28-48a6d4244259-maas-api-service-ca\") pod \"4671143b-d94e-4b39-8e28-48a6d4244259\" (UID: \"4671143b-d94e-4b39-8e28-48a6d4244259\") "
Sep 15 10:54:12.159994 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:12.159964    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4671143b-d94e-4b39-8e28-48a6d4244259-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4671143b-d94e-4b39-8e28-48a6d4244259" (UID: "4671143b-d94e-4b39-8e28-48a6d4244259"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:54:12.260904 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:12.260815    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4671143b-d94e-4b39-8e28-48a6d4244259-maas-api-service-ca\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:54:12.972891 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:12.972863    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-44134e-9fn76"
Sep 15 10:54:12.973059 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:12.972891    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-44134e-9fn76" event={"ID":"4671143b-d94e-4b39-8e28-48a6d4244259","Type":"ContainerDied","Data":"e70a261cad3d24692ab2f659c9bebb9d015956abc7d6908e7e2c072a94c24543"}
Sep 15 10:54:12.973059 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:12.972933    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e70a261cad3d24692ab2f659c9bebb9d015956abc7d6908e7e2c072a94c24543"
Sep 15 10:54:19.445430 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:19.445398    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-44134e-29824485-drts6"]
Sep 15 10:54:19.447768 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:19.447695    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-44134e-29824485-drts6"]
Sep 15 10:54:19.474703 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:19.474671    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-44134e-5cd878fc74-dfzfg"]
Sep 15 10:54:19.475189 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:19.474936    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-44134e-5cd878fc74-dfzfg" podUID="8a7c6101-5e8f-43d1-8359-9d502cd63bff" containerName="payload-pre-processing" containerID="cri-o://072f74fdf07b45ab4f249bc3a6fc9900d2c9d6568b87bfd3c468fc2928216207" gracePeriod=30
Sep 15 10:54:19.611839 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:19.611569    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-44134e-9fn76"]
Sep 15 10:54:19.614912 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:19.614880    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-44134e-9fn76"]
Sep 15 10:54:19.740680 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:19.740651    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-44134e-5cd878fc74-dfzfg"
Sep 15 10:54:19.829373 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:19.829331    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbg6n\" (UniqueName: \"kubernetes.io/projected/8a7c6101-5e8f-43d1-8359-9d502cd63bff-kube-api-access-wbg6n\") pod \"8a7c6101-5e8f-43d1-8359-9d502cd63bff\" (UID: \"8a7c6101-5e8f-43d1-8359-9d502cd63bff\") "
Sep 15 10:54:19.829571 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:19.829407    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a7c6101-5e8f-43d1-8359-9d502cd63bff-plugins-config-volume\") pod \"8a7c6101-5e8f-43d1-8359-9d502cd63bff\" (UID: \"8a7c6101-5e8f-43d1-8359-9d502cd63bff\") "
Sep 15 10:54:19.829874 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:19.829843    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a7c6101-5e8f-43d1-8359-9d502cd63bff-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8a7c6101-5e8f-43d1-8359-9d502cd63bff" (UID: "8a7c6101-5e8f-43d1-8359-9d502cd63bff"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:54:19.831598 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:19.831568    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a7c6101-5e8f-43d1-8359-9d502cd63bff-kube-api-access-wbg6n" (OuterVolumeSpecName: "kube-api-access-wbg6n") pod "8a7c6101-5e8f-43d1-8359-9d502cd63bff" (UID: "8a7c6101-5e8f-43d1-8359-9d502cd63bff"). InnerVolumeSpecName "kube-api-access-wbg6n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:54:19.930383 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:19.930339    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbg6n\" (UniqueName: \"kubernetes.io/projected/8a7c6101-5e8f-43d1-8359-9d502cd63bff-kube-api-access-wbg6n\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:54:19.930383 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:19.930377    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a7c6101-5e8f-43d1-8359-9d502cd63bff-plugins-config-volume\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:54:20.014202 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:20.014110    2579 generic.go:356] "Generic (PLEG): container finished" podID="8a7c6101-5e8f-43d1-8359-9d502cd63bff" containerID="072f74fdf07b45ab4f249bc3a6fc9900d2c9d6568b87bfd3c468fc2928216207" exitCode=0
Sep 15 10:54:20.014202 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:20.014172    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-44134e-5cd878fc74-dfzfg"
Sep 15 10:54:20.014427 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:20.014201    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-44134e-5cd878fc74-dfzfg" event={"ID":"8a7c6101-5e8f-43d1-8359-9d502cd63bff","Type":"ContainerDied","Data":"072f74fdf07b45ab4f249bc3a6fc9900d2c9d6568b87bfd3c468fc2928216207"}
Sep 15 10:54:20.014427 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:20.014277    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-44134e-5cd878fc74-dfzfg" event={"ID":"8a7c6101-5e8f-43d1-8359-9d502cd63bff","Type":"ContainerDied","Data":"e360e0238e989d9457a255f687717e5c68ab10f0df9447b9367d37ca4154d724"}
Sep 15 10:54:20.014427 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:20.014310    2579 scope.go:117] "RemoveContainer" containerID="072f74fdf07b45ab4f249bc3a6fc9900d2c9d6568b87bfd3c468fc2928216207"
Sep 15 10:54:20.029742 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:20.024182    2579 scope.go:117] "RemoveContainer" containerID="072f74fdf07b45ab4f249bc3a6fc9900d2c9d6568b87bfd3c468fc2928216207"
Sep 15 10:54:20.030605 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:54:20.030571    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"072f74fdf07b45ab4f249bc3a6fc9900d2c9d6568b87bfd3c468fc2928216207\": container with ID starting with 072f74fdf07b45ab4f249bc3a6fc9900d2c9d6568b87bfd3c468fc2928216207 not found: ID does not exist" containerID="072f74fdf07b45ab4f249bc3a6fc9900d2c9d6568b87bfd3c468fc2928216207"
Sep 15 10:54:20.030791 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:20.030616    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"072f74fdf07b45ab4f249bc3a6fc9900d2c9d6568b87bfd3c468fc2928216207"} err="failed to get container status \"072f74fdf07b45ab4f249bc3a6fc9900d2c9d6568b87bfd3c468fc2928216207\": rpc error: code = NotFound desc = could not find container \"072f74fdf07b45ab4f249bc3a6fc9900d2c9d6568b87bfd3c468fc2928216207\": container with ID starting with 072f74fdf07b45ab4f249bc3a6fc9900d2c9d6568b87bfd3c468fc2928216207 not found: ID does not exist"
Sep 15 10:54:20.040815 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:20.040779    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-44134e-5cd878fc74-dfzfg"]
Sep 15 10:54:20.046390 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:20.046368    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-44134e-5cd878fc74-dfzfg"]
Sep 15 10:54:21.148250 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:21.148219    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="015af010-a13e-4517-a611-8bf41cd48488" path="/var/lib/kubelet/pods/015af010-a13e-4517-a611-8bf41cd48488/volumes"
Sep 15 10:54:21.148636 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:21.148511    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4671143b-d94e-4b39-8e28-48a6d4244259" path="/var/lib/kubelet/pods/4671143b-d94e-4b39-8e28-48a6d4244259/volumes"
Sep 15 10:54:21.148846 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:21.148833    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a7c6101-5e8f-43d1-8359-9d502cd63bff" path="/var/lib/kubelet/pods/8a7c6101-5e8f-43d1-8359-9d502cd63bff/volumes"
Sep 15 10:54:26.044227 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:26.044190    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw"]
Sep 15 10:54:26.044697 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:26.044414    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw" podUID="61734c1a-5952-4196-af16-412530218079" containerName="istio-proxy" containerID="cri-o://d27285d8efd3f8030b30ef2594014076301135d5817e914d68b08d4e4ef9943d" gracePeriod=30
Sep 15 10:54:28.519050 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:28.519005    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-568cc65688-kdq2q"]
Sep 15 10:54:28.519648 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:28.519225    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-568cc65688-kdq2q" podUID="a35176ff-1489-4671-bbd4-cfb2815b3aa6" containerName="manager" containerID="cri-o://33de2f9b905cb5b6bff02c5b4aa480d8e63f0d7a53ac9abdedb6c44f15aafa3c" gracePeriod=30
Sep 15 10:54:28.766077 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:28.766050    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-568cc65688-kdq2q"
Sep 15 10:54:28.813053 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:28.813023    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a35176ff-1489-4671-bbd4-cfb2815b3aa6-metrics-certs\") pod \"a35176ff-1489-4671-bbd4-cfb2815b3aa6\" (UID: \"a35176ff-1489-4671-bbd4-cfb2815b3aa6\") "
Sep 15 10:54:28.813053 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:28.813056    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a35176ff-1489-4671-bbd4-cfb2815b3aa6-webhook-cert\") pod \"a35176ff-1489-4671-bbd4-cfb2815b3aa6\" (UID: \"a35176ff-1489-4671-bbd4-cfb2815b3aa6\") "
Sep 15 10:54:28.813278 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:28.813205    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wz2sc\" (UniqueName: \"kubernetes.io/projected/a35176ff-1489-4671-bbd4-cfb2815b3aa6-kube-api-access-wz2sc\") pod \"a35176ff-1489-4671-bbd4-cfb2815b3aa6\" (UID: \"a35176ff-1489-4671-bbd4-cfb2815b3aa6\") "
Sep 15 10:54:28.815216 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:28.815182    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a35176ff-1489-4671-bbd4-cfb2815b3aa6-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a35176ff-1489-4671-bbd4-cfb2815b3aa6" (UID: "a35176ff-1489-4671-bbd4-cfb2815b3aa6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 10:54:28.815554 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:28.815526    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a35176ff-1489-4671-bbd4-cfb2815b3aa6-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "a35176ff-1489-4671-bbd4-cfb2815b3aa6" (UID: "a35176ff-1489-4671-bbd4-cfb2815b3aa6"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 10:54:28.815554 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:28.815546    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a35176ff-1489-4671-bbd4-cfb2815b3aa6-kube-api-access-wz2sc" (OuterVolumeSpecName: "kube-api-access-wz2sc") pod "a35176ff-1489-4671-bbd4-cfb2815b3aa6" (UID: "a35176ff-1489-4671-bbd4-cfb2815b3aa6"). InnerVolumeSpecName "kube-api-access-wz2sc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:54:28.914848 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:28.914812    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a35176ff-1489-4671-bbd4-cfb2815b3aa6-metrics-certs\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:54:28.914848 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:28.914841    2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a35176ff-1489-4671-bbd4-cfb2815b3aa6-webhook-cert\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:54:28.914848 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:28.914850    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wz2sc\" (UniqueName: \"kubernetes.io/projected/a35176ff-1489-4671-bbd4-cfb2815b3aa6-kube-api-access-wz2sc\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:54:29.068420 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:29.068333    2579 generic.go:356] "Generic (PLEG): container finished" podID="a35176ff-1489-4671-bbd4-cfb2815b3aa6" containerID="33de2f9b905cb5b6bff02c5b4aa480d8e63f0d7a53ac9abdedb6c44f15aafa3c" exitCode=0
Sep 15 10:54:29.068420 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:29.068382    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-568cc65688-kdq2q"
Sep 15 10:54:29.068420 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:29.068406    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-568cc65688-kdq2q" event={"ID":"a35176ff-1489-4671-bbd4-cfb2815b3aa6","Type":"ContainerDied","Data":"33de2f9b905cb5b6bff02c5b4aa480d8e63f0d7a53ac9abdedb6c44f15aafa3c"}
Sep 15 10:54:29.068691 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:29.068448    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-568cc65688-kdq2q" event={"ID":"a35176ff-1489-4671-bbd4-cfb2815b3aa6","Type":"ContainerDied","Data":"076c0e9d8d347ac05e9654193a31e8dcde8a2e278a513d1d0d971b99d27d7448"}
Sep 15 10:54:29.068691 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:29.068469    2579 scope.go:117] "RemoveContainer" containerID="33de2f9b905cb5b6bff02c5b4aa480d8e63f0d7a53ac9abdedb6c44f15aafa3c"
Sep 15 10:54:29.079121 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:29.079097    2579 scope.go:117] "RemoveContainer" containerID="33de2f9b905cb5b6bff02c5b4aa480d8e63f0d7a53ac9abdedb6c44f15aafa3c"
Sep 15 10:54:29.079436 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:54:29.079412    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33de2f9b905cb5b6bff02c5b4aa480d8e63f0d7a53ac9abdedb6c44f15aafa3c\": container with ID starting with 33de2f9b905cb5b6bff02c5b4aa480d8e63f0d7a53ac9abdedb6c44f15aafa3c not found: ID does not exist" containerID="33de2f9b905cb5b6bff02c5b4aa480d8e63f0d7a53ac9abdedb6c44f15aafa3c"
Sep 15 10:54:29.079489 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:29.079447    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33de2f9b905cb5b6bff02c5b4aa480d8e63f0d7a53ac9abdedb6c44f15aafa3c"} err="failed to get container status \"33de2f9b905cb5b6bff02c5b4aa480d8e63f0d7a53ac9abdedb6c44f15aafa3c\": rpc error: code = NotFound desc = could not find container \"33de2f9b905cb5b6bff02c5b4aa480d8e63f0d7a53ac9abdedb6c44f15aafa3c\": container with ID starting with 33de2f9b905cb5b6bff02c5b4aa480d8e63f0d7a53ac9abdedb6c44f15aafa3c not found: ID does not exist"
Sep 15 10:54:29.090662 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:29.090633    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-568cc65688-kdq2q"]
Sep 15 10:54:29.093960 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:29.093939    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-568cc65688-kdq2q"]
Sep 15 10:54:29.149076 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:29.149045    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a35176ff-1489-4671-bbd4-cfb2815b3aa6" path="/var/lib/kubelet/pods/a35176ff-1489-4671-bbd4-cfb2815b3aa6/volumes"
Sep 15 10:54:29.451635 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:29.451544    2579 patch_prober.go:28] interesting pod/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 15 10:54:29.451635 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:29.451622    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw" podUID="61734c1a-5952-4196-af16-412530218079" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 10:54:31.322441 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:31.322352    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw"
Sep 15 10:54:31.437779 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:31.437742    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61734c1a-5952-4196-af16-412530218079-credential-socket\") pod \"61734c1a-5952-4196-af16-412530218079\" (UID: \"61734c1a-5952-4196-af16-412530218079\") "
Sep 15 10:54:31.437975 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:31.437799    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zjgp\" (UniqueName: \"kubernetes.io/projected/61734c1a-5952-4196-af16-412530218079-kube-api-access-4zjgp\") pod \"61734c1a-5952-4196-af16-412530218079\" (UID: \"61734c1a-5952-4196-af16-412530218079\") "
Sep 15 10:54:31.437975 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:31.437831    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61734c1a-5952-4196-af16-412530218079-istio-data\") pod \"61734c1a-5952-4196-af16-412530218079\" (UID: \"61734c1a-5952-4196-af16-412530218079\") "
Sep 15 10:54:31.437975 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:31.437856    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61734c1a-5952-4196-af16-412530218079-workload-socket\") pod \"61734c1a-5952-4196-af16-412530218079\" (UID: \"61734c1a-5952-4196-af16-412530218079\") "
Sep 15 10:54:31.437975 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:31.437899    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61734c1a-5952-4196-af16-412530218079-istio-podinfo\") pod \"61734c1a-5952-4196-af16-412530218079\" (UID: \"61734c1a-5952-4196-af16-412530218079\") "
Sep 15 10:54:31.437975 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:31.437936    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61734c1a-5952-4196-af16-412530218079-workload-certs\") pod \"61734c1a-5952-4196-af16-412530218079\" (UID: \"61734c1a-5952-4196-af16-412530218079\") "
Sep 15 10:54:31.437975 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:31.437956    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61734c1a-5952-4196-af16-412530218079-istio-token\") pod \"61734c1a-5952-4196-af16-412530218079\" (UID: \"61734c1a-5952-4196-af16-412530218079\") "
Sep 15 10:54:31.438272 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:31.437986    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61734c1a-5952-4196-af16-412530218079-istiod-ca-cert\") pod \"61734c1a-5952-4196-af16-412530218079\" (UID: \"61734c1a-5952-4196-af16-412530218079\") "
Sep 15 10:54:31.438272 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:31.438013    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61734c1a-5952-4196-af16-412530218079-istio-envoy\") pod \"61734c1a-5952-4196-af16-412530218079\" (UID: \"61734c1a-5952-4196-af16-412530218079\") "
Sep 15 10:54:31.438393 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:31.438318    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61734c1a-5952-4196-af16-412530218079-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "61734c1a-5952-4196-af16-412530218079" (UID: "61734c1a-5952-4196-af16-412530218079"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:54:31.438517 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:31.438486    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61734c1a-5952-4196-af16-412530218079-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "61734c1a-5952-4196-af16-412530218079" (UID: "61734c1a-5952-4196-af16-412530218079"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 10:54:31.438610 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:31.438586    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61734c1a-5952-4196-af16-412530218079-istio-data" (OuterVolumeSpecName: "istio-data") pod "61734c1a-5952-4196-af16-412530218079" (UID: "61734c1a-5952-4196-af16-412530218079"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:54:31.438669 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:31.438604    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61734c1a-5952-4196-af16-412530218079-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "61734c1a-5952-4196-af16-412530218079" (UID: "61734c1a-5952-4196-af16-412530218079"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:54:31.438904 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:31.438880    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61734c1a-5952-4196-af16-412530218079-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "61734c1a-5952-4196-af16-412530218079" (UID: "61734c1a-5952-4196-af16-412530218079"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:54:31.440428 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:31.440381    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61734c1a-5952-4196-af16-412530218079-kube-api-access-4zjgp" (OuterVolumeSpecName: "kube-api-access-4zjgp") pod "61734c1a-5952-4196-af16-412530218079" (UID: "61734c1a-5952-4196-af16-412530218079"). InnerVolumeSpecName "kube-api-access-4zjgp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:54:31.440713 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:31.440681    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61734c1a-5952-4196-af16-412530218079-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "61734c1a-5952-4196-af16-412530218079" (UID: "61734c1a-5952-4196-af16-412530218079"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:54:31.440859 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:31.440791    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/61734c1a-5952-4196-af16-412530218079-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "61734c1a-5952-4196-af16-412530218079" (UID: "61734c1a-5952-4196-af16-412530218079"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 10:54:31.440859 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:31.440792    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61734c1a-5952-4196-af16-412530218079-istio-token" (OuterVolumeSpecName: "istio-token") pod "61734c1a-5952-4196-af16-412530218079" (UID: "61734c1a-5952-4196-af16-412530218079"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:54:31.538968 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:31.538929    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61734c1a-5952-4196-af16-412530218079-credential-socket\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:54:31.538968 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:31.538965    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zjgp\" (UniqueName: \"kubernetes.io/projected/61734c1a-5952-4196-af16-412530218079-kube-api-access-4zjgp\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:54:31.539162 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:31.538979    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61734c1a-5952-4196-af16-412530218079-istio-data\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:54:31.539162 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:31.538992    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61734c1a-5952-4196-af16-412530218079-workload-socket\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:54:31.539162 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:31.539004    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61734c1a-5952-4196-af16-412530218079-istio-podinfo\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:54:31.539162 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:31.539016    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61734c1a-5952-4196-af16-412530218079-workload-certs\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:54:31.539162 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:31.539027    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61734c1a-5952-4196-af16-412530218079-istio-token\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:54:31.539162 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:31.539038    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61734c1a-5952-4196-af16-412530218079-istiod-ca-cert\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:54:31.539162 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:31.539050    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61734c1a-5952-4196-af16-412530218079-istio-envoy\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:54:32.087970 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:32.087940    2579 generic.go:356] "Generic (PLEG): container finished" podID="61734c1a-5952-4196-af16-412530218079" containerID="d27285d8efd3f8030b30ef2594014076301135d5817e914d68b08d4e4ef9943d" exitCode=0
Sep 15 10:54:32.088150 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:32.087990    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw"
Sep 15 10:54:32.088150 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:32.088024    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw" event={"ID":"61734c1a-5952-4196-af16-412530218079","Type":"ContainerDied","Data":"d27285d8efd3f8030b30ef2594014076301135d5817e914d68b08d4e4ef9943d"}
Sep 15 10:54:32.088150 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:32.088079    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw" event={"ID":"61734c1a-5952-4196-af16-412530218079","Type":"ContainerDied","Data":"8a61077cf1066b69705f39e675d3f5d8941cab07075418157e0b12f400186fa8"}
Sep 15 10:54:32.088150 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:32.088101    2579 scope.go:117] "RemoveContainer" containerID="d27285d8efd3f8030b30ef2594014076301135d5817e914d68b08d4e4ef9943d"
Sep 15 10:54:32.099367 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:32.099094    2579 scope.go:117] "RemoveContainer" containerID="8c154b80c02f4b145cad2b7376dfd85aebf140fae94e75a45c937df55c5d7b87"
Sep 15 10:54:32.109187 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:32.109146    2579 scope.go:117] "RemoveContainer" containerID="d27285d8efd3f8030b30ef2594014076301135d5817e914d68b08d4e4ef9943d"
Sep 15 10:54:32.109501 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:54:32.109480    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d27285d8efd3f8030b30ef2594014076301135d5817e914d68b08d4e4ef9943d\": container with ID starting with d27285d8efd3f8030b30ef2594014076301135d5817e914d68b08d4e4ef9943d not found: ID does not exist" containerID="d27285d8efd3f8030b30ef2594014076301135d5817e914d68b08d4e4ef9943d"
Sep 15 10:54:32.109556 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:32.109513    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d27285d8efd3f8030b30ef2594014076301135d5817e914d68b08d4e4ef9943d"} err="failed to get container status \"d27285d8efd3f8030b30ef2594014076301135d5817e914d68b08d4e4ef9943d\": rpc error: code = NotFound desc = could not find container \"d27285d8efd3f8030b30ef2594014076301135d5817e914d68b08d4e4ef9943d\": container with ID starting with d27285d8efd3f8030b30ef2594014076301135d5817e914d68b08d4e4ef9943d not found: ID does not exist"
Sep 15 10:54:32.109556 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:32.109532    2579 scope.go:117] "RemoveContainer" containerID="8c154b80c02f4b145cad2b7376dfd85aebf140fae94e75a45c937df55c5d7b87"
Sep 15 10:54:32.109849 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:54:32.109830    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c154b80c02f4b145cad2b7376dfd85aebf140fae94e75a45c937df55c5d7b87\": container with ID starting with 8c154b80c02f4b145cad2b7376dfd85aebf140fae94e75a45c937df55c5d7b87 not found: ID does not exist" containerID="8c154b80c02f4b145cad2b7376dfd85aebf140fae94e75a45c937df55c5d7b87"
Sep 15 10:54:32.109916 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:32.109855    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c154b80c02f4b145cad2b7376dfd85aebf140fae94e75a45c937df55c5d7b87"} err="failed to get container status \"8c154b80c02f4b145cad2b7376dfd85aebf140fae94e75a45c937df55c5d7b87\": rpc error: code = NotFound desc = could not find container \"8c154b80c02f4b145cad2b7376dfd85aebf140fae94e75a45c937df55c5d7b87\": container with ID starting with 8c154b80c02f4b145cad2b7376dfd85aebf140fae94e75a45c937df55c5d7b87 not found: ID does not exist"
Sep 15 10:54:32.110526 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:32.110506    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw"]
Sep 15 10:54:32.114220 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:32.114199    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-44134e-openshift-default-849b446d7b-zm5sw"]
Sep 15 10:54:33.148989 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:33.148956    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61734c1a-5952-4196-af16-412530218079" path="/var/lib/kubelet/pods/61734c1a-5952-4196-af16-412530218079/volumes"
Sep 15 10:54:47.754396 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:54:47.754362    2579 scope.go:117] "RemoveContainer" containerID="fc9e728d9d437558a84f46dfa79bf4b29e70a9a005cb93a01ae62157bb0051d2"
Sep 15 10:55:29.877635 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:29.877593    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-568cc65688-crljb"]
Sep 15 10:55:29.878118 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:29.878013    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61734c1a-5952-4196-af16-412530218079" containerName="istio-proxy"
Sep 15 10:55:29.878118 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:29.878029    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="61734c1a-5952-4196-af16-412530218079" containerName="istio-proxy"
Sep 15 10:55:29.878118 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:29.878038    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9da531c0-1e7c-4508-8069-2424401f67ef" containerName="istio-proxy"
Sep 15 10:55:29.878118 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:29.878043    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9da531c0-1e7c-4508-8069-2424401f67ef" containerName="istio-proxy"
Sep 15 10:55:29.878118 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:29.878058    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61734c1a-5952-4196-af16-412530218079" containerName="istio-proxy"
Sep 15 10:55:29.878118 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:29.878064    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="61734c1a-5952-4196-af16-412530218079" containerName="istio-proxy"
Sep 15 10:55:29.878118 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:29.878076    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4671143b-d94e-4b39-8e28-48a6d4244259" containerName="revoke-keys"
Sep 15 10:55:29.878118 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:29.878081    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4671143b-d94e-4b39-8e28-48a6d4244259" containerName="revoke-keys"
Sep 15 10:55:29.878118 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:29.878092    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a7c6101-5e8f-43d1-8359-9d502cd63bff" containerName="payload-pre-processing"
Sep 15 10:55:29.878118 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:29.878097    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a7c6101-5e8f-43d1-8359-9d502cd63bff" containerName="payload-pre-processing"
Sep 15 10:55:29.878118 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:29.878106    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a35176ff-1489-4671-bbd4-cfb2815b3aa6" containerName="manager"
Sep 15 10:55:29.878118 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:29.878111    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a35176ff-1489-4671-bbd4-cfb2815b3aa6" containerName="manager"
Sep 15 10:55:29.878675 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:29.878168    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="61734c1a-5952-4196-af16-412530218079" containerName="istio-proxy"
Sep 15 10:55:29.878675 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:29.878176    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="61734c1a-5952-4196-af16-412530218079" containerName="istio-proxy"
Sep 15 10:55:29.878675 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:29.878181    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a7c6101-5e8f-43d1-8359-9d502cd63bff" containerName="payload-pre-processing"
Sep 15 10:55:29.878675 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:29.878188    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a35176ff-1489-4671-bbd4-cfb2815b3aa6" containerName="manager"
Sep 15 10:55:29.878675 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:29.878192    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4671143b-d94e-4b39-8e28-48a6d4244259" containerName="revoke-keys"
Sep 15 10:55:29.881319 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:29.881302    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-568cc65688-crljb"
Sep 15 10:55:29.884388 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:29.884369    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 15 10:55:29.884510 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:29.884435    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 15 10:55:29.884510 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:29.884479    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 15 10:55:29.884606 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:29.884538    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-w8pwn\""
Sep 15 10:55:29.890861 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:29.890836    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-568cc65688-crljb"]
Sep 15 10:55:29.959985 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:29.959953    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/91997775-d29b-4cc6-8b20-eca7c8d44831-webhook-cert\") pod \"maas-controller-568cc65688-crljb\" (UID: \"91997775-d29b-4cc6-8b20-eca7c8d44831\") " pod="opendatahub/maas-controller-568cc65688-crljb"
Sep 15 10:55:29.960160 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:29.960013    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91997775-d29b-4cc6-8b20-eca7c8d44831-metrics-certs\") pod \"maas-controller-568cc65688-crljb\" (UID: \"91997775-d29b-4cc6-8b20-eca7c8d44831\") " pod="opendatahub/maas-controller-568cc65688-crljb"
Sep 15 10:55:29.960160 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:29.960090    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5pnp\" (UniqueName: \"kubernetes.io/projected/91997775-d29b-4cc6-8b20-eca7c8d44831-kube-api-access-x5pnp\") pod \"maas-controller-568cc65688-crljb\" (UID: \"91997775-d29b-4cc6-8b20-eca7c8d44831\") " pod="opendatahub/maas-controller-568cc65688-crljb"
Sep 15 10:55:30.061478 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:30.061442    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91997775-d29b-4cc6-8b20-eca7c8d44831-metrics-certs\") pod \"maas-controller-568cc65688-crljb\" (UID: \"91997775-d29b-4cc6-8b20-eca7c8d44831\") " pod="opendatahub/maas-controller-568cc65688-crljb"
Sep 15 10:55:30.061626 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:30.061499    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5pnp\" (UniqueName: \"kubernetes.io/projected/91997775-d29b-4cc6-8b20-eca7c8d44831-kube-api-access-x5pnp\") pod \"maas-controller-568cc65688-crljb\" (UID: \"91997775-d29b-4cc6-8b20-eca7c8d44831\") " pod="opendatahub/maas-controller-568cc65688-crljb"
Sep 15 10:55:30.061626 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:30.061562    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/91997775-d29b-4cc6-8b20-eca7c8d44831-webhook-cert\") pod \"maas-controller-568cc65688-crljb\" (UID: \"91997775-d29b-4cc6-8b20-eca7c8d44831\") " pod="opendatahub/maas-controller-568cc65688-crljb"
Sep 15 10:55:30.064025 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:30.063993    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91997775-d29b-4cc6-8b20-eca7c8d44831-metrics-certs\") pod \"maas-controller-568cc65688-crljb\" (UID: \"91997775-d29b-4cc6-8b20-eca7c8d44831\") " pod="opendatahub/maas-controller-568cc65688-crljb"
Sep 15 10:55:30.064130 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:30.064028    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/91997775-d29b-4cc6-8b20-eca7c8d44831-webhook-cert\") pod \"maas-controller-568cc65688-crljb\" (UID: \"91997775-d29b-4cc6-8b20-eca7c8d44831\") " pod="opendatahub/maas-controller-568cc65688-crljb"
Sep 15 10:55:30.069069 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:30.069038    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5pnp\" (UniqueName: \"kubernetes.io/projected/91997775-d29b-4cc6-8b20-eca7c8d44831-kube-api-access-x5pnp\") pod \"maas-controller-568cc65688-crljb\" (UID: \"91997775-d29b-4cc6-8b20-eca7c8d44831\") " pod="opendatahub/maas-controller-568cc65688-crljb"
Sep 15 10:55:30.192892 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:30.192808    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-568cc65688-crljb"
Sep 15 10:55:30.463102 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:30.463067    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-568cc65688-crljb"]
Sep 15 10:55:30.465076 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:55:30.465047    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91997775_d29b_4cc6_8b20_eca7c8d44831.slice/crio-db16879a35fc874e9991d45ff9ce8837bd2e083bd30757b33d4968bae99de564 WatchSource:0}: Error finding container db16879a35fc874e9991d45ff9ce8837bd2e083bd30757b33d4968bae99de564: Status 404 returned error can't find the container with id db16879a35fc874e9991d45ff9ce8837bd2e083bd30757b33d4968bae99de564
Sep 15 10:55:30.466444 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:30.466423    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 10:55:31.399775 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:31.399661    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-568cc65688-crljb" event={"ID":"91997775-d29b-4cc6-8b20-eca7c8d44831","Type":"ContainerStarted","Data":"eebef89536d54aafefa5ec01d2952b4cf90d38bde0dcbe147d8cabf24fc4fe36"}
Sep 15 10:55:31.399775 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:31.399719    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-568cc65688-crljb" event={"ID":"91997775-d29b-4cc6-8b20-eca7c8d44831","Type":"ContainerStarted","Data":"db16879a35fc874e9991d45ff9ce8837bd2e083bd30757b33d4968bae99de564"}
Sep 15 10:55:31.399775 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:31.399755    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-568cc65688-crljb"
Sep 15 10:55:31.417618 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:31.417568    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-568cc65688-crljb" podStartSLOduration=1.794380419 podStartE2EDuration="2.417555219s" totalImagesPullingTime="623.1748ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:55:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:55:31.41497824 +0000 UTC m=+2264.811070326" watchObservedRunningTime="2026-09-15 10:55:31.417555219 +0000 UTC m=+2264.813647307"
Sep 15 10:55:42.407053 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:42.407022    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-568cc65688-crljb"
Sep 15 10:55:53.798242 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:53.798205    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-568cc65688-crljb"]
Sep 15 10:55:53.800790 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:53.798465    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-568cc65688-crljb" podUID="91997775-d29b-4cc6-8b20-eca7c8d44831" containerName="manager" containerID="cri-o://eebef89536d54aafefa5ec01d2952b4cf90d38bde0dcbe147d8cabf24fc4fe36" gracePeriod=30
Sep 15 10:55:54.044082 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:54.044049    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-568cc65688-crljb"
Sep 15 10:55:54.078046 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:54.077536    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/91997775-d29b-4cc6-8b20-eca7c8d44831-webhook-cert\") pod \"91997775-d29b-4cc6-8b20-eca7c8d44831\" (UID: \"91997775-d29b-4cc6-8b20-eca7c8d44831\") "
Sep 15 10:55:54.078046 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:54.077608    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x5pnp\" (UniqueName: \"kubernetes.io/projected/91997775-d29b-4cc6-8b20-eca7c8d44831-kube-api-access-x5pnp\") pod \"91997775-d29b-4cc6-8b20-eca7c8d44831\" (UID: \"91997775-d29b-4cc6-8b20-eca7c8d44831\") "
Sep 15 10:55:54.078046 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:54.077984    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91997775-d29b-4cc6-8b20-eca7c8d44831-metrics-certs\") pod \"91997775-d29b-4cc6-8b20-eca7c8d44831\" (UID: \"91997775-d29b-4cc6-8b20-eca7c8d44831\") "
Sep 15 10:55:54.080434 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:54.080391    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91997775-d29b-4cc6-8b20-eca7c8d44831-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "91997775-d29b-4cc6-8b20-eca7c8d44831" (UID: "91997775-d29b-4cc6-8b20-eca7c8d44831"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 10:55:54.080688 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:54.080649    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91997775-d29b-4cc6-8b20-eca7c8d44831-kube-api-access-x5pnp" (OuterVolumeSpecName: "kube-api-access-x5pnp") pod "91997775-d29b-4cc6-8b20-eca7c8d44831" (UID: "91997775-d29b-4cc6-8b20-eca7c8d44831"). InnerVolumeSpecName "kube-api-access-x5pnp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:55:54.092290 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:54.092257    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91997775-d29b-4cc6-8b20-eca7c8d44831-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "91997775-d29b-4cc6-8b20-eca7c8d44831" (UID: "91997775-d29b-4cc6-8b20-eca7c8d44831"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 10:55:54.179135 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:54.179100    2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/91997775-d29b-4cc6-8b20-eca7c8d44831-webhook-cert\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:55:54.179135 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:54.179130    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x5pnp\" (UniqueName: \"kubernetes.io/projected/91997775-d29b-4cc6-8b20-eca7c8d44831-kube-api-access-x5pnp\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:55:54.179135 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:54.179140    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91997775-d29b-4cc6-8b20-eca7c8d44831-metrics-certs\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:55:54.524987 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:54.524891    2579 generic.go:356] "Generic (PLEG): container finished" podID="91997775-d29b-4cc6-8b20-eca7c8d44831" containerID="eebef89536d54aafefa5ec01d2952b4cf90d38bde0dcbe147d8cabf24fc4fe36" exitCode=0
Sep 15 10:55:54.524987 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:54.524938    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-568cc65688-crljb"
Sep 15 10:55:54.524987 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:54.524951    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-568cc65688-crljb" event={"ID":"91997775-d29b-4cc6-8b20-eca7c8d44831","Type":"ContainerDied","Data":"eebef89536d54aafefa5ec01d2952b4cf90d38bde0dcbe147d8cabf24fc4fe36"}
Sep 15 10:55:54.525264 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:54.524993    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-568cc65688-crljb" event={"ID":"91997775-d29b-4cc6-8b20-eca7c8d44831","Type":"ContainerDied","Data":"db16879a35fc874e9991d45ff9ce8837bd2e083bd30757b33d4968bae99de564"}
Sep 15 10:55:54.525264 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:54.525018    2579 scope.go:117] "RemoveContainer" containerID="eebef89536d54aafefa5ec01d2952b4cf90d38bde0dcbe147d8cabf24fc4fe36"
Sep 15 10:55:54.534944 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:54.534925    2579 scope.go:117] "RemoveContainer" containerID="eebef89536d54aafefa5ec01d2952b4cf90d38bde0dcbe147d8cabf24fc4fe36"
Sep 15 10:55:54.535230 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:55:54.535212    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eebef89536d54aafefa5ec01d2952b4cf90d38bde0dcbe147d8cabf24fc4fe36\": container with ID starting with eebef89536d54aafefa5ec01d2952b4cf90d38bde0dcbe147d8cabf24fc4fe36 not found: ID does not exist" containerID="eebef89536d54aafefa5ec01d2952b4cf90d38bde0dcbe147d8cabf24fc4fe36"
Sep 15 10:55:54.535296 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:54.535238    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eebef89536d54aafefa5ec01d2952b4cf90d38bde0dcbe147d8cabf24fc4fe36"} err="failed to get container status \"eebef89536d54aafefa5ec01d2952b4cf90d38bde0dcbe147d8cabf24fc4fe36\": rpc error: code = NotFound desc = could not find container \"eebef89536d54aafefa5ec01d2952b4cf90d38bde0dcbe147d8cabf24fc4fe36\": container with ID starting with eebef89536d54aafefa5ec01d2952b4cf90d38bde0dcbe147d8cabf24fc4fe36 not found: ID does not exist"
Sep 15 10:55:54.554257 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:54.554228    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-568cc65688-crljb"]
Sep 15 10:55:54.557582 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:54.557559    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-568cc65688-crljb"]
Sep 15 10:55:55.150556 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:55.150522    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91997775-d29b-4cc6-8b20-eca7c8d44831" path="/var/lib/kubelet/pods/91997775-d29b-4cc6-8b20-eca7c8d44831/volumes"
Sep 15 10:55:55.363562 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:55.363528    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-568cc65688-f5t57"]
Sep 15 10:55:55.363924 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:55.363911    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91997775-d29b-4cc6-8b20-eca7c8d44831" containerName="manager"
Sep 15 10:55:55.363981 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:55.363925    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="91997775-d29b-4cc6-8b20-eca7c8d44831" containerName="manager"
Sep 15 10:55:55.364021 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:55.363989    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="91997775-d29b-4cc6-8b20-eca7c8d44831" containerName="manager"
Sep 15 10:55:55.368405 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:55.368385    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-568cc65688-f5t57"
Sep 15 10:55:55.371682 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:55.371663    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 15 10:55:55.371804 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:55.371682    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 15 10:55:55.371804 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:55.371683    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 15 10:55:55.371804 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:55.371748    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-w8pwn\""
Sep 15 10:55:55.376770 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:55.376747    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-568cc65688-f5t57"]
Sep 15 10:55:55.390151 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:55.390124    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f93a2943-6438-4edb-ae57-af65a67eaf07-metrics-certs\") pod \"maas-controller-568cc65688-f5t57\" (UID: \"f93a2943-6438-4edb-ae57-af65a67eaf07\") " pod="opendatahub/maas-controller-568cc65688-f5t57"
Sep 15 10:55:55.390290 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:55.390161    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tj595\" (UniqueName: \"kubernetes.io/projected/f93a2943-6438-4edb-ae57-af65a67eaf07-kube-api-access-tj595\") pod \"maas-controller-568cc65688-f5t57\" (UID: \"f93a2943-6438-4edb-ae57-af65a67eaf07\") " pod="opendatahub/maas-controller-568cc65688-f5t57"
Sep 15 10:55:55.390290 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:55.390266    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f93a2943-6438-4edb-ae57-af65a67eaf07-webhook-cert\") pod \"maas-controller-568cc65688-f5t57\" (UID: \"f93a2943-6438-4edb-ae57-af65a67eaf07\") " pod="opendatahub/maas-controller-568cc65688-f5t57"
Sep 15 10:55:55.491566 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:55.491471    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f93a2943-6438-4edb-ae57-af65a67eaf07-metrics-certs\") pod \"maas-controller-568cc65688-f5t57\" (UID: \"f93a2943-6438-4edb-ae57-af65a67eaf07\") " pod="opendatahub/maas-controller-568cc65688-f5t57"
Sep 15 10:55:55.491566 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:55.491510    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tj595\" (UniqueName: \"kubernetes.io/projected/f93a2943-6438-4edb-ae57-af65a67eaf07-kube-api-access-tj595\") pod \"maas-controller-568cc65688-f5t57\" (UID: \"f93a2943-6438-4edb-ae57-af65a67eaf07\") " pod="opendatahub/maas-controller-568cc65688-f5t57"
Sep 15 10:55:55.491566 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:55.491553    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f93a2943-6438-4edb-ae57-af65a67eaf07-webhook-cert\") pod \"maas-controller-568cc65688-f5t57\" (UID: \"f93a2943-6438-4edb-ae57-af65a67eaf07\") " pod="opendatahub/maas-controller-568cc65688-f5t57"
Sep 15 10:55:55.493934 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:55.493905    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f93a2943-6438-4edb-ae57-af65a67eaf07-webhook-cert\") pod \"maas-controller-568cc65688-f5t57\" (UID: \"f93a2943-6438-4edb-ae57-af65a67eaf07\") " pod="opendatahub/maas-controller-568cc65688-f5t57"
Sep 15 10:55:55.494031 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:55.494004    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f93a2943-6438-4edb-ae57-af65a67eaf07-metrics-certs\") pod \"maas-controller-568cc65688-f5t57\" (UID: \"f93a2943-6438-4edb-ae57-af65a67eaf07\") " pod="opendatahub/maas-controller-568cc65688-f5t57"
Sep 15 10:55:55.498789 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:55.498765    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tj595\" (UniqueName: \"kubernetes.io/projected/f93a2943-6438-4edb-ae57-af65a67eaf07-kube-api-access-tj595\") pod \"maas-controller-568cc65688-f5t57\" (UID: \"f93a2943-6438-4edb-ae57-af65a67eaf07\") " pod="opendatahub/maas-controller-568cc65688-f5t57"
Sep 15 10:55:55.679257 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:55.679217    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-568cc65688-f5t57"
Sep 15 10:55:55.950806 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:55.950765    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-568cc65688-f5t57"]
Sep 15 10:55:55.954085 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:55:55.954054    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf93a2943_6438_4edb_ae57_af65a67eaf07.slice/crio-d3acb425acb0b09ad18ae10d7a2afab17a58c53861960f7de0bf1559195ad841 WatchSource:0}: Error finding container d3acb425acb0b09ad18ae10d7a2afab17a58c53861960f7de0bf1559195ad841: Status 404 returned error can't find the container with id d3acb425acb0b09ad18ae10d7a2afab17a58c53861960f7de0bf1559195ad841
Sep 15 10:55:56.538790 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:56.538754    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-568cc65688-f5t57" event={"ID":"f93a2943-6438-4edb-ae57-af65a67eaf07","Type":"ContainerStarted","Data":"f4e2415cf797ba35c570cecaef8d6fd2ebbc4b21abca5b0db020b37ededc410e"}
Sep 15 10:55:56.539185 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:56.538951    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-568cc65688-f5t57"
Sep 15 10:55:56.539185 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:56.538974    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-568cc65688-f5t57" event={"ID":"f93a2943-6438-4edb-ae57-af65a67eaf07","Type":"ContainerStarted","Data":"d3acb425acb0b09ad18ae10d7a2afab17a58c53861960f7de0bf1559195ad841"}
Sep 15 10:55:56.555862 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:55:56.555812    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-568cc65688-f5t57" podStartSLOduration=1.233398963 podStartE2EDuration="1.555797488s" totalImagesPullingTime="322.398525ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:55:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:55:56.554466879 +0000 UTC m=+2289.950558965" watchObservedRunningTime="2026-09-15 10:55:56.555797488 +0000 UTC m=+2289.951889575"
Sep 15 10:56:07.545293 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:56:07.545257    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-568cc65688-f5t57"
Sep 15 10:56:47.800222 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:56:47.800129    2579 scope.go:117] "RemoveContainer" containerID="a4fe495f68574a60b927db9bf05e3b2f732094176ab36fa8673982becb2154d3"
Sep 15 10:57:11.648857 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:57:11.648823    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-jkvtf"]
Sep 15 10:57:11.649280 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:57:11.649040    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-jkvtf" podUID="7f478d38-ac67-43e5-b85c-f47ea55d09a7" containerName="manager" containerID="cri-o://ece5d685b3ff4fceed72979d801f0fa0f9535c291a5c4fb69d9dd27ba34fca74" gracePeriod=10
Sep 15 10:57:11.897440 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:57:11.897417    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-jkvtf"
Sep 15 10:57:11.949849 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:57:11.949739    2579 generic.go:356] "Generic (PLEG): container finished" podID="7f478d38-ac67-43e5-b85c-f47ea55d09a7" containerID="ece5d685b3ff4fceed72979d801f0fa0f9535c291a5c4fb69d9dd27ba34fca74" exitCode=0
Sep 15 10:57:11.949849 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:57:11.949760    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-jkvtf" event={"ID":"7f478d38-ac67-43e5-b85c-f47ea55d09a7","Type":"ContainerDied","Data":"ece5d685b3ff4fceed72979d801f0fa0f9535c291a5c4fb69d9dd27ba34fca74"}
Sep 15 10:57:11.949849 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:57:11.949801    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-jkvtf"
Sep 15 10:57:11.949849 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:57:11.949832    2579 scope.go:117] "RemoveContainer" containerID="ece5d685b3ff4fceed72979d801f0fa0f9535c291a5c4fb69d9dd27ba34fca74"
Sep 15 10:57:11.950218 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:57:11.949819    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-jkvtf" event={"ID":"7f478d38-ac67-43e5-b85c-f47ea55d09a7","Type":"ContainerDied","Data":"f30fbdd1af6ad8b1e8ef9fa5471c3e02cac1251c579d3594e7ac334a3aa4b08b"}
Sep 15 10:57:11.959071 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:57:11.959052    2579 scope.go:117] "RemoveContainer" containerID="ece5d685b3ff4fceed72979d801f0fa0f9535c291a5c4fb69d9dd27ba34fca74"
Sep 15 10:57:11.959423 ip-10-0-135-231 kubenswrapper[2579]: E0915 10:57:11.959400    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ece5d685b3ff4fceed72979d801f0fa0f9535c291a5c4fb69d9dd27ba34fca74\": container with ID starting with ece5d685b3ff4fceed72979d801f0fa0f9535c291a5c4fb69d9dd27ba34fca74 not found: ID does not exist" containerID="ece5d685b3ff4fceed72979d801f0fa0f9535c291a5c4fb69d9dd27ba34fca74"
Sep 15 10:57:11.959487 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:57:11.959433    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ece5d685b3ff4fceed72979d801f0fa0f9535c291a5c4fb69d9dd27ba34fca74"} err="failed to get container status \"ece5d685b3ff4fceed72979d801f0fa0f9535c291a5c4fb69d9dd27ba34fca74\": rpc error: code = NotFound desc = could not find container \"ece5d685b3ff4fceed72979d801f0fa0f9535c291a5c4fb69d9dd27ba34fca74\": container with ID starting with ece5d685b3ff4fceed72979d801f0fa0f9535c291a5c4fb69d9dd27ba34fca74 not found: ID does not exist"
Sep 15 10:57:11.965793 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:57:11.965763    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vdqlb\" (UniqueName: \"kubernetes.io/projected/7f478d38-ac67-43e5-b85c-f47ea55d09a7-kube-api-access-vdqlb\") pod \"7f478d38-ac67-43e5-b85c-f47ea55d09a7\" (UID: \"7f478d38-ac67-43e5-b85c-f47ea55d09a7\") "
Sep 15 10:57:11.965902 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:57:11.965821    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7f478d38-ac67-43e5-b85c-f47ea55d09a7-extensions-socket-volume\") pod \"7f478d38-ac67-43e5-b85c-f47ea55d09a7\" (UID: \"7f478d38-ac67-43e5-b85c-f47ea55d09a7\") "
Sep 15 10:57:11.966270 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:57:11.966242    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f478d38-ac67-43e5-b85c-f47ea55d09a7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7f478d38-ac67-43e5-b85c-f47ea55d09a7" (UID: "7f478d38-ac67-43e5-b85c-f47ea55d09a7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 10:57:11.967886 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:57:11.967856    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f478d38-ac67-43e5-b85c-f47ea55d09a7-kube-api-access-vdqlb" (OuterVolumeSpecName: "kube-api-access-vdqlb") pod "7f478d38-ac67-43e5-b85c-f47ea55d09a7" (UID: "7f478d38-ac67-43e5-b85c-f47ea55d09a7"). InnerVolumeSpecName "kube-api-access-vdqlb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 10:57:12.066429 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:57:12.066392    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdqlb\" (UniqueName: \"kubernetes.io/projected/7f478d38-ac67-43e5-b85c-f47ea55d09a7-kube-api-access-vdqlb\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:57:12.066429 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:57:12.066422    2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7f478d38-ac67-43e5-b85c-f47ea55d09a7-extensions-socket-volume\") on node \"ip-10-0-135-231.ec2.internal\" DevicePath \"\""
Sep 15 10:57:12.273409 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:57:12.273368    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-jkvtf"]
Sep 15 10:57:12.277265 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:57:12.277239    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-jkvtf"]
Sep 15 10:57:13.148662 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:57:13.148629    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f478d38-ac67-43e5-b85c-f47ea55d09a7" path="/var/lib/kubelet/pods/7f478d38-ac67-43e5-b85c-f47ea55d09a7/volumes"
Sep 15 10:58:12.368322 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:58:12.368241    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5m5kv"]
Sep 15 10:58:12.368779 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:58:12.368635    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f478d38-ac67-43e5-b85c-f47ea55d09a7" containerName="manager"
Sep 15 10:58:12.368779 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:58:12.368646    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f478d38-ac67-43e5-b85c-f47ea55d09a7" containerName="manager"
Sep 15 10:58:12.368779 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:58:12.368716    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f478d38-ac67-43e5-b85c-f47ea55d09a7" containerName="manager"
Sep 15 10:58:12.371767 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:58:12.371751    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5m5kv"
Sep 15 10:58:12.374248 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:58:12.374227    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-z7jr5\""
Sep 15 10:58:12.381365 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:58:12.381337    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5m5kv"]
Sep 15 10:58:12.493451 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:58:12.493414    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d091d2ef-044e-48a1-84a1-010af24c1996-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-5m5kv\" (UID: \"d091d2ef-044e-48a1-84a1-010af24c1996\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5m5kv"
Sep 15 10:58:12.493634 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:58:12.493475    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9crc\" (UniqueName: \"kubernetes.io/projected/d091d2ef-044e-48a1-84a1-010af24c1996-kube-api-access-d9crc\") pod \"kuadrant-operator-controller-manager-5769f99d9f-5m5kv\" (UID: \"d091d2ef-044e-48a1-84a1-010af24c1996\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5m5kv"
Sep 15 10:58:12.594168 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:58:12.594132    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d091d2ef-044e-48a1-84a1-010af24c1996-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-5m5kv\" (UID: \"d091d2ef-044e-48a1-84a1-010af24c1996\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5m5kv"
Sep 15 10:58:12.594361 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:58:12.594200    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9crc\" (UniqueName: \"kubernetes.io/projected/d091d2ef-044e-48a1-84a1-010af24c1996-kube-api-access-d9crc\") pod \"kuadrant-operator-controller-manager-5769f99d9f-5m5kv\" (UID: \"d091d2ef-044e-48a1-84a1-010af24c1996\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5m5kv"
Sep 15 10:58:12.594522 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:58:12.594503    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d091d2ef-044e-48a1-84a1-010af24c1996-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-5m5kv\" (UID: \"d091d2ef-044e-48a1-84a1-010af24c1996\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5m5kv"
Sep 15 10:58:12.603492 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:58:12.603465    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9crc\" (UniqueName: \"kubernetes.io/projected/d091d2ef-044e-48a1-84a1-010af24c1996-kube-api-access-d9crc\") pod \"kuadrant-operator-controller-manager-5769f99d9f-5m5kv\" (UID: \"d091d2ef-044e-48a1-84a1-010af24c1996\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5m5kv"
Sep 15 10:58:12.682381 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:58:12.682296    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5m5kv"
Sep 15 10:58:12.959707 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:58:12.959679    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5m5kv"]
Sep 15 10:58:12.962560 ip-10-0-135-231 kubenswrapper[2579]: W0915 10:58:12.962533    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd091d2ef_044e_48a1_84a1_010af24c1996.slice/crio-701db35d75e346a4918b97498dc35094beb99bec92dc2051988b92d45879d2b6 WatchSource:0}: Error finding container 701db35d75e346a4918b97498dc35094beb99bec92dc2051988b92d45879d2b6: Status 404 returned error can't find the container with id 701db35d75e346a4918b97498dc35094beb99bec92dc2051988b92d45879d2b6
Sep 15 10:58:13.265207 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:58:13.265106    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5m5kv" event={"ID":"d091d2ef-044e-48a1-84a1-010af24c1996","Type":"ContainerStarted","Data":"e98def30d3861024cd72bbdb1295fcd61c32f71ead223177fded29dbd3481f76"}
Sep 15 10:58:13.265207 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:58:13.265164    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5m5kv" event={"ID":"d091d2ef-044e-48a1-84a1-010af24c1996","Type":"ContainerStarted","Data":"701db35d75e346a4918b97498dc35094beb99bec92dc2051988b92d45879d2b6"}
Sep 15 10:58:13.265421 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:58:13.265274    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5m5kv"
Sep 15 10:58:13.287355 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:58:13.287303    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5m5kv" podStartSLOduration=1.287287243 podStartE2EDuration="1.287287243s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 10:58:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 10:58:13.285037334 +0000 UTC m=+2426.681129421" watchObservedRunningTime="2026-09-15 10:58:13.287287243 +0000 UTC m=+2426.683379330"
Sep 15 10:58:24.273183 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:58:24.273150    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5m5kv"
Sep 15 10:58:47.838193 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:58:47.838161    2579 scope.go:117] "RemoveContainer" containerID="d446ac045328bd8f25eb3a312070f1535a2943a1cfc2f343da51f95b38e9a05f"
Sep 15 10:58:47.846263 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:58:47.846241    2579 scope.go:117] "RemoveContainer" containerID="b1960e60fbe993ad9d0d579e132603770784dec8deeeadefcb4901e7f9cfaaa9"
Sep 15 10:59:47.870259 ip-10-0-135-231 kubenswrapper[2579]: I0915 10:59:47.870185    2579 scope.go:117] "RemoveContainer" containerID="861eb91da4f4f7bfbf6a2f70389f720acd17efc70256ed7ca8d0cd513b806266"
Sep 15 11:00:00.128740 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:00.128699    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29824500-vnm85"]
Sep 15 11:00:00.132174 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:00.132156    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824500-vnm85"
Sep 15 11:00:00.134636 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:00.134615    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5jrzm\""
Sep 15 11:00:00.138638 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:00.138611    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29824500-vnm85"]
Sep 15 11:00:00.143825 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:00.143801    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824500-vnm85"
Sep 15 11:00:00.415027 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:00.414948    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29824500-vnm85"]
Sep 15 11:00:00.417383 ip-10-0-135-231 kubenswrapper[2579]: W0915 11:00:00.417357    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb7c5c2b_1838_4571_bbcc_def5a32a876a.slice/crio-cd8e281ddf258c0af8671956d828dbbe1371de760db19caaa7eb2cf112e0c22a WatchSource:0}: Error finding container cd8e281ddf258c0af8671956d828dbbe1371de760db19caaa7eb2cf112e0c22a: Status 404 returned error can't find the container with id cd8e281ddf258c0af8671956d828dbbe1371de760db19caaa7eb2cf112e0c22a
Sep 15 11:00:00.831739 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:00.831685    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824500-vnm85" event={"ID":"db7c5c2b-1838-4571-bbcc-def5a32a876a","Type":"ContainerStarted","Data":"852974848a9da39cc8f8bf3984e9d1931341e27b42068783f895a5b06a612888"}
Sep 15 11:00:00.831901 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:00.831759    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824500-vnm85" event={"ID":"db7c5c2b-1838-4571-bbcc-def5a32a876a","Type":"ContainerStarted","Data":"cd8e281ddf258c0af8671956d828dbbe1371de760db19caaa7eb2cf112e0c22a"}
Sep 15 11:00:00.846204 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:00.846150    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824500-vnm85" podStartSLOduration=0.846133071 podStartE2EDuration="846.133071ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:00:00.844438616 +0000 UTC m=+2534.240530705" watchObservedRunningTime="2026-09-15 11:00:00.846133071 +0000 UTC m=+2534.242225158"
Sep 15 11:00:01.838946 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:01.838910    2579 generic.go:356] "Generic (PLEG): container finished" podID="db7c5c2b-1838-4571-bbcc-def5a32a876a" containerID="852974848a9da39cc8f8bf3984e9d1931341e27b42068783f895a5b06a612888" exitCode=0
Sep 15 11:00:01.839329 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:01.838997    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824500-vnm85" event={"ID":"db7c5c2b-1838-4571-bbcc-def5a32a876a","Type":"ContainerDied","Data":"852974848a9da39cc8f8bf3984e9d1931341e27b42068783f895a5b06a612888"}
Sep 15 11:00:02.980063 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:02.980039    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824500-vnm85"
Sep 15 11:00:03.849515 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:03.849482    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824500-vnm85"
Sep 15 11:00:03.849685 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:03.849531    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824500-vnm85" event={"ID":"db7c5c2b-1838-4571-bbcc-def5a32a876a","Type":"ContainerDied","Data":"cd8e281ddf258c0af8671956d828dbbe1371de760db19caaa7eb2cf112e0c22a"}
Sep 15 11:00:03.849685 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:03.849591    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cd8e281ddf258c0af8671956d828dbbe1371de760db19caaa7eb2cf112e0c22a"
Sep 15 11:00:17.973031 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:17.972981    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-w665l_5c106c2b-9cab-4065-94fc-570cb38a824c/manager/0.log"
Sep 15 11:00:18.091102 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:18.091068    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-568cc65688-f5t57_f93a2943-6438-4edb-ae57-af65a67eaf07/manager/0.log"
Sep 15 11:00:18.545360 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:18.545331    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6699d7bd9c-bl6dv_f1f0c8e4-2edc-4730-b139-e5963034c519/copy-manifests/0.log"
Sep 15 11:00:18.551567 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:18.551549    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6699d7bd9c-bl6dv_f1f0c8e4-2edc-4730-b139-e5963034c519/manager/0.log"
Sep 15 11:00:19.199557 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:19.199516    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29824470-7wzq6_5fce7680-e335-4adf-8b99-66aec1612eb0/cleanup/0.log"
Sep 15 11:00:19.302257 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:19.302233    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29824485-xx4rm_aba8c176-382b-49aa-aee8-b15c7143d8da/cleanup/0.log"
Sep 15 11:00:19.405643 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:19.405611    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29824500-vnm85_db7c5c2b-1838-4571-bbcc-def5a32a876a/cleanup/0.log"
Sep 15 11:00:19.507831 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:19.507753    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-tgfw6_6772359c-7969-4cb6-bd66-4e4103d050fb/postgres/0.log"
Sep 15 11:00:20.357822 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:20.357791    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-rwzr7_ce598231-f2bd-402d-9de6-cc60a655f4f8/manager/0.log"
Sep 15 11:00:20.465096 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:20.465062    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-h784l_63c8dc47-0204-4647-a628-0aba034f0496/manager/0.log"
Sep 15 11:00:20.683271 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:20.683175    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-5m5kv_d091d2ef-044e-48a1-84a1-010af24c1996/manager/0.log"
Sep 15 11:00:20.903591 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:20.903562    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-4gb2h_d07bf3fa-0b4e-4118-8d17-791cc11bcf35/manager/0.log"
Sep 15 11:00:21.448133 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:21.448080    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58df565b49-nnp8b_df6356ab-59ce-4c29-b89e-e1fd72214d47/kube-auth-proxy/0.log"
Sep 15 11:00:21.663044 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:21.663013    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-7kkz5_c1c808c8-4ef3-4a21-bf2a-d632af367669/istio-proxy/1.log"
Sep 15 11:00:21.769421 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:21.769332    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-svrrd_0cdce33f-918e-4ba0-b2bc-f6e9a95f7996/payload-pre-processing/0.log"
Sep 15 11:00:21.879881 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:21.879849    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-frx6w_b2e4baf3-a86b-4bc0-9eca-144514bfafa8/payload-processing/0.log"
Sep 15 11:00:21.988541 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:21.988508    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7594c67c56-ww8nk_e50e72a0-48f2-4d2d-9490-1e77265c84b6/router/0.log"
Sep 15 11:00:22.305173 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:22.305132    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-xx5ch_5dd7e51d-4452-45fa-9d8d-b2c05259a2bd/main/0.log"
Sep 15 11:00:28.419615 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:28.419572    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2wphs/must-gather-v55p9"]
Sep 15 11:00:28.420007 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:28.419988    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db7c5c2b-1838-4571-bbcc-def5a32a876a" containerName="cleanup"
Sep 15 11:00:28.420007 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:28.420000    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="db7c5c2b-1838-4571-bbcc-def5a32a876a" containerName="cleanup"
Sep 15 11:00:28.420080 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:28.420060    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="db7c5c2b-1838-4571-bbcc-def5a32a876a" containerName="cleanup"
Sep 15 11:00:28.423216 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:28.423192    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2wphs/must-gather-v55p9"
Sep 15 11:00:28.425710 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:28.425688    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2wphs\"/\"default-dockercfg-4b7wp\""
Sep 15 11:00:28.425913 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:28.425890    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2wphs\"/\"openshift-service-ca.crt\""
Sep 15 11:00:28.426783 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:28.426768    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2wphs\"/\"kube-root-ca.crt\""
Sep 15 11:00:28.432273 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:28.432250    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2wphs/must-gather-v55p9"]
Sep 15 11:00:28.525736 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:28.525699    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a7bbe737-9da1-456e-8812-21404f9c4648-must-gather-output\") pod \"must-gather-v55p9\" (UID: \"a7bbe737-9da1-456e-8812-21404f9c4648\") " pod="openshift-must-gather-2wphs/must-gather-v55p9"
Sep 15 11:00:28.525937 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:28.525857    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f982g\" (UniqueName: \"kubernetes.io/projected/a7bbe737-9da1-456e-8812-21404f9c4648-kube-api-access-f982g\") pod \"must-gather-v55p9\" (UID: \"a7bbe737-9da1-456e-8812-21404f9c4648\") " pod="openshift-must-gather-2wphs/must-gather-v55p9"
Sep 15 11:00:28.626887 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:28.626820    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a7bbe737-9da1-456e-8812-21404f9c4648-must-gather-output\") pod \"must-gather-v55p9\" (UID: \"a7bbe737-9da1-456e-8812-21404f9c4648\") " pod="openshift-must-gather-2wphs/must-gather-v55p9"
Sep 15 11:00:28.627082 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:28.626925    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f982g\" (UniqueName: \"kubernetes.io/projected/a7bbe737-9da1-456e-8812-21404f9c4648-kube-api-access-f982g\") pod \"must-gather-v55p9\" (UID: \"a7bbe737-9da1-456e-8812-21404f9c4648\") " pod="openshift-must-gather-2wphs/must-gather-v55p9"
Sep 15 11:00:28.627235 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:28.627212    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a7bbe737-9da1-456e-8812-21404f9c4648-must-gather-output\") pod \"must-gather-v55p9\" (UID: \"a7bbe737-9da1-456e-8812-21404f9c4648\") " pod="openshift-must-gather-2wphs/must-gather-v55p9"
Sep 15 11:00:28.636622 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:28.636594    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f982g\" (UniqueName: \"kubernetes.io/projected/a7bbe737-9da1-456e-8812-21404f9c4648-kube-api-access-f982g\") pod \"must-gather-v55p9\" (UID: \"a7bbe737-9da1-456e-8812-21404f9c4648\") " pod="openshift-must-gather-2wphs/must-gather-v55p9"
Sep 15 11:00:28.733803 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:28.733680    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2wphs/must-gather-v55p9"
Sep 15 11:00:29.000795 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:29.000769    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2wphs/must-gather-v55p9"]
Sep 15 11:00:29.003316 ip-10-0-135-231 kubenswrapper[2579]: W0915 11:00:29.003289    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda7bbe737_9da1_456e_8812_21404f9c4648.slice/crio-e4976be1518f9f2fe96776709c869fe143b216687b69f8d417596b26de9fac1d WatchSource:0}: Error finding container e4976be1518f9f2fe96776709c869fe143b216687b69f8d417596b26de9fac1d: Status 404 returned error can't find the container with id e4976be1518f9f2fe96776709c869fe143b216687b69f8d417596b26de9fac1d
Sep 15 11:00:29.993465 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:29.993375    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2wphs/must-gather-v55p9" event={"ID":"a7bbe737-9da1-456e-8812-21404f9c4648","Type":"ContainerStarted","Data":"75eb79d3e916737ee608b1ec89343fa6d5b01fe9416a0a273aa636b01b5b09f9"}
Sep 15 11:00:29.993465 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:29.993418    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2wphs/must-gather-v55p9" event={"ID":"a7bbe737-9da1-456e-8812-21404f9c4648","Type":"ContainerStarted","Data":"4020bb1c4e9bfac22513042e761b8f034673ba83c3e9e50dade2777a6ca6e986"}
Sep 15 11:00:29.993465 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:29.993430    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2wphs/must-gather-v55p9" event={"ID":"a7bbe737-9da1-456e-8812-21404f9c4648","Type":"ContainerStarted","Data":"e4976be1518f9f2fe96776709c869fe143b216687b69f8d417596b26de9fac1d"}
Sep 15 11:00:30.012742 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:30.012654    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2wphs/must-gather-v55p9" podStartSLOduration=1.310756396 podStartE2EDuration="2.012632741s" totalImagesPullingTime="701.876345ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:00:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:00:30.008067076 +0000 UTC m=+2563.404159165" watchObservedRunningTime="2026-09-15 11:00:30.012632741 +0000 UTC m=+2563.408724829"
Sep 15 11:00:31.223593 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:31.223560    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-d48mp_ecad1164-c9d0-4df5-a0b8-382e33ac5629/global-pull-secret-syncer/0.log"
Sep 15 11:00:31.375205 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:31.375168    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-h4d8p_1a9137a7-9b75-4af5-8b82-10102bd76707/konnectivity-agent/0.log"
Sep 15 11:00:31.445036 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:31.445003    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-231.ec2.internal_d7516d9a8a3fc6042bb1e0dad3631678/haproxy/0.log"
Sep 15 11:00:36.101805 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:36.101765    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-rwzr7_ce598231-f2bd-402d-9de6-cc60a655f4f8/manager/0.log"
Sep 15 11:00:36.129493 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:36.129426    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-h784l_63c8dc47-0204-4647-a628-0aba034f0496/manager/0.log"
Sep 15 11:00:36.225971 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:36.225935    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-5m5kv_d091d2ef-044e-48a1-84a1-010af24c1996/manager/0.log"
Sep 15 11:00:36.323747 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:36.322795    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-4gb2h_d07bf3fa-0b4e-4118-8d17-791cc11bcf35/manager/0.log"
Sep 15 11:00:37.979221 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:37.979184    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-pzr7v_4fb7ba56-a242-461d-a7b2-e03daa1b56a4/cluster-monitoring-operator/0.log"
Sep 15 11:00:38.298667 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:38.298571    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jkbvn_db4c0e16-f681-40e7-9048-0002a5eb04e0/node-exporter/0.log"
Sep 15 11:00:38.319748 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:38.319538    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jkbvn_db4c0e16-f681-40e7-9048-0002a5eb04e0/kube-rbac-proxy/0.log"
Sep 15 11:00:38.344430 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:38.344399    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jkbvn_db4c0e16-f681-40e7-9048-0002a5eb04e0/init-textfile/0.log"
Sep 15 11:00:40.458674 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:40.458643    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-vs4m6_f9ee683b-5f4d-4a00-81d8-affa82ff7362/networking-console-plugin/0.log"
Sep 15 11:00:41.118524 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:41.118477    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-pqrzc_9d592c77-7bd0-4187-8f90-12c5e8f1dc32/console-operator/0.log"
Sep 15 11:00:42.282252 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:42.282214    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2wphs/perf-node-gather-daemonset-58k4d"]
Sep 15 11:00:42.291585 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:42.291554    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2wphs/perf-node-gather-daemonset-58k4d"
Sep 15 11:00:42.293824 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:42.293793    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2wphs/perf-node-gather-daemonset-58k4d"]
Sep 15 11:00:42.383552 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:42.383501    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/24969557-4814-42fe-a5f7-cecf41cf5706-proc\") pod \"perf-node-gather-daemonset-58k4d\" (UID: \"24969557-4814-42fe-a5f7-cecf41cf5706\") " pod="openshift-must-gather-2wphs/perf-node-gather-daemonset-58k4d"
Sep 15 11:00:42.383758 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:42.383581    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/24969557-4814-42fe-a5f7-cecf41cf5706-sys\") pod \"perf-node-gather-daemonset-58k4d\" (UID: \"24969557-4814-42fe-a5f7-cecf41cf5706\") " pod="openshift-must-gather-2wphs/perf-node-gather-daemonset-58k4d"
Sep 15 11:00:42.383758 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:42.383634    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/24969557-4814-42fe-a5f7-cecf41cf5706-lib-modules\") pod \"perf-node-gather-daemonset-58k4d\" (UID: \"24969557-4814-42fe-a5f7-cecf41cf5706\") " pod="openshift-must-gather-2wphs/perf-node-gather-daemonset-58k4d"
Sep 15 11:00:42.383758 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:42.383714    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdcgl\" (UniqueName: \"kubernetes.io/projected/24969557-4814-42fe-a5f7-cecf41cf5706-kube-api-access-hdcgl\") pod \"perf-node-gather-daemonset-58k4d\" (UID: \"24969557-4814-42fe-a5f7-cecf41cf5706\") " pod="openshift-must-gather-2wphs/perf-node-gather-daemonset-58k4d"
Sep 15 11:00:42.383957 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:42.383844    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/24969557-4814-42fe-a5f7-cecf41cf5706-podres\") pod \"perf-node-gather-daemonset-58k4d\" (UID: \"24969557-4814-42fe-a5f7-cecf41cf5706\") " pod="openshift-must-gather-2wphs/perf-node-gather-daemonset-58k4d"
Sep 15 11:00:42.485149 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:42.485110    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/24969557-4814-42fe-a5f7-cecf41cf5706-podres\") pod \"perf-node-gather-daemonset-58k4d\" (UID: \"24969557-4814-42fe-a5f7-cecf41cf5706\") " pod="openshift-must-gather-2wphs/perf-node-gather-daemonset-58k4d"
Sep 15 11:00:42.485344 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:42.485160    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/24969557-4814-42fe-a5f7-cecf41cf5706-proc\") pod \"perf-node-gather-daemonset-58k4d\" (UID: \"24969557-4814-42fe-a5f7-cecf41cf5706\") " pod="openshift-must-gather-2wphs/perf-node-gather-daemonset-58k4d"
Sep 15 11:00:42.485344 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:42.485191    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/24969557-4814-42fe-a5f7-cecf41cf5706-sys\") pod \"perf-node-gather-daemonset-58k4d\" (UID: \"24969557-4814-42fe-a5f7-cecf41cf5706\") " pod="openshift-must-gather-2wphs/perf-node-gather-daemonset-58k4d"
Sep 15 11:00:42.485344 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:42.485205    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/24969557-4814-42fe-a5f7-cecf41cf5706-lib-modules\") pod \"perf-node-gather-daemonset-58k4d\" (UID: \"24969557-4814-42fe-a5f7-cecf41cf5706\") " pod="openshift-must-gather-2wphs/perf-node-gather-daemonset-58k4d"
Sep 15 11:00:42.485344 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:42.485234    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdcgl\" (UniqueName: \"kubernetes.io/projected/24969557-4814-42fe-a5f7-cecf41cf5706-kube-api-access-hdcgl\") pod \"perf-node-gather-daemonset-58k4d\" (UID: \"24969557-4814-42fe-a5f7-cecf41cf5706\") " pod="openshift-must-gather-2wphs/perf-node-gather-daemonset-58k4d"
Sep 15 11:00:42.485344 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:42.485302    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/24969557-4814-42fe-a5f7-cecf41cf5706-podres\") pod \"perf-node-gather-daemonset-58k4d\" (UID: \"24969557-4814-42fe-a5f7-cecf41cf5706\") " pod="openshift-must-gather-2wphs/perf-node-gather-daemonset-58k4d"
Sep 15 11:00:42.485344 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:42.485302    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/24969557-4814-42fe-a5f7-cecf41cf5706-sys\") pod \"perf-node-gather-daemonset-58k4d\" (UID: \"24969557-4814-42fe-a5f7-cecf41cf5706\") " pod="openshift-must-gather-2wphs/perf-node-gather-daemonset-58k4d"
Sep 15 11:00:42.485660 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:42.485345    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/24969557-4814-42fe-a5f7-cecf41cf5706-proc\") pod \"perf-node-gather-daemonset-58k4d\" (UID: \"24969557-4814-42fe-a5f7-cecf41cf5706\") " pod="openshift-must-gather-2wphs/perf-node-gather-daemonset-58k4d"
Sep 15 11:00:42.485660 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:42.485496    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/24969557-4814-42fe-a5f7-cecf41cf5706-lib-modules\") pod \"perf-node-gather-daemonset-58k4d\" (UID: \"24969557-4814-42fe-a5f7-cecf41cf5706\") " pod="openshift-must-gather-2wphs/perf-node-gather-daemonset-58k4d"
Sep 15 11:00:42.494056 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:42.493992    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdcgl\" (UniqueName: \"kubernetes.io/projected/24969557-4814-42fe-a5f7-cecf41cf5706-kube-api-access-hdcgl\") pod \"perf-node-gather-daemonset-58k4d\" (UID: \"24969557-4814-42fe-a5f7-cecf41cf5706\") " pod="openshift-must-gather-2wphs/perf-node-gather-daemonset-58k4d"
Sep 15 11:00:42.510700 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:42.510658    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-5d69f_5a686d3b-f162-4b86-8f8e-b0f9871c0375/volume-data-source-validator/0.log"
Sep 15 11:00:42.605562 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:42.605475    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2wphs/perf-node-gather-daemonset-58k4d"
Sep 15 11:00:42.908327 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:42.908250    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2wphs/perf-node-gather-daemonset-58k4d"]
Sep 15 11:00:43.093493 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:43.093453    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2wphs/perf-node-gather-daemonset-58k4d" event={"ID":"24969557-4814-42fe-a5f7-cecf41cf5706","Type":"ContainerStarted","Data":"c1a888176990415821c12ed0cc01b40f74406a7cb234ad4386d84f50c6db8dcd"}
Sep 15 11:00:43.094255 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:43.093804    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2wphs/perf-node-gather-daemonset-58k4d"
Sep 15 11:00:43.094434 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:43.094413    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2wphs/perf-node-gather-daemonset-58k4d" event={"ID":"24969557-4814-42fe-a5f7-cecf41cf5706","Type":"ContainerStarted","Data":"32ae8639c4e78a60617d9234ec46f5d69aa6818fd604537736231bb406d7c007"}
Sep 15 11:00:43.109742 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:43.109673    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2wphs/perf-node-gather-daemonset-58k4d" podStartSLOduration=1.109657982 podStartE2EDuration="1.109657982s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:00:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:00:43.108815653 +0000 UTC m=+2576.504907739" watchObservedRunningTime="2026-09-15 11:00:43.109657982 +0000 UTC m=+2576.505750069"
Sep 15 11:00:43.760485 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:43.760456    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hqxdd_8bd905c9-2601-4b09-93ff-07596c04b509/dns/0.log"
Sep 15 11:00:43.779151 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:43.779122    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hqxdd_8bd905c9-2601-4b09-93ff-07596c04b509/kube-rbac-proxy/0.log"
Sep 15 11:00:43.896473 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:43.896445    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t5gjf_764a519b-87a8-4759-b03a-585cc4731146/dns-node-resolver/0.log"
Sep 15 11:00:44.570680 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:44.570650    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pbf8k_aaa39564-bf93-4ed2-b834-bdb0dba37aea/node-ca/0.log"
Sep 15 11:00:45.981988 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:45.981960    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58df565b49-nnp8b_df6356ab-59ce-4c29-b89e-e1fd72214d47/kube-auth-proxy/0.log"
Sep 15 11:00:46.040691 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:46.040660    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-7kkz5_c1c808c8-4ef3-4a21-bf2a-d632af367669/istio-proxy/0.log"
Sep 15 11:00:46.043798 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:46.043766    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-7kkz5_c1c808c8-4ef3-4a21-bf2a-d632af367669/istio-proxy/1.log"
Sep 15 11:00:46.080853 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:46.080808    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-svrrd_0cdce33f-918e-4ba0-b2bc-f6e9a95f7996/payload-pre-processing/0.log"
Sep 15 11:00:46.118284 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:46.118246    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-frx6w_b2e4baf3-a86b-4bc0-9eca-144514bfafa8/payload-processing/0.log"
Sep 15 11:00:46.141007 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:46.140978    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7594c67c56-ww8nk_e50e72a0-48f2-4d2d-9490-1e77265c84b6/router/0.log"
Sep 15 11:00:47.018785 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:47.018755    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fqjvg_a79f7e20-c11d-4204-bde9-8cd257af7a46/serve-healthcheck-canary/0.log"
Sep 15 11:00:47.542322 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:47.542289    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-8tffb_fc61ef2f-aa66-46c2-b5b9-59f2cc500775/insights-operator/0.log"
Sep 15 11:00:47.707114 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:47.707079    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fmwsn_217b59f7-d005-4acd-b7ef-144d5be0991e/kube-rbac-proxy/0.log"
Sep 15 11:00:47.727165 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:47.727132    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fmwsn_217b59f7-d005-4acd-b7ef-144d5be0991e/exporter/0.log"
Sep 15 11:00:47.748061 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:47.748027    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fmwsn_217b59f7-d005-4acd-b7ef-144d5be0991e/extractor/0.log"
Sep 15 11:00:47.890550 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:47.890464    2579 scope.go:117] "RemoveContainer" containerID="231429410b3b7e761f80c752c12ebced9ed435f825a801eb23e1381d2fdc4420"
Sep 15 11:00:47.901283 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:47.901235    2579 scope.go:117] "RemoveContainer" containerID="6f02094505293f51fc5556ba853508900aa592b9c7d54acc4fd87f6c3412aaeb"
Sep 15 11:00:50.119427 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:50.119393    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2wphs/perf-node-gather-daemonset-58k4d"
Sep 15 11:00:50.130049 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:50.130018    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-w665l_5c106c2b-9cab-4065-94fc-570cb38a824c/manager/0.log"
Sep 15 11:00:50.191876 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:50.191838    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-568cc65688-f5t57_f93a2943-6438-4edb-ae57-af65a67eaf07/manager/0.log"
Sep 15 11:00:50.407541 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:50.407444    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6699d7bd9c-bl6dv_f1f0c8e4-2edc-4730-b139-e5963034c519/manager/0.log"
Sep 15 11:00:50.427106 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:50.427072    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6699d7bd9c-bl6dv_f1f0c8e4-2edc-4730-b139-e5963034c519/copy-manifests/0.log"
Sep 15 11:00:52.772880 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:52.772800    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58df565b49-nnp8b_df6356ab-59ce-4c29-b89e-e1fd72214d47/kube-auth-proxy/0.log"
Sep 15 11:00:52.804207 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:52.804174    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-7kkz5_c1c808c8-4ef3-4a21-bf2a-d632af367669/istio-proxy/0.log"
Sep 15 11:00:52.807915 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:52.807888    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-7kkz5_c1c808c8-4ef3-4a21-bf2a-d632af367669/istio-proxy/1.log"
Sep 15 11:00:52.831115 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:52.831077    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-svrrd_0cdce33f-918e-4ba0-b2bc-f6e9a95f7996/payload-pre-processing/0.log"
Sep 15 11:00:52.860839 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:52.860806    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-frx6w_b2e4baf3-a86b-4bc0-9eca-144514bfafa8/payload-processing/0.log"
Sep 15 11:00:52.873475 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:52.873449    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7594c67c56-ww8nk_e50e72a0-48f2-4d2d-9490-1e77265c84b6/router/0.log"
Sep 15 11:00:54.899068 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:54.899039    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58df565b49-nnp8b_df6356ab-59ce-4c29-b89e-e1fd72214d47/kube-auth-proxy/0.log"
Sep 15 11:00:54.938411 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:54.938379    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-7kkz5_c1c808c8-4ef3-4a21-bf2a-d632af367669/istio-proxy/0.log"
Sep 15 11:00:54.941148 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:54.941101    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-7kkz5_c1c808c8-4ef3-4a21-bf2a-d632af367669/istio-proxy/1.log"
Sep 15 11:00:54.963093 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:54.963066    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-svrrd_0cdce33f-918e-4ba0-b2bc-f6e9a95f7996/payload-pre-processing/0.log"
Sep 15 11:00:54.992514 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:54.992481    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-frx6w_b2e4baf3-a86b-4bc0-9eca-144514bfafa8/payload-processing/0.log"
Sep 15 11:00:55.006084 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:55.006036    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7594c67c56-ww8nk_e50e72a0-48f2-4d2d-9490-1e77265c84b6/router/0.log"
Sep 15 11:00:57.210026 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:57.210000    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-v9xzk_e8ba041a-9aae-4323-ae15-cedce130f84b/migrator/0.log"
Sep 15 11:00:57.231204 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:57.231174    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-v9xzk_e8ba041a-9aae-4323-ae15-cedce130f84b/graceful-termination/0.log"
Sep 15 11:00:57.578249 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:57.578217    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-xqnct_d42015bc-21f5-4d25-8cc5-0ade2c4a93fa/kube-storage-version-migrator-operator/1.log"
Sep 15 11:00:57.579173 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:57.579152    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-xqnct_d42015bc-21f5-4d25-8cc5-0ade2c4a93fa/kube-storage-version-migrator-operator/0.log"
Sep 15 11:00:58.850651 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:58.850625    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vl7m7_8821682e-804a-4bc8-9b87-f190576d59f4/kube-multus-additional-cni-plugins/0.log"
Sep 15 11:00:58.871124 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:58.871097    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vl7m7_8821682e-804a-4bc8-9b87-f190576d59f4/egress-router-binary-copy/0.log"
Sep 15 11:00:58.892541 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:58.892515    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vl7m7_8821682e-804a-4bc8-9b87-f190576d59f4/cni-plugins/0.log"
Sep 15 11:00:58.911439 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:58.911413    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vl7m7_8821682e-804a-4bc8-9b87-f190576d59f4/bond-cni-plugin/0.log"
Sep 15 11:00:58.934509 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:58.934489    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vl7m7_8821682e-804a-4bc8-9b87-f190576d59f4/routeoverride-cni/0.log"
Sep 15 11:00:58.958808 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:58.958777    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vl7m7_8821682e-804a-4bc8-9b87-f190576d59f4/whereabouts-cni-bincopy/0.log"
Sep 15 11:00:58.980176 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:58.980146    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vl7m7_8821682e-804a-4bc8-9b87-f190576d59f4/whereabouts-cni/0.log"
Sep 15 11:00:59.032364 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:59.032325    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jlrbr_9f425ab3-69a3-4fa3-81a0-2bccfb818349/kube-multus/0.log"
Sep 15 11:00:59.219168 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:59.219061    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hh4zk_c101b9f1-4c96-416c-b899-fc7eee86e4ea/network-metrics-daemon/0.log"
Sep 15 11:00:59.234442 ip-10-0-135-231 kubenswrapper[2579]: I0915 11:00:59.234417    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hh4zk_c101b9f1-4c96-416c-b899-fc7eee86e4ea/kube-rbac-proxy/0.log"