Sep 11 11:32:04.083284 ip-10-0-142-230 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 11 11:32:04.083299 ip-10-0-142-230 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 11 11:32:04.083309 ip-10-0-142-230 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 11 11:32:04.083552 ip-10-0-142-230 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 11 11:32:14.222675 ip-10-0-142-230 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 11 11:32:14.222690 ip-10-0-142-230 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot ef72c833b1d844648463d67c8703f4fa --
Sep 11 11:34:09.088939 ip-10-0-142-230 systemd[1]: Starting Kubernetes Kubelet...
Sep 11 11:34:09.487239 ip-10-0-142-230 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 11:34:09.487239 ip-10-0-142-230 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 11 11:34:09.487239 ip-10-0-142-230 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 11:34:09.487239 ip-10-0-142-230 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 11 11:34:09.487239 ip-10-0-142-230 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 11:34:09.489247 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.489158    2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 11 11:34:09.493318 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493304    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 11:34:09.493318 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493319    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 11:34:09.493384 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493324    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 11:34:09.493384 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493327    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 11:34:09.493384 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493330    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 11:34:09.493384 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493333    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 11:34:09.493384 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493336    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 11:34:09.493384 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493339    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 11:34:09.493384 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493342    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 11:34:09.493384 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493345    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 11:34:09.493384 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493347    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 11:34:09.493384 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493350    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 11:34:09.493384 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493353    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 11:34:09.493384 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493355    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 11:34:09.493384 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493358    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 11:34:09.493384 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493362    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 11:34:09.493384 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493364    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 11:34:09.493384 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493367    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 11:34:09.493384 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493370    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 11:34:09.493384 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493373    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 11:34:09.493384 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493376    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 11:34:09.493384 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493379    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 11:34:09.493924 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493381    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 11:34:09.493924 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493384    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 11:34:09.493924 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493387    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 11:34:09.493924 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493390    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 11:34:09.493924 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493393    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 11:34:09.493924 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493396    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 11:34:09.493924 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493399    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 11:34:09.493924 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493403    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 11:34:09.493924 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493407    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 11:34:09.493924 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493410    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 11:34:09.493924 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493413    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 11:34:09.493924 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493416    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 11:34:09.493924 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493419    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 11:34:09.493924 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493422    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 11:34:09.493924 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493424    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 11:34:09.493924 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493427    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 11:34:09.493924 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493430    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 11:34:09.493924 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493433    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 11:34:09.493924 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493435    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 11:34:09.493924 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493437    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 11:34:09.494409 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493441    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 11:34:09.494409 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493443    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 11:34:09.494409 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493446    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 11:34:09.494409 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493448    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 11:34:09.494409 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493451    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 11:34:09.494409 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493453    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 11:34:09.494409 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493456    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 11:34:09.494409 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493458    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 11:34:09.494409 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493461    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 11:34:09.494409 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493463    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 11:34:09.494409 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493466    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 11:34:09.494409 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493468    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 11:34:09.494409 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493470    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 11:34:09.494409 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493475    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 11:34:09.494409 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493478    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 11:34:09.494409 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493480    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 11:34:09.494409 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493486    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 11:34:09.494409 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493490    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 11:34:09.494409 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493493    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 11:34:09.494409 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493496    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 11:34:09.494908 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493498    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 11:34:09.494908 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493502    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 11:34:09.494908 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493504    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 11:34:09.494908 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493507    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 11:34:09.494908 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493510    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 11:34:09.494908 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493512    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 11:34:09.494908 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493515    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 11:34:09.494908 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493518    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 11:34:09.494908 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493520    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 11:34:09.494908 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493523    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 11:34:09.494908 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493525    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 11:34:09.494908 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493528    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 11:34:09.494908 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493531    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 11:34:09.494908 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493534    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 11:34:09.494908 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493536    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 11:34:09.494908 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493539    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 11:34:09.494908 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493542    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 11:34:09.494908 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493544    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 11:34:09.494908 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493547    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 11:34:09.494908 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493549    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 11:34:09.495396 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493552    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 11:34:09.495396 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493554    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 11:34:09.495396 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493557    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 11:34:09.495396 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493560    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 11:34:09.495396 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493564    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 11:34:09.495396 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493568    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 11:34:09.495396 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493571    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 11:34:09.495396 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493573    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 11:34:09.495396 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493576    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 11:34:09.495396 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493578    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 11:34:09.495396 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493581    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 11:34:09.495396 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493583    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 11:34:09.495396 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493586    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 11:34:09.495396 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493588    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 11:34:09.495396 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493591    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 11:34:09.495396 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493593    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 11:34:09.495396 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.493596    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 11:34:09.495396 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494317    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 11:34:09.495396 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494323    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 11:34:09.495885 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494326    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 11:34:09.495885 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494329    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 11:34:09.495885 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494332    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 11:34:09.495885 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494335    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 11:34:09.495885 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494337    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 11:34:09.495885 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494340    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 11:34:09.495885 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494343    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 11:34:09.495885 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494346    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 11:34:09.495885 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494349    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 11:34:09.495885 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494352    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 11:34:09.495885 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494355    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 11:34:09.495885 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494357    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 11:34:09.495885 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494360    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 11:34:09.495885 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494363    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 11:34:09.495885 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494365    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 11:34:09.495885 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494368    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 11:34:09.495885 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494370    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 11:34:09.495885 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494373    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 11:34:09.495885 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494376    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 11:34:09.495885 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494379    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 11:34:09.496415 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494382    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 11:34:09.496415 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494384    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 11:34:09.496415 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494387    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 11:34:09.496415 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494389    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 11:34:09.496415 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494392    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 11:34:09.496415 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494396    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 11:34:09.496415 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494401    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 11:34:09.496415 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494405    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 11:34:09.496415 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494409    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 11:34:09.496415 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494412    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 11:34:09.496415 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494415    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 11:34:09.496415 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494418    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 11:34:09.496415 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494420    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 11:34:09.496415 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494423    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 11:34:09.496415 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494426    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 11:34:09.496415 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494428    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 11:34:09.496415 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494431    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 11:34:09.496415 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494434    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 11:34:09.496415 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494436    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 11:34:09.496900 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494439    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 11:34:09.496900 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494442    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 11:34:09.496900 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494444    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 11:34:09.496900 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494447    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 11:34:09.496900 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494450    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 11:34:09.496900 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494452    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 11:34:09.496900 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494456    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 11:34:09.496900 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494459    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 11:34:09.496900 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494461    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 11:34:09.496900 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494464    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 11:34:09.496900 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494466    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 11:34:09.496900 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494470    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 11:34:09.496900 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494473    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 11:34:09.496900 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494475    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 11:34:09.496900 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494478    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 11:34:09.496900 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494481    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 11:34:09.496900 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494483    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 11:34:09.496900 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494486    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 11:34:09.496900 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494489    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 11:34:09.497369 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494491    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 11:34:09.497369 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494494    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 11:34:09.497369 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494496    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 11:34:09.497369 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494499    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 11:34:09.497369 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494502    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 11:34:09.497369 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494504    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 11:34:09.497369 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494507    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 11:34:09.497369 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494510    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 11:34:09.497369 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494513    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 11:34:09.497369 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494515    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 11:34:09.497369 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494518    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 11:34:09.497369 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494521    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 11:34:09.497369 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494523    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 11:34:09.497369 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494526    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 11:34:09.497369 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494528    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 11:34:09.497369 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494531    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 11:34:09.497369 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494533    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 11:34:09.497369 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494536    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 11:34:09.497369 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494538    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 11:34:09.497369 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494541    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 11:34:09.497369 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494543    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 11:34:09.497887 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494546    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 11:34:09.497887 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494548    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 11:34:09.497887 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494551    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 11:34:09.497887 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494556    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 11:34:09.497887 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494558    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 11:34:09.497887 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494561    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 11:34:09.497887 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494563    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 11:34:09.497887 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494566    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 11:34:09.497887 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494569    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 11:34:09.497887 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494571    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 11:34:09.497887 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494574    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 11:34:09.497887 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494578    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 11:34:09.497887 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494582    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 11:34:09.497887 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494585    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 11:34:09.497887 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494588    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 11:34:09.497887 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494591    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 11:34:09.497887 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494593    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 11:34:09.497887 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.494596    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 11:34:09.497887 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495037    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 11:34:09.498365 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495043    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 11:34:09.498365 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495046    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 11:34:09.498365 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495050    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 11:34:09.498365 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495053    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 11:34:09.498365 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495056    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 11:34:09.498365 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495059    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 11:34:09.498365 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495062    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 11:34:09.498365 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495066    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 11:34:09.498365 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495070    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 11:34:09.498365 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495073    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 11:34:09.498365 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495076    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 11:34:09.498365 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495079    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 11:34:09.498365 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495082    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 11:34:09.498365 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495085    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 11:34:09.498365 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495088    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 11:34:09.498365 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495091    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 11:34:09.498365 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495094    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 11:34:09.498365 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495097    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 11:34:09.498365 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495100    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 11:34:09.498365 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495103    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 11:34:09.498859 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495106    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 11:34:09.498859 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495108    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 11:34:09.498859 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495111    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 11:34:09.498859 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495114    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 11:34:09.498859 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495117    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 11:34:09.498859 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495120    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 11:34:09.498859 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495123    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 11:34:09.498859 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495125    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 11:34:09.498859 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495128    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 11:34:09.498859 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495131    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 11:34:09.498859 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495133    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 11:34:09.498859 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495136    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 11:34:09.498859 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495138    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 11:34:09.498859 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495141    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 11:34:09.498859 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495143    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 11:34:09.498859 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495146    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 11:34:09.498859 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495149    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 11:34:09.498859 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495151    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 11:34:09.498859 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495153    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 11:34:09.498859 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495156    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 11:34:09.499348 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495159    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 11:34:09.499348 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495161    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 11:34:09.499348 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495164    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 11:34:09.499348 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495166    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 11:34:09.499348 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495169    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 11:34:09.499348 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495171    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 11:34:09.499348 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495176    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 11:34:09.499348 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495179    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 11:34:09.499348 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495182    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 11:34:09.499348 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495184    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 11:34:09.499348 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495187    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 11:34:09.499348 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495190    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 11:34:09.499348 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495192    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 11:34:09.499348 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495195    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 11:34:09.499348 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495197    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 11:34:09.499348 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495200    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 11:34:09.499348 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495203    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 11:34:09.499348 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495206    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 11:34:09.499348 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495209    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 11:34:09.499348 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495212    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 11:34:09.499850 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495215    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 11:34:09.499850 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495217    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 11:34:09.499850 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495220    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 11:34:09.499850 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495223    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 11:34:09.499850 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495226    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 11:34:09.499850 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495228    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 11:34:09.499850 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495231    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 11:34:09.499850 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495233    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 11:34:09.499850 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495238    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 11:34:09.499850 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495241    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 11:34:09.499850 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495244    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 11:34:09.499850 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495246    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 11:34:09.499850 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495249    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 11:34:09.499850 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495252    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 11:34:09.499850 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495254    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 11:34:09.499850 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495257    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 11:34:09.499850 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495260    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 11:34:09.499850 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495262    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 11:34:09.499850 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495266    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 11:34:09.499850 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495269    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 11:34:09.500338 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495272    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 11:34:09.500338 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495274    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 11:34:09.500338 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495277    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 11:34:09.500338 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495279    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 11:34:09.500338 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495282    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 11:34:09.500338 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495285    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 11:34:09.500338 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495287    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 11:34:09.500338 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495290    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 11:34:09.500338 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495293    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 11:34:09.500338 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495295    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 11:34:09.500338 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495298    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 11:34:09.500338 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495300    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 11:34:09.500338 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495303    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 11:34:09.500338 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495305    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 11:34:09.500338 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495308    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 11:34:09.500338 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495312    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 11:34:09.500338 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495315    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 11:34:09.500338 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.495318    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 11:34:09.500338 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495382    2560 flags.go:64] FLAG: --address="0.0.0.0"
Sep 11 11:34:09.500841 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495412    2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 11 11:34:09.500841 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495418    2560 flags.go:64] FLAG: --anonymous-auth="true"
Sep 11 11:34:09.500841 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495423    2560 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 11 11:34:09.500841 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495427    2560 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 11 11:34:09.500841 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495431    2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 11 11:34:09.500841 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495435    2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 11 11:34:09.500841 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495439    2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 11 11:34:09.500841 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495450    2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 11 11:34:09.500841 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495454    2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 11 11:34:09.500841 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495457    2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 11 11:34:09.500841 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495460    2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 11 11:34:09.500841 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495465    2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 11 11:34:09.500841 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495470    2560 flags.go:64] FLAG: --cgroup-root=""
Sep 11 11:34:09.500841 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495473    2560 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 11 11:34:09.500841 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495476    2560 flags.go:64] FLAG: --client-ca-file=""
Sep 11 11:34:09.500841 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495479    2560 flags.go:64] FLAG: --cloud-provider="external"
Sep 11 11:34:09.500841 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495482    2560 flags.go:64] FLAG: --cluster-dns="[]"
Sep 11 11:34:09.500841 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495486    2560 flags.go:64] FLAG: --cluster-domain=""
Sep 11 11:34:09.500841 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495489    2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 11 11:34:09.500841 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495492    2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 11 11:34:09.500841 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495495    2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 11 11:34:09.500841 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495498    2560 flags.go:64] FLAG: --container-log-max-files="5"
Sep 11 11:34:09.500841 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495506    2560 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 11 11:34:09.500841 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495509    2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 11 11:34:09.501442 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495512    2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 11 11:34:09.501442 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495516    2560 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 11 11:34:09.501442 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495519    2560 flags.go:64] FLAG: --contention-profiling="false"
Sep 11 11:34:09.501442 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495522    2560 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 11 11:34:09.501442 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495525    2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 11 11:34:09.501442 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495528    2560 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 11 11:34:09.501442 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495531    2560 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 11 11:34:09.501442 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495535    2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 11 11:34:09.501442 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495538    2560 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 11 11:34:09.501442 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495541    2560 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 11 11:34:09.501442 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495544    2560 flags.go:64] FLAG: --enable-load-reader="false"
Sep 11 11:34:09.501442 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495547    2560 flags.go:64] FLAG: --enable-server="true"
Sep 11 11:34:09.501442 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495550    2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 11 11:34:09.501442 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495555    2560 flags.go:64] FLAG: --event-burst="100"
Sep 11 11:34:09.501442 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495559    2560 flags.go:64] FLAG: --event-qps="50"
Sep 11 11:34:09.501442 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495561    2560 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 11 11:34:09.501442 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495565    2560 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 11 11:34:09.501442 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495568    2560 flags.go:64] FLAG: --eviction-hard=""
Sep 11 11:34:09.501442 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495571    2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 11 11:34:09.501442 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495577    2560 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 11 11:34:09.501442 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495581    2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 11 11:34:09.501442 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495585    2560 flags.go:64] FLAG: --eviction-soft=""
Sep 11 11:34:09.501442 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495588    2560 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 11 11:34:09.501442 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495591    2560 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 11 11:34:09.501442 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495594    2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 11 11:34:09.502102 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495597    2560 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 11 11:34:09.502102 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495600    2560 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 11 11:34:09.502102 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495603    2560 flags.go:64] FLAG: --fail-swap-on="true"
Sep 11 11:34:09.502102 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495606    2560 flags.go:64] FLAG: --feature-gates=""
Sep 11 11:34:09.502102 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495610    2560 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 11 11:34:09.502102 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495613    2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 11 11:34:09.502102 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495615    2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 11 11:34:09.502102 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495619    2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 11 11:34:09.502102 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495622    2560 flags.go:64] FLAG: --healthz-port="10248"
Sep 11 11:34:09.502102 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495625    2560 flags.go:64] FLAG: --help="false"
Sep 11 11:34:09.502102 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495628    2560 flags.go:64] FLAG: --hostname-override="ip-10-0-142-230.ec2.internal"
Sep 11 11:34:09.502102 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495630    2560 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 11 11:34:09.502102 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495633    2560 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 11 11:34:09.502102 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495636    2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 11 11:34:09.502102 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495640    2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 11 11:34:09.502102 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495656    2560 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 11 11:34:09.502102 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495659    2560 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 11 11:34:09.502102 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495662    2560 flags.go:64] FLAG: --image-service-endpoint=""
Sep 11 11:34:09.502102 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495665    2560 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 11 11:34:09.502102 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495668    2560 flags.go:64] FLAG: --kube-api-burst="100"
Sep 11 11:34:09.502102 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495671    2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 11 11:34:09.502102 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495674    2560 flags.go:64] FLAG: --kube-api-qps="50"
Sep 11 11:34:09.502102 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495677    2560 flags.go:64] FLAG: --kube-reserved=""
Sep 11 11:34:09.502102 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495680    2560 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 11 11:34:09.502753 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495684    2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 11 11:34:09.502753 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495687    2560 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 11 11:34:09.502753 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495691    2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 11 11:34:09.502753 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495695    2560 flags.go:64] FLAG: --lock-file=""
Sep 11 11:34:09.502753 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495698    2560 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 11 11:34:09.502753 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495701    2560 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 11 11:34:09.502753 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495704    2560 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 11 11:34:09.502753 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495710    2560 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 11 11:34:09.502753 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495713    2560 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 11 11:34:09.502753 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495715    2560 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 11 11:34:09.502753 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495719    2560 flags.go:64] FLAG: --logging-format="text"
Sep 11 11:34:09.502753 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495722    2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 11 11:34:09.502753 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495726    2560 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 11 11:34:09.502753 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495728    2560 flags.go:64] FLAG: --manifest-url=""
Sep 11 11:34:09.502753 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495731    2560 flags.go:64] FLAG: --manifest-url-header=""
Sep 11 11:34:09.502753 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495736    2560 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 11 11:34:09.502753 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495738    2560 flags.go:64] FLAG: --max-open-files="1000000"
Sep 11 11:34:09.502753 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495743    2560 flags.go:64] FLAG: --max-pods="110"
Sep 11 11:34:09.502753 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495746    2560 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 11 11:34:09.502753 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495749    2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 11 11:34:09.502753 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495752    2560 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 11 11:34:09.502753 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495755    2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 11 11:34:09.502753 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495758    2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 11 11:34:09.502753 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495761    2560 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 11 11:34:09.502753 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495764    2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 11 11:34:09.503475 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495770    2560 flags.go:64] FLAG: --node-status-max-images="50"
Sep 11 11:34:09.503475 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495773    2560 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 11 11:34:09.503475 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495776    2560 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 11 11:34:09.503475 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495779    2560 flags.go:64] FLAG: --pod-cidr=""
Sep 11 11:34:09.503475 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495782    2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 11 11:34:09.503475 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495787    2560 flags.go:64] FLAG: --pod-manifest-path=""
Sep 11 11:34:09.503475 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495791    2560 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 11 11:34:09.503475 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495794    2560 flags.go:64] FLAG: --pods-per-core="0"
Sep 11 11:34:09.503475 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495797    2560 flags.go:64] FLAG: --port="10250"
Sep 11 11:34:09.503475 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495800    2560 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 11 11:34:09.503475 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495808    2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-010849422d7b4e68e"
Sep 11 11:34:09.503475 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495811    2560 flags.go:64] FLAG: --qos-reserved=""
Sep 11 11:34:09.503475 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495814    2560 flags.go:64] FLAG: --read-only-port="10255"
Sep 11 11:34:09.503475 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495817    2560 flags.go:64] FLAG: --register-node="true"
Sep 11 11:34:09.503475 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495820    2560 flags.go:64] FLAG: --register-with-taints=""
Sep 11 11:34:09.503475 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495824    2560 flags.go:64] FLAG: --registry-burst="10"
Sep 11 11:34:09.503475 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495827    2560 flags.go:64] FLAG: --registry-qps="5"
Sep 11 11:34:09.503475 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495830    2560 flags.go:64] FLAG: --reserved-cpus=""
Sep 11 11:34:09.503475 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495832    2560 flags.go:64] FLAG: --reserved-memory=""
Sep 11 11:34:09.503475 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495836    2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 11 11:34:09.503475 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495839    2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 11 11:34:09.503475 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495842    2560 flags.go:64] FLAG: --rotate-certificates="false"
Sep 11 11:34:09.503475 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495845    2560 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 11 11:34:09.503475 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495848    2560 flags.go:64] FLAG: --runonce="false"
Sep 11 11:34:09.503475 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495851    2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 11 11:34:09.504148 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495854    2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 11 11:34:09.504148 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495857    2560 flags.go:64] FLAG: --seccomp-default="false"
Sep 11 11:34:09.504148 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495860    2560 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 11 11:34:09.504148 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495863    2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 11 11:34:09.504148 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495866    2560 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 11 11:34:09.504148 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495869    2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 11 11:34:09.504148 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495872    2560 flags.go:64] FLAG: --storage-driver-password="root"
Sep 11 11:34:09.504148 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495875    2560 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 11 11:34:09.504148 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495878    2560 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 11 11:34:09.504148 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495881    2560 flags.go:64] FLAG: --storage-driver-user="root"
Sep 11 11:34:09.504148 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495884    2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 11 11:34:09.504148 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495887    2560 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 11 11:34:09.504148 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495890    2560 flags.go:64] FLAG: --system-cgroups=""
Sep 11 11:34:09.504148 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495893    2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 11 11:34:09.504148 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495898    2560 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 11 11:34:09.504148 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495901    2560 flags.go:64] FLAG: --tls-cert-file=""
Sep 11 11:34:09.504148 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495905    2560 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 11 11:34:09.504148 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495910    2560 flags.go:64] FLAG: --tls-min-version=""
Sep 11 11:34:09.504148 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495913    2560 flags.go:64] FLAG: --tls-private-key-file=""
Sep 11 11:34:09.504148 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495916    2560 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 11 11:34:09.504148 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495919    2560 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 11 11:34:09.504148 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495922    2560 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 11 11:34:09.504148 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495925    2560 flags.go:64] FLAG: --v="2"
Sep 11 11:34:09.504148 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495929    2560 flags.go:64] FLAG: --version="false"
Sep 11 11:34:09.504148 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495933    2560 flags.go:64] FLAG: --vmodule=""
Sep 11 11:34:09.504791 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495937    2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 11 11:34:09.504791 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.495940    2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 11 11:34:09.504791 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496056    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 11:34:09.504791 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496061    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 11:34:09.504791 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496064    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 11:34:09.504791 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496066    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 11:34:09.504791 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496069    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 11:34:09.504791 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496072    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 11:34:09.504791 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496075    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 11:34:09.504791 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496078    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 11:34:09.504791 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496081    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 11:34:09.504791 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496083    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 11:34:09.504791 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496086    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 11:34:09.504791 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496089    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 11:34:09.504791 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496091    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 11:34:09.504791 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496094    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 11:34:09.504791 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496097    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 11:34:09.504791 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496099    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 11:34:09.504791 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496102    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 11:34:09.504791 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496104    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 11:34:09.505280 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496107    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 11:34:09.505280 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496109    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 11:34:09.505280 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496112    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 11:34:09.505280 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496114    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 11:34:09.505280 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496118    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 11:34:09.505280 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496121    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 11:34:09.505280 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496124    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 11:34:09.505280 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496126    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 11:34:09.505280 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496129    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 11:34:09.505280 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496131    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 11:34:09.505280 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496134    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 11:34:09.505280 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496136    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 11:34:09.505280 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496139    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 11:34:09.505280 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496142    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 11:34:09.505280 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496144    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 11:34:09.505280 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496147    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 11:34:09.505280 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496149    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 11:34:09.505280 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496152    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 11:34:09.505280 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496155    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 11:34:09.505280 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496157    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 11:34:09.505821 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496160    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 11:34:09.505821 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496162    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 11:34:09.505821 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496165    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 11:34:09.505821 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496168    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 11:34:09.505821 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496171    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 11:34:09.505821 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496174    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 11:34:09.505821 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496176    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 11:34:09.505821 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496179    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 11:34:09.505821 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496182    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 11:34:09.505821 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496184    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 11:34:09.505821 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496187    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 11:34:09.505821 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496189    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 11:34:09.505821 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496192    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 11:34:09.505821 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496194    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 11:34:09.505821 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496197    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 11:34:09.505821 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496199    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 11:34:09.505821 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496202    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 11:34:09.505821 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496205    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 11:34:09.505821 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496208    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 11:34:09.505821 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496211    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 11:34:09.506304 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496213    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 11:34:09.506304 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496216    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 11:34:09.506304 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496218    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 11:34:09.506304 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496221    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 11:34:09.506304 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496224    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 11:34:09.506304 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496227    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 11:34:09.506304 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496229    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 11:34:09.506304 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496232    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 11:34:09.506304 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496234    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 11:34:09.506304 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496237    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 11:34:09.506304 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496240    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 11:34:09.506304 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496242    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 11:34:09.506304 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496245    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 11:34:09.506304 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496247    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 11:34:09.506304 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496250    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 11:34:09.506304 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496252    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 11:34:09.506304 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496255    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 11:34:09.506304 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496258    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 11:34:09.506304 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496260    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 11:34:09.506304 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496263    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 11:34:09.506813 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496266    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 11:34:09.506813 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496268    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 11:34:09.506813 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496271    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 11:34:09.506813 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496274    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 11:34:09.506813 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496278    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 11:34:09.506813 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496281    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 11:34:09.506813 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496284    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 11:34:09.506813 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496287    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 11:34:09.506813 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496289    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 11:34:09.506813 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496292    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 11:34:09.506813 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496295    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 11:34:09.506813 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496299    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 11:34:09.506813 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496303    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 11:34:09.506813 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496306    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 11:34:09.506813 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496309    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 11:34:09.506813 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496313    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 11:34:09.506813 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496316    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 11:34:09.506813 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496319    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 11:34:09.507272 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496321    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 11:34:09.507272 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496324    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 11:34:09.507272 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.496326    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 11:34:09.507272 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.496332    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 11:34:09.507272 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.506257    2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 11 11:34:09.507272 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.506274    2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 11 11:34:09.507272 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.507140    2560 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 11 11:34:09.507272 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.507148    2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 11 11:34:09.507272 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507218    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 11:34:09.507272 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507224    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 11:34:09.507272 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507227    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 11:34:09.507272 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507231    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 11:34:09.507272 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507234    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 11:34:09.507272 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507236    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 11:34:09.507272 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507239    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 11:34:09.507667 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507242    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 11:34:09.507667 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507245    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 11:34:09.507667 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507247    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 11:34:09.507667 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507250    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 11:34:09.507667 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507252    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 11:34:09.507667 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507255    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 11:34:09.507667 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507258    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 11:34:09.507667 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507261    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 11:34:09.507667 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507263    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 11:34:09.507667 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507265    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 11:34:09.507667 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507268    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 11:34:09.507667 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507270    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 11:34:09.507667 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507273    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 11:34:09.507667 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507276    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 11:34:09.507667 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507279    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 11:34:09.507667 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507282    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 11:34:09.507667 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507285    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 11:34:09.507667 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507287    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 11:34:09.507667 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507290    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 11:34:09.507667 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507293    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 11:34:09.508155 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507295    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 11:34:09.508155 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507298    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 11:34:09.508155 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507307    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 11:34:09.508155 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507310    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 11:34:09.508155 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507312    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 11:34:09.508155 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507315    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 11:34:09.508155 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507317    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 11:34:09.508155 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507320    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 11:34:09.508155 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507322    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 11:34:09.508155 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507325    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 11:34:09.508155 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507327    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 11:34:09.508155 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507330    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 11:34:09.508155 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507332    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 11:34:09.508155 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507336    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 11:34:09.508155 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507339    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 11:34:09.508155 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507343    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 11:34:09.508155 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507347    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 11:34:09.508155 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507350    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 11:34:09.508155 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507353    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 11:34:09.508611 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507356    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 11:34:09.508611 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507358    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 11:34:09.508611 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507361    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 11:34:09.508611 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507364    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 11:34:09.508611 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507366    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 11:34:09.508611 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507369    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 11:34:09.508611 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507371    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 11:34:09.508611 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507374    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 11:34:09.508611 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507376    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 11:34:09.508611 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507379    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 11:34:09.508611 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507382    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 11:34:09.508611 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507384    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 11:34:09.508611 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507387    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 11:34:09.508611 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507389    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 11:34:09.508611 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507392    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 11:34:09.508611 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507394    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 11:34:09.508611 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507402    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 11:34:09.508611 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507405    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 11:34:09.508611 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507407    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 11:34:09.508611 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507410    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 11:34:09.509229 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507412    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 11:34:09.509229 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507415    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 11:34:09.509229 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507418    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 11:34:09.509229 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507420    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 11:34:09.509229 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507423    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 11:34:09.509229 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507426    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 11:34:09.509229 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507428    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 11:34:09.509229 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507431    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 11:34:09.509229 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507433    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 11:34:09.509229 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507436    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 11:34:09.509229 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507438    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 11:34:09.509229 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507441    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 11:34:09.509229 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507443    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 11:34:09.509229 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507446    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 11:34:09.509229 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507449    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 11:34:09.509229 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507451    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 11:34:09.509229 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507454    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 11:34:09.509229 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507456    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 11:34:09.509229 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507459    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 11:34:09.509229 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507462    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 11:34:09.509738 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507465    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 11:34:09.509738 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507468    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 11:34:09.509738 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507472    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 11:34:09.509738 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507474    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 11:34:09.509738 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507477    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 11:34:09.509738 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507481    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 11:34:09.509738 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507484    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 11:34:09.509738 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507487    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 11:34:09.509738 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507490    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 11:34:09.509738 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507498    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 11:34:09.509738 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507501    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 11:34:09.509738 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507504    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 11:34:09.509738 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507506    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 11:34:09.509738 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.507511    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 11:34:09.510079 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507675    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 11:34:09.510079 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507681    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 11:34:09.510079 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507684    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 11:34:09.510079 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507687    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 11:34:09.510079 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507689    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 11:34:09.510079 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507692    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 11:34:09.510079 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507695    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 11:34:09.510079 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507697    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 11:34:09.510079 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507700    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 11:34:09.510079 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507702    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 11:34:09.510079 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507705    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 11:34:09.510079 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507707    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 11:34:09.510079 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507710    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 11:34:09.510079 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507713    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 11:34:09.510079 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507717    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 11:34:09.510079 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507720    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 11:34:09.510079 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507723    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 11:34:09.510079 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507726    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 11:34:09.510079 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507729    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 11:34:09.510555 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507732    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 11:34:09.510555 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507735    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 11:34:09.510555 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507737    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 11:34:09.510555 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507741    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 11:34:09.510555 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507744    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 11:34:09.510555 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507747    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 11:34:09.510555 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507750    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 11:34:09.510555 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507752    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 11:34:09.510555 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507755    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 11:34:09.510555 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507763    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 11:34:09.510555 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507766    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 11:34:09.510555 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507769    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 11:34:09.510555 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507771    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 11:34:09.510555 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507774    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 11:34:09.510555 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507776    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 11:34:09.510555 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507779    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 11:34:09.510555 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507782    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 11:34:09.510555 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507784    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 11:34:09.510555 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507787    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 11:34:09.511048 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507789    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 11:34:09.511048 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507792    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 11:34:09.511048 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507794    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 11:34:09.511048 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507797    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 11:34:09.511048 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507799    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 11:34:09.511048 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507802    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 11:34:09.511048 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507804    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 11:34:09.511048 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507807    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 11:34:09.511048 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507809    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 11:34:09.511048 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507818    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 11:34:09.511048 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507820    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 11:34:09.511048 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507823    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 11:34:09.511048 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507825    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 11:34:09.511048 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507828    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 11:34:09.511048 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507830    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 11:34:09.511048 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507833    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 11:34:09.511048 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507835    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 11:34:09.511048 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507837    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 11:34:09.511048 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507840    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 11:34:09.511048 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507842    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 11:34:09.511545 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507845    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 11:34:09.511545 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507847    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 11:34:09.511545 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507850    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 11:34:09.511545 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507859    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 11:34:09.511545 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507862    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 11:34:09.511545 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507864    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 11:34:09.511545 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507866    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 11:34:09.511545 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507869    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 11:34:09.511545 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507872    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 11:34:09.511545 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507874    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 11:34:09.511545 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507877    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 11:34:09.511545 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507879    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 11:34:09.511545 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507882    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 11:34:09.511545 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507885    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 11:34:09.511545 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507887    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 11:34:09.511545 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507890    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 11:34:09.511545 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507892    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 11:34:09.511545 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507895    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 11:34:09.511545 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507897    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 11:34:09.511545 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507899    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 11:34:09.512053 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507902    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 11:34:09.512053 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507905    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 11:34:09.512053 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507907    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 11:34:09.512053 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507909    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 11:34:09.512053 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507912    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 11:34:09.512053 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507915    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 11:34:09.512053 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507917    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 11:34:09.512053 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507920    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 11:34:09.512053 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507922    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 11:34:09.512053 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507925    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 11:34:09.512053 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507927    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 11:34:09.512053 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507930    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 11:34:09.512053 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507934    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 11:34:09.512053 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507937    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 11:34:09.512053 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507939    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 11:34:09.512053 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507942    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 11:34:09.512053 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507954    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 11:34:09.512053 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507957    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 11:34:09.512053 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507959    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 11:34:09.512527 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507962    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 11:34:09.512527 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:09.507965    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 11:34:09.512527 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.507972    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 11:34:09.512527 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.508088    2560 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 11 11:34:09.512527 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.510580    2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 11 11:34:09.513497 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.513469    2560 server.go:1019] "Starting client certificate rotation"
Sep 11 11:34:09.513771 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.513749    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 11:34:09.513991 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.513963    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 11:34:09.518856 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.518835    2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 11:34:09.520000 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.519974    2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 11:34:09.534622 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.534606    2560 log.go:25] "Validated CRI v1 runtime API"
Sep 11 11:34:09.537778 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.537763    2560 log.go:25] "Validated CRI v1 image API"
Sep 11 11:34:09.538580 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.538558    2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 11 11:34:09.542789 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.542767    2560 fs.go:135] Filesystem UUIDs: map[73c6beb6-7f16-44c9-88a8-89bd12c8d16d:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 ae4f9295-d958-4a0b-9021-9f06c105862e:/dev/nvme0n1p4]
Sep 11 11:34:09.542868 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.542787    2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 11 11:34:09.544710 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.544694    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 11:34:09.549762 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.549618    2560 manager.go:216] Machine: {Timestamp:2026-09-11 11:34:09.548213325 +0000 UTC m=+0.370673209 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3079214 MemoryCapacity:33164472320 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec226fb7ea3b3ae17668375cb4dc1f52 SystemUUID:ec226fb7-ea3b-3ae1-7668-375cb4dc1f52 BootID:ef72c833-b1d8-4464-8463-d67c8703f4fa Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582234112 Type:vfs Inodes:4048397 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:32:d4:23:cc:a7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:32:d4:23:cc:a7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:72:40:4e:ef:b1:a1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164472320 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 11 11:34:09.549762 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.549759    2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 11 11:34:09.549875 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.549841    2560 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 11 11:34:09.553368 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.553337    2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 11 11:34:09.553506 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.553371    2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-230.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 11 11:34:09.554249 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.554240    2560 topology_manager.go:138] "Creating topology manager with none policy"
Sep 11 11:34:09.554283 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.554251    2560 container_manager_linux.go:309] "Creating device plugin manager"
Sep 11 11:34:09.554283 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.554259    2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 11:34:09.554283 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.554272    2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 11:34:09.556163 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.556153    2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 11 11:34:09.560904 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.560892    2560 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 11:34:09.561023 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.561014    2560 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 11 11:34:09.561058 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.561046    2560 kubelet.go:486] "Attempting to sync node with API server"
Sep 11 11:34:09.561088 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.561072    2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 11 11:34:09.561088 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.561083    2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 11 11:34:09.561158 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.561093    2560 kubelet.go:398] "Adding apiserver pod source"
Sep 11 11:34:09.561158 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.561102    2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 11 11:34:09.561519 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.561507    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 11:34:09.561568 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.561526    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 11:34:09.564436 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.564293    2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 11 11:34:09.568570 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.568551    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9rlqf"
Sep 11 11:34:09.572915 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:09.572892    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 11 11:34:09.572915 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:09.572890    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-230.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 11 11:34:09.574273 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.574259    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9rlqf"
Sep 11 11:34:09.652221 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.652187    2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 11 11:34:09.652221 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.652229    2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 11 11:34:09.655067 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.655052    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 11 11:34:09.655148 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.655074    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 11 11:34:09.655148 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.655083    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 11 11:34:09.655148 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.655090    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 11 11:34:09.655148 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.655101    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 11 11:34:09.655148 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.655109    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 11 11:34:09.655148 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.655128    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 11 11:34:09.655148 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.655135    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 11 11:34:09.655148 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.655145    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 11 11:34:09.655390 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.655154    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 11 11:34:09.655390 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.655167    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 11 11:34:09.655390 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.655176    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 11 11:34:09.656143 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.656132    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 11 11:34:09.656195 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.656145    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 11 11:34:09.659975 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.659949    2560 server.go:1268] "Started kubelet"
Sep 11 11:34:09.660065 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.660031    2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 11 11:34:09.660180 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.660122    2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 11 11:34:09.660291 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.660204    2560 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 11 11:34:09.660828 ip-10-0-142-230 systemd[1]: Started Kubernetes Kubelet.
Sep 11 11:34:09.661753 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.661565    2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 11 11:34:09.661933 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.661912    2560 server.go:310] "Adding debug handlers to kubelet server"
Sep 11 11:34:09.666836 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:09.666817    2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 11 11:34:09.669630 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.669612    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 11 11:34:09.670346 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.670327    2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 11 11:34:09.670550 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:09.670491    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-230.ec2.internal\" not found"
Sep 11 11:34:09.671262 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.671244    2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 11 11:34:09.671262 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.671245    2560 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 11 11:34:09.671389 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.671273    2560 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 11 11:34:09.671389 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.671336    2560 reconstruct.go:97] "Volume reconstruction finished"
Sep 11 11:34:09.671389 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.671344    2560 reconciler.go:29] "Reconciler: start to sync state"
Sep 11 11:34:09.672263 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.672239    2560 factory.go:55] Registering systemd factory
Sep 11 11:34:09.672263 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.672261    2560 factory.go:223] Registration of the systemd container factory successfully
Sep 11 11:34:09.672545 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.672527    2560 factory.go:153] Registering CRI-O factory
Sep 11 11:34:09.672545 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.672545    2560 factory.go:223] Registration of the crio container factory successfully
Sep 11 11:34:09.672737 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.672595    2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 11:34:09.672737 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.672615    2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 11 11:34:09.672737 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.672635    2560 factory.go:103] Registering Raw factory
Sep 11 11:34:09.672737 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.672665    2560 manager.go:1196] Started watching for new ooms in manager
Sep 11 11:34:09.673858 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.673046    2560 manager.go:349] Starting recovery of all containers
Sep 11 11:34:09.674176 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.674156    2560 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-142-230.ec2.internal" not found
Sep 11 11:34:09.675037 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:09.675013    2560 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-142-230.ec2.internal\" not found" node="ip-10-0-142-230.ec2.internal"
Sep 11 11:34:09.682933 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.682913    2560 manager.go:354] Recovery completed
Sep 11 11:34:09.686957 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.686943    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 11:34:09.688546 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.688531    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-230.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 11:34:09.688620 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.688562    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-230.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 11:34:09.688620 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.688577    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-230.ec2.internal" event="NodeHasSufficientPID"
Sep 11 11:34:09.689080 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.689067    2560 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 11 11:34:09.689080 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.689079    2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 11 11:34:09.689166 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.689082    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 11:34:09.689238 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.689098    2560 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 11:34:09.689274 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.689262    2560 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-142-230.ec2.internal" not found
Sep 11 11:34:09.689795 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.689782    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-230.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 11:34:09.689847 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.689808    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-230.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 11:34:09.689847 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.689817    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-230.ec2.internal" event="NodeHasSufficientPID"
Sep 11 11:34:09.691408 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.691396    2560 policy_none.go:49] "None policy: Start"
Sep 11 11:34:09.691442 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.691411    2560 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 11 11:34:09.691442 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.691422    2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 11 11:34:09.693295 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.693281    2560 policy_none.go:47] "Start"
Sep 11 11:34:09.728274 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.728258    2560 manager.go:337] "Starting Device Plugin manager"
Sep 11 11:34:09.739602 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:09.728300    2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 11 11:34:09.739602 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.728315    2560 server.go:87] "Starting device plugin registration server"
Sep 11 11:34:09.739602 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.728626    2560 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 11 11:34:09.739602 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.728639    2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 11 11:34:09.739602 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.728765    2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 11 11:34:09.739602 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.728853    2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 11 11:34:09.739602 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.728862    2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 11 11:34:09.739602 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:09.729351    2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 11 11:34:09.739602 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:09.729401    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-230.ec2.internal\" not found"
Sep 11 11:34:09.748236 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.748220    2560 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-142-230.ec2.internal" not found
Sep 11 11:34:09.805901 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.805868    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 11 11:34:09.807054 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.807040    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 11 11:34:09.807115 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.807086    2560 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 11 11:34:09.807115 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.807110    2560 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 11 11:34:09.807184 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:09.807144    2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 11 11:34:09.809563 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.809546    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 11:34:09.829278 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.829258    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 11:34:09.830424 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.830408    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-230.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 11:34:09.830507 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.830441    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-230.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 11:34:09.830507 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.830459    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-230.ec2.internal" event="NodeHasSufficientPID"
Sep 11 11:34:09.830507 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.830483    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-230.ec2.internal"
Sep 11 11:34:09.838604 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.838590    2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-230.ec2.internal"
Sep 11 11:34:09.838666 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:09.838612    2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-230.ec2.internal\": node \"ip-10-0-142-230.ec2.internal\" not found"
Sep 11 11:34:09.859332 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:09.859307    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-230.ec2.internal\" not found"
Sep 11 11:34:09.908040 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.908014    2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-230.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-230.ec2.internal"]
Sep 11 11:34:09.908119 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.908095    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 11:34:09.909070 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.909053    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-230.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 11:34:09.909149 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.909084    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-230.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 11:34:09.909149 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.909094    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-230.ec2.internal" event="NodeHasSufficientPID"
Sep 11 11:34:09.911404 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.911392    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 11:34:09.911536 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.911523    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-230.ec2.internal"
Sep 11 11:34:09.911571 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.911552    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 11:34:09.912157 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.912138    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-230.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 11:34:09.912238 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.912169    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-230.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 11:34:09.912238 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.912180    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-230.ec2.internal" event="NodeHasSufficientPID"
Sep 11 11:34:09.912238 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.912138    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-230.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 11:34:09.912326 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.912245    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-230.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 11:34:09.912326 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.912257    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-230.ec2.internal" event="NodeHasSufficientPID"
Sep 11 11:34:09.914438 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.914425    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-230.ec2.internal"
Sep 11 11:34:09.914493 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.914452    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 11:34:09.915232 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.915213    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-230.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 11:34:09.915336 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.915246    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-230.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 11:34:09.915336 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.915261    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-230.ec2.internal" event="NodeHasSufficientPID"
Sep 11 11:34:09.946355 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:09.946327    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-230.ec2.internal\" not found" node="ip-10-0-142-230.ec2.internal"
Sep 11 11:34:09.950559 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:09.950544    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-230.ec2.internal\" not found" node="ip-10-0-142-230.ec2.internal"
Sep 11 11:34:09.960384 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:09.960367    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-230.ec2.internal\" not found"
Sep 11 11:34:09.972230 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.972212    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9b510c5ec560886a56425db6533b4ec1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-230.ec2.internal\" (UID: \"9b510c5ec560886a56425db6533b4ec1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-230.ec2.internal"
Sep 11 11:34:09.972315 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.972237    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b510c5ec560886a56425db6533b4ec1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-230.ec2.internal\" (UID: \"9b510c5ec560886a56425db6533b4ec1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-230.ec2.internal"
Sep 11 11:34:09.972315 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:09.972254    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a41d8d936191e7605296179362bc8cf0-config\") pod \"kube-apiserver-proxy-ip-10-0-142-230.ec2.internal\" (UID: \"a41d8d936191e7605296179362bc8cf0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-230.ec2.internal"
Sep 11 11:34:10.060893 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:10.060854    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-230.ec2.internal\" not found"
Sep 11 11:34:10.073195 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:10.073167    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9b510c5ec560886a56425db6533b4ec1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-230.ec2.internal\" (UID: \"9b510c5ec560886a56425db6533b4ec1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-230.ec2.internal"
Sep 11 11:34:10.073312 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:10.073202    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b510c5ec560886a56425db6533b4ec1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-230.ec2.internal\" (UID: \"9b510c5ec560886a56425db6533b4ec1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-230.ec2.internal"
Sep 11 11:34:10.073312 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:10.073228    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a41d8d936191e7605296179362bc8cf0-config\") pod \"kube-apiserver-proxy-ip-10-0-142-230.ec2.internal\" (UID: \"a41d8d936191e7605296179362bc8cf0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-230.ec2.internal"
Sep 11 11:34:10.073312 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:10.073266    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a41d8d936191e7605296179362bc8cf0-config\") pod \"kube-apiserver-proxy-ip-10-0-142-230.ec2.internal\" (UID: \"a41d8d936191e7605296179362bc8cf0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-230.ec2.internal"
Sep 11 11:34:10.073312 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:10.073267    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9b510c5ec560886a56425db6533b4ec1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-230.ec2.internal\" (UID: \"9b510c5ec560886a56425db6533b4ec1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-230.ec2.internal"
Sep 11 11:34:10.073312 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:10.073272    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b510c5ec560886a56425db6533b4ec1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-230.ec2.internal\" (UID: \"9b510c5ec560886a56425db6533b4ec1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-230.ec2.internal"
Sep 11 11:34:10.165838 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:10.165792    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-230.ec2.internal\" not found"
Sep 11 11:34:10.248944 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:10.248919    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-230.ec2.internal"
Sep 11 11:34:10.252703 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:10.252685    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-230.ec2.internal"
Sep 11 11:34:10.265999 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:10.265951    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-230.ec2.internal\" not found"
Sep 11 11:34:10.367817 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:10.367768    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-230.ec2.internal\" not found"
Sep 11 11:34:10.475183 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:10.475140    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-230.ec2.internal\" not found"
Sep 11 11:34:10.513789 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:10.513765    2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 11 11:34:10.514276 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:10.513929    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 11:34:10.514276 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:10.513982    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 11:34:10.576149 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:10.576061    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-230.ec2.internal\" not found"
Sep 11 11:34:10.580646 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:10.580620    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-10 11:29:10 +0000 UTC" deadline="2028-02-15 23:00:12.327308923 +0000 UTC"
Sep 11 11:34:10.580755 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:10.580645    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12539h26m1.746666658s"
Sep 11 11:34:10.677258 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:10.677214    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-230.ec2.internal\" not found"
Sep 11 11:34:10.777807 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:10.777766    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-230.ec2.internal\" not found"
Sep 11 11:34:10.877935 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:10.877844    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-230.ec2.internal\" not found"
Sep 11 11:34:10.904659 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:10.904622    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b510c5ec560886a56425db6533b4ec1.slice/crio-5e1582ef01b41817e415b1c56afc7f93e7a81e7f300a301e53658e8ffd5969a8 WatchSource:0}: Error finding container 5e1582ef01b41817e415b1c56afc7f93e7a81e7f300a301e53658e8ffd5969a8: Status 404 returned error can't find the container with id 5e1582ef01b41817e415b1c56afc7f93e7a81e7f300a301e53658e8ffd5969a8
Sep 11 11:34:10.906246 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:10.906219    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda41d8d936191e7605296179362bc8cf0.slice/crio-e9a1a9da131e2a39b4c0bb6bc713f63955cabff13b4219ba09396945b236a1c2 WatchSource:0}: Error finding container e9a1a9da131e2a39b4c0bb6bc713f63955cabff13b4219ba09396945b236a1c2: Status 404 returned error can't find the container with id e9a1a9da131e2a39b4c0bb6bc713f63955cabff13b4219ba09396945b236a1c2
Sep 11 11:34:10.910252 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:10.910235    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 11:34:10.978720 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:10.978644    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-230.ec2.internal\" not found"
Sep 11 11:34:11.078830 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:11.078798    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-230.ec2.internal\" not found"
Sep 11 11:34:11.099127 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.099103    2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 11:34:11.149455 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.149372    2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 11:34:11.171717 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.171685    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-230.ec2.internal"
Sep 11 11:34:11.185244 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.185221    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 11:34:11.185954 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.185939    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-230.ec2.internal"
Sep 11 11:34:11.194829 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.194812    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 11:34:11.564311 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.564232    2560 apiserver.go:52] "Watching apiserver"
Sep 11 11:34:11.571866 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.571480    2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 11 11:34:11.573605 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.573569    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-w27hd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-230.ec2.internal","openshift-network-diagnostics/network-check-target-5g8rf","openshift-ovn-kubernetes/ovnkube-node-vvjr6","kube-system/global-pull-secret-syncer-mtjkj","kube-system/kube-apiserver-proxy-ip-10-0-142-230.ec2.internal","openshift-dns/node-resolver-xc7zl","openshift-image-registry/node-ca-fjlr9","openshift-multus/multus-additional-cni-plugins-58qjk","openshift-multus/multus-jtbjs","openshift-multus/network-metrics-daemon-flnj5","openshift-network-operator/iptables-alerter-lgnht","kube-system/konnectivity-agent-fv2ft","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr5cp"]
Sep 11 11:34:11.576762 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.576367    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xc7zl"
Sep 11 11:34:11.578988 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.578774    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 11 11:34:11.578988 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.578800    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 11 11:34:11.578988 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.578809    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pxl55\""
Sep 11 11:34:11.585789 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.585767    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fv2ft"
Sep 11 11:34:11.589830 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.589808    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fxgb9\""
Sep 11 11:34:11.590073 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.590053    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 11 11:34:11.590157 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.590145    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 11 11:34:11.591615 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.591589    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5g8rf"
Sep 11 11:34:11.591739 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:11.591669    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5g8rf" podUID="c74969dd-4205-4c53-9577-a6b387e33252"
Sep 11 11:34:11.596513 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.595612    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.597886 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.597640    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtjkj"
Sep 11 11:34:11.597886 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:11.597727    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtjkj" podUID="81901073-d576-4c23-bb13-e150254f32b7"
Sep 11 11:34:11.598884 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.598138    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 11 11:34:11.598884 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.598530    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 11 11:34:11.598884 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.598606    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 11 11:34:11.598884 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.598733    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 11 11:34:11.598884 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.598774    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 11 11:34:11.599177 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.598910    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-l6k5s\""
Sep 11 11:34:11.599177 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.598996    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 11 11:34:11.601074 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.600419    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr5cp"
Sep 11 11:34:11.602558 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.602538    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 11 11:34:11.602699 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.602679    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 11 11:34:11.602883 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.602862    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 11 11:34:11.603048 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.603032    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-58qjk"
Sep 11 11:34:11.603225 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.603205    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-np7v8\""
Sep 11 11:34:11.605792 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.605423    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 11 11:34:11.605792 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.605749    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 11 11:34:11.605975 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.605958    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 11 11:34:11.606203 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.606186    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 11 11:34:11.606372 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.606356    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 11 11:34:11.606410 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.606375    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-26djp\""
Sep 11 11:34:11.606607 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.606560    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-w27hd"
Sep 11 11:34:11.608431 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.608114    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fjlr9"
Sep 11 11:34:11.609373 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.608874    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 11 11:34:11.609373 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.608965    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-f6tzd\""
Sep 11 11:34:11.609373 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.609178    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 11 11:34:11.610116 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.610089    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 11 11:34:11.610444 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.610425    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 11 11:34:11.610558 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.610513    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-j2psn\""
Sep 11 11:34:11.610558 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.610554    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 11 11:34:11.610946 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.610928    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jtbjs"
Sep 11 11:34:11.612904 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.612883    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 11 11:34:11.613176 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.613157    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-l5hn4\""
Sep 11 11:34:11.616530 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.613651    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flnj5"
Sep 11 11:34:11.616698 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:11.616636    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flnj5" podUID="5ed2dabe-863c-4c3f-9c21-ce551acf7712"
Sep 11 11:34:11.620219 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.620197    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lgnht"
Sep 11 11:34:11.624116 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.622506    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 11 11:34:11.624116 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.622870    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 11 11:34:11.624116 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.623085    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-zvf8j\""
Sep 11 11:34:11.624116 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.623319    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 11 11:34:11.670700 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.670664    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 11 11:34:11.672601 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.672506    2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 11 11:34:11.682893 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.682751    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 11:34:11.685772 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.685698    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81901073-d576-4c23-bb13-e150254f32b7-original-pull-secret\") pod \"global-pull-secret-syncer-mtjkj\" (UID: \"81901073-d576-4c23-bb13-e150254f32b7\") " pod="kube-system/global-pull-secret-syncer-mtjkj"
Sep 11 11:34:11.685772 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.685740    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48jbz\" (UniqueName: \"kubernetes.io/projected/129a8b0d-dd99-476a-bc21-8fcf5b3335d0-kube-api-access-48jbz\") pod \"node-resolver-xc7zl\" (UID: \"129a8b0d-dd99-476a-bc21-8fcf5b3335d0\") " pod="openshift-dns/node-resolver-xc7zl"
Sep 11 11:34:11.685772 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.685766    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/210895f6-8c7c-4160-9ce0-83948df8a896-var-lib-openvswitch\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.686002 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.685791    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5c491281-d63d-4e9b-a258-626813c70eab-tuning-conf-dir\") pod \"multus-additional-cni-plugins-58qjk\" (UID: \"5c491281-d63d-4e9b-a258-626813c70eab\") " pod="openshift-multus/multus-additional-cni-plugins-58qjk"
Sep 11 11:34:11.686002 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.685824    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5c491281-d63d-4e9b-a258-626813c70eab-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-58qjk\" (UID: \"5c491281-d63d-4e9b-a258-626813c70eab\") " pod="openshift-multus/multus-additional-cni-plugins-58qjk"
Sep 11 11:34:11.686002 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.685847    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ceec02a6-0160-40d7-9cde-b676a1cc636a-host-var-lib-cni-multus\") pod \"multus-jtbjs\" (UID: \"ceec02a6-0160-40d7-9cde-b676a1cc636a\") " pod="openshift-multus/multus-jtbjs"
Sep 11 11:34:11.686002 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.685872    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ceec02a6-0160-40d7-9cde-b676a1cc636a-host-run-multus-certs\") pod \"multus-jtbjs\" (UID: \"ceec02a6-0160-40d7-9cde-b676a1cc636a\") " pod="openshift-multus/multus-jtbjs"
Sep 11 11:34:11.686002 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.685926    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/831fe212-2c6f-4595-a7d3-bf75c740f746-iptables-alerter-script\") pod \"iptables-alerter-lgnht\" (UID: \"831fe212-2c6f-4595-a7d3-bf75c740f746\") " pod="openshift-network-operator/iptables-alerter-lgnht"
Sep 11 11:34:11.686247 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.685995    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zn8g9\" (UniqueName: \"kubernetes.io/projected/f1f60bc1-6275-4391-87a0-3edcef0b9c02-kube-api-access-zn8g9\") pod \"tuned-w27hd\" (UID: \"f1f60bc1-6275-4391-87a0-3edcef0b9c02\") " pod="openshift-cluster-node-tuning-operator/tuned-w27hd"
Sep 11 11:34:11.686247 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.686032    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/45e17ebc-35d4-4af6-92fa-7deed7b064a2-sys-fs\") pod \"aws-ebs-csi-driver-node-kr5cp\" (UID: \"45e17ebc-35d4-4af6-92fa-7deed7b064a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr5cp"
Sep 11 11:34:11.686247 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.686058    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8q86r\" (UniqueName: \"kubernetes.io/projected/45e17ebc-35d4-4af6-92fa-7deed7b064a2-kube-api-access-8q86r\") pod \"aws-ebs-csi-driver-node-kr5cp\" (UID: \"45e17ebc-35d4-4af6-92fa-7deed7b064a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr5cp"
Sep 11 11:34:11.686247 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.686083    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f1f60bc1-6275-4391-87a0-3edcef0b9c02-etc-systemd\") pod \"tuned-w27hd\" (UID: \"f1f60bc1-6275-4391-87a0-3edcef0b9c02\") " pod="openshift-cluster-node-tuning-operator/tuned-w27hd"
Sep 11 11:34:11.686247 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.686116    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f1f60bc1-6275-4391-87a0-3edcef0b9c02-lib-modules\") pod \"tuned-w27hd\" (UID: \"f1f60bc1-6275-4391-87a0-3edcef0b9c02\") " pod="openshift-cluster-node-tuning-operator/tuned-w27hd"
Sep 11 11:34:11.686247 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.686139    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f1f60bc1-6275-4391-87a0-3edcef0b9c02-host\") pod \"tuned-w27hd\" (UID: \"f1f60bc1-6275-4391-87a0-3edcef0b9c02\") " pod="openshift-cluster-node-tuning-operator/tuned-w27hd"
Sep 11 11:34:11.686247 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.686165    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/129a8b0d-dd99-476a-bc21-8fcf5b3335d0-hosts-file\") pod \"node-resolver-xc7zl\" (UID: \"129a8b0d-dd99-476a-bc21-8fcf5b3335d0\") " pod="openshift-dns/node-resolver-xc7zl"
Sep 11 11:34:11.686247 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.686193    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/210895f6-8c7c-4160-9ce0-83948df8a896-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.686626 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.686269    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/45e17ebc-35d4-4af6-92fa-7deed7b064a2-socket-dir\") pod \"aws-ebs-csi-driver-node-kr5cp\" (UID: \"45e17ebc-35d4-4af6-92fa-7deed7b064a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr5cp"
Sep 11 11:34:11.686626 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.686304    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f1f60bc1-6275-4391-87a0-3edcef0b9c02-etc-sysctl-conf\") pod \"tuned-w27hd\" (UID: \"f1f60bc1-6275-4391-87a0-3edcef0b9c02\") " pod="openshift-cluster-node-tuning-operator/tuned-w27hd"
Sep 11 11:34:11.686626 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.686342    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9vjk\" (UniqueName: \"kubernetes.io/projected/5ed2dabe-863c-4c3f-9c21-ce551acf7712-kube-api-access-c9vjk\") pod \"network-metrics-daemon-flnj5\" (UID: \"5ed2dabe-863c-4c3f-9c21-ce551acf7712\") " pod="openshift-multus/network-metrics-daemon-flnj5"
Sep 11 11:34:11.686626 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.686369    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/210895f6-8c7c-4160-9ce0-83948df8a896-ovn-node-metrics-cert\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.686626 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.686394    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ceec02a6-0160-40d7-9cde-b676a1cc636a-cni-binary-copy\") pod \"multus-jtbjs\" (UID: \"ceec02a6-0160-40d7-9cde-b676a1cc636a\") " pod="openshift-multus/multus-jtbjs"
Sep 11 11:34:11.686626 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.686422    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ceec02a6-0160-40d7-9cde-b676a1cc636a-multus-socket-dir-parent\") pod \"multus-jtbjs\" (UID: \"ceec02a6-0160-40d7-9cde-b676a1cc636a\") " pod="openshift-multus/multus-jtbjs"
Sep 11 11:34:11.686626 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.686457    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ceec02a6-0160-40d7-9cde-b676a1cc636a-multus-conf-dir\") pod \"multus-jtbjs\" (UID: \"ceec02a6-0160-40d7-9cde-b676a1cc636a\") " pod="openshift-multus/multus-jtbjs"
Sep 11 11:34:11.686626 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.686480    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97tfs\" (UniqueName: \"kubernetes.io/projected/ceec02a6-0160-40d7-9cde-b676a1cc636a-kube-api-access-97tfs\") pod \"multus-jtbjs\" (UID: \"ceec02a6-0160-40d7-9cde-b676a1cc636a\") " pod="openshift-multus/multus-jtbjs"
Sep 11 11:34:11.686626 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.686514    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f1f60bc1-6275-4391-87a0-3edcef0b9c02-sys\") pod \"tuned-w27hd\" (UID: \"f1f60bc1-6275-4391-87a0-3edcef0b9c02\") " pod="openshift-cluster-node-tuning-operator/tuned-w27hd"
Sep 11 11:34:11.686626 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.686547    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/129a8b0d-dd99-476a-bc21-8fcf5b3335d0-tmp-dir\") pod \"node-resolver-xc7zl\" (UID: \"129a8b0d-dd99-476a-bc21-8fcf5b3335d0\") " pod="openshift-dns/node-resolver-xc7zl"
Sep 11 11:34:11.686626 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.686573    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/210895f6-8c7c-4160-9ce0-83948df8a896-host-slash\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.686626 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.686620    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/210895f6-8c7c-4160-9ce0-83948df8a896-host-run-netns\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.687264 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.686645    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/210895f6-8c7c-4160-9ce0-83948df8a896-etc-openvswitch\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.687264 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.686686    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qjwh\" (UniqueName: \"kubernetes.io/projected/c74969dd-4205-4c53-9577-a6b387e33252-kube-api-access-2qjwh\") pod \"network-check-target-5g8rf\" (UID: \"c74969dd-4205-4c53-9577-a6b387e33252\") " pod="openshift-network-diagnostics/network-check-target-5g8rf"
Sep 11 11:34:11.687264 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.686711    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/81901073-d576-4c23-bb13-e150254f32b7-dbus\") pod \"global-pull-secret-syncer-mtjkj\" (UID: \"81901073-d576-4c23-bb13-e150254f32b7\") " pod="kube-system/global-pull-secret-syncer-mtjkj"
Sep 11 11:34:11.687264 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.686734    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f1f60bc1-6275-4391-87a0-3edcef0b9c02-etc-sysconfig\") pod \"tuned-w27hd\" (UID: \"f1f60bc1-6275-4391-87a0-3edcef0b9c02\") " pod="openshift-cluster-node-tuning-operator/tuned-w27hd"
Sep 11 11:34:11.687264 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.686758    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ceec02a6-0160-40d7-9cde-b676a1cc636a-multus-cni-dir\") pod \"multus-jtbjs\" (UID: \"ceec02a6-0160-40d7-9cde-b676a1cc636a\") " pod="openshift-multus/multus-jtbjs"
Sep 11 11:34:11.687264 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.686782    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/831fe212-2c6f-4595-a7d3-bf75c740f746-host-slash\") pod \"iptables-alerter-lgnht\" (UID: \"831fe212-2c6f-4595-a7d3-bf75c740f746\") " pod="openshift-network-operator/iptables-alerter-lgnht"
Sep 11 11:34:11.687264 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.686811    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/210895f6-8c7c-4160-9ce0-83948df8a896-host-kubelet\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.687264 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.686837    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/210895f6-8c7c-4160-9ce0-83948df8a896-run-systemd\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.687264 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.686870    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/da5daa69-1f21-42d2-b6d5-388f49a097d2-host\") pod \"node-ca-fjlr9\" (UID: \"da5daa69-1f21-42d2-b6d5-388f49a097d2\") " pod="openshift-image-registry/node-ca-fjlr9"
Sep 11 11:34:11.687264 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.686894    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ceec02a6-0160-40d7-9cde-b676a1cc636a-host-run-k8s-cni-cncf-io\") pod \"multus-jtbjs\" (UID: \"ceec02a6-0160-40d7-9cde-b676a1cc636a\") " pod="openshift-multus/multus-jtbjs"
Sep 11 11:34:11.687264 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.686923    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/45e17ebc-35d4-4af6-92fa-7deed7b064a2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kr5cp\" (UID: \"45e17ebc-35d4-4af6-92fa-7deed7b064a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr5cp"
Sep 11 11:34:11.687264 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.686948    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1f60bc1-6275-4391-87a0-3edcef0b9c02-tmp\") pod \"tuned-w27hd\" (UID: \"f1f60bc1-6275-4391-87a0-3edcef0b9c02\") " pod="openshift-cluster-node-tuning-operator/tuned-w27hd"
Sep 11 11:34:11.687264 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.686973    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7kjd\" (UniqueName: \"kubernetes.io/projected/831fe212-2c6f-4595-a7d3-bf75c740f746-kube-api-access-r7kjd\") pod \"iptables-alerter-lgnht\" (UID: \"831fe212-2c6f-4595-a7d3-bf75c740f746\") " pod="openshift-network-operator/iptables-alerter-lgnht"
Sep 11 11:34:11.687264 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.686997    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/210895f6-8c7c-4160-9ce0-83948df8a896-log-socket\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.687264 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.687022    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/210895f6-8c7c-4160-9ce0-83948df8a896-env-overrides\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.687264 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.687046    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5c491281-d63d-4e9b-a258-626813c70eab-system-cni-dir\") pod \"multus-additional-cni-plugins-58qjk\" (UID: \"5c491281-d63d-4e9b-a258-626813c70eab\") " pod="openshift-multus/multus-additional-cni-plugins-58qjk"
Sep 11 11:34:11.687977 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.687073    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/da5daa69-1f21-42d2-b6d5-388f49a097d2-serviceca\") pod \"node-ca-fjlr9\" (UID: \"da5daa69-1f21-42d2-b6d5-388f49a097d2\") " pod="openshift-image-registry/node-ca-fjlr9"
Sep 11 11:34:11.687977 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.687098    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ceec02a6-0160-40d7-9cde-b676a1cc636a-hostroot\") pod \"multus-jtbjs\" (UID: \"ceec02a6-0160-40d7-9cde-b676a1cc636a\") " pod="openshift-multus/multus-jtbjs"
Sep 11 11:34:11.687977 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.687127    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/45e17ebc-35d4-4af6-92fa-7deed7b064a2-etc-selinux\") pod \"aws-ebs-csi-driver-node-kr5cp\" (UID: \"45e17ebc-35d4-4af6-92fa-7deed7b064a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr5cp"
Sep 11 11:34:11.687977 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.687149    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f1f60bc1-6275-4391-87a0-3edcef0b9c02-run\") pod \"tuned-w27hd\" (UID: \"f1f60bc1-6275-4391-87a0-3edcef0b9c02\") " pod="openshift-cluster-node-tuning-operator/tuned-w27hd"
Sep 11 11:34:11.687977 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.687174    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/210895f6-8c7c-4160-9ce0-83948df8a896-ovnkube-script-lib\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.687977 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.687200    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ceec02a6-0160-40d7-9cde-b676a1cc636a-etc-kubernetes\") pod \"multus-jtbjs\" (UID: \"ceec02a6-0160-40d7-9cde-b676a1cc636a\") " pod="openshift-multus/multus-jtbjs"
Sep 11 11:34:11.687977 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.687225    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7hhf\" (UniqueName: \"kubernetes.io/projected/210895f6-8c7c-4160-9ce0-83948df8a896-kube-api-access-l7hhf\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.687977 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.687249    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f1f60bc1-6275-4391-87a0-3edcef0b9c02-etc-tuned\") pod \"tuned-w27hd\" (UID: \"f1f60bc1-6275-4391-87a0-3edcef0b9c02\") " pod="openshift-cluster-node-tuning-operator/tuned-w27hd"
Sep 11 11:34:11.687977 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.687275    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1f60bc1-6275-4391-87a0-3edcef0b9c02-etc-kubernetes\") pod \"tuned-w27hd\" (UID: \"f1f60bc1-6275-4391-87a0-3edcef0b9c02\") " pod="openshift-cluster-node-tuning-operator/tuned-w27hd"
Sep 11 11:34:11.687977 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.687300    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ed2dabe-863c-4c3f-9c21-ce551acf7712-metrics-certs\") pod \"network-metrics-daemon-flnj5\" (UID: \"5ed2dabe-863c-4c3f-9c21-ce551acf7712\") " pod="openshift-multus/network-metrics-daemon-flnj5"
Sep 11 11:34:11.687977 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.687327    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3b040dc1-8688-4630-8a3d-3b8d7bc7fdd5-konnectivity-ca\") pod \"konnectivity-agent-fv2ft\" (UID: \"3b040dc1-8688-4630-8a3d-3b8d7bc7fdd5\") " pod="kube-system/konnectivity-agent-fv2ft"
Sep 11 11:34:11.687977 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.687360    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/210895f6-8c7c-4160-9ce0-83948df8a896-systemd-units\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.687977 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.687385    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/210895f6-8c7c-4160-9ce0-83948df8a896-node-log\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.687977 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.687411    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/45e17ebc-35d4-4af6-92fa-7deed7b064a2-registration-dir\") pod \"aws-ebs-csi-driver-node-kr5cp\" (UID: \"45e17ebc-35d4-4af6-92fa-7deed7b064a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr5cp"
Sep 11 11:34:11.687977 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.687435    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/210895f6-8c7c-4160-9ce0-83948df8a896-host-cni-netd\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.687977 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.687462    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfgjb\" (UniqueName: \"kubernetes.io/projected/5c491281-d63d-4e9b-a258-626813c70eab-kube-api-access-zfgjb\") pod \"multus-additional-cni-plugins-58qjk\" (UID: \"5c491281-d63d-4e9b-a258-626813c70eab\") " pod="openshift-multus/multus-additional-cni-plugins-58qjk"
Sep 11 11:34:11.688791 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.687489    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f1f60bc1-6275-4391-87a0-3edcef0b9c02-etc-modprobe-d\") pod \"tuned-w27hd\" (UID: \"f1f60bc1-6275-4391-87a0-3edcef0b9c02\") " pod="openshift-cluster-node-tuning-operator/tuned-w27hd"
Sep 11 11:34:11.688791 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.687517    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/210895f6-8c7c-4160-9ce0-83948df8a896-host-cni-bin\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.688791 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.687543    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5c491281-d63d-4e9b-a258-626813c70eab-cni-binary-copy\") pod \"multus-additional-cni-plugins-58qjk\" (UID: \"5c491281-d63d-4e9b-a258-626813c70eab\") " pod="openshift-multus/multus-additional-cni-plugins-58qjk"
Sep 11 11:34:11.688791 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.687578    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zft9v\" (UniqueName: \"kubernetes.io/projected/da5daa69-1f21-42d2-b6d5-388f49a097d2-kube-api-access-zft9v\") pod \"node-ca-fjlr9\" (UID: \"da5daa69-1f21-42d2-b6d5-388f49a097d2\") " pod="openshift-image-registry/node-ca-fjlr9"
Sep 11 11:34:11.688791 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.687605    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ceec02a6-0160-40d7-9cde-b676a1cc636a-multus-daemon-config\") pod \"multus-jtbjs\" (UID: \"ceec02a6-0160-40d7-9cde-b676a1cc636a\") " pod="openshift-multus/multus-jtbjs"
Sep 11 11:34:11.688791 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.687645    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/81901073-d576-4c23-bb13-e150254f32b7-kubelet-config\") pod \"global-pull-secret-syncer-mtjkj\" (UID: \"81901073-d576-4c23-bb13-e150254f32b7\") " pod="kube-system/global-pull-secret-syncer-mtjkj"
Sep 11 11:34:11.688791 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.687684    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/45e17ebc-35d4-4af6-92fa-7deed7b064a2-device-dir\") pod \"aws-ebs-csi-driver-node-kr5cp\" (UID: \"45e17ebc-35d4-4af6-92fa-7deed7b064a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr5cp"
Sep 11 11:34:11.688791 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.687708    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/210895f6-8c7c-4160-9ce0-83948df8a896-ovnkube-config\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.688791 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.687736    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5c491281-d63d-4e9b-a258-626813c70eab-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-58qjk\" (UID: \"5c491281-d63d-4e9b-a258-626813c70eab\") " pod="openshift-multus/multus-additional-cni-plugins-58qjk"
Sep 11 11:34:11.688791 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.687769    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ceec02a6-0160-40d7-9cde-b676a1cc636a-cnibin\") pod \"multus-jtbjs\" (UID: \"ceec02a6-0160-40d7-9cde-b676a1cc636a\") " pod="openshift-multus/multus-jtbjs"
Sep 11 11:34:11.688791 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.687796    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ceec02a6-0160-40d7-9cde-b676a1cc636a-host-run-netns\") pod \"multus-jtbjs\" (UID: \"ceec02a6-0160-40d7-9cde-b676a1cc636a\") " pod="openshift-multus/multus-jtbjs"
Sep 11 11:34:11.688791 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.687821    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ceec02a6-0160-40d7-9cde-b676a1cc636a-host-var-lib-kubelet\") pod \"multus-jtbjs\" (UID: \"ceec02a6-0160-40d7-9cde-b676a1cc636a\") " pod="openshift-multus/multus-jtbjs"
Sep 11 11:34:11.688791 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.687845    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f1f60bc1-6275-4391-87a0-3edcef0b9c02-etc-sysctl-d\") pod \"tuned-w27hd\" (UID: \"f1f60bc1-6275-4391-87a0-3edcef0b9c02\") " pod="openshift-cluster-node-tuning-operator/tuned-w27hd"
Sep 11 11:34:11.688791 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.687869    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/210895f6-8c7c-4160-9ce0-83948df8a896-run-openvswitch\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.688791 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.687900    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/210895f6-8c7c-4160-9ce0-83948df8a896-host-run-ovn-kubernetes\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.688791 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.687925    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ceec02a6-0160-40d7-9cde-b676a1cc636a-system-cni-dir\") pod \"multus-jtbjs\" (UID: \"ceec02a6-0160-40d7-9cde-b676a1cc636a\") " pod="openshift-multus/multus-jtbjs"
Sep 11 11:34:11.689635 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.687951    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1f60bc1-6275-4391-87a0-3edcef0b9c02-var-lib-kubelet\") pod \"tuned-w27hd\" (UID: \"f1f60bc1-6275-4391-87a0-3edcef0b9c02\") " pod="openshift-cluster-node-tuning-operator/tuned-w27hd"
Sep 11 11:34:11.689635 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.687976    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3b040dc1-8688-4630-8a3d-3b8d7bc7fdd5-agent-certs\") pod \"konnectivity-agent-fv2ft\" (UID: \"3b040dc1-8688-4630-8a3d-3b8d7bc7fdd5\") " pod="kube-system/konnectivity-agent-fv2ft"
Sep 11 11:34:11.689635 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.688005    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/210895f6-8c7c-4160-9ce0-83948df8a896-run-ovn\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.689635 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.688030    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5c491281-d63d-4e9b-a258-626813c70eab-cnibin\") pod \"multus-additional-cni-plugins-58qjk\" (UID: \"5c491281-d63d-4e9b-a258-626813c70eab\") " pod="openshift-multus/multus-additional-cni-plugins-58qjk"
Sep 11 11:34:11.689635 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.688056    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ceec02a6-0160-40d7-9cde-b676a1cc636a-host-var-lib-cni-bin\") pod \"multus-jtbjs\" (UID: \"ceec02a6-0160-40d7-9cde-b676a1cc636a\") " pod="openshift-multus/multus-jtbjs"
Sep 11 11:34:11.709112 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.709085    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dxr8g"
Sep 11 11:34:11.718414 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.718040    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dxr8g"
Sep 11 11:34:11.788701 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.788646    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1f60bc1-6275-4391-87a0-3edcef0b9c02-etc-kubernetes\") pod \"tuned-w27hd\" (UID: \"f1f60bc1-6275-4391-87a0-3edcef0b9c02\") " pod="openshift-cluster-node-tuning-operator/tuned-w27hd"
Sep 11 11:34:11.788701 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.788711    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ed2dabe-863c-4c3f-9c21-ce551acf7712-metrics-certs\") pod \"network-metrics-daemon-flnj5\" (UID: \"5ed2dabe-863c-4c3f-9c21-ce551acf7712\") " pod="openshift-multus/network-metrics-daemon-flnj5"
Sep 11 11:34:11.788964 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.788741    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3b040dc1-8688-4630-8a3d-3b8d7bc7fdd5-konnectivity-ca\") pod \"konnectivity-agent-fv2ft\" (UID: \"3b040dc1-8688-4630-8a3d-3b8d7bc7fdd5\") " pod="kube-system/konnectivity-agent-fv2ft"
Sep 11 11:34:11.788964 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.788765    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/210895f6-8c7c-4160-9ce0-83948df8a896-systemd-units\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.788964 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.788790    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/210895f6-8c7c-4160-9ce0-83948df8a896-node-log\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.788964 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.788814    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/45e17ebc-35d4-4af6-92fa-7deed7b064a2-registration-dir\") pod \"aws-ebs-csi-driver-node-kr5cp\" (UID: \"45e17ebc-35d4-4af6-92fa-7deed7b064a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr5cp"
Sep 11 11:34:11.788964 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.788844    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/210895f6-8c7c-4160-9ce0-83948df8a896-host-cni-netd\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.788964 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.788876    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfgjb\" (UniqueName: \"kubernetes.io/projected/5c491281-d63d-4e9b-a258-626813c70eab-kube-api-access-zfgjb\") pod \"multus-additional-cni-plugins-58qjk\" (UID: \"5c491281-d63d-4e9b-a258-626813c70eab\") " pod="openshift-multus/multus-additional-cni-plugins-58qjk"
Sep 11 11:34:11.788964 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.788890    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1f60bc1-6275-4391-87a0-3edcef0b9c02-etc-kubernetes\") pod \"tuned-w27hd\" (UID: \"f1f60bc1-6275-4391-87a0-3edcef0b9c02\") " pod="openshift-cluster-node-tuning-operator/tuned-w27hd"
Sep 11 11:34:11.788964 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:11.788898    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 11:34:11.788964 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.788947    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/210895f6-8c7c-4160-9ce0-83948df8a896-node-log\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.788964 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.788968    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/45e17ebc-35d4-4af6-92fa-7deed7b064a2-registration-dir\") pod \"aws-ebs-csi-driver-node-kr5cp\" (UID: \"45e17ebc-35d4-4af6-92fa-7deed7b064a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr5cp"
Sep 11 11:34:11.789487 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:11.789014    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ed2dabe-863c-4c3f-9c21-ce551acf7712-metrics-certs podName:5ed2dabe-863c-4c3f-9c21-ce551acf7712 nodeName:}" failed. No retries permitted until 2026-09-11 11:34:12.288989756 +0000 UTC m=+3.111449612 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5ed2dabe-863c-4c3f-9c21-ce551acf7712-metrics-certs") pod "network-metrics-daemon-flnj5" (UID: "5ed2dabe-863c-4c3f-9c21-ce551acf7712") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 11:34:11.789487 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.789017    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/210895f6-8c7c-4160-9ce0-83948df8a896-host-cni-netd\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.789487 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.788901    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f1f60bc1-6275-4391-87a0-3edcef0b9c02-etc-modprobe-d\") pod \"tuned-w27hd\" (UID: \"f1f60bc1-6275-4391-87a0-3edcef0b9c02\") " pod="openshift-cluster-node-tuning-operator/tuned-w27hd"
Sep 11 11:34:11.789487 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.789059    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/210895f6-8c7c-4160-9ce0-83948df8a896-host-cni-bin\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.789487 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.789092    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5c491281-d63d-4e9b-a258-626813c70eab-cni-binary-copy\") pod \"multus-additional-cni-plugins-58qjk\" (UID: \"5c491281-d63d-4e9b-a258-626813c70eab\") " pod="openshift-multus/multus-additional-cni-plugins-58qjk"
Sep 11 11:34:11.789487 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.789122    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zft9v\" (UniqueName: \"kubernetes.io/projected/da5daa69-1f21-42d2-b6d5-388f49a097d2-kube-api-access-zft9v\") pod \"node-ca-fjlr9\" (UID: \"da5daa69-1f21-42d2-b6d5-388f49a097d2\") " pod="openshift-image-registry/node-ca-fjlr9"
Sep 11 11:34:11.789487 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.789127    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f1f60bc1-6275-4391-87a0-3edcef0b9c02-etc-modprobe-d\") pod \"tuned-w27hd\" (UID: \"f1f60bc1-6275-4391-87a0-3edcef0b9c02\") " pod="openshift-cluster-node-tuning-operator/tuned-w27hd"
Sep 11 11:34:11.789487 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.789151    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ceec02a6-0160-40d7-9cde-b676a1cc636a-multus-daemon-config\") pod \"multus-jtbjs\" (UID: \"ceec02a6-0160-40d7-9cde-b676a1cc636a\") " pod="openshift-multus/multus-jtbjs"
Sep 11 11:34:11.789487 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.789178    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/81901073-d576-4c23-bb13-e150254f32b7-kubelet-config\") pod \"global-pull-secret-syncer-mtjkj\" (UID: \"81901073-d576-4c23-bb13-e150254f32b7\") " pod="kube-system/global-pull-secret-syncer-mtjkj"
Sep 11 11:34:11.789487 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.789227    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/45e17ebc-35d4-4af6-92fa-7deed7b064a2-device-dir\") pod \"aws-ebs-csi-driver-node-kr5cp\" (UID: \"45e17ebc-35d4-4af6-92fa-7deed7b064a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr5cp"
Sep 11 11:34:11.789487 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.789251    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/210895f6-8c7c-4160-9ce0-83948df8a896-ovnkube-config\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.789487 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.789288    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5c491281-d63d-4e9b-a258-626813c70eab-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-58qjk\" (UID: \"5c491281-d63d-4e9b-a258-626813c70eab\") " pod="openshift-multus/multus-additional-cni-plugins-58qjk"
Sep 11 11:34:11.789487 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.789315    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ceec02a6-0160-40d7-9cde-b676a1cc636a-cnibin\") pod \"multus-jtbjs\" (UID: \"ceec02a6-0160-40d7-9cde-b676a1cc636a\") " pod="openshift-multus/multus-jtbjs"
Sep 11 11:34:11.789487 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.789338    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ceec02a6-0160-40d7-9cde-b676a1cc636a-host-run-netns\") pod \"multus-jtbjs\" (UID: \"ceec02a6-0160-40d7-9cde-b676a1cc636a\") " pod="openshift-multus/multus-jtbjs"
Sep 11 11:34:11.789487 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.789362    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ceec02a6-0160-40d7-9cde-b676a1cc636a-host-var-lib-kubelet\") pod \"multus-jtbjs\" (UID: \"ceec02a6-0160-40d7-9cde-b676a1cc636a\") " pod="openshift-multus/multus-jtbjs"
Sep 11 11:34:11.789487 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.789397    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f1f60bc1-6275-4391-87a0-3edcef0b9c02-etc-sysctl-d\") pod \"tuned-w27hd\" (UID: \"f1f60bc1-6275-4391-87a0-3edcef0b9c02\") " pod="openshift-cluster-node-tuning-operator/tuned-w27hd"
Sep 11 11:34:11.790453 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.789438    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/210895f6-8c7c-4160-9ce0-83948df8a896-run-openvswitch\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.790453 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.789471    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/210895f6-8c7c-4160-9ce0-83948df8a896-host-run-ovn-kubernetes\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.790453 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.789497    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ceec02a6-0160-40d7-9cde-b676a1cc636a-system-cni-dir\") pod \"multus-jtbjs\" (UID: \"ceec02a6-0160-40d7-9cde-b676a1cc636a\") " pod="openshift-multus/multus-jtbjs"
Sep 11 11:34:11.790453 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.789526    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1f60bc1-6275-4391-87a0-3edcef0b9c02-var-lib-kubelet\") pod \"tuned-w27hd\" (UID: \"f1f60bc1-6275-4391-87a0-3edcef0b9c02\") " pod="openshift-cluster-node-tuning-operator/tuned-w27hd"
Sep 11 11:34:11.790453 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.789550    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3b040dc1-8688-4630-8a3d-3b8d7bc7fdd5-agent-certs\") pod \"konnectivity-agent-fv2ft\" (UID: \"3b040dc1-8688-4630-8a3d-3b8d7bc7fdd5\") " pod="kube-system/konnectivity-agent-fv2ft"
Sep 11 11:34:11.790453 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.789574    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/210895f6-8c7c-4160-9ce0-83948df8a896-run-ovn\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.790453 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.789022    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/210895f6-8c7c-4160-9ce0-83948df8a896-systemd-units\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.790453 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.789600    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5c491281-d63d-4e9b-a258-626813c70eab-cnibin\") pod \"multus-additional-cni-plugins-58qjk\" (UID: \"5c491281-d63d-4e9b-a258-626813c70eab\") " pod="openshift-multus/multus-additional-cni-plugins-58qjk"
Sep 11 11:34:11.790453 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.789987    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/210895f6-8c7c-4160-9ce0-83948df8a896-host-cni-bin\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.791432 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.791407    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3b040dc1-8688-4630-8a3d-3b8d7bc7fdd5-konnectivity-ca\") pod \"konnectivity-agent-fv2ft\" (UID: \"3b040dc1-8688-4630-8a3d-3b8d7bc7fdd5\") " pod="kube-system/konnectivity-agent-fv2ft"
Sep 11 11:34:11.791543 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.789626    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ceec02a6-0160-40d7-9cde-b676a1cc636a-host-var-lib-cni-bin\") pod \"multus-jtbjs\" (UID: \"ceec02a6-0160-40d7-9cde-b676a1cc636a\") " pod="openshift-multus/multus-jtbjs"
Sep 11 11:34:11.791543 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.791520    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81901073-d576-4c23-bb13-e150254f32b7-original-pull-secret\") pod \"global-pull-secret-syncer-mtjkj\" (UID: \"81901073-d576-4c23-bb13-e150254f32b7\") " pod="kube-system/global-pull-secret-syncer-mtjkj"
Sep 11 11:34:11.791673 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.791557    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48jbz\" (UniqueName: \"kubernetes.io/projected/129a8b0d-dd99-476a-bc21-8fcf5b3335d0-kube-api-access-48jbz\") pod \"node-resolver-xc7zl\" (UID: \"129a8b0d-dd99-476a-bc21-8fcf5b3335d0\") " pod="openshift-dns/node-resolver-xc7zl"
Sep 11 11:34:11.791673 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.791587    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/210895f6-8c7c-4160-9ce0-83948df8a896-var-lib-openvswitch\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.791673 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.791619    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5c491281-d63d-4e9b-a258-626813c70eab-tuning-conf-dir\") pod \"multus-additional-cni-plugins-58qjk\" (UID: \"5c491281-d63d-4e9b-a258-626813c70eab\") " pod="openshift-multus/multus-additional-cni-plugins-58qjk"
Sep 11 11:34:11.791673 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.791653    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5c491281-d63d-4e9b-a258-626813c70eab-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-58qjk\" (UID: \"5c491281-d63d-4e9b-a258-626813c70eab\") " pod="openshift-multus/multus-additional-cni-plugins-58qjk"
Sep 11 11:34:11.791880 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.791686    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ceec02a6-0160-40d7-9cde-b676a1cc636a-host-var-lib-cni-multus\") pod \"multus-jtbjs\" (UID: \"ceec02a6-0160-40d7-9cde-b676a1cc636a\") " pod="openshift-multus/multus-jtbjs"
Sep 11 11:34:11.791880 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.791735    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ceec02a6-0160-40d7-9cde-b676a1cc636a-host-run-multus-certs\") pod \"multus-jtbjs\" (UID: \"ceec02a6-0160-40d7-9cde-b676a1cc636a\") " pod="openshift-multus/multus-jtbjs"
Sep 11 11:34:11.791880 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.791767    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/831fe212-2c6f-4595-a7d3-bf75c740f746-iptables-alerter-script\") pod \"iptables-alerter-lgnht\" (UID: \"831fe212-2c6f-4595-a7d3-bf75c740f746\") " pod="openshift-network-operator/iptables-alerter-lgnht"
Sep 11 11:34:11.791880 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.791799    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zn8g9\" (UniqueName: \"kubernetes.io/projected/f1f60bc1-6275-4391-87a0-3edcef0b9c02-kube-api-access-zn8g9\") pod \"tuned-w27hd\" (UID: \"f1f60bc1-6275-4391-87a0-3edcef0b9c02\") " pod="openshift-cluster-node-tuning-operator/tuned-w27hd"
Sep 11 11:34:11.791880 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.791829    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/45e17ebc-35d4-4af6-92fa-7deed7b064a2-sys-fs\") pod \"aws-ebs-csi-driver-node-kr5cp\" (UID: \"45e17ebc-35d4-4af6-92fa-7deed7b064a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr5cp"
Sep 11 11:34:11.791880 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.791858    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8q86r\" (UniqueName: \"kubernetes.io/projected/45e17ebc-35d4-4af6-92fa-7deed7b064a2-kube-api-access-8q86r\") pod \"aws-ebs-csi-driver-node-kr5cp\" (UID: \"45e17ebc-35d4-4af6-92fa-7deed7b064a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr5cp"
Sep 11 11:34:11.792181 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.791882    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f1f60bc1-6275-4391-87a0-3edcef0b9c02-etc-systemd\") pod \"tuned-w27hd\" (UID: \"f1f60bc1-6275-4391-87a0-3edcef0b9c02\") " pod="openshift-cluster-node-tuning-operator/tuned-w27hd"
Sep 11 11:34:11.792181 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.791913    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f1f60bc1-6275-4391-87a0-3edcef0b9c02-lib-modules\") pod \"tuned-w27hd\" (UID: \"f1f60bc1-6275-4391-87a0-3edcef0b9c02\") " pod="openshift-cluster-node-tuning-operator/tuned-w27hd"
Sep 11 11:34:11.792181 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.791942    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f1f60bc1-6275-4391-87a0-3edcef0b9c02-host\") pod \"tuned-w27hd\" (UID: \"f1f60bc1-6275-4391-87a0-3edcef0b9c02\") " pod="openshift-cluster-node-tuning-operator/tuned-w27hd"
Sep 11 11:34:11.792181 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.791974    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/129a8b0d-dd99-476a-bc21-8fcf5b3335d0-hosts-file\") pod \"node-resolver-xc7zl\" (UID: \"129a8b0d-dd99-476a-bc21-8fcf5b3335d0\") " pod="openshift-dns/node-resolver-xc7zl"
Sep 11 11:34:11.792181 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.792001    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/210895f6-8c7c-4160-9ce0-83948df8a896-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.792181 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.792032    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/45e17ebc-35d4-4af6-92fa-7deed7b064a2-socket-dir\") pod \"aws-ebs-csi-driver-node-kr5cp\" (UID: \"45e17ebc-35d4-4af6-92fa-7deed7b064a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr5cp"
Sep 11 11:34:11.792181 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.792066    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f1f60bc1-6275-4391-87a0-3edcef0b9c02-etc-sysctl-conf\") pod \"tuned-w27hd\" (UID: \"f1f60bc1-6275-4391-87a0-3edcef0b9c02\") " pod="openshift-cluster-node-tuning-operator/tuned-w27hd"
Sep 11 11:34:11.792181 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.792099    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9vjk\" (UniqueName: \"kubernetes.io/projected/5ed2dabe-863c-4c3f-9c21-ce551acf7712-kube-api-access-c9vjk\") pod \"network-metrics-daemon-flnj5\" (UID: \"5ed2dabe-863c-4c3f-9c21-ce551acf7712\") " pod="openshift-multus/network-metrics-daemon-flnj5"
Sep 11 11:34:11.792181 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.792130    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/210895f6-8c7c-4160-9ce0-83948df8a896-ovn-node-metrics-cert\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.792181 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.792156    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ceec02a6-0160-40d7-9cde-b676a1cc636a-cni-binary-copy\") pod \"multus-jtbjs\" (UID: \"ceec02a6-0160-40d7-9cde-b676a1cc636a\") " pod="openshift-multus/multus-jtbjs"
Sep 11 11:34:11.792810 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.792188    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ceec02a6-0160-40d7-9cde-b676a1cc636a-multus-socket-dir-parent\") pod \"multus-jtbjs\" (UID: \"ceec02a6-0160-40d7-9cde-b676a1cc636a\") " pod="openshift-multus/multus-jtbjs"
Sep 11 11:34:11.792810 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.792220    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ceec02a6-0160-40d7-9cde-b676a1cc636a-multus-conf-dir\") pod \"multus-jtbjs\" (UID: \"ceec02a6-0160-40d7-9cde-b676a1cc636a\") " pod="openshift-multus/multus-jtbjs"
Sep 11 11:34:11.792810 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.792251    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97tfs\" (UniqueName: \"kubernetes.io/projected/ceec02a6-0160-40d7-9cde-b676a1cc636a-kube-api-access-97tfs\") pod \"multus-jtbjs\" (UID: \"ceec02a6-0160-40d7-9cde-b676a1cc636a\") " pod="openshift-multus/multus-jtbjs"
Sep 11 11:34:11.792810 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.792281    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f1f60bc1-6275-4391-87a0-3edcef0b9c02-sys\") pod \"tuned-w27hd\" (UID: \"f1f60bc1-6275-4391-87a0-3edcef0b9c02\") " pod="openshift-cluster-node-tuning-operator/tuned-w27hd"
Sep 11 11:34:11.792810 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.792306    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/129a8b0d-dd99-476a-bc21-8fcf5b3335d0-tmp-dir\") pod \"node-resolver-xc7zl\" (UID: \"129a8b0d-dd99-476a-bc21-8fcf5b3335d0\") " pod="openshift-dns/node-resolver-xc7zl"
Sep 11 11:34:11.792810 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.792337    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/210895f6-8c7c-4160-9ce0-83948df8a896-host-slash\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.792810 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.792367    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/210895f6-8c7c-4160-9ce0-83948df8a896-host-run-netns\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.792810 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.792399    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/210895f6-8c7c-4160-9ce0-83948df8a896-etc-openvswitch\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.792810 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.792431    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qjwh\" (UniqueName: \"kubernetes.io/projected/c74969dd-4205-4c53-9577-a6b387e33252-kube-api-access-2qjwh\") pod \"network-check-target-5g8rf\" (UID: \"c74969dd-4205-4c53-9577-a6b387e33252\") " pod="openshift-network-diagnostics/network-check-target-5g8rf"
Sep 11 11:34:11.792810 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.792462    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/81901073-d576-4c23-bb13-e150254f32b7-dbus\") pod \"global-pull-secret-syncer-mtjkj\" (UID: \"81901073-d576-4c23-bb13-e150254f32b7\") " pod="kube-system/global-pull-secret-syncer-mtjkj"
Sep 11 11:34:11.792810 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.792507    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f1f60bc1-6275-4391-87a0-3edcef0b9c02-etc-sysconfig\") pod \"tuned-w27hd\" (UID: \"f1f60bc1-6275-4391-87a0-3edcef0b9c02\") " pod="openshift-cluster-node-tuning-operator/tuned-w27hd"
Sep 11 11:34:11.792810 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.792539    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ceec02a6-0160-40d7-9cde-b676a1cc636a-multus-cni-dir\") pod \"multus-jtbjs\" (UID: \"ceec02a6-0160-40d7-9cde-b676a1cc636a\") " pod="openshift-multus/multus-jtbjs"
Sep 11 11:34:11.792810 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.792570    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/831fe212-2c6f-4595-a7d3-bf75c740f746-host-slash\") pod \"iptables-alerter-lgnht\" (UID: \"831fe212-2c6f-4595-a7d3-bf75c740f746\") " pod="openshift-network-operator/iptables-alerter-lgnht"
Sep 11 11:34:11.792810 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.792600    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/210895f6-8c7c-4160-9ce0-83948df8a896-host-kubelet\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.792810 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.792632    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/210895f6-8c7c-4160-9ce0-83948df8a896-run-systemd\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.792810 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.792663    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/da5daa69-1f21-42d2-b6d5-388f49a097d2-host\") pod \"node-ca-fjlr9\" (UID: \"da5daa69-1f21-42d2-b6d5-388f49a097d2\") " pod="openshift-image-registry/node-ca-fjlr9"
Sep 11 11:34:11.792810 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.792696    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ceec02a6-0160-40d7-9cde-b676a1cc636a-host-run-k8s-cni-cncf-io\") pod \"multus-jtbjs\" (UID: \"ceec02a6-0160-40d7-9cde-b676a1cc636a\") " pod="openshift-multus/multus-jtbjs"
Sep 11 11:34:11.792810 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.792746    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/45e17ebc-35d4-4af6-92fa-7deed7b064a2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kr5cp\" (UID: \"45e17ebc-35d4-4af6-92fa-7deed7b064a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr5cp"
Sep 11 11:34:11.793779 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.792778    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1f60bc1-6275-4391-87a0-3edcef0b9c02-tmp\") pod \"tuned-w27hd\" (UID: \"f1f60bc1-6275-4391-87a0-3edcef0b9c02\") " pod="openshift-cluster-node-tuning-operator/tuned-w27hd"
Sep 11 11:34:11.793779 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.792786    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5c491281-d63d-4e9b-a258-626813c70eab-cni-binary-copy\") pod \"multus-additional-cni-plugins-58qjk\" (UID: \"5c491281-d63d-4e9b-a258-626813c70eab\") " pod="openshift-multus/multus-additional-cni-plugins-58qjk"
Sep 11 11:34:11.793779 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.792810    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7kjd\" (UniqueName: \"kubernetes.io/projected/831fe212-2c6f-4595-a7d3-bf75c740f746-kube-api-access-r7kjd\") pod \"iptables-alerter-lgnht\" (UID: \"831fe212-2c6f-4595-a7d3-bf75c740f746\") " pod="openshift-network-operator/iptables-alerter-lgnht"
Sep 11 11:34:11.793779 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.792845    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/210895f6-8c7c-4160-9ce0-83948df8a896-log-socket\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.793779 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.792878    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/210895f6-8c7c-4160-9ce0-83948df8a896-env-overrides\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.793779 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.792904    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5c491281-d63d-4e9b-a258-626813c70eab-system-cni-dir\") pod \"multus-additional-cni-plugins-58qjk\" (UID: \"5c491281-d63d-4e9b-a258-626813c70eab\") " pod="openshift-multus/multus-additional-cni-plugins-58qjk"
Sep 11 11:34:11.793779 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:11.792922    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 11:34:11.793779 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.792938    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/da5daa69-1f21-42d2-b6d5-388f49a097d2-serviceca\") pod \"node-ca-fjlr9\" (UID: \"da5daa69-1f21-42d2-b6d5-388f49a097d2\") " pod="openshift-image-registry/node-ca-fjlr9"
Sep 11 11:34:11.793779 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.792970    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ceec02a6-0160-40d7-9cde-b676a1cc636a-hostroot\") pod \"multus-jtbjs\" (UID: \"ceec02a6-0160-40d7-9cde-b676a1cc636a\") " pod="openshift-multus/multus-jtbjs"
Sep 11 11:34:11.793779 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:11.792988    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81901073-d576-4c23-bb13-e150254f32b7-original-pull-secret podName:81901073-d576-4c23-bb13-e150254f32b7 nodeName:}" failed. No retries permitted until 2026-09-11 11:34:12.292969494 +0000 UTC m=+3.115429347 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/81901073-d576-4c23-bb13-e150254f32b7-original-pull-secret") pod "global-pull-secret-syncer-mtjkj" (UID: "81901073-d576-4c23-bb13-e150254f32b7") : object "kube-system"/"original-pull-secret" not registered
Sep 11 11:34:11.793779 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.793025    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ceec02a6-0160-40d7-9cde-b676a1cc636a-hostroot\") pod \"multus-jtbjs\" (UID: \"ceec02a6-0160-40d7-9cde-b676a1cc636a\") " pod="openshift-multus/multus-jtbjs"
Sep 11 11:34:11.793779 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.793034    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/45e17ebc-35d4-4af6-92fa-7deed7b064a2-etc-selinux\") pod \"aws-ebs-csi-driver-node-kr5cp\" (UID: \"45e17ebc-35d4-4af6-92fa-7deed7b064a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr5cp"
Sep 11 11:34:11.793779 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.793070    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f1f60bc1-6275-4391-87a0-3edcef0b9c02-run\") pod \"tuned-w27hd\" (UID: \"f1f60bc1-6275-4391-87a0-3edcef0b9c02\") " pod="openshift-cluster-node-tuning-operator/tuned-w27hd"
Sep 11 11:34:11.793779 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.793114    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/210895f6-8c7c-4160-9ce0-83948df8a896-ovnkube-script-lib\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.793779 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.793147    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ceec02a6-0160-40d7-9cde-b676a1cc636a-etc-kubernetes\") pod \"multus-jtbjs\" (UID: \"ceec02a6-0160-40d7-9cde-b676a1cc636a\") " pod="openshift-multus/multus-jtbjs"
Sep 11 11:34:11.793779 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.793182    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7hhf\" (UniqueName: \"kubernetes.io/projected/210895f6-8c7c-4160-9ce0-83948df8a896-kube-api-access-l7hhf\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.793779 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.793213    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f1f60bc1-6275-4391-87a0-3edcef0b9c02-etc-tuned\") pod \"tuned-w27hd\" (UID: \"f1f60bc1-6275-4391-87a0-3edcef0b9c02\") " pod="openshift-cluster-node-tuning-operator/tuned-w27hd"
Sep 11 11:34:11.794715 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.793577    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ceec02a6-0160-40d7-9cde-b676a1cc636a-cni-binary-copy\") pod \"multus-jtbjs\" (UID: \"ceec02a6-0160-40d7-9cde-b676a1cc636a\") " pod="openshift-multus/multus-jtbjs"
Sep 11 11:34:11.794715 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.793654    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ceec02a6-0160-40d7-9cde-b676a1cc636a-multus-socket-dir-parent\") pod \"multus-jtbjs\" (UID: \"ceec02a6-0160-40d7-9cde-b676a1cc636a\") " pod="openshift-multus/multus-jtbjs"
Sep 11 11:34:11.794715 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.793712    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ceec02a6-0160-40d7-9cde-b676a1cc636a-multus-conf-dir\") pod \"multus-jtbjs\" (UID: \"ceec02a6-0160-40d7-9cde-b676a1cc636a\") " pod="openshift-multus/multus-jtbjs"
Sep 11 11:34:11.794715 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.793926    2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 11 11:34:11.794715 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.794054    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f1f60bc1-6275-4391-87a0-3edcef0b9c02-sys\") pod \"tuned-w27hd\" (UID: \"f1f60bc1-6275-4391-87a0-3edcef0b9c02\") " pod="openshift-cluster-node-tuning-operator/tuned-w27hd"
Sep 11 11:34:11.794715 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.794341    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/129a8b0d-dd99-476a-bc21-8fcf5b3335d0-tmp-dir\") pod \"node-resolver-xc7zl\" (UID: \"129a8b0d-dd99-476a-bc21-8fcf5b3335d0\") " pod="openshift-dns/node-resolver-xc7zl"
Sep 11 11:34:11.794715 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.794416    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/210895f6-8c7c-4160-9ce0-83948df8a896-host-slash\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.794715 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.794473    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/210895f6-8c7c-4160-9ce0-83948df8a896-host-run-netns\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.794715 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.794527    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/210895f6-8c7c-4160-9ce0-83948df8a896-etc-openvswitch\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.795159 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.794835    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/81901073-d576-4c23-bb13-e150254f32b7-dbus\") pod \"global-pull-secret-syncer-mtjkj\" (UID: \"81901073-d576-4c23-bb13-e150254f32b7\") " pod="kube-system/global-pull-secret-syncer-mtjkj"
Sep 11 11:34:11.795159 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.794895    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f1f60bc1-6275-4391-87a0-3edcef0b9c02-etc-sysconfig\") pod \"tuned-w27hd\" (UID: \"f1f60bc1-6275-4391-87a0-3edcef0b9c02\") " pod="openshift-cluster-node-tuning-operator/tuned-w27hd"
Sep 11 11:34:11.795159 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.794957    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ceec02a6-0160-40d7-9cde-b676a1cc636a-multus-cni-dir\") pod \"multus-jtbjs\" (UID: \"ceec02a6-0160-40d7-9cde-b676a1cc636a\") " pod="openshift-multus/multus-jtbjs"
Sep 11 11:34:11.795159 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.795003    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/831fe212-2c6f-4595-a7d3-bf75c740f746-host-slash\") pod \"iptables-alerter-lgnht\" (UID: \"831fe212-2c6f-4595-a7d3-bf75c740f746\") " pod="openshift-network-operator/iptables-alerter-lgnht"
Sep 11 11:34:11.795159 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.795066    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/210895f6-8c7c-4160-9ce0-83948df8a896-host-kubelet\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.795159 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.795122    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/210895f6-8c7c-4160-9ce0-83948df8a896-run-systemd\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.795459 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.795171    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/da5daa69-1f21-42d2-b6d5-388f49a097d2-host\") pod \"node-ca-fjlr9\" (UID: \"da5daa69-1f21-42d2-b6d5-388f49a097d2\") " pod="openshift-image-registry/node-ca-fjlr9"
Sep 11 11:34:11.795459 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.795220    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ceec02a6-0160-40d7-9cde-b676a1cc636a-host-run-k8s-cni-cncf-io\") pod \"multus-jtbjs\" (UID: \"ceec02a6-0160-40d7-9cde-b676a1cc636a\") " pod="openshift-multus/multus-jtbjs"
Sep 11 11:34:11.795459 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.795278    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/45e17ebc-35d4-4af6-92fa-7deed7b064a2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kr5cp\" (UID: \"45e17ebc-35d4-4af6-92fa-7deed7b064a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr5cp"
Sep 11 11:34:11.795873 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.795851    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ceec02a6-0160-40d7-9cde-b676a1cc636a-host-var-lib-kubelet\") pod \"multus-jtbjs\" (UID: \"ceec02a6-0160-40d7-9cde-b676a1cc636a\") " pod="openshift-multus/multus-jtbjs"
Sep 11 11:34:11.796579 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.796382    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ceec02a6-0160-40d7-9cde-b676a1cc636a-multus-daemon-config\") pod \"multus-jtbjs\" (UID: \"ceec02a6-0160-40d7-9cde-b676a1cc636a\") " pod="openshift-multus/multus-jtbjs"
Sep 11 11:34:11.796705 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.796682    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/210895f6-8c7c-4160-9ce0-83948df8a896-var-lib-openvswitch\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.796804 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.796783    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/45e17ebc-35d4-4af6-92fa-7deed7b064a2-device-dir\") pod \"aws-ebs-csi-driver-node-kr5cp\" (UID: \"45e17ebc-35d4-4af6-92fa-7deed7b064a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr5cp"
Sep 11 11:34:11.796804 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.796801    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ceec02a6-0160-40d7-9cde-b676a1cc636a-system-cni-dir\") pod \"multus-jtbjs\" (UID: \"ceec02a6-0160-40d7-9cde-b676a1cc636a\") " pod="openshift-multus/multus-jtbjs"
Sep 11 11:34:11.798672 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.796939    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f1f60bc1-6275-4391-87a0-3edcef0b9c02-etc-sysctl-d\") pod \"tuned-w27hd\" (UID: \"f1f60bc1-6275-4391-87a0-3edcef0b9c02\") " pod="openshift-cluster-node-tuning-operator/tuned-w27hd"
Sep 11 11:34:11.798672 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.797023    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/210895f6-8c7c-4160-9ce0-83948df8a896-run-openvswitch\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.798672 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.797408    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/210895f6-8c7c-4160-9ce0-83948df8a896-ovnkube-config\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.798672 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.797611    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/210895f6-8c7c-4160-9ce0-83948df8a896-host-run-ovn-kubernetes\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.798672 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.797742    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/129a8b0d-dd99-476a-bc21-8fcf5b3335d0-hosts-file\") pod \"node-resolver-xc7zl\" (UID: \"129a8b0d-dd99-476a-bc21-8fcf5b3335d0\") " pod="openshift-dns/node-resolver-xc7zl"
Sep 11 11:34:11.798672 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.797854    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/45e17ebc-35d4-4af6-92fa-7deed7b064a2-etc-selinux\") pod \"aws-ebs-csi-driver-node-kr5cp\" (UID: \"45e17ebc-35d4-4af6-92fa-7deed7b064a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr5cp"
Sep 11 11:34:11.798672 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.797939    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5c491281-d63d-4e9b-a258-626813c70eab-tuning-conf-dir\") pod \"multus-additional-cni-plugins-58qjk\" (UID: \"5c491281-d63d-4e9b-a258-626813c70eab\") " pod="openshift-multus/multus-additional-cni-plugins-58qjk"
Sep 11 11:34:11.798672 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.797972    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5c491281-d63d-4e9b-a258-626813c70eab-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-58qjk\" (UID: \"5c491281-d63d-4e9b-a258-626813c70eab\") " pod="openshift-multus/multus-additional-cni-plugins-58qjk"
Sep 11 11:34:11.798672 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.798135    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f1f60bc1-6275-4391-87a0-3edcef0b9c02-etc-sysctl-conf\") pod \"tuned-w27hd\" (UID: \"f1f60bc1-6275-4391-87a0-3edcef0b9c02\") " pod="openshift-cluster-node-tuning-operator/tuned-w27hd"
Sep 11 11:34:11.798672 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.798261    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/45e17ebc-35d4-4af6-92fa-7deed7b064a2-socket-dir\") pod \"aws-ebs-csi-driver-node-kr5cp\" (UID: \"45e17ebc-35d4-4af6-92fa-7deed7b064a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr5cp"
Sep 11 11:34:11.798672 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.798374    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f1f60bc1-6275-4391-87a0-3edcef0b9c02-run\") pod \"tuned-w27hd\" (UID: \"f1f60bc1-6275-4391-87a0-3edcef0b9c02\") " pod="openshift-cluster-node-tuning-operator/tuned-w27hd"
Sep 11 11:34:11.798672 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.798616    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/210895f6-8c7c-4160-9ce0-83948df8a896-ovnkube-script-lib\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.798672 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.798681    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ceec02a6-0160-40d7-9cde-b676a1cc636a-etc-kubernetes\") pod \"multus-jtbjs\" (UID: \"ceec02a6-0160-40d7-9cde-b676a1cc636a\") " pod="openshift-multus/multus-jtbjs"
Sep 11 11:34:11.800044 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.798891    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5c491281-d63d-4e9b-a258-626813c70eab-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-58qjk\" (UID: \"5c491281-d63d-4e9b-a258-626813c70eab\") " pod="openshift-multus/multus-additional-cni-plugins-58qjk"
Sep 11 11:34:11.800044 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.796685    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/81901073-d576-4c23-bb13-e150254f32b7-kubelet-config\") pod \"global-pull-secret-syncer-mtjkj\" (UID: \"81901073-d576-4c23-bb13-e150254f32b7\") " pod="kube-system/global-pull-secret-syncer-mtjkj"
Sep 11 11:34:11.800044 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.798961    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ceec02a6-0160-40d7-9cde-b676a1cc636a-host-var-lib-cni-multus\") pod \"multus-jtbjs\" (UID: \"ceec02a6-0160-40d7-9cde-b676a1cc636a\") " pod="openshift-multus/multus-jtbjs"
Sep 11 11:34:11.800044 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.799010    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ceec02a6-0160-40d7-9cde-b676a1cc636a-cnibin\") pod \"multus-jtbjs\" (UID: \"ceec02a6-0160-40d7-9cde-b676a1cc636a\") " pod="openshift-multus/multus-jtbjs"
Sep 11 11:34:11.800044 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.799057    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ceec02a6-0160-40d7-9cde-b676a1cc636a-host-run-netns\") pod \"multus-jtbjs\" (UID: \"ceec02a6-0160-40d7-9cde-b676a1cc636a\") " pod="openshift-multus/multus-jtbjs"
Sep 11 11:34:11.800044 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.797952    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/210895f6-8c7c-4160-9ce0-83948df8a896-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.800044 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.799263    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ceec02a6-0160-40d7-9cde-b676a1cc636a-host-run-multus-certs\") pod \"multus-jtbjs\" (UID: \"ceec02a6-0160-40d7-9cde-b676a1cc636a\") " pod="openshift-multus/multus-jtbjs"
Sep 11 11:34:11.800044 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.799349    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/45e17ebc-35d4-4af6-92fa-7deed7b064a2-sys-fs\") pod \"aws-ebs-csi-driver-node-kr5cp\" (UID: \"45e17ebc-35d4-4af6-92fa-7deed7b064a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr5cp"
Sep 11 11:34:11.800044 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.799736    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f1f60bc1-6275-4391-87a0-3edcef0b9c02-etc-systemd\") pod \"tuned-w27hd\" (UID: \"f1f60bc1-6275-4391-87a0-3edcef0b9c02\") " pod="openshift-cluster-node-tuning-operator/tuned-w27hd"
Sep 11 11:34:11.800044 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.799866    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/831fe212-2c6f-4595-a7d3-bf75c740f746-iptables-alerter-script\") pod \"iptables-alerter-lgnht\" (UID: \"831fe212-2c6f-4595-a7d3-bf75c740f746\") " pod="openshift-network-operator/iptables-alerter-lgnht"
Sep 11 11:34:11.800044 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.799884    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f1f60bc1-6275-4391-87a0-3edcef0b9c02-lib-modules\") pod \"tuned-w27hd\" (UID: \"f1f60bc1-6275-4391-87a0-3edcef0b9c02\") " pod="openshift-cluster-node-tuning-operator/tuned-w27hd"
Sep 11 11:34:11.800044 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.799966    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/210895f6-8c7c-4160-9ce0-83948df8a896-log-socket\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.800044 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.800042    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f1f60bc1-6275-4391-87a0-3edcef0b9c02-host\") pod \"tuned-w27hd\" (UID: \"f1f60bc1-6275-4391-87a0-3edcef0b9c02\") " pod="openshift-cluster-node-tuning-operator/tuned-w27hd"
Sep 11 11:34:11.801123 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.801096    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/210895f6-8c7c-4160-9ce0-83948df8a896-env-overrides\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.801217 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.801185    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5c491281-d63d-4e9b-a258-626813c70eab-system-cni-dir\") pod \"multus-additional-cni-plugins-58qjk\" (UID: \"5c491281-d63d-4e9b-a258-626813c70eab\") " pod="openshift-multus/multus-additional-cni-plugins-58qjk"
Sep 11 11:34:11.801611 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.801589    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/da5daa69-1f21-42d2-b6d5-388f49a097d2-serviceca\") pod \"node-ca-fjlr9\" (UID: \"da5daa69-1f21-42d2-b6d5-388f49a097d2\") " pod="openshift-image-registry/node-ca-fjlr9"
Sep 11 11:34:11.801698 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.801679    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ceec02a6-0160-40d7-9cde-b676a1cc636a-host-var-lib-cni-bin\") pod \"multus-jtbjs\" (UID: \"ceec02a6-0160-40d7-9cde-b676a1cc636a\") " pod="openshift-multus/multus-jtbjs"
Sep 11 11:34:11.801809 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.801786    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/210895f6-8c7c-4160-9ce0-83948df8a896-run-ovn\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.801867 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.801856    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5c491281-d63d-4e9b-a258-626813c70eab-cnibin\") pod \"multus-additional-cni-plugins-58qjk\" (UID: \"5c491281-d63d-4e9b-a258-626813c70eab\") " pod="openshift-multus/multus-additional-cni-plugins-58qjk"
Sep 11 11:34:11.802072 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.802051    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f1f60bc1-6275-4391-87a0-3edcef0b9c02-etc-tuned\") pod \"tuned-w27hd\" (UID: \"f1f60bc1-6275-4391-87a0-3edcef0b9c02\") " pod="openshift-cluster-node-tuning-operator/tuned-w27hd"
Sep 11 11:34:11.803526 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.803503    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1f60bc1-6275-4391-87a0-3edcef0b9c02-var-lib-kubelet\") pod \"tuned-w27hd\" (UID: \"f1f60bc1-6275-4391-87a0-3edcef0b9c02\") " pod="openshift-cluster-node-tuning-operator/tuned-w27hd"
Sep 11 11:34:11.805663 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.805628    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3b040dc1-8688-4630-8a3d-3b8d7bc7fdd5-agent-certs\") pod \"konnectivity-agent-fv2ft\" (UID: \"3b040dc1-8688-4630-8a3d-3b8d7bc7fdd5\") " pod="kube-system/konnectivity-agent-fv2ft"
Sep 11 11:34:11.805815 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.805791    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zft9v\" (UniqueName: \"kubernetes.io/projected/da5daa69-1f21-42d2-b6d5-388f49a097d2-kube-api-access-zft9v\") pod \"node-ca-fjlr9\" (UID: \"da5daa69-1f21-42d2-b6d5-388f49a097d2\") " pod="openshift-image-registry/node-ca-fjlr9"
Sep 11 11:34:11.806773 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.806709    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1f60bc1-6275-4391-87a0-3edcef0b9c02-tmp\") pod \"tuned-w27hd\" (UID: \"f1f60bc1-6275-4391-87a0-3edcef0b9c02\") " pod="openshift-cluster-node-tuning-operator/tuned-w27hd"
Sep 11 11:34:11.807594 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.807421    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/210895f6-8c7c-4160-9ce0-83948df8a896-ovn-node-metrics-cert\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.807717 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:11.807679    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 11:34:11.807717 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:11.807714    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 11:34:11.807845 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:11.807729    2560 projected.go:196] Error preparing data for projected volume kube-api-access-2qjwh for pod openshift-network-diagnostics/network-check-target-5g8rf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 11:34:11.807845 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:11.807811    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c74969dd-4205-4c53-9577-a6b387e33252-kube-api-access-2qjwh podName:c74969dd-4205-4c53-9577-a6b387e33252 nodeName:}" failed. No retries permitted until 2026-09-11 11:34:12.307792674 +0000 UTC m=+3.130252543 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2qjwh" (UniqueName: "kubernetes.io/projected/c74969dd-4205-4c53-9577-a6b387e33252-kube-api-access-2qjwh") pod "network-check-target-5g8rf" (UID: "c74969dd-4205-4c53-9577-a6b387e33252") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 11:34:11.808914 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.808685    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfgjb\" (UniqueName: \"kubernetes.io/projected/5c491281-d63d-4e9b-a258-626813c70eab-kube-api-access-zfgjb\") pod \"multus-additional-cni-plugins-58qjk\" (UID: \"5c491281-d63d-4e9b-a258-626813c70eab\") " pod="openshift-multus/multus-additional-cni-plugins-58qjk"
Sep 11 11:34:11.812603 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.812239    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97tfs\" (UniqueName: \"kubernetes.io/projected/ceec02a6-0160-40d7-9cde-b676a1cc636a-kube-api-access-97tfs\") pod \"multus-jtbjs\" (UID: \"ceec02a6-0160-40d7-9cde-b676a1cc636a\") " pod="openshift-multus/multus-jtbjs"
Sep 11 11:34:11.814011 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.813986    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zn8g9\" (UniqueName: \"kubernetes.io/projected/f1f60bc1-6275-4391-87a0-3edcef0b9c02-kube-api-access-zn8g9\") pod \"tuned-w27hd\" (UID: \"f1f60bc1-6275-4391-87a0-3edcef0b9c02\") " pod="openshift-cluster-node-tuning-operator/tuned-w27hd"
Sep 11 11:34:11.814126 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.814062    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7hhf\" (UniqueName: \"kubernetes.io/projected/210895f6-8c7c-4160-9ce0-83948df8a896-kube-api-access-l7hhf\") pod \"ovnkube-node-vvjr6\" (UID: \"210895f6-8c7c-4160-9ce0-83948df8a896\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.814528 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.814475    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48jbz\" (UniqueName: \"kubernetes.io/projected/129a8b0d-dd99-476a-bc21-8fcf5b3335d0-kube-api-access-48jbz\") pod \"node-resolver-xc7zl\" (UID: \"129a8b0d-dd99-476a-bc21-8fcf5b3335d0\") " pod="openshift-dns/node-resolver-xc7zl"
Sep 11 11:34:11.815172 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.815116    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-230.ec2.internal" event={"ID":"a41d8d936191e7605296179362bc8cf0","Type":"ContainerStarted","Data":"e9a1a9da131e2a39b4c0bb6bc713f63955cabff13b4219ba09396945b236a1c2"}
Sep 11 11:34:11.816349 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.816316    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9vjk\" (UniqueName: \"kubernetes.io/projected/5ed2dabe-863c-4c3f-9c21-ce551acf7712-kube-api-access-c9vjk\") pod \"network-metrics-daemon-flnj5\" (UID: \"5ed2dabe-863c-4c3f-9c21-ce551acf7712\") " pod="openshift-multus/network-metrics-daemon-flnj5"
Sep 11 11:34:11.817993 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.817915    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-230.ec2.internal" event={"ID":"9b510c5ec560886a56425db6533b4ec1","Type":"ContainerStarted","Data":"5e1582ef01b41817e415b1c56afc7f93e7a81e7f300a301e53658e8ffd5969a8"}
Sep 11 11:34:11.817993 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.817974    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8q86r\" (UniqueName: \"kubernetes.io/projected/45e17ebc-35d4-4af6-92fa-7deed7b064a2-kube-api-access-8q86r\") pod \"aws-ebs-csi-driver-node-kr5cp\" (UID: \"45e17ebc-35d4-4af6-92fa-7deed7b064a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr5cp"
Sep 11 11:34:11.818295 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.818277    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7kjd\" (UniqueName: \"kubernetes.io/projected/831fe212-2c6f-4595-a7d3-bf75c740f746-kube-api-access-r7kjd\") pod \"iptables-alerter-lgnht\" (UID: \"831fe212-2c6f-4595-a7d3-bf75c740f746\") " pod="openshift-network-operator/iptables-alerter-lgnht"
Sep 11 11:34:11.894022 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.893987    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xc7zl"
Sep 11 11:34:11.907184 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.907155    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fv2ft"
Sep 11 11:34:11.921348 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.921319    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:11.929144 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.929114    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr5cp"
Sep 11 11:34:11.935885 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.935865    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-58qjk"
Sep 11 11:34:11.945798 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.945774    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-w27hd"
Sep 11 11:34:11.954794 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.954773    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fjlr9"
Sep 11 11:34:11.964699 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.964680    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jtbjs"
Sep 11 11:34:11.973502 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:11.973484    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lgnht"
Sep 11 11:34:12.058140 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:12.058111    2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 11:34:12.062744 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:12.062714    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 11:34:12.297613 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:12.297523    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81901073-d576-4c23-bb13-e150254f32b7-original-pull-secret\") pod \"global-pull-secret-syncer-mtjkj\" (UID: \"81901073-d576-4c23-bb13-e150254f32b7\") " pod="kube-system/global-pull-secret-syncer-mtjkj"
Sep 11 11:34:12.297801 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:12.297703    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ed2dabe-863c-4c3f-9c21-ce551acf7712-metrics-certs\") pod \"network-metrics-daemon-flnj5\" (UID: \"5ed2dabe-863c-4c3f-9c21-ce551acf7712\") " pod="openshift-multus/network-metrics-daemon-flnj5"
Sep 11 11:34:12.297801 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:12.297718    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 11:34:12.297906 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:12.297810    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81901073-d576-4c23-bb13-e150254f32b7-original-pull-secret podName:81901073-d576-4c23-bb13-e150254f32b7 nodeName:}" failed. No retries permitted until 2026-09-11 11:34:13.297786751 +0000 UTC m=+4.120246606 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/81901073-d576-4c23-bb13-e150254f32b7-original-pull-secret") pod "global-pull-secret-syncer-mtjkj" (UID: "81901073-d576-4c23-bb13-e150254f32b7") : object "kube-system"/"original-pull-secret" not registered
Sep 11 11:34:12.297906 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:12.297829    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 11:34:12.297906 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:12.297889    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ed2dabe-863c-4c3f-9c21-ce551acf7712-metrics-certs podName:5ed2dabe-863c-4c3f-9c21-ce551acf7712 nodeName:}" failed. No retries permitted until 2026-09-11 11:34:13.297871355 +0000 UTC m=+4.120331212 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5ed2dabe-863c-4c3f-9c21-ce551acf7712-metrics-certs") pod "network-metrics-daemon-flnj5" (UID: "5ed2dabe-863c-4c3f-9c21-ce551acf7712") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 11:34:12.398352 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:12.398303    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qjwh\" (UniqueName: \"kubernetes.io/projected/c74969dd-4205-4c53-9577-a6b387e33252-kube-api-access-2qjwh\") pod \"network-check-target-5g8rf\" (UID: \"c74969dd-4205-4c53-9577-a6b387e33252\") " pod="openshift-network-diagnostics/network-check-target-5g8rf"
Sep 11 11:34:12.398547 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:12.398461    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 11:34:12.398547 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:12.398482    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 11:34:12.398547 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:12.398495    2560 projected.go:196] Error preparing data for projected volume kube-api-access-2qjwh for pod openshift-network-diagnostics/network-check-target-5g8rf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 11:34:12.398729 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:12.398566    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c74969dd-4205-4c53-9577-a6b387e33252-kube-api-access-2qjwh podName:c74969dd-4205-4c53-9577-a6b387e33252 nodeName:}" failed. No retries permitted until 2026-09-11 11:34:13.398545502 +0000 UTC m=+4.221005374 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2qjwh" (UniqueName: "kubernetes.io/projected/c74969dd-4205-4c53-9577-a6b387e33252-kube-api-access-2qjwh") pod "network-check-target-5g8rf" (UID: "c74969dd-4205-4c53-9577-a6b387e33252") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 11:34:12.721818 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:12.721719    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 11:29:12 +0000 UTC" deadline="2028-04-18 15:53:09.005526256 +0000 UTC"
Sep 11 11:34:12.721818 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:12.721759    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14044h18m56.283773036s"
Sep 11 11:34:12.962544 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:12.962497    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod831fe212_2c6f_4595_a7d3_bf75c740f746.slice/crio-5281c3546a33154af194cfa8759b0ada27998defbadd37762cf90f3b32974f61 WatchSource:0}: Error finding container 5281c3546a33154af194cfa8759b0ada27998defbadd37762cf90f3b32974f61: Status 404 returned error can't find the container with id 5281c3546a33154af194cfa8759b0ada27998defbadd37762cf90f3b32974f61
Sep 11 11:34:12.968030 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:12.967844    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod129a8b0d_dd99_476a_bc21_8fcf5b3335d0.slice/crio-7e4b8324a098835ee1fccc47114aa1f1699651e3162e4b5fb38ca6e589f6208d WatchSource:0}: Error finding container 7e4b8324a098835ee1fccc47114aa1f1699651e3162e4b5fb38ca6e589f6208d: Status 404 returned error can't find the container with id 7e4b8324a098835ee1fccc47114aa1f1699651e3162e4b5fb38ca6e589f6208d
Sep 11 11:34:12.968690 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:12.968647    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podceec02a6_0160_40d7_9cde_b676a1cc636a.slice/crio-c7c7cafab8e142a8d22e9113a7276e91e55423bcf1ce5d3659a7ab875853280a WatchSource:0}: Error finding container c7c7cafab8e142a8d22e9113a7276e91e55423bcf1ce5d3659a7ab875853280a: Status 404 returned error can't find the container with id c7c7cafab8e142a8d22e9113a7276e91e55423bcf1ce5d3659a7ab875853280a
Sep 11 11:34:12.970951 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:12.970927    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c491281_d63d_4e9b_a258_626813c70eab.slice/crio-a89c352a50385b08d42d751dcc3aad7e399a6bb823c06fa1915b20b6f8299294 WatchSource:0}: Error finding container a89c352a50385b08d42d751dcc3aad7e399a6bb823c06fa1915b20b6f8299294: Status 404 returned error can't find the container with id a89c352a50385b08d42d751dcc3aad7e399a6bb823c06fa1915b20b6f8299294
Sep 11 11:34:13.304220 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:13.304186    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ed2dabe-863c-4c3f-9c21-ce551acf7712-metrics-certs\") pod \"network-metrics-daemon-flnj5\" (UID: \"5ed2dabe-863c-4c3f-9c21-ce551acf7712\") " pod="openshift-multus/network-metrics-daemon-flnj5"
Sep 11 11:34:13.304363 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:13.304237    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81901073-d576-4c23-bb13-e150254f32b7-original-pull-secret\") pod \"global-pull-secret-syncer-mtjkj\" (UID: \"81901073-d576-4c23-bb13-e150254f32b7\") " pod="kube-system/global-pull-secret-syncer-mtjkj"
Sep 11 11:34:13.304439 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:13.304379    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 11:34:13.304439 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:13.304408    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 11:34:13.304535 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:13.304441    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81901073-d576-4c23-bb13-e150254f32b7-original-pull-secret podName:81901073-d576-4c23-bb13-e150254f32b7 nodeName:}" failed. No retries permitted until 2026-09-11 11:34:15.304425254 +0000 UTC m=+6.126885107 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/81901073-d576-4c23-bb13-e150254f32b7-original-pull-secret") pod "global-pull-secret-syncer-mtjkj" (UID: "81901073-d576-4c23-bb13-e150254f32b7") : object "kube-system"/"original-pull-secret" not registered
Sep 11 11:34:13.304535 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:13.304487    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ed2dabe-863c-4c3f-9c21-ce551acf7712-metrics-certs podName:5ed2dabe-863c-4c3f-9c21-ce551acf7712 nodeName:}" failed. No retries permitted until 2026-09-11 11:34:15.304466236 +0000 UTC m=+6.126926111 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5ed2dabe-863c-4c3f-9c21-ce551acf7712-metrics-certs") pod "network-metrics-daemon-flnj5" (UID: "5ed2dabe-863c-4c3f-9c21-ce551acf7712") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 11:34:13.404949 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:13.404911    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qjwh\" (UniqueName: \"kubernetes.io/projected/c74969dd-4205-4c53-9577-a6b387e33252-kube-api-access-2qjwh\") pod \"network-check-target-5g8rf\" (UID: \"c74969dd-4205-4c53-9577-a6b387e33252\") " pod="openshift-network-diagnostics/network-check-target-5g8rf"
Sep 11 11:34:13.405150 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:13.405067    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 11:34:13.405150 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:13.405088    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 11:34:13.405150 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:13.405107    2560 projected.go:196] Error preparing data for projected volume kube-api-access-2qjwh for pod openshift-network-diagnostics/network-check-target-5g8rf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 11:34:13.405298 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:13.405165    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c74969dd-4205-4c53-9577-a6b387e33252-kube-api-access-2qjwh podName:c74969dd-4205-4c53-9577-a6b387e33252 nodeName:}" failed. No retries permitted until 2026-09-11 11:34:15.40514955 +0000 UTC m=+6.227609402 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2qjwh" (UniqueName: "kubernetes.io/projected/c74969dd-4205-4c53-9577-a6b387e33252-kube-api-access-2qjwh") pod "network-check-target-5g8rf" (UID: "c74969dd-4205-4c53-9577-a6b387e33252") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 11:34:13.723021 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:13.722878    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 11:29:12 +0000 UTC" deadline="2028-02-22 00:06:06.479106128 +0000 UTC"
Sep 11 11:34:13.723021 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:13.722939    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12684h31m52.756173385s"
Sep 11 11:34:13.808976 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:13.808374    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5g8rf"
Sep 11 11:34:13.808976 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:13.808406    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtjkj"
Sep 11 11:34:13.808976 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:13.808538    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5g8rf" podUID="c74969dd-4205-4c53-9577-a6b387e33252"
Sep 11 11:34:13.808976 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:13.808606    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtjkj" podUID="81901073-d576-4c23-bb13-e150254f32b7"
Sep 11 11:34:13.808976 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:13.808639    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flnj5"
Sep 11 11:34:13.808976 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:13.808795    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flnj5" podUID="5ed2dabe-863c-4c3f-9c21-ce551acf7712"
Sep 11 11:34:13.851616 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:13.851569    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lgnht" event={"ID":"831fe212-2c6f-4595-a7d3-bf75c740f746","Type":"ContainerStarted","Data":"5281c3546a33154af194cfa8759b0ada27998defbadd37762cf90f3b32974f61"}
Sep 11 11:34:13.856837 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:13.856805    2560 generic.go:356] "Generic (PLEG): container finished" podID="9b510c5ec560886a56425db6533b4ec1" containerID="6e1de73190275b269a1d6159ff6a6b0b9213cb59cc112174368f9312e10d5afa" exitCode=0
Sep 11 11:34:13.857954 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:13.857931    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-230.ec2.internal" event={"ID":"9b510c5ec560886a56425db6533b4ec1","Type":"ContainerDied","Data":"6e1de73190275b269a1d6159ff6a6b0b9213cb59cc112174368f9312e10d5afa"}
Sep 11 11:34:13.864413 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:13.864382    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr5cp" event={"ID":"45e17ebc-35d4-4af6-92fa-7deed7b064a2","Type":"ContainerStarted","Data":"945d59079fcbebe5f66d54cce2f32dad2cfc6bc77829e30c96f4dfc964649089"}
Sep 11 11:34:13.867660 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:13.867608    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fjlr9" event={"ID":"da5daa69-1f21-42d2-b6d5-388f49a097d2","Type":"ContainerStarted","Data":"4c0f0c99d5a194398f5ed65565210f366d5636d0728ac858897b36f8952c6841"}
Sep 11 11:34:13.871158 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:13.871130    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-58qjk" event={"ID":"5c491281-d63d-4e9b-a258-626813c70eab","Type":"ContainerStarted","Data":"a89c352a50385b08d42d751dcc3aad7e399a6bb823c06fa1915b20b6f8299294"}
Sep 11 11:34:13.882486 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:13.882450    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-230.ec2.internal" event={"ID":"a41d8d936191e7605296179362bc8cf0","Type":"ContainerStarted","Data":"08376b4ca7eb914c000d590088c25dce5d7c0fcc0d368a16f6894012d835af14"}
Sep 11 11:34:13.897325 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:13.897269    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-230.ec2.internal" podStartSLOduration=1.897248145 podStartE2EDuration="1.897248145s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 11:34:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:34:13.896591906 +0000 UTC m=+4.719051813" watchObservedRunningTime="2026-09-11 11:34:13.897248145 +0000 UTC m=+4.719708025"
Sep 11 11:34:13.899924 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:13.899884    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-w27hd" event={"ID":"f1f60bc1-6275-4391-87a0-3edcef0b9c02","Type":"ContainerStarted","Data":"2e71f76e0dec507d7fa67cc9e5fb946109f131fca54d91444e5493993ab2be46"}
Sep 11 11:34:13.909698 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:13.909668    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6" event={"ID":"210895f6-8c7c-4160-9ce0-83948df8a896","Type":"ContainerStarted","Data":"e019d625660a00edaa1d3cc246ba5868bc72105b8a50537b85ca8b78762055bc"}
Sep 11 11:34:13.929079 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:13.929037    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fv2ft" event={"ID":"3b040dc1-8688-4630-8a3d-3b8d7bc7fdd5","Type":"ContainerStarted","Data":"7186c68ddb8f855fc967f180faccd5165736cf651a661192dad9fc93160a8b9c"}
Sep 11 11:34:13.948485 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:13.948418    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jtbjs" event={"ID":"ceec02a6-0160-40d7-9cde-b676a1cc636a","Type":"ContainerStarted","Data":"c7c7cafab8e142a8d22e9113a7276e91e55423bcf1ce5d3659a7ab875853280a"}
Sep 11 11:34:13.961283 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:13.960982    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xc7zl" event={"ID":"129a8b0d-dd99-476a-bc21-8fcf5b3335d0","Type":"ContainerStarted","Data":"7e4b8324a098835ee1fccc47114aa1f1699651e3162e4b5fb38ca6e589f6208d"}
Sep 11 11:34:14.982870 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:14.982828    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-230.ec2.internal" event={"ID":"9b510c5ec560886a56425db6533b4ec1","Type":"ContainerStarted","Data":"a82993ac2e7bcdab0410e5e27762b45e9340c4f71bb21f1aa5753949cfe744f0"}
Sep 11 11:34:15.000907 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:15.000851    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-230.ec2.internal" podStartSLOduration=3.000827546 podStartE2EDuration="3.000827546s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 11:34:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:34:14.999972439 +0000 UTC m=+5.822432318" watchObservedRunningTime="2026-09-11 11:34:15.000827546 +0000 UTC m=+5.823287426"
Sep 11 11:34:15.322761 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:15.322642    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ed2dabe-863c-4c3f-9c21-ce551acf7712-metrics-certs\") pod \"network-metrics-daemon-flnj5\" (UID: \"5ed2dabe-863c-4c3f-9c21-ce551acf7712\") " pod="openshift-multus/network-metrics-daemon-flnj5"
Sep 11 11:34:15.322761 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:15.322725    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81901073-d576-4c23-bb13-e150254f32b7-original-pull-secret\") pod \"global-pull-secret-syncer-mtjkj\" (UID: \"81901073-d576-4c23-bb13-e150254f32b7\") " pod="kube-system/global-pull-secret-syncer-mtjkj"
Sep 11 11:34:15.323000 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:15.322852    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 11:34:15.323000 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:15.322919    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81901073-d576-4c23-bb13-e150254f32b7-original-pull-secret podName:81901073-d576-4c23-bb13-e150254f32b7 nodeName:}" failed. No retries permitted until 2026-09-11 11:34:19.322899059 +0000 UTC m=+10.145358927 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/81901073-d576-4c23-bb13-e150254f32b7-original-pull-secret") pod "global-pull-secret-syncer-mtjkj" (UID: "81901073-d576-4c23-bb13-e150254f32b7") : object "kube-system"/"original-pull-secret" not registered
Sep 11 11:34:15.323354 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:15.323332    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 11:34:15.323472 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:15.323397    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ed2dabe-863c-4c3f-9c21-ce551acf7712-metrics-certs podName:5ed2dabe-863c-4c3f-9c21-ce551acf7712 nodeName:}" failed. No retries permitted until 2026-09-11 11:34:19.323379029 +0000 UTC m=+10.145838901 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5ed2dabe-863c-4c3f-9c21-ce551acf7712-metrics-certs") pod "network-metrics-daemon-flnj5" (UID: "5ed2dabe-863c-4c3f-9c21-ce551acf7712") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 11:34:15.423705 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:15.423650    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qjwh\" (UniqueName: \"kubernetes.io/projected/c74969dd-4205-4c53-9577-a6b387e33252-kube-api-access-2qjwh\") pod \"network-check-target-5g8rf\" (UID: \"c74969dd-4205-4c53-9577-a6b387e33252\") " pod="openshift-network-diagnostics/network-check-target-5g8rf"
Sep 11 11:34:15.423911 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:15.423837    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 11:34:15.423911 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:15.423859    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 11:34:15.423911 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:15.423873    2560 projected.go:196] Error preparing data for projected volume kube-api-access-2qjwh for pod openshift-network-diagnostics/network-check-target-5g8rf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 11:34:15.424079 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:15.423936    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c74969dd-4205-4c53-9577-a6b387e33252-kube-api-access-2qjwh podName:c74969dd-4205-4c53-9577-a6b387e33252 nodeName:}" failed. No retries permitted until 2026-09-11 11:34:19.423916414 +0000 UTC m=+10.246376289 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2qjwh" (UniqueName: "kubernetes.io/projected/c74969dd-4205-4c53-9577-a6b387e33252-kube-api-access-2qjwh") pod "network-check-target-5g8rf" (UID: "c74969dd-4205-4c53-9577-a6b387e33252") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 11:34:15.808898 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:15.808814    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5g8rf"
Sep 11 11:34:15.809075 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:15.808963    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5g8rf" podUID="c74969dd-4205-4c53-9577-a6b387e33252"
Sep 11 11:34:15.809344 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:15.809323    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtjkj"
Sep 11 11:34:15.809454 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:15.809433    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtjkj" podUID="81901073-d576-4c23-bb13-e150254f32b7"
Sep 11 11:34:15.809529 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:15.809506    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flnj5"
Sep 11 11:34:15.809614 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:15.809595    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flnj5" podUID="5ed2dabe-863c-4c3f-9c21-ce551acf7712"
Sep 11 11:34:17.807708 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:17.807672    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5g8rf"
Sep 11 11:34:17.808241 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:17.807802    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5g8rf" podUID="c74969dd-4205-4c53-9577-a6b387e33252"
Sep 11 11:34:17.808241 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:17.807688    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtjkj"
Sep 11 11:34:17.808241 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:17.807812    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flnj5"
Sep 11 11:34:17.808241 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:17.807903    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flnj5" podUID="5ed2dabe-863c-4c3f-9c21-ce551acf7712"
Sep 11 11:34:17.808241 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:17.807949    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtjkj" podUID="81901073-d576-4c23-bb13-e150254f32b7"
Sep 11 11:34:19.361006 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:19.360724    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ed2dabe-863c-4c3f-9c21-ce551acf7712-metrics-certs\") pod \"network-metrics-daemon-flnj5\" (UID: \"5ed2dabe-863c-4c3f-9c21-ce551acf7712\") " pod="openshift-multus/network-metrics-daemon-flnj5"
Sep 11 11:34:19.361509 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:19.361060    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81901073-d576-4c23-bb13-e150254f32b7-original-pull-secret\") pod \"global-pull-secret-syncer-mtjkj\" (UID: \"81901073-d576-4c23-bb13-e150254f32b7\") " pod="kube-system/global-pull-secret-syncer-mtjkj"
Sep 11 11:34:19.361509 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:19.360870    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 11:34:19.361509 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:19.361248    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ed2dabe-863c-4c3f-9c21-ce551acf7712-metrics-certs podName:5ed2dabe-863c-4c3f-9c21-ce551acf7712 nodeName:}" failed. No retries permitted until 2026-09-11 11:34:27.361226694 +0000 UTC m=+18.183686569 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5ed2dabe-863c-4c3f-9c21-ce551acf7712-metrics-certs") pod "network-metrics-daemon-flnj5" (UID: "5ed2dabe-863c-4c3f-9c21-ce551acf7712") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 11:34:19.361764 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:19.361176    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 11:34:19.361764 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:19.361637    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81901073-d576-4c23-bb13-e150254f32b7-original-pull-secret podName:81901073-d576-4c23-bb13-e150254f32b7 nodeName:}" failed. No retries permitted until 2026-09-11 11:34:27.361618519 +0000 UTC m=+18.184078387 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/81901073-d576-4c23-bb13-e150254f32b7-original-pull-secret") pod "global-pull-secret-syncer-mtjkj" (UID: "81901073-d576-4c23-bb13-e150254f32b7") : object "kube-system"/"original-pull-secret" not registered
Sep 11 11:34:19.462160 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:19.462111    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qjwh\" (UniqueName: \"kubernetes.io/projected/c74969dd-4205-4c53-9577-a6b387e33252-kube-api-access-2qjwh\") pod \"network-check-target-5g8rf\" (UID: \"c74969dd-4205-4c53-9577-a6b387e33252\") " pod="openshift-network-diagnostics/network-check-target-5g8rf"
Sep 11 11:34:19.462417 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:19.462315    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 11:34:19.462417 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:19.462335    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 11:34:19.462417 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:19.462349    2560 projected.go:196] Error preparing data for projected volume kube-api-access-2qjwh for pod openshift-network-diagnostics/network-check-target-5g8rf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 11:34:19.462417 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:19.462414    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c74969dd-4205-4c53-9577-a6b387e33252-kube-api-access-2qjwh podName:c74969dd-4205-4c53-9577-a6b387e33252 nodeName:}" failed. No retries permitted until 2026-09-11 11:34:27.46239507 +0000 UTC m=+18.284854947 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2qjwh" (UniqueName: "kubernetes.io/projected/c74969dd-4205-4c53-9577-a6b387e33252-kube-api-access-2qjwh") pod "network-check-target-5g8rf" (UID: "c74969dd-4205-4c53-9577-a6b387e33252") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 11:34:19.809335 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:19.809156    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5g8rf"
Sep 11 11:34:19.809335 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:19.809268    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5g8rf" podUID="c74969dd-4205-4c53-9577-a6b387e33252"
Sep 11 11:34:19.809658 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:19.809630    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtjkj"
Sep 11 11:34:19.809798 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:19.809765    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flnj5"
Sep 11 11:34:19.809883 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:19.809793    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtjkj" podUID="81901073-d576-4c23-bb13-e150254f32b7"
Sep 11 11:34:19.809883 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:19.809872    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flnj5" podUID="5ed2dabe-863c-4c3f-9c21-ce551acf7712"
Sep 11 11:34:21.808116 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:21.808024    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flnj5"
Sep 11 11:34:21.808584 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:21.808194    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flnj5" podUID="5ed2dabe-863c-4c3f-9c21-ce551acf7712"
Sep 11 11:34:21.808584 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:21.808411    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5g8rf"
Sep 11 11:34:21.808584 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:21.808500    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5g8rf" podUID="c74969dd-4205-4c53-9577-a6b387e33252"
Sep 11 11:34:21.808826 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:21.808593    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtjkj"
Sep 11 11:34:21.808826 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:21.808685    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtjkj" podUID="81901073-d576-4c23-bb13-e150254f32b7"
Sep 11 11:34:23.807948 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:23.807916    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5g8rf"
Sep 11 11:34:23.807948 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:23.807917    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtjkj"
Sep 11 11:34:23.808469 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:23.807917    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flnj5"
Sep 11 11:34:23.808469 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:23.808093    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtjkj" podUID="81901073-d576-4c23-bb13-e150254f32b7"
Sep 11 11:34:23.808469 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:23.808160    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5g8rf" podUID="c74969dd-4205-4c53-9577-a6b387e33252"
Sep 11 11:34:23.808469 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:23.808231    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flnj5" podUID="5ed2dabe-863c-4c3f-9c21-ce551acf7712"
Sep 11 11:34:25.807845 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:25.807816    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtjkj"
Sep 11 11:34:25.808250 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:25.807859    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5g8rf"
Sep 11 11:34:25.808250 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:25.807816    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flnj5"
Sep 11 11:34:25.808250 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:25.807949    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtjkj" podUID="81901073-d576-4c23-bb13-e150254f32b7"
Sep 11 11:34:25.808415 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:25.808172    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5g8rf" podUID="c74969dd-4205-4c53-9577-a6b387e33252"
Sep 11 11:34:25.808666 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:25.808623    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flnj5" podUID="5ed2dabe-863c-4c3f-9c21-ce551acf7712"
Sep 11 11:34:27.421166 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:27.421135    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ed2dabe-863c-4c3f-9c21-ce551acf7712-metrics-certs\") pod \"network-metrics-daemon-flnj5\" (UID: \"5ed2dabe-863c-4c3f-9c21-ce551acf7712\") " pod="openshift-multus/network-metrics-daemon-flnj5"
Sep 11 11:34:27.421606 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:27.421176    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81901073-d576-4c23-bb13-e150254f32b7-original-pull-secret\") pod \"global-pull-secret-syncer-mtjkj\" (UID: \"81901073-d576-4c23-bb13-e150254f32b7\") " pod="kube-system/global-pull-secret-syncer-mtjkj"
Sep 11 11:34:27.421606 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:27.421276    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 11:34:27.421606 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:27.421330    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81901073-d576-4c23-bb13-e150254f32b7-original-pull-secret podName:81901073-d576-4c23-bb13-e150254f32b7 nodeName:}" failed. No retries permitted until 2026-09-11 11:34:43.421314556 +0000 UTC m=+34.243774412 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/81901073-d576-4c23-bb13-e150254f32b7-original-pull-secret") pod "global-pull-secret-syncer-mtjkj" (UID: "81901073-d576-4c23-bb13-e150254f32b7") : object "kube-system"/"original-pull-secret" not registered
Sep 11 11:34:27.421606 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:27.421276    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 11:34:27.421606 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:27.421395    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ed2dabe-863c-4c3f-9c21-ce551acf7712-metrics-certs podName:5ed2dabe-863c-4c3f-9c21-ce551acf7712 nodeName:}" failed. No retries permitted until 2026-09-11 11:34:43.421382716 +0000 UTC m=+34.243842571 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5ed2dabe-863c-4c3f-9c21-ce551acf7712-metrics-certs") pod "network-metrics-daemon-flnj5" (UID: "5ed2dabe-863c-4c3f-9c21-ce551acf7712") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 11:34:27.521999 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:27.521970    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qjwh\" (UniqueName: \"kubernetes.io/projected/c74969dd-4205-4c53-9577-a6b387e33252-kube-api-access-2qjwh\") pod \"network-check-target-5g8rf\" (UID: \"c74969dd-4205-4c53-9577-a6b387e33252\") " pod="openshift-network-diagnostics/network-check-target-5g8rf"
Sep 11 11:34:27.522184 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:27.522128    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 11:34:27.522184 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:27.522148    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 11:34:27.522184 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:27.522159    2560 projected.go:196] Error preparing data for projected volume kube-api-access-2qjwh for pod openshift-network-diagnostics/network-check-target-5g8rf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 11:34:27.522366 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:27.522219    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c74969dd-4205-4c53-9577-a6b387e33252-kube-api-access-2qjwh podName:c74969dd-4205-4c53-9577-a6b387e33252 nodeName:}" failed. No retries permitted until 2026-09-11 11:34:43.522202277 +0000 UTC m=+34.344662147 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2qjwh" (UniqueName: "kubernetes.io/projected/c74969dd-4205-4c53-9577-a6b387e33252-kube-api-access-2qjwh") pod "network-check-target-5g8rf" (UID: "c74969dd-4205-4c53-9577-a6b387e33252") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 11:34:27.808222 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:27.807717    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5g8rf"
Sep 11 11:34:27.808222 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:27.807716    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtjkj"
Sep 11 11:34:27.808222 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:27.807860    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flnj5"
Sep 11 11:34:27.808222 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:27.807854    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5g8rf" podUID="c74969dd-4205-4c53-9577-a6b387e33252"
Sep 11 11:34:27.808222 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:27.807966    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtjkj" podUID="81901073-d576-4c23-bb13-e150254f32b7"
Sep 11 11:34:27.808222 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:27.808047    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flnj5" podUID="5ed2dabe-863c-4c3f-9c21-ce551acf7712"
Sep 11 11:34:29.808390 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:29.808357    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5g8rf"
Sep 11 11:34:29.808841 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:29.808417    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtjkj"
Sep 11 11:34:29.808841 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:29.808779    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5g8rf" podUID="c74969dd-4205-4c53-9577-a6b387e33252"
Sep 11 11:34:29.808943 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:29.808893    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtjkj" podUID="81901073-d576-4c23-bb13-e150254f32b7"
Sep 11 11:34:29.808943 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:29.808445    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flnj5"
Sep 11 11:34:29.809125 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:29.809103    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flnj5" podUID="5ed2dabe-863c-4c3f-9c21-ce551acf7712"
Sep 11 11:34:31.808026 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:31.807850    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtjkj"
Sep 11 11:34:31.808783 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:31.807850    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flnj5"
Sep 11 11:34:31.808783 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:31.808103    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtjkj" podUID="81901073-d576-4c23-bb13-e150254f32b7"
Sep 11 11:34:31.808783 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:31.807850    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5g8rf"
Sep 11 11:34:31.808783 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:31.808233    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flnj5" podUID="5ed2dabe-863c-4c3f-9c21-ce551acf7712"
Sep 11 11:34:31.808783 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:31.808264    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5g8rf" podUID="c74969dd-4205-4c53-9577-a6b387e33252"
Sep 11 11:34:32.019702 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:32.019609    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr5cp" event={"ID":"45e17ebc-35d4-4af6-92fa-7deed7b064a2","Type":"ContainerStarted","Data":"a6c8ec0d61a65aacbb1033563a5f5b855ba727046dcf91585f9c5aa569407af3"}
Sep 11 11:34:32.021093 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:32.021063    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fjlr9" event={"ID":"da5daa69-1f21-42d2-b6d5-388f49a097d2","Type":"ContainerStarted","Data":"0ca251254b7c0e91de58bb2dcaaecde32cb4f7fe4897f7d59efd49a2f81a4239"}
Sep 11 11:34:32.022525 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:32.022502    2560 generic.go:356] "Generic (PLEG): container finished" podID="5c491281-d63d-4e9b-a258-626813c70eab" containerID="8d2596e792afda0478a9c3047793db02e7c785f89365cb919c315f7af7e98273" exitCode=0
Sep 11 11:34:32.022643 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:32.022583    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-58qjk" event={"ID":"5c491281-d63d-4e9b-a258-626813c70eab","Type":"ContainerDied","Data":"8d2596e792afda0478a9c3047793db02e7c785f89365cb919c315f7af7e98273"}
Sep 11 11:34:32.024273 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:32.024248    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-w27hd" event={"ID":"f1f60bc1-6275-4391-87a0-3edcef0b9c02","Type":"ContainerStarted","Data":"abaeb02d1039423a719242c4bbe458c4184000fedcc4f1676a89a79356614983"}
Sep 11 11:34:32.027442 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:32.027421    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6" event={"ID":"210895f6-8c7c-4160-9ce0-83948df8a896","Type":"ContainerStarted","Data":"fe1d8a37aecde648b20728ab1044128e24217e7cdd99e1a62b548fece2a5720f"}
Sep 11 11:34:32.027535 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:32.027491    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6" event={"ID":"210895f6-8c7c-4160-9ce0-83948df8a896","Type":"ContainerStarted","Data":"3fc4a43a43f72d057a942c387085379544d7de167b98e775eb1aaedcc1568800"}
Sep 11 11:34:32.027581 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:32.027537    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6" event={"ID":"210895f6-8c7c-4160-9ce0-83948df8a896","Type":"ContainerStarted","Data":"5c9431004d53141f57baeafb3a227e413fa2068aa27010f426c2d68b2de8ff50"}
Sep 11 11:34:32.027581 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:32.027570    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6" event={"ID":"210895f6-8c7c-4160-9ce0-83948df8a896","Type":"ContainerStarted","Data":"296966ffa9656e04923fd2a7cbe2287e4547c1b36ef823123deb79fc50ea3e81"}
Sep 11 11:34:32.027693 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:32.027610    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6" event={"ID":"210895f6-8c7c-4160-9ce0-83948df8a896","Type":"ContainerStarted","Data":"86175353203d05a5764fcc6c5ec99bf53c39e985af17f5d5ec3526a4e816fe85"}
Sep 11 11:34:32.027693 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:32.027642    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6" event={"ID":"210895f6-8c7c-4160-9ce0-83948df8a896","Type":"ContainerStarted","Data":"590696f67074b6be1bfebab03a56a3a45419469ed991db649924d2364869da73"}
Sep 11 11:34:32.028860 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:32.028841    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fv2ft" event={"ID":"3b040dc1-8688-4630-8a3d-3b8d7bc7fdd5","Type":"ContainerStarted","Data":"ede21ea2b1e560581d03159687dbf63860dba891384fbaf92be05e62d123cba9"}
Sep 11 11:34:32.030234 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:32.030216    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jtbjs" event={"ID":"ceec02a6-0160-40d7-9cde-b676a1cc636a","Type":"ContainerStarted","Data":"08866e77b9e7b6e32eb042440e0b0fe95bcf00b54a2710c1fa7e7cc6af0f3f65"}
Sep 11 11:34:32.031516 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:32.031499    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xc7zl" event={"ID":"129a8b0d-dd99-476a-bc21-8fcf5b3335d0","Type":"ContainerStarted","Data":"59ca861924a9a39241f44ba59af5a550069a15a0a0c3973e126948b98d249e59"}
Sep 11 11:34:32.036783 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:32.036748    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-fjlr9" podStartSLOduration=3.76750873 podStartE2EDuration="22.03673577s" totalImagesPullingTime="18.26922704s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 11:34:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:34:32.036095419 +0000 UTC m=+22.858555295" watchObservedRunningTime="2026-09-11 11:34:32.03673577 +0000 UTC m=+22.859195653"
Sep 11 11:34:32.049780 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:32.049745    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-fv2ft" podStartSLOduration=7.455715325 podStartE2EDuration="22.04973349s" totalImagesPullingTime="14.594018165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:34:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:34:32.049521049 +0000 UTC m=+22.871980940" watchObservedRunningTime="2026-09-11 11:34:32.04973349 +0000 UTC m=+22.872193397"
Sep 11 11:34:32.066904 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:32.066865    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-w27hd" podStartSLOduration=3.797297432 podStartE2EDuration="22.066854112s" totalImagesPullingTime="18.26955668s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 11:34:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:34:32.066718473 +0000 UTC m=+22.889178379" watchObservedRunningTime="2026-09-11 11:34:32.066854112 +0000 UTC m=+22.889313985"
Sep 11 11:34:32.083012 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:32.082977    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jtbjs" podStartSLOduration=3.730201471 podStartE2EDuration="22.082966834s" totalImagesPullingTime="18.352765363s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 11:34:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:34:32.082798716 +0000 UTC m=+22.905258622" watchObservedRunningTime="2026-09-11 11:34:32.082966834 +0000 UTC m=+22.905426706"
Sep 11 11:34:32.096679 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:32.096624    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xc7zl" podStartSLOduration=3.798641624 podStartE2EDuration="22.096615885s" totalImagesPullingTime="18.297974261s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 11:34:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:34:32.096229279 +0000 UTC m=+22.918689177" watchObservedRunningTime="2026-09-11 11:34:32.096615885 +0000 UTC m=+22.919075758"
Sep 11 11:34:32.815805 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:32.815779    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-fv2ft"
Sep 11 11:34:32.816549 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:32.816529    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-fv2ft"
Sep 11 11:34:32.830280 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:32.830261    2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 11 11:34:33.035133 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:33.035094    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lgnht" event={"ID":"831fe212-2c6f-4595-a7d3-bf75c740f746","Type":"ContainerStarted","Data":"345ada1b939b591b91fd591894263741418ba04747afbdea1c02c13187e1aedc"}
Sep 11 11:34:33.037283 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:33.037253    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr5cp" event={"ID":"45e17ebc-35d4-4af6-92fa-7deed7b064a2","Type":"ContainerStarted","Data":"77c0d176807468c2b5397658f171ca6514922b39e78c2654034c6be197d71fd9"}
Sep 11 11:34:33.052636 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:33.052593    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lgnht" podStartSLOduration=4.750408946 podStartE2EDuration="23.052579358s" totalImagesPullingTime="18.302170412s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 11:34:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:34:33.051996736 +0000 UTC m=+23.874456630" watchObservedRunningTime="2026-09-11 11:34:33.052579358 +0000 UTC m=+23.875039231"
Sep 11 11:34:33.740768 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:33.740677    2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-11T11:34:32.830274977Z","UUID":"4a2a8d41-b70d-48e7-8a1e-7051247f21db","Handler":null,"Name":"","Endpoint":""}
Sep 11 11:34:33.743494 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:33.743460    2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 11 11:34:33.743494 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:33.743495    2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 11 11:34:33.807780 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:33.807745    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5g8rf"
Sep 11 11:34:33.807959 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:33.807875    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5g8rf" podUID="c74969dd-4205-4c53-9577-a6b387e33252"
Sep 11 11:34:33.807959 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:33.807897    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtjkj"
Sep 11 11:34:33.807959 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:33.807978    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flnj5"
Sep 11 11:34:33.808182 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:33.808088    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flnj5" podUID="5ed2dabe-863c-4c3f-9c21-ce551acf7712"
Sep 11 11:34:33.808299 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:33.808200    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtjkj" podUID="81901073-d576-4c23-bb13-e150254f32b7"
Sep 11 11:34:34.043929 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:34.043901    2560 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 11 11:34:34.044287 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:34.043899    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6" event={"ID":"210895f6-8c7c-4160-9ce0-83948df8a896","Type":"ContainerStarted","Data":"e6b58c22b7967f3795310ab834cc2ff88c50b40c45cc7b053eec6863f8ef18a2"}
Sep 11 11:34:35.048358 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:35.048319    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr5cp" event={"ID":"45e17ebc-35d4-4af6-92fa-7deed7b064a2","Type":"ContainerStarted","Data":"5b0fe3b8a2ac5b2b0b90929f9ae3e76b37370e0611087eff6ad1cb27bf9ed8dd"}
Sep 11 11:34:35.067941 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:35.067896    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr5cp" podStartSLOduration=4.171760191 podStartE2EDuration="25.067883262s" totalImagesPullingTime="20.896123071s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 11:34:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:34:35.067199332 +0000 UTC m=+25.889659264" watchObservedRunningTime="2026-09-11 11:34:35.067883262 +0000 UTC m=+25.890343140"
Sep 11 11:34:35.628499 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:35.628465    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-fv2ft"
Sep 11 11:34:35.628710 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:35.628663    2560 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 11 11:34:35.629192 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:35.629171    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fv2ft"
Sep 11 11:34:35.808384 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:35.808350    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flnj5"
Sep 11 11:34:35.808568 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:35.808355    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtjkj"
Sep 11 11:34:35.808568 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:35.808490    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flnj5" podUID="5ed2dabe-863c-4c3f-9c21-ce551acf7712"
Sep 11 11:34:35.808568 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:35.808508    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5g8rf"
Sep 11 11:34:35.808750 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:35.808608    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtjkj" podUID="81901073-d576-4c23-bb13-e150254f32b7"
Sep 11 11:34:35.808750 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:35.808688    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5g8rf" podUID="c74969dd-4205-4c53-9577-a6b387e33252"
Sep 11 11:34:37.056023 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:37.055837    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-58qjk" event={"ID":"5c491281-d63d-4e9b-a258-626813c70eab","Type":"ContainerStarted","Data":"b0d97be364583b9986e682d0727ecbe7c16f95ab7712961bcbd0a3526afb6ace"}
Sep 11 11:34:37.059600 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:37.059572    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6" event={"ID":"210895f6-8c7c-4160-9ce0-83948df8a896","Type":"ContainerStarted","Data":"9021d648eee10e7ce4f79dd5d09093512fc6d9ae21fba6929e65b758d3787dd6"}
Sep 11 11:34:37.059798 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:37.059776    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:37.059938 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:37.059845    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:37.074361 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:37.074324    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:37.100632 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:37.100588    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6" podStartSLOduration=8.779881596 podStartE2EDuration="27.100574594s" totalImagesPullingTime="18.320692998s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 11:34:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:34:37.099593058 +0000 UTC m=+27.922052949" watchObservedRunningTime="2026-09-11 11:34:37.100574594 +0000 UTC m=+27.923034466"
Sep 11 11:34:37.808143 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:37.808111    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5g8rf"
Sep 11 11:34:37.808281 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:37.808111    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtjkj"
Sep 11 11:34:37.808281 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:37.808216    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5g8rf" podUID="c74969dd-4205-4c53-9577-a6b387e33252"
Sep 11 11:34:37.808363 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:37.808120    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flnj5"
Sep 11 11:34:37.808363 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:37.808290    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtjkj" podUID="81901073-d576-4c23-bb13-e150254f32b7"
Sep 11 11:34:37.808427 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:37.808367    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flnj5" podUID="5ed2dabe-863c-4c3f-9c21-ce551acf7712"
Sep 11 11:34:38.064007 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:38.063918    2560 generic.go:356] "Generic (PLEG): container finished" podID="5c491281-d63d-4e9b-a258-626813c70eab" containerID="b0d97be364583b9986e682d0727ecbe7c16f95ab7712961bcbd0a3526afb6ace" exitCode=0
Sep 11 11:34:38.064470 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:38.064007    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-58qjk" event={"ID":"5c491281-d63d-4e9b-a258-626813c70eab","Type":"ContainerDied","Data":"b0d97be364583b9986e682d0727ecbe7c16f95ab7712961bcbd0a3526afb6ace"}
Sep 11 11:34:38.064470 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:38.064228    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:38.081456 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:38.081426    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:34:38.976725 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:38.976413    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5g8rf"]
Sep 11 11:34:38.976838 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:38.976823    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5g8rf"
Sep 11 11:34:38.976970 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:38.976947    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5g8rf" podUID="c74969dd-4205-4c53-9577-a6b387e33252"
Sep 11 11:34:38.980491 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:38.980468    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mtjkj"]
Sep 11 11:34:38.981123 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:38.981102    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtjkj"
Sep 11 11:34:38.981282 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:38.981214    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtjkj" podUID="81901073-d576-4c23-bb13-e150254f32b7"
Sep 11 11:34:38.983705 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:38.983639    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-flnj5"]
Sep 11 11:34:38.983793 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:38.983740    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flnj5"
Sep 11 11:34:38.983844 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:38.983819    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flnj5" podUID="5ed2dabe-863c-4c3f-9c21-ce551acf7712"
Sep 11 11:34:39.068781 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:39.068743    2560 generic.go:356] "Generic (PLEG): container finished" podID="5c491281-d63d-4e9b-a258-626813c70eab" containerID="c8be115a5adb0c3ef1b45929ae674e4dd04da7899141345b44a6809e049a7dc0" exitCode=0
Sep 11 11:34:39.069239 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:39.068820    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-58qjk" event={"ID":"5c491281-d63d-4e9b-a258-626813c70eab","Type":"ContainerDied","Data":"c8be115a5adb0c3ef1b45929ae674e4dd04da7899141345b44a6809e049a7dc0"}
Sep 11 11:34:40.807953 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:40.807919    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flnj5"
Sep 11 11:34:40.807953 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:40.807946    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtjkj"
Sep 11 11:34:40.808372 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:40.807920    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5g8rf"
Sep 11 11:34:40.808372 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:40.808028    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flnj5" podUID="5ed2dabe-863c-4c3f-9c21-ce551acf7712"
Sep 11 11:34:40.808372 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:40.808089    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5g8rf" podUID="c74969dd-4205-4c53-9577-a6b387e33252"
Sep 11 11:34:40.808372 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:40.808169    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtjkj" podUID="81901073-d576-4c23-bb13-e150254f32b7"
Sep 11 11:34:41.075545 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:41.075457    2560 generic.go:356] "Generic (PLEG): container finished" podID="5c491281-d63d-4e9b-a258-626813c70eab" containerID="6c9462e726b43799f8e6e9847bffbb75fcf17e470ee2417cf287a17f2a339840" exitCode=0
Sep 11 11:34:41.075545 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:41.075512    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-58qjk" event={"ID":"5c491281-d63d-4e9b-a258-626813c70eab","Type":"ContainerDied","Data":"6c9462e726b43799f8e6e9847bffbb75fcf17e470ee2417cf287a17f2a339840"}
Sep 11 11:34:42.808254 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:42.807964    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flnj5"
Sep 11 11:34:42.808711 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:42.808316    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flnj5" podUID="5ed2dabe-863c-4c3f-9c21-ce551acf7712"
Sep 11 11:34:42.808711 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:42.808013    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtjkj"
Sep 11 11:34:42.808711 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:42.808013    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5g8rf"
Sep 11 11:34:42.808711 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:42.808543    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtjkj" podUID="81901073-d576-4c23-bb13-e150254f32b7"
Sep 11 11:34:42.808711 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:42.808616    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5g8rf" podUID="c74969dd-4205-4c53-9577-a6b387e33252"
Sep 11 11:34:43.438792 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:43.438756    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ed2dabe-863c-4c3f-9c21-ce551acf7712-metrics-certs\") pod \"network-metrics-daemon-flnj5\" (UID: \"5ed2dabe-863c-4c3f-9c21-ce551acf7712\") " pod="openshift-multus/network-metrics-daemon-flnj5"
Sep 11 11:34:43.439052 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:43.438802    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81901073-d576-4c23-bb13-e150254f32b7-original-pull-secret\") pod \"global-pull-secret-syncer-mtjkj\" (UID: \"81901073-d576-4c23-bb13-e150254f32b7\") " pod="kube-system/global-pull-secret-syncer-mtjkj"
Sep 11 11:34:43.439052 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:43.438915    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 11:34:43.439052 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:43.438926    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 11:34:43.439052 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:43.438974    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81901073-d576-4c23-bb13-e150254f32b7-original-pull-secret podName:81901073-d576-4c23-bb13-e150254f32b7 nodeName:}" failed. No retries permitted until 2026-09-11 11:35:15.438959073 +0000 UTC m=+66.261418926 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/81901073-d576-4c23-bb13-e150254f32b7-original-pull-secret") pod "global-pull-secret-syncer-mtjkj" (UID: "81901073-d576-4c23-bb13-e150254f32b7") : object "kube-system"/"original-pull-secret" not registered
Sep 11 11:34:43.439052 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:43.438988    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ed2dabe-863c-4c3f-9c21-ce551acf7712-metrics-certs podName:5ed2dabe-863c-4c3f-9c21-ce551acf7712 nodeName:}" failed. No retries permitted until 2026-09-11 11:35:15.438982001 +0000 UTC m=+66.261441851 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5ed2dabe-863c-4c3f-9c21-ce551acf7712-metrics-certs") pod "network-metrics-daemon-flnj5" (UID: "5ed2dabe-863c-4c3f-9c21-ce551acf7712") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 11:34:43.540061 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:43.540024    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qjwh\" (UniqueName: \"kubernetes.io/projected/c74969dd-4205-4c53-9577-a6b387e33252-kube-api-access-2qjwh\") pod \"network-check-target-5g8rf\" (UID: \"c74969dd-4205-4c53-9577-a6b387e33252\") " pod="openshift-network-diagnostics/network-check-target-5g8rf"
Sep 11 11:34:43.540249 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:43.540222    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 11:34:43.540249 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:43.540250    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 11:34:43.540362 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:43.540262    2560 projected.go:196] Error preparing data for projected volume kube-api-access-2qjwh for pod openshift-network-diagnostics/network-check-target-5g8rf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 11:34:43.540362 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:43.540331    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c74969dd-4205-4c53-9577-a6b387e33252-kube-api-access-2qjwh podName:c74969dd-4205-4c53-9577-a6b387e33252 nodeName:}" failed. No retries permitted until 2026-09-11 11:35:15.540312214 +0000 UTC m=+66.362772081 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2qjwh" (UniqueName: "kubernetes.io/projected/c74969dd-4205-4c53-9577-a6b387e33252-kube-api-access-2qjwh") pod "network-check-target-5g8rf" (UID: "c74969dd-4205-4c53-9577-a6b387e33252") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 11:34:43.985332 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:43.985303    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-230.ec2.internal" event="NodeReady"
Sep 11 11:34:43.985750 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:43.985458    2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 11 11:34:44.023228 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.023185    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-84c7bcd7f9-fs264"]
Sep 11 11:34:44.056444 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.056373    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mlqk5"]
Sep 11 11:34:44.056599 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.056526    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84c7bcd7f9-fs264"
Sep 11 11:34:44.059230 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.059207    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mms9n\""
Sep 11 11:34:44.059532 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.059483    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 11 11:34:44.059532 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.059495    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 11 11:34:44.059532 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.059515    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 11 11:34:44.065275 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.065251    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 11 11:34:44.070264 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.070243    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7h8hv"]
Sep 11 11:34:44.070373 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.070357    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mlqk5"
Sep 11 11:34:44.073879 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.073857    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 11 11:34:44.073989 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.073975    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nnmkw\""
Sep 11 11:34:44.074126 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.074109    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 11 11:34:44.088320 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.088299    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-84c7bcd7f9-fs264"]
Sep 11 11:34:44.088437 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.088329    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mlqk5"]
Sep 11 11:34:44.088437 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.088349    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7h8hv"]
Sep 11 11:34:44.088437 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.088371    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qx5fk"]
Sep 11 11:34:44.088437 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.088419    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7h8hv"
Sep 11 11:34:44.091302 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.091282    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 11 11:34:44.091727 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.091710    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 11 11:34:44.091817 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.091738    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9rhw9\""
Sep 11 11:34:44.092069 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.092041    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 11 11:34:44.092168 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.092130    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 11 11:34:44.110662 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.110627    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qx5fk"]
Sep 11 11:34:44.110769 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.110734    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qx5fk"
Sep 11 11:34:44.112850 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.112831    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-glmqf\""
Sep 11 11:34:44.112970 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.112859    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 11 11:34:44.113139 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.113119    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 11 11:34:44.113249 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.113226    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 11 11:34:44.145444 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.145410    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ccea5f58-9718-4139-8a7f-21f15d7c95b4-config-volume\") pod \"dns-default-mlqk5\" (UID: \"ccea5f58-9718-4139-8a7f-21f15d7c95b4\") " pod="openshift-dns/dns-default-mlqk5"
Sep 11 11:34:44.145591 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.145489    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-installation-pull-secrets\") pod \"image-registry-84c7bcd7f9-fs264\" (UID: \"1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2\") " pod="openshift-image-registry/image-registry-84c7bcd7f9-fs264"
Sep 11 11:34:44.145591 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.145511    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-bound-sa-token\") pod \"image-registry-84c7bcd7f9-fs264\" (UID: \"1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2\") " pod="openshift-image-registry/image-registry-84c7bcd7f9-fs264"
Sep 11 11:34:44.145591 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.145527    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ccea5f58-9718-4139-8a7f-21f15d7c95b4-metrics-tls\") pod \"dns-default-mlqk5\" (UID: \"ccea5f58-9718-4139-8a7f-21f15d7c95b4\") " pod="openshift-dns/dns-default-mlqk5"
Sep 11 11:34:44.145591 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.145549    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ccea5f58-9718-4139-8a7f-21f15d7c95b4-tmp-dir\") pod \"dns-default-mlqk5\" (UID: \"ccea5f58-9718-4139-8a7f-21f15d7c95b4\") " pod="openshift-dns/dns-default-mlqk5"
Sep 11 11:34:44.145591 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.145572    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc4pv\" (UniqueName: \"kubernetes.io/projected/ccea5f58-9718-4139-8a7f-21f15d7c95b4-kube-api-access-fc4pv\") pod \"dns-default-mlqk5\" (UID: \"ccea5f58-9718-4139-8a7f-21f15d7c95b4\") " pod="openshift-dns/dns-default-mlqk5"
Sep 11 11:34:44.145849 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.145621    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-trusted-ca\") pod \"image-registry-84c7bcd7f9-fs264\" (UID: \"1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2\") " pod="openshift-image-registry/image-registry-84c7bcd7f9-fs264"
Sep 11 11:34:44.145849 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.145701    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-registry-tls\") pod \"image-registry-84c7bcd7f9-fs264\" (UID: \"1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2\") " pod="openshift-image-registry/image-registry-84c7bcd7f9-fs264"
Sep 11 11:34:44.145849 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.145762    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-ca-trust-extracted\") pod \"image-registry-84c7bcd7f9-fs264\" (UID: \"1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2\") " pod="openshift-image-registry/image-registry-84c7bcd7f9-fs264"
Sep 11 11:34:44.145849 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.145791    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-registry-certificates\") pod \"image-registry-84c7bcd7f9-fs264\" (UID: \"1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2\") " pod="openshift-image-registry/image-registry-84c7bcd7f9-fs264"
Sep 11 11:34:44.146001 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.145851    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-image-registry-private-configuration\") pod \"image-registry-84c7bcd7f9-fs264\" (UID: \"1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2\") " pod="openshift-image-registry/image-registry-84c7bcd7f9-fs264"
Sep 11 11:34:44.146001 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.145884    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jd5zm\" (UniqueName: \"kubernetes.io/projected/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-kube-api-access-jd5zm\") pod \"image-registry-84c7bcd7f9-fs264\" (UID: \"1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2\") " pod="openshift-image-registry/image-registry-84c7bcd7f9-fs264"
Sep 11 11:34:44.247219 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.247184    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ccea5f58-9718-4139-8a7f-21f15d7c95b4-tmp-dir\") pod \"dns-default-mlqk5\" (UID: \"ccea5f58-9718-4139-8a7f-21f15d7c95b4\") " pod="openshift-dns/dns-default-mlqk5"
Sep 11 11:34:44.247219 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.247224    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc4pv\" (UniqueName: \"kubernetes.io/projected/ccea5f58-9718-4139-8a7f-21f15d7c95b4-kube-api-access-fc4pv\") pod \"dns-default-mlqk5\" (UID: \"ccea5f58-9718-4139-8a7f-21f15d7c95b4\") " pod="openshift-dns/dns-default-mlqk5"
Sep 11 11:34:44.247455 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.247247    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-trusted-ca\") pod \"image-registry-84c7bcd7f9-fs264\" (UID: \"1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2\") " pod="openshift-image-registry/image-registry-84c7bcd7f9-fs264"
Sep 11 11:34:44.247455 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.247270    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-registry-tls\") pod \"image-registry-84c7bcd7f9-fs264\" (UID: \"1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2\") " pod="openshift-image-registry/image-registry-84c7bcd7f9-fs264"
Sep 11 11:34:44.247455 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.247315    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-ca-trust-extracted\") pod \"image-registry-84c7bcd7f9-fs264\" (UID: \"1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2\") " pod="openshift-image-registry/image-registry-84c7bcd7f9-fs264"
Sep 11 11:34:44.247455 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.247341    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-registry-certificates\") pod \"image-registry-84c7bcd7f9-fs264\" (UID: \"1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2\") " pod="openshift-image-registry/image-registry-84c7bcd7f9-fs264"
Sep 11 11:34:44.247455 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.247369    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-image-registry-private-configuration\") pod \"image-registry-84c7bcd7f9-fs264\" (UID: \"1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2\") " pod="openshift-image-registry/image-registry-84c7bcd7f9-fs264"
Sep 11 11:34:44.247455 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.247395    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jd5zm\" (UniqueName: \"kubernetes.io/projected/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-kube-api-access-jd5zm\") pod \"image-registry-84c7bcd7f9-fs264\" (UID: \"1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2\") " pod="openshift-image-registry/image-registry-84c7bcd7f9-fs264"
Sep 11 11:34:44.247455 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.247421    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d5ddcf1-e41b-4400-bb50-8747546410f5-cert\") pod \"ingress-canary-qx5fk\" (UID: \"1d5ddcf1-e41b-4400-bb50-8747546410f5\") " pod="openshift-ingress-canary/ingress-canary-qx5fk"
Sep 11 11:34:44.247455 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:44.247443    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 11:34:44.247921 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:44.247466    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84c7bcd7f9-fs264: secret "image-registry-tls" not found
Sep 11 11:34:44.247921 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:44.247541    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-registry-tls podName:1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2 nodeName:}" failed. No retries permitted until 2026-09-11 11:34:44.747519855 +0000 UTC m=+35.569979727 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-registry-tls") pod "image-registry-84c7bcd7f9-fs264" (UID: "1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2") : secret "image-registry-tls" not found
Sep 11 11:34:44.247921 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.247603    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ccea5f58-9718-4139-8a7f-21f15d7c95b4-tmp-dir\") pod \"dns-default-mlqk5\" (UID: \"ccea5f58-9718-4139-8a7f-21f15d7c95b4\") " pod="openshift-dns/dns-default-mlqk5"
Sep 11 11:34:44.247921 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.247449    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqqjc\" (UniqueName: \"kubernetes.io/projected/1d5ddcf1-e41b-4400-bb50-8747546410f5-kube-api-access-vqqjc\") pod \"ingress-canary-qx5fk\" (UID: \"1d5ddcf1-e41b-4400-bb50-8747546410f5\") " pod="openshift-ingress-canary/ingress-canary-qx5fk"
Sep 11 11:34:44.247921 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.247759    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-ca-trust-extracted\") pod \"image-registry-84c7bcd7f9-fs264\" (UID: \"1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2\") " pod="openshift-image-registry/image-registry-84c7bcd7f9-fs264"
Sep 11 11:34:44.247921 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.247789    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ccea5f58-9718-4139-8a7f-21f15d7c95b4-config-volume\") pod \"dns-default-mlqk5\" (UID: \"ccea5f58-9718-4139-8a7f-21f15d7c95b4\") " pod="openshift-dns/dns-default-mlqk5"
Sep 11 11:34:44.247921 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.247819    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a144c788-3457-4841-8e4e-877e722a32f1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7h8hv\" (UID: \"a144c788-3457-4841-8e4e-877e722a32f1\") " pod="openshift-insights/insights-runtime-extractor-7h8hv"
Sep 11 11:34:44.247921 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.247848    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a144c788-3457-4841-8e4e-877e722a32f1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7h8hv\" (UID: \"a144c788-3457-4841-8e4e-877e722a32f1\") " pod="openshift-insights/insights-runtime-extractor-7h8hv"
Sep 11 11:34:44.247921 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.247895    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a144c788-3457-4841-8e4e-877e722a32f1-crio-socket\") pod \"insights-runtime-extractor-7h8hv\" (UID: \"a144c788-3457-4841-8e4e-877e722a32f1\") " pod="openshift-insights/insights-runtime-extractor-7h8hv"
Sep 11 11:34:44.247921 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.247920    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a144c788-3457-4841-8e4e-877e722a32f1-data-volume\") pod \"insights-runtime-extractor-7h8hv\" (UID: \"a144c788-3457-4841-8e4e-877e722a32f1\") " pod="openshift-insights/insights-runtime-extractor-7h8hv"
Sep 11 11:34:44.248448 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.247964    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-installation-pull-secrets\") pod \"image-registry-84c7bcd7f9-fs264\" (UID: \"1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2\") " pod="openshift-image-registry/image-registry-84c7bcd7f9-fs264"
Sep 11 11:34:44.248448 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.247995    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-bound-sa-token\") pod \"image-registry-84c7bcd7f9-fs264\" (UID: \"1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2\") " pod="openshift-image-registry/image-registry-84c7bcd7f9-fs264"
Sep 11 11:34:44.248448 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.248025    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ccea5f58-9718-4139-8a7f-21f15d7c95b4-metrics-tls\") pod \"dns-default-mlqk5\" (UID: \"ccea5f58-9718-4139-8a7f-21f15d7c95b4\") " pod="openshift-dns/dns-default-mlqk5"
Sep 11 11:34:44.248448 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.248049    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5jsq\" (UniqueName: \"kubernetes.io/projected/a144c788-3457-4841-8e4e-877e722a32f1-kube-api-access-d5jsq\") pod \"insights-runtime-extractor-7h8hv\" (UID: \"a144c788-3457-4841-8e4e-877e722a32f1\") " pod="openshift-insights/insights-runtime-extractor-7h8hv"
Sep 11 11:34:44.248448 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.248111    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-registry-certificates\") pod \"image-registry-84c7bcd7f9-fs264\" (UID: \"1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2\") " pod="openshift-image-registry/image-registry-84c7bcd7f9-fs264"
Sep 11 11:34:44.248448 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:44.248204    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 11:34:44.248448 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:44.248262    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccea5f58-9718-4139-8a7f-21f15d7c95b4-metrics-tls podName:ccea5f58-9718-4139-8a7f-21f15d7c95b4 nodeName:}" failed. No retries permitted until 2026-09-11 11:34:44.748246104 +0000 UTC m=+35.570705957 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ccea5f58-9718-4139-8a7f-21f15d7c95b4-metrics-tls") pod "dns-default-mlqk5" (UID: "ccea5f58-9718-4139-8a7f-21f15d7c95b4") : secret "dns-default-metrics-tls" not found
Sep 11 11:34:44.248448 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.248273    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ccea5f58-9718-4139-8a7f-21f15d7c95b4-config-volume\") pod \"dns-default-mlqk5\" (UID: \"ccea5f58-9718-4139-8a7f-21f15d7c95b4\") " pod="openshift-dns/dns-default-mlqk5"
Sep 11 11:34:44.248448 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.248281    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-trusted-ca\") pod \"image-registry-84c7bcd7f9-fs264\" (UID: \"1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2\") " pod="openshift-image-registry/image-registry-84c7bcd7f9-fs264"
Sep 11 11:34:44.252048 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.252024    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-image-registry-private-configuration\") pod \"image-registry-84c7bcd7f9-fs264\" (UID: \"1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2\") " pod="openshift-image-registry/image-registry-84c7bcd7f9-fs264"
Sep 11 11:34:44.252160 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.252032    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-installation-pull-secrets\") pod \"image-registry-84c7bcd7f9-fs264\" (UID: \"1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2\") " pod="openshift-image-registry/image-registry-84c7bcd7f9-fs264"
Sep 11 11:34:44.261783 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.261761    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-bound-sa-token\") pod \"image-registry-84c7bcd7f9-fs264\" (UID: \"1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2\") " pod="openshift-image-registry/image-registry-84c7bcd7f9-fs264"
Sep 11 11:34:44.262849 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.262827    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc4pv\" (UniqueName: \"kubernetes.io/projected/ccea5f58-9718-4139-8a7f-21f15d7c95b4-kube-api-access-fc4pv\") pod \"dns-default-mlqk5\" (UID: \"ccea5f58-9718-4139-8a7f-21f15d7c95b4\") " pod="openshift-dns/dns-default-mlqk5"
Sep 11 11:34:44.264396 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.264371    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd5zm\" (UniqueName: \"kubernetes.io/projected/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-kube-api-access-jd5zm\") pod \"image-registry-84c7bcd7f9-fs264\" (UID: \"1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2\") " pod="openshift-image-registry/image-registry-84c7bcd7f9-fs264"
Sep 11 11:34:44.348606 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.348526    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a144c788-3457-4841-8e4e-877e722a32f1-crio-socket\") pod \"insights-runtime-extractor-7h8hv\" (UID: \"a144c788-3457-4841-8e4e-877e722a32f1\") " pod="openshift-insights/insights-runtime-extractor-7h8hv"
Sep 11 11:34:44.348606 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.348561    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a144c788-3457-4841-8e4e-877e722a32f1-data-volume\") pod \"insights-runtime-extractor-7h8hv\" (UID: \"a144c788-3457-4841-8e4e-877e722a32f1\") " pod="openshift-insights/insights-runtime-extractor-7h8hv"
Sep 11 11:34:44.348811 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.348621    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5jsq\" (UniqueName: \"kubernetes.io/projected/a144c788-3457-4841-8e4e-877e722a32f1-kube-api-access-d5jsq\") pod \"insights-runtime-extractor-7h8hv\" (UID: \"a144c788-3457-4841-8e4e-877e722a32f1\") " pod="openshift-insights/insights-runtime-extractor-7h8hv"
Sep 11 11:34:44.348811 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.348713    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d5ddcf1-e41b-4400-bb50-8747546410f5-cert\") pod \"ingress-canary-qx5fk\" (UID: \"1d5ddcf1-e41b-4400-bb50-8747546410f5\") " pod="openshift-ingress-canary/ingress-canary-qx5fk"
Sep 11 11:34:44.348811 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.348742    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqqjc\" (UniqueName: \"kubernetes.io/projected/1d5ddcf1-e41b-4400-bb50-8747546410f5-kube-api-access-vqqjc\") pod \"ingress-canary-qx5fk\" (UID: \"1d5ddcf1-e41b-4400-bb50-8747546410f5\") " pod="openshift-ingress-canary/ingress-canary-qx5fk"
Sep 11 11:34:44.348811 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.348778    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a144c788-3457-4841-8e4e-877e722a32f1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7h8hv\" (UID: \"a144c788-3457-4841-8e4e-877e722a32f1\") " pod="openshift-insights/insights-runtime-extractor-7h8hv"
Sep 11 11:34:44.348811 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.348801    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a144c788-3457-4841-8e4e-877e722a32f1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7h8hv\" (UID: \"a144c788-3457-4841-8e4e-877e722a32f1\") " pod="openshift-insights/insights-runtime-extractor-7h8hv"
Sep 11 11:34:44.349051 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:44.348918    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 11:34:44.349051 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.348967    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a144c788-3457-4841-8e4e-877e722a32f1-data-volume\") pod \"insights-runtime-extractor-7h8hv\" (UID: \"a144c788-3457-4841-8e4e-877e722a32f1\") " pod="openshift-insights/insights-runtime-extractor-7h8hv"
Sep 11 11:34:44.349051 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:44.348990    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a144c788-3457-4841-8e4e-877e722a32f1-insights-runtime-extractor-tls podName:a144c788-3457-4841-8e4e-877e722a32f1 nodeName:}" failed. No retries permitted until 2026-09-11 11:34:44.848971568 +0000 UTC m=+35.671431435 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a144c788-3457-4841-8e4e-877e722a32f1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7h8hv" (UID: "a144c788-3457-4841-8e4e-877e722a32f1") : secret "insights-runtime-extractor-tls" not found
Sep 11 11:34:44.349051 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:44.349036    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 11:34:44.349246 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:44.349092    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a144c788-3457-4841-8e4e-877e722a32f1-kube-rbac-proxy-cm podName:a144c788-3457-4841-8e4e-877e722a32f1 nodeName:}" failed. No retries permitted until 2026-09-11 11:34:44.84908011 +0000 UTC m=+35.671539966 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a144c788-3457-4841-8e4e-877e722a32f1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7h8hv" (UID: "a144c788-3457-4841-8e4e-877e722a32f1") : configmap "kube-rbac-proxy" not found
Sep 11 11:34:44.349246 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.349152    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a144c788-3457-4841-8e4e-877e722a32f1-crio-socket\") pod \"insights-runtime-extractor-7h8hv\" (UID: \"a144c788-3457-4841-8e4e-877e722a32f1\") " pod="openshift-insights/insights-runtime-extractor-7h8hv"
Sep 11 11:34:44.351279 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.351260    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d5ddcf1-e41b-4400-bb50-8747546410f5-cert\") pod \"ingress-canary-qx5fk\" (UID: \"1d5ddcf1-e41b-4400-bb50-8747546410f5\") " pod="openshift-ingress-canary/ingress-canary-qx5fk"
Sep 11 11:34:44.357509 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.357475    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5jsq\" (UniqueName: \"kubernetes.io/projected/a144c788-3457-4841-8e4e-877e722a32f1-kube-api-access-d5jsq\") pod \"insights-runtime-extractor-7h8hv\" (UID: \"a144c788-3457-4841-8e4e-877e722a32f1\") " pod="openshift-insights/insights-runtime-extractor-7h8hv"
Sep 11 11:34:44.357778 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.357757    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqqjc\" (UniqueName: \"kubernetes.io/projected/1d5ddcf1-e41b-4400-bb50-8747546410f5-kube-api-access-vqqjc\") pod \"ingress-canary-qx5fk\" (UID: \"1d5ddcf1-e41b-4400-bb50-8747546410f5\") " pod="openshift-ingress-canary/ingress-canary-qx5fk"
Sep 11 11:34:44.419745 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.419707    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qx5fk"
Sep 11 11:34:44.693235 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.693157    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-x65tx"]
Sep 11 11:34:44.711183 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.711153    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-x65tx"]
Sep 11 11:34:44.711336 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.711283    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-x65tx"
Sep 11 11:34:44.714318 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.714109    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 11 11:34:44.714318 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.714119    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-9vccc\""
Sep 11 11:34:44.714318 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.714167    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 11 11:34:44.714318 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.714110    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 11 11:34:44.714318 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.714110    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 11 11:34:44.751868 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.751836    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ccea5f58-9718-4139-8a7f-21f15d7c95b4-metrics-tls\") pod \"dns-default-mlqk5\" (UID: \"ccea5f58-9718-4139-8a7f-21f15d7c95b4\") " pod="openshift-dns/dns-default-mlqk5"
Sep 11 11:34:44.752028 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.751884    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-registry-tls\") pod \"image-registry-84c7bcd7f9-fs264\" (UID: \"1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2\") " pod="openshift-image-registry/image-registry-84c7bcd7f9-fs264"
Sep 11 11:34:44.752028 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:44.751983    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 11:34:44.752151 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:44.752031    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 11:34:44.752151 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:44.752044    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84c7bcd7f9-fs264: secret "image-registry-tls" not found
Sep 11 11:34:44.752151 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:44.752048    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccea5f58-9718-4139-8a7f-21f15d7c95b4-metrics-tls podName:ccea5f58-9718-4139-8a7f-21f15d7c95b4 nodeName:}" failed. No retries permitted until 2026-09-11 11:34:45.752030403 +0000 UTC m=+36.574490257 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ccea5f58-9718-4139-8a7f-21f15d7c95b4-metrics-tls") pod "dns-default-mlqk5" (UID: "ccea5f58-9718-4139-8a7f-21f15d7c95b4") : secret "dns-default-metrics-tls" not found
Sep 11 11:34:44.752151 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:44.752092    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-registry-tls podName:1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2 nodeName:}" failed. No retries permitted until 2026-09-11 11:34:45.752075138 +0000 UTC m=+36.574535002 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-registry-tls") pod "image-registry-84c7bcd7f9-fs264" (UID: "1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2") : secret "image-registry-tls" not found
Sep 11 11:34:44.807710 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.807678    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtjkj"
Sep 11 11:34:44.807870 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.807678    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5g8rf"
Sep 11 11:34:44.808097 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.807685    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flnj5"
Sep 11 11:34:44.810243 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.810212    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 11:34:44.810371 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.810349    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tk98p\""
Sep 11 11:34:44.810450 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.810375    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 11:34:44.810450 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.810433    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 11:34:44.810639 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.810624    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 11:34:44.810722 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.810639    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-b45p4\""
Sep 11 11:34:44.853104 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.853068    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a144c788-3457-4841-8e4e-877e722a32f1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7h8hv\" (UID: \"a144c788-3457-4841-8e4e-877e722a32f1\") " pod="openshift-insights/insights-runtime-extractor-7h8hv"
Sep 11 11:34:44.853251 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.853135    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpngz\" (UniqueName: \"kubernetes.io/projected/4453ac26-d38a-4be9-9f75-dbc4de99f927-kube-api-access-cpngz\") pod \"service-ca-568869fdc5-x65tx\" (UID: \"4453ac26-d38a-4be9-9f75-dbc4de99f927\") " pod="openshift-service-ca/service-ca-568869fdc5-x65tx"
Sep 11 11:34:44.853251 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.853177    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4453ac26-d38a-4be9-9f75-dbc4de99f927-signing-cabundle\") pod \"service-ca-568869fdc5-x65tx\" (UID: \"4453ac26-d38a-4be9-9f75-dbc4de99f927\") " pod="openshift-service-ca/service-ca-568869fdc5-x65tx"
Sep 11 11:34:44.853251 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:44.853225    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 11:34:44.853394 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.853277    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4453ac26-d38a-4be9-9f75-dbc4de99f927-signing-key\") pod \"service-ca-568869fdc5-x65tx\" (UID: \"4453ac26-d38a-4be9-9f75-dbc4de99f927\") " pod="openshift-service-ca/service-ca-568869fdc5-x65tx"
Sep 11 11:34:44.853394 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:44.853286    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a144c788-3457-4841-8e4e-877e722a32f1-insights-runtime-extractor-tls podName:a144c788-3457-4841-8e4e-877e722a32f1 nodeName:}" failed. No retries permitted until 2026-09-11 11:34:45.853269604 +0000 UTC m=+36.675729455 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a144c788-3457-4841-8e4e-877e722a32f1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7h8hv" (UID: "a144c788-3457-4841-8e4e-877e722a32f1") : secret "insights-runtime-extractor-tls" not found
Sep 11 11:34:44.853394 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.853384    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a144c788-3457-4841-8e4e-877e722a32f1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7h8hv\" (UID: \"a144c788-3457-4841-8e4e-877e722a32f1\") " pod="openshift-insights/insights-runtime-extractor-7h8hv"
Sep 11 11:34:44.853490 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:44.853464    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 11:34:44.853522 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:44.853505    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a144c788-3457-4841-8e4e-877e722a32f1-kube-rbac-proxy-cm podName:a144c788-3457-4841-8e4e-877e722a32f1 nodeName:}" failed. No retries permitted until 2026-09-11 11:34:45.853492044 +0000 UTC m=+36.675951916 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a144c788-3457-4841-8e4e-877e722a32f1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7h8hv" (UID: "a144c788-3457-4841-8e4e-877e722a32f1") : configmap "kube-rbac-proxy" not found
Sep 11 11:34:44.954589 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.954501    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpngz\" (UniqueName: \"kubernetes.io/projected/4453ac26-d38a-4be9-9f75-dbc4de99f927-kube-api-access-cpngz\") pod \"service-ca-568869fdc5-x65tx\" (UID: \"4453ac26-d38a-4be9-9f75-dbc4de99f927\") " pod="openshift-service-ca/service-ca-568869fdc5-x65tx"
Sep 11 11:34:44.954589 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.954561    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4453ac26-d38a-4be9-9f75-dbc4de99f927-signing-cabundle\") pod \"service-ca-568869fdc5-x65tx\" (UID: \"4453ac26-d38a-4be9-9f75-dbc4de99f927\") " pod="openshift-service-ca/service-ca-568869fdc5-x65tx"
Sep 11 11:34:44.954823 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.954623    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4453ac26-d38a-4be9-9f75-dbc4de99f927-signing-key\") pod \"service-ca-568869fdc5-x65tx\" (UID: \"4453ac26-d38a-4be9-9f75-dbc4de99f927\") " pod="openshift-service-ca/service-ca-568869fdc5-x65tx"
Sep 11 11:34:44.955346 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.955322    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4453ac26-d38a-4be9-9f75-dbc4de99f927-signing-cabundle\") pod \"service-ca-568869fdc5-x65tx\" (UID: \"4453ac26-d38a-4be9-9f75-dbc4de99f927\") " pod="openshift-service-ca/service-ca-568869fdc5-x65tx"
Sep 11 11:34:44.957287 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.957269    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4453ac26-d38a-4be9-9f75-dbc4de99f927-signing-key\") pod \"service-ca-568869fdc5-x65tx\" (UID: \"4453ac26-d38a-4be9-9f75-dbc4de99f927\") " pod="openshift-service-ca/service-ca-568869fdc5-x65tx"
Sep 11 11:34:44.965765 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:44.965743    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpngz\" (UniqueName: \"kubernetes.io/projected/4453ac26-d38a-4be9-9f75-dbc4de99f927-kube-api-access-cpngz\") pod \"service-ca-568869fdc5-x65tx\" (UID: \"4453ac26-d38a-4be9-9f75-dbc4de99f927\") " pod="openshift-service-ca/service-ca-568869fdc5-x65tx"
Sep 11 11:34:45.022275 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:45.022235    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-x65tx"
Sep 11 11:34:45.353182 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:45.353154    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xc7zl_129a8b0d-dd99-476a-bc21-8fcf5b3335d0/dns-node-resolver/0.log"
Sep 11 11:34:45.742438 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:45.742154    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qx5fk"]
Sep 11 11:34:45.743109 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:45.743088    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-x65tx"]
Sep 11 11:34:45.745890 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:45.745868    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d5ddcf1_e41b_4400_bb50_8747546410f5.slice/crio-8102d8243d230bc706751a7fafeebc996b260188ebdd97d66832fb4bb2a2d1c7 WatchSource:0}: Error finding container 8102d8243d230bc706751a7fafeebc996b260188ebdd97d66832fb4bb2a2d1c7: Status 404 returned error can't find the container with id 8102d8243d230bc706751a7fafeebc996b260188ebdd97d66832fb4bb2a2d1c7
Sep 11 11:34:45.746432 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:34:45.746415    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4453ac26_d38a_4be9_9f75_dbc4de99f927.slice/crio-c1b23878b3c5bc91f75d41a9e561f3e991b69849cac4c01fb32f523ba04e3969 WatchSource:0}: Error finding container c1b23878b3c5bc91f75d41a9e561f3e991b69849cac4c01fb32f523ba04e3969: Status 404 returned error can't find the container with id c1b23878b3c5bc91f75d41a9e561f3e991b69849cac4c01fb32f523ba04e3969
Sep 11 11:34:45.761439 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:45.761418    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ccea5f58-9718-4139-8a7f-21f15d7c95b4-metrics-tls\") pod \"dns-default-mlqk5\" (UID: \"ccea5f58-9718-4139-8a7f-21f15d7c95b4\") " pod="openshift-dns/dns-default-mlqk5"
Sep 11 11:34:45.761525 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:45.761453    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-registry-tls\") pod \"image-registry-84c7bcd7f9-fs264\" (UID: \"1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2\") " pod="openshift-image-registry/image-registry-84c7bcd7f9-fs264"
Sep 11 11:34:45.761573 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:45.761546    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 11:34:45.761609 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:45.761594    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccea5f58-9718-4139-8a7f-21f15d7c95b4-metrics-tls podName:ccea5f58-9718-4139-8a7f-21f15d7c95b4 nodeName:}" failed. No retries permitted until 2026-09-11 11:34:47.761580758 +0000 UTC m=+38.584040614 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ccea5f58-9718-4139-8a7f-21f15d7c95b4-metrics-tls") pod "dns-default-mlqk5" (UID: "ccea5f58-9718-4139-8a7f-21f15d7c95b4") : secret "dns-default-metrics-tls" not found
Sep 11 11:34:45.761665 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:45.761550    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 11:34:45.761665 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:45.761636    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84c7bcd7f9-fs264: secret "image-registry-tls" not found
Sep 11 11:34:45.761735 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:45.761691    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-registry-tls podName:1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2 nodeName:}" failed. No retries permitted until 2026-09-11 11:34:47.761679815 +0000 UTC m=+38.584139667 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-registry-tls") pod "image-registry-84c7bcd7f9-fs264" (UID: "1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2") : secret "image-registry-tls" not found
Sep 11 11:34:45.862624 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:45.862592    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a144c788-3457-4841-8e4e-877e722a32f1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7h8hv\" (UID: \"a144c788-3457-4841-8e4e-877e722a32f1\") " pod="openshift-insights/insights-runtime-extractor-7h8hv"
Sep 11 11:34:45.862760 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:45.862640    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a144c788-3457-4841-8e4e-877e722a32f1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7h8hv\" (UID: \"a144c788-3457-4841-8e4e-877e722a32f1\") " pod="openshift-insights/insights-runtime-extractor-7h8hv"
Sep 11 11:34:45.862760 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:45.862743    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 11:34:45.862836 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:45.862807    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a144c788-3457-4841-8e4e-877e722a32f1-kube-rbac-proxy-cm podName:a144c788-3457-4841-8e4e-877e722a32f1 nodeName:}" failed. No retries permitted until 2026-09-11 11:34:47.862789567 +0000 UTC m=+38.685249418 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a144c788-3457-4841-8e4e-877e722a32f1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7h8hv" (UID: "a144c788-3457-4841-8e4e-877e722a32f1") : configmap "kube-rbac-proxy" not found
Sep 11 11:34:45.862836 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:45.862807    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 11:34:45.862915 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:45.862862    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a144c788-3457-4841-8e4e-877e722a32f1-insights-runtime-extractor-tls podName:a144c788-3457-4841-8e4e-877e722a32f1 nodeName:}" failed. No retries permitted until 2026-09-11 11:34:47.862846205 +0000 UTC m=+38.685306075 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a144c788-3457-4841-8e4e-877e722a32f1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7h8hv" (UID: "a144c788-3457-4841-8e4e-877e722a32f1") : secret "insights-runtime-extractor-tls" not found
Sep 11 11:34:45.925086 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:45.925062    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fjlr9_da5daa69-1f21-42d2-b6d5-388f49a097d2/node-ca/0.log"
Sep 11 11:34:46.089985 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:46.089947    2560 generic.go:356] "Generic (PLEG): container finished" podID="5c491281-d63d-4e9b-a258-626813c70eab" containerID="e4af8f3ac7dde30d84443c08c7302f163e165c45dba8758c3cb42051399f8869" exitCode=0
Sep 11 11:34:46.090587 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:46.090020    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-58qjk" event={"ID":"5c491281-d63d-4e9b-a258-626813c70eab","Type":"ContainerDied","Data":"e4af8f3ac7dde30d84443c08c7302f163e165c45dba8758c3cb42051399f8869"}
Sep 11 11:34:46.091311 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:46.091283    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qx5fk" event={"ID":"1d5ddcf1-e41b-4400-bb50-8747546410f5","Type":"ContainerStarted","Data":"8102d8243d230bc706751a7fafeebc996b260188ebdd97d66832fb4bb2a2d1c7"}
Sep 11 11:34:46.094748 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:46.094714    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-x65tx" event={"ID":"4453ac26-d38a-4be9-9f75-dbc4de99f927","Type":"ContainerStarted","Data":"c1b23878b3c5bc91f75d41a9e561f3e991b69849cac4c01fb32f523ba04e3969"}
Sep 11 11:34:47.100992 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:47.100953    2560 generic.go:356] "Generic (PLEG): container finished" podID="5c491281-d63d-4e9b-a258-626813c70eab" containerID="330ed8be706cfad7244beff0913488fa719cee557f2854082398578216cd92f4" exitCode=0
Sep 11 11:34:47.101421 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:47.101008    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-58qjk" event={"ID":"5c491281-d63d-4e9b-a258-626813c70eab","Type":"ContainerDied","Data":"330ed8be706cfad7244beff0913488fa719cee557f2854082398578216cd92f4"}
Sep 11 11:34:47.778634 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:47.778593    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ccea5f58-9718-4139-8a7f-21f15d7c95b4-metrics-tls\") pod \"dns-default-mlqk5\" (UID: \"ccea5f58-9718-4139-8a7f-21f15d7c95b4\") " pod="openshift-dns/dns-default-mlqk5"
Sep 11 11:34:47.778824 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:47.778662    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-registry-tls\") pod \"image-registry-84c7bcd7f9-fs264\" (UID: \"1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2\") " pod="openshift-image-registry/image-registry-84c7bcd7f9-fs264"
Sep 11 11:34:47.778824 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:47.778761    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 11:34:47.778926 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:47.778841    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccea5f58-9718-4139-8a7f-21f15d7c95b4-metrics-tls podName:ccea5f58-9718-4139-8a7f-21f15d7c95b4 nodeName:}" failed. No retries permitted until 2026-09-11 11:34:51.778820906 +0000 UTC m=+42.601280781 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ccea5f58-9718-4139-8a7f-21f15d7c95b4-metrics-tls") pod "dns-default-mlqk5" (UID: "ccea5f58-9718-4139-8a7f-21f15d7c95b4") : secret "dns-default-metrics-tls" not found
Sep 11 11:34:47.778926 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:47.778767    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 11:34:47.778926 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:47.778867    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84c7bcd7f9-fs264: secret "image-registry-tls" not found
Sep 11 11:34:47.778926 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:47.778926    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-registry-tls podName:1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2 nodeName:}" failed. No retries permitted until 2026-09-11 11:34:51.778908542 +0000 UTC m=+42.601368404 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-registry-tls") pod "image-registry-84c7bcd7f9-fs264" (UID: "1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2") : secret "image-registry-tls" not found
Sep 11 11:34:47.879452 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:47.879405    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a144c788-3457-4841-8e4e-877e722a32f1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7h8hv\" (UID: \"a144c788-3457-4841-8e4e-877e722a32f1\") " pod="openshift-insights/insights-runtime-extractor-7h8hv"
Sep 11 11:34:47.879603 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:47.879465    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a144c788-3457-4841-8e4e-877e722a32f1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7h8hv\" (UID: \"a144c788-3457-4841-8e4e-877e722a32f1\") " pod="openshift-insights/insights-runtime-extractor-7h8hv"
Sep 11 11:34:47.879603 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:47.879526    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 11:34:47.879603 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:47.879600    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a144c788-3457-4841-8e4e-877e722a32f1-kube-rbac-proxy-cm podName:a144c788-3457-4841-8e4e-877e722a32f1 nodeName:}" failed. No retries permitted until 2026-09-11 11:34:51.879580987 +0000 UTC m=+42.702040857 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a144c788-3457-4841-8e4e-877e722a32f1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7h8hv" (UID: "a144c788-3457-4841-8e4e-877e722a32f1") : configmap "kube-rbac-proxy" not found
Sep 11 11:34:47.879791 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:47.879617    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 11:34:47.879791 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:47.879686    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a144c788-3457-4841-8e4e-877e722a32f1-insights-runtime-extractor-tls podName:a144c788-3457-4841-8e4e-877e722a32f1 nodeName:}" failed. No retries permitted until 2026-09-11 11:34:51.879671885 +0000 UTC m=+42.702131752 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a144c788-3457-4841-8e4e-877e722a32f1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7h8hv" (UID: "a144c788-3457-4841-8e4e-877e722a32f1") : secret "insights-runtime-extractor-tls" not found
Sep 11 11:34:48.107627 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:48.107548    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-58qjk" event={"ID":"5c491281-d63d-4e9b-a258-626813c70eab","Type":"ContainerStarted","Data":"5fc8fb86a8d24889290d0012715dfeb30575a42b1c609a5ee6ef8b716a6bd2ca"}
Sep 11 11:34:48.135065 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:48.135008    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-58qjk" podStartSLOduration=8.620136603 podStartE2EDuration="38.134991857s" totalImagesPullingTime="29.514855254s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 11:34:10 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:34:48.133938597 +0000 UTC m=+38.956398489" watchObservedRunningTime="2026-09-11 11:34:48.134991857 +0000 UTC m=+38.957451731"
Sep 11 11:34:49.112503 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:49.112196    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qx5fk" event={"ID":"1d5ddcf1-e41b-4400-bb50-8747546410f5","Type":"ContainerStarted","Data":"0253e939b4aaa788257b7ff9b688c3cd23f0fef9777848be8b716be99910c4fe"}
Sep 11 11:34:49.113959 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:49.113925    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-x65tx" event={"ID":"4453ac26-d38a-4be9-9f75-dbc4de99f927","Type":"ContainerStarted","Data":"e4312ef49af9036cf9b18598fc58136dc48f9a13a7715cd92f74da2259a877e9"}
Sep 11 11:34:49.131486 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:49.131431    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qx5fk" podStartSLOduration=2.016588846 podStartE2EDuration="5.131413558s" totalImagesPullingTime="3.114824712s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:34:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:34:49.131207869 +0000 UTC m=+39.953667768" watchObservedRunningTime="2026-09-11 11:34:49.131413558 +0000 UTC m=+39.953873428"
Sep 11 11:34:49.148810 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:49.148747    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-568869fdc5-x65tx" podStartSLOduration=2.040651405 podStartE2EDuration="5.148725949s" totalImagesPullingTime="3.108074544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:34:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:34:49.14752116 +0000 UTC m=+39.969981070" watchObservedRunningTime="2026-09-11 11:34:49.148725949 +0000 UTC m=+39.971185824"
Sep 11 11:34:51.815073 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:51.815044    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ccea5f58-9718-4139-8a7f-21f15d7c95b4-metrics-tls\") pod \"dns-default-mlqk5\" (UID: \"ccea5f58-9718-4139-8a7f-21f15d7c95b4\") " pod="openshift-dns/dns-default-mlqk5"
Sep 11 11:34:51.815479 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:51.815080    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-registry-tls\") pod \"image-registry-84c7bcd7f9-fs264\" (UID: \"1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2\") " pod="openshift-image-registry/image-registry-84c7bcd7f9-fs264"
Sep 11 11:34:51.815479 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:51.815180    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 11:34:51.815479 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:51.815238    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccea5f58-9718-4139-8a7f-21f15d7c95b4-metrics-tls podName:ccea5f58-9718-4139-8a7f-21f15d7c95b4 nodeName:}" failed. No retries permitted until 2026-09-11 11:34:59.815221494 +0000 UTC m=+50.637681350 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ccea5f58-9718-4139-8a7f-21f15d7c95b4-metrics-tls") pod "dns-default-mlqk5" (UID: "ccea5f58-9718-4139-8a7f-21f15d7c95b4") : secret "dns-default-metrics-tls" not found
Sep 11 11:34:51.815479 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:51.815185    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 11:34:51.815479 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:51.815279    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84c7bcd7f9-fs264: secret "image-registry-tls" not found
Sep 11 11:34:51.815479 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:51.815322    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-registry-tls podName:1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2 nodeName:}" failed. No retries permitted until 2026-09-11 11:34:59.815311454 +0000 UTC m=+50.637771305 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-registry-tls") pod "image-registry-84c7bcd7f9-fs264" (UID: "1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2") : secret "image-registry-tls" not found
Sep 11 11:34:51.915803 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:51.915771    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a144c788-3457-4841-8e4e-877e722a32f1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7h8hv\" (UID: \"a144c788-3457-4841-8e4e-877e722a32f1\") " pod="openshift-insights/insights-runtime-extractor-7h8hv"
Sep 11 11:34:51.915803 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:51.915805    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a144c788-3457-4841-8e4e-877e722a32f1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7h8hv\" (UID: \"a144c788-3457-4841-8e4e-877e722a32f1\") " pod="openshift-insights/insights-runtime-extractor-7h8hv"
Sep 11 11:34:51.916010 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:51.915910    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 11:34:51.916010 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:34:51.915959    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a144c788-3457-4841-8e4e-877e722a32f1-insights-runtime-extractor-tls podName:a144c788-3457-4841-8e4e-877e722a32f1 nodeName:}" failed. No retries permitted until 2026-09-11 11:34:59.915946655 +0000 UTC m=+50.738406505 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a144c788-3457-4841-8e4e-877e722a32f1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7h8hv" (UID: "a144c788-3457-4841-8e4e-877e722a32f1") : secret "insights-runtime-extractor-tls" not found
Sep 11 11:34:51.916401 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:51.916381    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a144c788-3457-4841-8e4e-877e722a32f1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7h8hv\" (UID: \"a144c788-3457-4841-8e4e-877e722a32f1\") " pod="openshift-insights/insights-runtime-extractor-7h8hv"
Sep 11 11:34:59.883161 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:59.883126    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ccea5f58-9718-4139-8a7f-21f15d7c95b4-metrics-tls\") pod \"dns-default-mlqk5\" (UID: \"ccea5f58-9718-4139-8a7f-21f15d7c95b4\") " pod="openshift-dns/dns-default-mlqk5"
Sep 11 11:34:59.883161 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:59.883167    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-registry-tls\") pod \"image-registry-84c7bcd7f9-fs264\" (UID: \"1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2\") " pod="openshift-image-registry/image-registry-84c7bcd7f9-fs264"
Sep 11 11:34:59.886940 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:59.886911    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-registry-tls\") pod \"image-registry-84c7bcd7f9-fs264\" (UID: \"1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2\") " pod="openshift-image-registry/image-registry-84c7bcd7f9-fs264"
Sep 11 11:34:59.886940 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:59.886921    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ccea5f58-9718-4139-8a7f-21f15d7c95b4-metrics-tls\") pod \"dns-default-mlqk5\" (UID: \"ccea5f58-9718-4139-8a7f-21f15d7c95b4\") " pod="openshift-dns/dns-default-mlqk5"
Sep 11 11:34:59.969890 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:59.969851    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84c7bcd7f9-fs264"
Sep 11 11:34:59.980982 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:59.980953    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mlqk5"
Sep 11 11:34:59.984248 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:59.984227    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a144c788-3457-4841-8e4e-877e722a32f1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7h8hv\" (UID: \"a144c788-3457-4841-8e4e-877e722a32f1\") " pod="openshift-insights/insights-runtime-extractor-7h8hv"
Sep 11 11:34:59.986435 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:59.986413    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a144c788-3457-4841-8e4e-877e722a32f1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7h8hv\" (UID: \"a144c788-3457-4841-8e4e-877e722a32f1\") " pod="openshift-insights/insights-runtime-extractor-7h8hv"
Sep 11 11:34:59.999346 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:34:59.999323    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7h8hv"
Sep 11 11:35:00.293223 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:00.293193    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-84c7bcd7f9-fs264"]
Sep 11 11:35:00.296132 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:35:00.296108    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b2c1aa9_0f50_4cfe_9e7a_40d74af056a2.slice/crio-2a0fac1f8dc930b2a559845bebe53cc859d40f0aa1f41f310806834daa7f1b4c WatchSource:0}: Error finding container 2a0fac1f8dc930b2a559845bebe53cc859d40f0aa1f41f310806834daa7f1b4c: Status 404 returned error can't find the container with id 2a0fac1f8dc930b2a559845bebe53cc859d40f0aa1f41f310806834daa7f1b4c
Sep 11 11:35:00.319160 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:00.319138    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mlqk5"]
Sep 11 11:35:00.321692 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:35:00.321664    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccea5f58_9718_4139_8a7f_21f15d7c95b4.slice/crio-0fed65b1cb83de3d6d9e895b7659f8ea4714fa989d5fab144e036bbc63bab4ee WatchSource:0}: Error finding container 0fed65b1cb83de3d6d9e895b7659f8ea4714fa989d5fab144e036bbc63bab4ee: Status 404 returned error can't find the container with id 0fed65b1cb83de3d6d9e895b7659f8ea4714fa989d5fab144e036bbc63bab4ee
Sep 11 11:35:00.338084 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:00.338058    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7h8hv"]
Sep 11 11:35:00.352635 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:35:00.352609    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda144c788_3457_4841_8e4e_877e722a32f1.slice/crio-7e42f51a5021d33d8c87b53eaccd2bdca92cdbad9f8daa58783c47bdb69b8492 WatchSource:0}: Error finding container 7e42f51a5021d33d8c87b53eaccd2bdca92cdbad9f8daa58783c47bdb69b8492: Status 404 returned error can't find the container with id 7e42f51a5021d33d8c87b53eaccd2bdca92cdbad9f8daa58783c47bdb69b8492
Sep 11 11:35:01.145145 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:01.145107    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mlqk5" event={"ID":"ccea5f58-9718-4139-8a7f-21f15d7c95b4","Type":"ContainerStarted","Data":"0fed65b1cb83de3d6d9e895b7659f8ea4714fa989d5fab144e036bbc63bab4ee"}
Sep 11 11:35:01.146880 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:01.146844    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-84c7bcd7f9-fs264" event={"ID":"1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2","Type":"ContainerStarted","Data":"481c719a92f9964ea6e2835db4f9e9e9f04774b62b4c2779126224c76a68b619"}
Sep 11 11:35:01.146880 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:01.146889    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-84c7bcd7f9-fs264" event={"ID":"1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2","Type":"ContainerStarted","Data":"2a0fac1f8dc930b2a559845bebe53cc859d40f0aa1f41f310806834daa7f1b4c"}
Sep 11 11:35:01.147098 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:01.146958    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-84c7bcd7f9-fs264"
Sep 11 11:35:01.148743 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:01.148723    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7h8hv" event={"ID":"a144c788-3457-4841-8e4e-877e722a32f1","Type":"ContainerStarted","Data":"6e5b7ee9c4fd70cc5152074680b8850ccc3933ed3ddc719c7e11789e440a1f78"}
Sep 11 11:35:01.148852 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:01.148768    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7h8hv" event={"ID":"a144c788-3457-4841-8e4e-877e722a32f1","Type":"ContainerStarted","Data":"7e42f51a5021d33d8c87b53eaccd2bdca92cdbad9f8daa58783c47bdb69b8492"}
Sep 11 11:35:01.174722 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:01.174664    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-84c7bcd7f9-fs264" podStartSLOduration=31.174632155 podStartE2EDuration="31.174632155s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:34:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:35:01.174087744 +0000 UTC m=+51.996547619" watchObservedRunningTime="2026-09-11 11:35:01.174632155 +0000 UTC m=+51.997092032"
Sep 11 11:35:02.153692 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:02.153638    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7h8hv" event={"ID":"a144c788-3457-4841-8e4e-877e722a32f1","Type":"ContainerStarted","Data":"37f1fc47068346dc9071ec9e9d9d4fd88bc864677b60fe932b514056f2b07d2d"}
Sep 11 11:35:03.160001 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:03.159965    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mlqk5" event={"ID":"ccea5f58-9718-4139-8a7f-21f15d7c95b4","Type":"ContainerStarted","Data":"c6b9710edef232aa2accc2e1601b0a00bd65ad72e324efc564b2f3ad11fb1bea"}
Sep 11 11:35:03.160309 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:03.160074    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mlqk5"
Sep 11 11:35:03.160309 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:03.160097    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mlqk5" event={"ID":"ccea5f58-9718-4139-8a7f-21f15d7c95b4","Type":"ContainerStarted","Data":"196d2b24008855be9a426ab10443c6834418728f77040139db717caafee0210c"}
Sep 11 11:35:03.177633 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:03.177577    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-mlqk5" podStartSLOduration=17.212580795 podStartE2EDuration="19.177561521s" totalImagesPullingTime="1.964980726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:34:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:35:03.176040964 +0000 UTC m=+53.998500858" watchObservedRunningTime="2026-09-11 11:35:03.177561521 +0000 UTC m=+54.000021431"
Sep 11 11:35:04.165295 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:04.165257    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7h8hv" event={"ID":"a144c788-3457-4841-8e4e-877e722a32f1","Type":"ContainerStarted","Data":"ec02addd4692388b8372056c82b5536221ea69d462b4a98f8ff3eb62fde8cdce"}
Sep 11 11:35:04.189949 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:04.189898    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7h8hv" podStartSLOduration=17.599248383 podStartE2EDuration="20.189879783s" totalImagesPullingTime="2.5906314s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 11:34:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:35:04.188594759 +0000 UTC m=+55.011054664" watchObservedRunningTime="2026-09-11 11:35:04.189879783 +0000 UTC m=+55.012339655"
Sep 11 11:35:08.213016 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.212980    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7888c58f96-697gr"]
Sep 11 11:35:08.243605 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.243577    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77c9775876-627vg"]
Sep 11 11:35:08.243771 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.243721    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7888c58f96-697gr"
Sep 11 11:35:08.246107 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.246086    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 11 11:35:08.246235 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.246166    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 11 11:35:08.246441 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.246421    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 11 11:35:08.246548 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.246440    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 11 11:35:08.267429 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.267405    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7899f94-hpnrr"]
Sep 11 11:35:08.267560 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.267525    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77c9775876-627vg"
Sep 11 11:35:08.270136 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.270117    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 11 11:35:08.270222 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.270208    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-4xxf9\""
Sep 11 11:35:08.283884 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.283857    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-84c7bcd7f9-fs264"]
Sep 11 11:35:08.284004 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.283905    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77c9775876-627vg"]
Sep 11 11:35:08.284004 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.283922    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7888c58f96-697gr"]
Sep 11 11:35:08.284004 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.283941    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7899f94-hpnrr"]
Sep 11 11:35:08.284004 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.283970    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7899f94-hpnrr"
Sep 11 11:35:08.286689 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.286670    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 11 11:35:08.286930 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.286914    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 11 11:35:08.286992 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.286980    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 11 11:35:08.287291 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.287276    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 11 11:35:08.344840 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.344807    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ae0f5a9-207f-45f0-b2ed-39028a343ceb-tmp\") pod \"klusterlet-addon-workmgr-7888c58f96-697gr\" (UID: \"0ae0f5a9-207f-45f0-b2ed-39028a343ceb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7888c58f96-697gr"
Sep 11 11:35:08.345012 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.344850    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f672e7d7-3ba2-4b42-9d13-9f6106ce0882-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7bd7899f94-hpnrr\" (UID: \"f672e7d7-3ba2-4b42-9d13-9f6106ce0882\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7899f94-hpnrr"
Sep 11 11:35:08.345012 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.344876    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f672e7d7-3ba2-4b42-9d13-9f6106ce0882-hub\") pod \"cluster-proxy-proxy-agent-7bd7899f94-hpnrr\" (UID: \"f672e7d7-3ba2-4b42-9d13-9f6106ce0882\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7899f94-hpnrr"
Sep 11 11:35:08.345012 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.344890    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0ae0f5a9-207f-45f0-b2ed-39028a343ceb-klusterlet-config\") pod \"klusterlet-addon-workmgr-7888c58f96-697gr\" (UID: \"0ae0f5a9-207f-45f0-b2ed-39028a343ceb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7888c58f96-697gr"
Sep 11 11:35:08.345012 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.344908    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f672e7d7-3ba2-4b42-9d13-9f6106ce0882-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7bd7899f94-hpnrr\" (UID: \"f672e7d7-3ba2-4b42-9d13-9f6106ce0882\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7899f94-hpnrr"
Sep 11 11:35:08.345012 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.344923    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fj5mb\" (UniqueName: \"kubernetes.io/projected/f672e7d7-3ba2-4b42-9d13-9f6106ce0882-kube-api-access-fj5mb\") pod \"cluster-proxy-proxy-agent-7bd7899f94-hpnrr\" (UID: \"f672e7d7-3ba2-4b42-9d13-9f6106ce0882\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7899f94-hpnrr"
Sep 11 11:35:08.345012 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.344963    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9391fbe5-0e0b-4c78-b9c1-a61af1bde307-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-77c9775876-627vg\" (UID: \"9391fbe5-0e0b-4c78-b9c1-a61af1bde307\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77c9775876-627vg"
Sep 11 11:35:08.345012 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.345009    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f672e7d7-3ba2-4b42-9d13-9f6106ce0882-ca\") pod \"cluster-proxy-proxy-agent-7bd7899f94-hpnrr\" (UID: \"f672e7d7-3ba2-4b42-9d13-9f6106ce0882\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7899f94-hpnrr"
Sep 11 11:35:08.345232 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.345023    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f672e7d7-3ba2-4b42-9d13-9f6106ce0882-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7bd7899f94-hpnrr\" (UID: \"f672e7d7-3ba2-4b42-9d13-9f6106ce0882\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7899f94-hpnrr"
Sep 11 11:35:08.345232 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.345041    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gls8\" (UniqueName: \"kubernetes.io/projected/9391fbe5-0e0b-4c78-b9c1-a61af1bde307-kube-api-access-7gls8\") pod \"managed-serviceaccount-addon-agent-77c9775876-627vg\" (UID: \"9391fbe5-0e0b-4c78-b9c1-a61af1bde307\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77c9775876-627vg"
Sep 11 11:35:08.345232 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.345062    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvvng\" (UniqueName: \"kubernetes.io/projected/0ae0f5a9-207f-45f0-b2ed-39028a343ceb-kube-api-access-dvvng\") pod \"klusterlet-addon-workmgr-7888c58f96-697gr\" (UID: \"0ae0f5a9-207f-45f0-b2ed-39028a343ceb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7888c58f96-697gr"
Sep 11 11:35:08.396402 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.396367    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-bbd5d68d4-ht82m"]
Sep 11 11:35:08.417575 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.417545    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bbd5d68d4-ht82m"
Sep 11 11:35:08.422614 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.422588    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-bbd5d68d4-ht82m"]
Sep 11 11:35:08.446281 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.446254    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f672e7d7-3ba2-4b42-9d13-9f6106ce0882-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7bd7899f94-hpnrr\" (UID: \"f672e7d7-3ba2-4b42-9d13-9f6106ce0882\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7899f94-hpnrr"
Sep 11 11:35:08.446423 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.446291    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/06144b87-a467-47fe-b379-8f6998bf26cb-installation-pull-secrets\") pod \"image-registry-bbd5d68d4-ht82m\" (UID: \"06144b87-a467-47fe-b379-8f6998bf26cb\") " pod="openshift-image-registry/image-registry-bbd5d68d4-ht82m"
Sep 11 11:35:08.446423 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.446316    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f672e7d7-3ba2-4b42-9d13-9f6106ce0882-hub\") pod \"cluster-proxy-proxy-agent-7bd7899f94-hpnrr\" (UID: \"f672e7d7-3ba2-4b42-9d13-9f6106ce0882\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7899f94-hpnrr"
Sep 11 11:35:08.446423 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.446332    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0ae0f5a9-207f-45f0-b2ed-39028a343ceb-klusterlet-config\") pod \"klusterlet-addon-workmgr-7888c58f96-697gr\" (UID: \"0ae0f5a9-207f-45f0-b2ed-39028a343ceb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7888c58f96-697gr"
Sep 11 11:35:08.446560 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.446458    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f672e7d7-3ba2-4b42-9d13-9f6106ce0882-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7bd7899f94-hpnrr\" (UID: \"f672e7d7-3ba2-4b42-9d13-9f6106ce0882\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7899f94-hpnrr"
Sep 11 11:35:08.446560 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.446493    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fj5mb\" (UniqueName: \"kubernetes.io/projected/f672e7d7-3ba2-4b42-9d13-9f6106ce0882-kube-api-access-fj5mb\") pod \"cluster-proxy-proxy-agent-7bd7899f94-hpnrr\" (UID: \"f672e7d7-3ba2-4b42-9d13-9f6106ce0882\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7899f94-hpnrr"
Sep 11 11:35:08.446560 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.446544    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9391fbe5-0e0b-4c78-b9c1-a61af1bde307-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-77c9775876-627vg\" (UID: \"9391fbe5-0e0b-4c78-b9c1-a61af1bde307\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77c9775876-627vg"
Sep 11 11:35:08.446738 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.446577    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/06144b87-a467-47fe-b379-8f6998bf26cb-registry-certificates\") pod \"image-registry-bbd5d68d4-ht82m\" (UID: \"06144b87-a467-47fe-b379-8f6998bf26cb\") " pod="openshift-image-registry/image-registry-bbd5d68d4-ht82m"
Sep 11 11:35:08.446738 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.446620    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f672e7d7-3ba2-4b42-9d13-9f6106ce0882-ca\") pod \"cluster-proxy-proxy-agent-7bd7899f94-hpnrr\" (UID: \"f672e7d7-3ba2-4b42-9d13-9f6106ce0882\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7899f94-hpnrr"
Sep 11 11:35:08.446738 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.446672    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f672e7d7-3ba2-4b42-9d13-9f6106ce0882-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7bd7899f94-hpnrr\" (UID: \"f672e7d7-3ba2-4b42-9d13-9f6106ce0882\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7899f94-hpnrr"
Sep 11 11:35:08.446738 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.446708    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gls8\" (UniqueName: \"kubernetes.io/projected/9391fbe5-0e0b-4c78-b9c1-a61af1bde307-kube-api-access-7gls8\") pod \"managed-serviceaccount-addon-agent-77c9775876-627vg\" (UID: \"9391fbe5-0e0b-4c78-b9c1-a61af1bde307\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77c9775876-627vg"
Sep 11 11:35:08.446953 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.446745    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvvng\" (UniqueName: \"kubernetes.io/projected/0ae0f5a9-207f-45f0-b2ed-39028a343ceb-kube-api-access-dvvng\") pod \"klusterlet-addon-workmgr-7888c58f96-697gr\" (UID: \"0ae0f5a9-207f-45f0-b2ed-39028a343ceb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7888c58f96-697gr"
Sep 11 11:35:08.446953 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.446801    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4whwd\" (UniqueName: \"kubernetes.io/projected/06144b87-a467-47fe-b379-8f6998bf26cb-kube-api-access-4whwd\") pod \"image-registry-bbd5d68d4-ht82m\" (UID: \"06144b87-a467-47fe-b379-8f6998bf26cb\") " pod="openshift-image-registry/image-registry-bbd5d68d4-ht82m"
Sep 11 11:35:08.446953 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.446832    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/06144b87-a467-47fe-b379-8f6998bf26cb-image-registry-private-configuration\") pod \"image-registry-bbd5d68d4-ht82m\" (UID: \"06144b87-a467-47fe-b379-8f6998bf26cb\") " pod="openshift-image-registry/image-registry-bbd5d68d4-ht82m"
Sep 11 11:35:08.446953 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.446859    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/06144b87-a467-47fe-b379-8f6998bf26cb-bound-sa-token\") pod \"image-registry-bbd5d68d4-ht82m\" (UID: \"06144b87-a467-47fe-b379-8f6998bf26cb\") " pod="openshift-image-registry/image-registry-bbd5d68d4-ht82m"
Sep 11 11:35:08.446953 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.446894    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ae0f5a9-207f-45f0-b2ed-39028a343ceb-tmp\") pod \"klusterlet-addon-workmgr-7888c58f96-697gr\" (UID: \"0ae0f5a9-207f-45f0-b2ed-39028a343ceb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7888c58f96-697gr"
Sep 11 11:35:08.446953 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.446919    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06144b87-a467-47fe-b379-8f6998bf26cb-registry-tls\") pod \"image-registry-bbd5d68d4-ht82m\" (UID: \"06144b87-a467-47fe-b379-8f6998bf26cb\") " pod="openshift-image-registry/image-registry-bbd5d68d4-ht82m"
Sep 11 11:35:08.446953 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.446941    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/06144b87-a467-47fe-b379-8f6998bf26cb-trusted-ca\") pod \"image-registry-bbd5d68d4-ht82m\" (UID: \"06144b87-a467-47fe-b379-8f6998bf26cb\") " pod="openshift-image-registry/image-registry-bbd5d68d4-ht82m"
Sep 11 11:35:08.447317 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.446965    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/06144b87-a467-47fe-b379-8f6998bf26cb-ca-trust-extracted\") pod \"image-registry-bbd5d68d4-ht82m\" (UID: \"06144b87-a467-47fe-b379-8f6998bf26cb\") " pod="openshift-image-registry/image-registry-bbd5d68d4-ht82m"
Sep 11 11:35:08.447317 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.447220    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f672e7d7-3ba2-4b42-9d13-9f6106ce0882-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7bd7899f94-hpnrr\" (UID: \"f672e7d7-3ba2-4b42-9d13-9f6106ce0882\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7899f94-hpnrr"
Sep 11 11:35:08.447421 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.447392    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ae0f5a9-207f-45f0-b2ed-39028a343ceb-tmp\") pod \"klusterlet-addon-workmgr-7888c58f96-697gr\" (UID: \"0ae0f5a9-207f-45f0-b2ed-39028a343ceb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7888c58f96-697gr"
Sep 11 11:35:08.449213 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.449168    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f672e7d7-3ba2-4b42-9d13-9f6106ce0882-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7bd7899f94-hpnrr\" (UID: \"f672e7d7-3ba2-4b42-9d13-9f6106ce0882\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7899f94-hpnrr"
Sep 11 11:35:08.449410 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.449348    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9391fbe5-0e0b-4c78-b9c1-a61af1bde307-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-77c9775876-627vg\" (UID: \"9391fbe5-0e0b-4c78-b9c1-a61af1bde307\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77c9775876-627vg"
Sep 11 11:35:08.449746 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.449726    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f672e7d7-3ba2-4b42-9d13-9f6106ce0882-hub\") pod \"cluster-proxy-proxy-agent-7bd7899f94-hpnrr\" (UID: \"f672e7d7-3ba2-4b42-9d13-9f6106ce0882\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7899f94-hpnrr"
Sep 11 11:35:08.449833 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.449762    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f672e7d7-3ba2-4b42-9d13-9f6106ce0882-ca\") pod \"cluster-proxy-proxy-agent-7bd7899f94-hpnrr\" (UID: \"f672e7d7-3ba2-4b42-9d13-9f6106ce0882\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7899f94-hpnrr"
Sep 11 11:35:08.449929 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.449912    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0ae0f5a9-207f-45f0-b2ed-39028a343ceb-klusterlet-config\") pod \"klusterlet-addon-workmgr-7888c58f96-697gr\" (UID: \"0ae0f5a9-207f-45f0-b2ed-39028a343ceb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7888c58f96-697gr"
Sep 11 11:35:08.450094 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.450074    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f672e7d7-3ba2-4b42-9d13-9f6106ce0882-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7bd7899f94-hpnrr\" (UID: \"f672e7d7-3ba2-4b42-9d13-9f6106ce0882\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7899f94-hpnrr"
Sep 11 11:35:08.458304 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.458285    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fj5mb\" (UniqueName: \"kubernetes.io/projected/f672e7d7-3ba2-4b42-9d13-9f6106ce0882-kube-api-access-fj5mb\") pod \"cluster-proxy-proxy-agent-7bd7899f94-hpnrr\" (UID: \"f672e7d7-3ba2-4b42-9d13-9f6106ce0882\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7899f94-hpnrr"
Sep 11 11:35:08.467279 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.467213    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gls8\" (UniqueName: \"kubernetes.io/projected/9391fbe5-0e0b-4c78-b9c1-a61af1bde307-kube-api-access-7gls8\") pod \"managed-serviceaccount-addon-agent-77c9775876-627vg\" (UID: \"9391fbe5-0e0b-4c78-b9c1-a61af1bde307\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77c9775876-627vg"
Sep 11 11:35:08.470818 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.470794    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvvng\" (UniqueName: \"kubernetes.io/projected/0ae0f5a9-207f-45f0-b2ed-39028a343ceb-kube-api-access-dvvng\") pod \"klusterlet-addon-workmgr-7888c58f96-697gr\" (UID: \"0ae0f5a9-207f-45f0-b2ed-39028a343ceb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7888c58f96-697gr"
Sep 11 11:35:08.547615 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.547566    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4whwd\" (UniqueName: \"kubernetes.io/projected/06144b87-a467-47fe-b379-8f6998bf26cb-kube-api-access-4whwd\") pod \"image-registry-bbd5d68d4-ht82m\" (UID: \"06144b87-a467-47fe-b379-8f6998bf26cb\") " pod="openshift-image-registry/image-registry-bbd5d68d4-ht82m"
Sep 11 11:35:08.547615 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.547611    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/06144b87-a467-47fe-b379-8f6998bf26cb-image-registry-private-configuration\") pod \"image-registry-bbd5d68d4-ht82m\" (UID: \"06144b87-a467-47fe-b379-8f6998bf26cb\") " pod="openshift-image-registry/image-registry-bbd5d68d4-ht82m"
Sep 11 11:35:08.547838 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.547629    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/06144b87-a467-47fe-b379-8f6998bf26cb-bound-sa-token\") pod \"image-registry-bbd5d68d4-ht82m\" (UID: \"06144b87-a467-47fe-b379-8f6998bf26cb\") " pod="openshift-image-registry/image-registry-bbd5d68d4-ht82m"
Sep 11 11:35:08.547838 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.547824    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06144b87-a467-47fe-b379-8f6998bf26cb-registry-tls\") pod \"image-registry-bbd5d68d4-ht82m\" (UID: \"06144b87-a467-47fe-b379-8f6998bf26cb\") " pod="openshift-image-registry/image-registry-bbd5d68d4-ht82m"
Sep 11 11:35:08.548146 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.547853    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/06144b87-a467-47fe-b379-8f6998bf26cb-trusted-ca\") pod \"image-registry-bbd5d68d4-ht82m\" (UID: \"06144b87-a467-47fe-b379-8f6998bf26cb\") " pod="openshift-image-registry/image-registry-bbd5d68d4-ht82m"
Sep 11 11:35:08.548146 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.547872    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/06144b87-a467-47fe-b379-8f6998bf26cb-ca-trust-extracted\") pod \"image-registry-bbd5d68d4-ht82m\" (UID: \"06144b87-a467-47fe-b379-8f6998bf26cb\") " pod="openshift-image-registry/image-registry-bbd5d68d4-ht82m"
Sep 11 11:35:08.548146 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.547918    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/06144b87-a467-47fe-b379-8f6998bf26cb-installation-pull-secrets\") pod \"image-registry-bbd5d68d4-ht82m\" (UID: \"06144b87-a467-47fe-b379-8f6998bf26cb\") " pod="openshift-image-registry/image-registry-bbd5d68d4-ht82m"
Sep 11 11:35:08.548146 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.547960    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/06144b87-a467-47fe-b379-8f6998bf26cb-registry-certificates\") pod \"image-registry-bbd5d68d4-ht82m\" (UID: \"06144b87-a467-47fe-b379-8f6998bf26cb\") " pod="openshift-image-registry/image-registry-bbd5d68d4-ht82m"
Sep 11 11:35:08.548482 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.548458    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/06144b87-a467-47fe-b379-8f6998bf26cb-ca-trust-extracted\") pod \"image-registry-bbd5d68d4-ht82m\" (UID: \"06144b87-a467-47fe-b379-8f6998bf26cb\") " pod="openshift-image-registry/image-registry-bbd5d68d4-ht82m"
Sep 11 11:35:08.548814 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.548792    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/06144b87-a467-47fe-b379-8f6998bf26cb-registry-certificates\") pod \"image-registry-bbd5d68d4-ht82m\" (UID: \"06144b87-a467-47fe-b379-8f6998bf26cb\") " pod="openshift-image-registry/image-registry-bbd5d68d4-ht82m"
Sep 11 11:35:08.548945 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.548923    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/06144b87-a467-47fe-b379-8f6998bf26cb-trusted-ca\") pod \"image-registry-bbd5d68d4-ht82m\" (UID: \"06144b87-a467-47fe-b379-8f6998bf26cb\") " pod="openshift-image-registry/image-registry-bbd5d68d4-ht82m"
Sep 11 11:35:08.550471 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.550448    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/06144b87-a467-47fe-b379-8f6998bf26cb-image-registry-private-configuration\") pod \"image-registry-bbd5d68d4-ht82m\" (UID: \"06144b87-a467-47fe-b379-8f6998bf26cb\") " pod="openshift-image-registry/image-registry-bbd5d68d4-ht82m"
Sep 11 11:35:08.550546 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.550522    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06144b87-a467-47fe-b379-8f6998bf26cb-registry-tls\") pod \"image-registry-bbd5d68d4-ht82m\" (UID: \"06144b87-a467-47fe-b379-8f6998bf26cb\") " pod="openshift-image-registry/image-registry-bbd5d68d4-ht82m"
Sep 11 11:35:08.552381 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.552365    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7888c58f96-697gr"
Sep 11 11:35:08.555572 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.555556    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/06144b87-a467-47fe-b379-8f6998bf26cb-bound-sa-token\") pod \"image-registry-bbd5d68d4-ht82m\" (UID: \"06144b87-a467-47fe-b379-8f6998bf26cb\") " pod="openshift-image-registry/image-registry-bbd5d68d4-ht82m"
Sep 11 11:35:08.562115 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.562096    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4whwd\" (UniqueName: \"kubernetes.io/projected/06144b87-a467-47fe-b379-8f6998bf26cb-kube-api-access-4whwd\") pod \"image-registry-bbd5d68d4-ht82m\" (UID: \"06144b87-a467-47fe-b379-8f6998bf26cb\") " pod="openshift-image-registry/image-registry-bbd5d68d4-ht82m"
Sep 11 11:35:08.563085 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.563065    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/06144b87-a467-47fe-b379-8f6998bf26cb-installation-pull-secrets\") pod \"image-registry-bbd5d68d4-ht82m\" (UID: \"06144b87-a467-47fe-b379-8f6998bf26cb\") " pod="openshift-image-registry/image-registry-bbd5d68d4-ht82m"
Sep 11 11:35:08.592675 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.592635    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77c9775876-627vg"
Sep 11 11:35:08.598805 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.598773    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7899f94-hpnrr"
Sep 11 11:35:08.741892 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.741811    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bbd5d68d4-ht82m"
Sep 11 11:35:08.856263 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.856214    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7888c58f96-697gr"]
Sep 11 11:35:08.860271 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:35:08.860244    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ae0f5a9_207f_45f0_b2ed_39028a343ceb.slice/crio-67237241df7a75a0b4f2534d531d7b458f9e535fbe93b6228d9ab7e0446ba5a8 WatchSource:0}: Error finding container 67237241df7a75a0b4f2534d531d7b458f9e535fbe93b6228d9ab7e0446ba5a8: Status 404 returned error can't find the container with id 67237241df7a75a0b4f2534d531d7b458f9e535fbe93b6228d9ab7e0446ba5a8
Sep 11 11:35:08.886303 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.886275    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77c9775876-627vg"]
Sep 11 11:35:08.890008 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:35:08.889975    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9391fbe5_0e0b_4c78_b9c1_a61af1bde307.slice/crio-5543336b26fbd1fe80a8793b6a22aba5d0cd8f60a2e7bc2fc71c23612c1d8c12 WatchSource:0}: Error finding container 5543336b26fbd1fe80a8793b6a22aba5d0cd8f60a2e7bc2fc71c23612c1d8c12: Status 404 returned error can't find the container with id 5543336b26fbd1fe80a8793b6a22aba5d0cd8f60a2e7bc2fc71c23612c1d8c12
Sep 11 11:35:08.911244 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:08.911151    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7899f94-hpnrr"]
Sep 11 11:35:08.916165 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:35:08.916132    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf672e7d7_3ba2_4b42_9d13_9f6106ce0882.slice/crio-dd981ad7f2cb623c54d3965b7f10592dee69e85ec5cf3eccd82f2b0a9bc65a50 WatchSource:0}: Error finding container dd981ad7f2cb623c54d3965b7f10592dee69e85ec5cf3eccd82f2b0a9bc65a50: Status 404 returned error can't find the container with id dd981ad7f2cb623c54d3965b7f10592dee69e85ec5cf3eccd82f2b0a9bc65a50
Sep 11 11:35:09.039186 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:09.039010    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-bbd5d68d4-ht82m"]
Sep 11 11:35:09.042057 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:35:09.042030    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06144b87_a467_47fe_b379_8f6998bf26cb.slice/crio-b661a27fa99c78e480c8bf5114146f9a196721561cb274c619d78394dfa29e0a WatchSource:0}: Error finding container b661a27fa99c78e480c8bf5114146f9a196721561cb274c619d78394dfa29e0a: Status 404 returned error can't find the container with id b661a27fa99c78e480c8bf5114146f9a196721561cb274c619d78394dfa29e0a
Sep 11 11:35:09.181854 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:09.181815    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bbd5d68d4-ht82m" event={"ID":"06144b87-a467-47fe-b379-8f6998bf26cb","Type":"ContainerStarted","Data":"94197f458402d4e22355583d16efe596e0017e754dd546341d4731c7a89d27c9"}
Sep 11 11:35:09.182033 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:09.181893    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bbd5d68d4-ht82m" event={"ID":"06144b87-a467-47fe-b379-8f6998bf26cb","Type":"ContainerStarted","Data":"b661a27fa99c78e480c8bf5114146f9a196721561cb274c619d78394dfa29e0a"}
Sep 11 11:35:09.182033 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:09.181922    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-bbd5d68d4-ht82m"
Sep 11 11:35:09.183641 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:09.183614    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77c9775876-627vg" event={"ID":"9391fbe5-0e0b-4c78-b9c1-a61af1bde307","Type":"ContainerStarted","Data":"5543336b26fbd1fe80a8793b6a22aba5d0cd8f60a2e7bc2fc71c23612c1d8c12"}
Sep 11 11:35:09.185031 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:09.185001    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7888c58f96-697gr" event={"ID":"0ae0f5a9-207f-45f0-b2ed-39028a343ceb","Type":"ContainerStarted","Data":"67237241df7a75a0b4f2534d531d7b458f9e535fbe93b6228d9ab7e0446ba5a8"}
Sep 11 11:35:09.186171 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:09.186149    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7899f94-hpnrr" event={"ID":"f672e7d7-3ba2-4b42-9d13-9f6106ce0882","Type":"ContainerStarted","Data":"dd981ad7f2cb623c54d3965b7f10592dee69e85ec5cf3eccd82f2b0a9bc65a50"}
Sep 11 11:35:09.202288 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:09.202228    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-bbd5d68d4-ht82m" podStartSLOduration=1.202208054 podStartE2EDuration="1.202208054s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:35:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:35:09.201596001 +0000 UTC m=+60.024055874" watchObservedRunningTime="2026-09-11 11:35:09.202208054 +0000 UTC m=+60.024667930"
Sep 11 11:35:10.086749 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:10.086716    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vvjr6"
Sep 11 11:35:13.167763 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:13.167725    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mlqk5"
Sep 11 11:35:15.512862 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:15.512823    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ed2dabe-863c-4c3f-9c21-ce551acf7712-metrics-certs\") pod \"network-metrics-daemon-flnj5\" (UID: \"5ed2dabe-863c-4c3f-9c21-ce551acf7712\") " pod="openshift-multus/network-metrics-daemon-flnj5"
Sep 11 11:35:15.513221 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:15.512896    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81901073-d576-4c23-bb13-e150254f32b7-original-pull-secret\") pod \"global-pull-secret-syncer-mtjkj\" (UID: \"81901073-d576-4c23-bb13-e150254f32b7\") " pod="kube-system/global-pull-secret-syncer-mtjkj"
Sep 11 11:35:15.515391 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:15.515370    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 11:35:15.515453 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:15.515370    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 11:35:15.525380 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:15.525355    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ed2dabe-863c-4c3f-9c21-ce551acf7712-metrics-certs\") pod \"network-metrics-daemon-flnj5\" (UID: \"5ed2dabe-863c-4c3f-9c21-ce551acf7712\") " pod="openshift-multus/network-metrics-daemon-flnj5"
Sep 11 11:35:15.525474 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:15.525355    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81901073-d576-4c23-bb13-e150254f32b7-original-pull-secret\") pod \"global-pull-secret-syncer-mtjkj\" (UID: \"81901073-d576-4c23-bb13-e150254f32b7\") " pod="kube-system/global-pull-secret-syncer-mtjkj"
Sep 11 11:35:15.613844 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:15.613809    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qjwh\" (UniqueName: \"kubernetes.io/projected/c74969dd-4205-4c53-9577-a6b387e33252-kube-api-access-2qjwh\") pod \"network-check-target-5g8rf\" (UID: \"c74969dd-4205-4c53-9577-a6b387e33252\") " pod="openshift-network-diagnostics/network-check-target-5g8rf"
Sep 11 11:35:15.616228 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:15.616210    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 11:35:15.626917 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:15.626900    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 11:35:15.637804 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:15.637778    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qjwh\" (UniqueName: \"kubernetes.io/projected/c74969dd-4205-4c53-9577-a6b387e33252-kube-api-access-2qjwh\") pod \"network-check-target-5g8rf\" (UID: \"c74969dd-4205-4c53-9577-a6b387e33252\") " pod="openshift-network-diagnostics/network-check-target-5g8rf"
Sep 11 11:35:15.718930 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:15.718908    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtjkj"
Sep 11 11:35:15.728027 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:15.728007    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-b45p4\""
Sep 11 11:35:15.733533 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:15.733511    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tk98p\""
Sep 11 11:35:15.736197 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:15.736182    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5g8rf"
Sep 11 11:35:15.742437 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:15.742420    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flnj5"
Sep 11 11:35:16.216719 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:16.216688    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7899f94-hpnrr" event={"ID":"f672e7d7-3ba2-4b42-9d13-9f6106ce0882","Type":"ContainerStarted","Data":"c9cc2869cd0d711622f9cbc52c646cafcc25257974f1f1eaa533d21fc0c4ced4"}
Sep 11 11:35:16.217992 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:16.217963    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77c9775876-627vg" event={"ID":"9391fbe5-0e0b-4c78-b9c1-a61af1bde307","Type":"ContainerStarted","Data":"62f6f77e0621be123f37267d89a53c87bed3b9689a1991dad6973d8ff8ba88aa"}
Sep 11 11:35:16.220779 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:16.220751    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7888c58f96-697gr" event={"ID":"0ae0f5a9-207f-45f0-b2ed-39028a343ceb","Type":"ContainerStarted","Data":"ff9549b015fccee7d4930dd8b7dab2168e8ba8d2db736ce208655011bdb15142"}
Sep 11 11:35:16.221143 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:16.221126    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7888c58f96-697gr"
Sep 11 11:35:16.222017 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:16.221987    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7888c58f96-697gr" podUID="0ae0f5a9-207f-45f0-b2ed-39028a343ceb" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.12:8000/readyz\": dial tcp 10.133.0.12:8000: connect: connection refused"
Sep 11 11:35:16.234575 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:16.234498    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77c9775876-627vg" podStartSLOduration=1.113438034 podStartE2EDuration="8.234479125s" totalImagesPullingTime="7.121041091s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:35:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:35:16.233089977 +0000 UTC m=+67.055549850" watchObservedRunningTime="2026-09-11 11:35:16.234479125 +0000 UTC m=+67.056938996"
Sep 11 11:35:16.251704 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:16.251663    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7888c58f96-697gr" podStartSLOduration=1.099923611 podStartE2EDuration="8.251626624s" totalImagesPullingTime="7.151703013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:35:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:35:16.251006877 +0000 UTC m=+67.073466751" watchObservedRunningTime="2026-09-11 11:35:16.251626624 +0000 UTC m=+67.074086498"
Sep 11 11:35:16.293476 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:16.293444    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-flnj5"]
Sep 11 11:35:16.296264 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:16.296239    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5g8rf"]
Sep 11 11:35:16.296800 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:35:16.296777    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ed2dabe_863c_4c3f_9c21_ce551acf7712.slice/crio-33348679aff122e0c23fada25c4cd3cebf4b4fcf382fbaddb2a909ba8e91516e WatchSource:0}: Error finding container 33348679aff122e0c23fada25c4cd3cebf4b4fcf382fbaddb2a909ba8e91516e: Status 404 returned error can't find the container with id 33348679aff122e0c23fada25c4cd3cebf4b4fcf382fbaddb2a909ba8e91516e
Sep 11 11:35:16.299840 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:35:16.299812    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc74969dd_4205_4c53_9577_a6b387e33252.slice/crio-b82231bcc813f4d3a6ae2ca229968ac37167ec699937281a9dec7f424304454b WatchSource:0}: Error finding container b82231bcc813f4d3a6ae2ca229968ac37167ec699937281a9dec7f424304454b: Status 404 returned error can't find the container with id b82231bcc813f4d3a6ae2ca229968ac37167ec699937281a9dec7f424304454b
Sep 11 11:35:16.305318 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:16.305293    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mtjkj"]
Sep 11 11:35:16.309855 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:35:16.309835    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81901073_d576_4c23_bb13_e150254f32b7.slice/crio-56d20ddd872d7868d2c1cc8ea243c4ffbfe36b2e05c2b22e224c6200a1797764 WatchSource:0}: Error finding container 56d20ddd872d7868d2c1cc8ea243c4ffbfe36b2e05c2b22e224c6200a1797764: Status 404 returned error can't find the container with id 56d20ddd872d7868d2c1cc8ea243c4ffbfe36b2e05c2b22e224c6200a1797764
Sep 11 11:35:17.228408 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:17.228312    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7899f94-hpnrr" event={"ID":"f672e7d7-3ba2-4b42-9d13-9f6106ce0882","Type":"ContainerStarted","Data":"6b03dac633a6d754e1594ea10bb4883b44b63ce11073a892c12c03aa1fbcb29b"}
Sep 11 11:35:17.228408 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:17.228367    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7899f94-hpnrr" event={"ID":"f672e7d7-3ba2-4b42-9d13-9f6106ce0882","Type":"ContainerStarted","Data":"22b0587d043ff390f0b425feecf20cf0bd10f39157bcb3532a05f1e45fe019d4"}
Sep 11 11:35:17.230400 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:17.230321    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5g8rf" event={"ID":"c74969dd-4205-4c53-9577-a6b387e33252","Type":"ContainerStarted","Data":"b82231bcc813f4d3a6ae2ca229968ac37167ec699937281a9dec7f424304454b"}
Sep 11 11:35:17.232539 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:17.232246    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-flnj5" event={"ID":"5ed2dabe-863c-4c3f-9c21-ce551acf7712","Type":"ContainerStarted","Data":"33348679aff122e0c23fada25c4cd3cebf4b4fcf382fbaddb2a909ba8e91516e"}
Sep 11 11:35:17.233786 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:17.233713    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mtjkj" event={"ID":"81901073-d576-4c23-bb13-e150254f32b7","Type":"ContainerStarted","Data":"56d20ddd872d7868d2c1cc8ea243c4ffbfe36b2e05c2b22e224c6200a1797764"}
Sep 11 11:35:17.235206 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:17.235152    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7888c58f96-697gr"
Sep 11 11:35:17.250470 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:17.250032    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7899f94-hpnrr" podStartSLOduration=2.137010499 podStartE2EDuration="9.250011783s" totalImagesPullingTime="7.113001284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:35:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:35:17.248824239 +0000 UTC m=+68.071284113" watchObservedRunningTime="2026-09-11 11:35:17.250011783 +0000 UTC m=+68.072471660"
Sep 11 11:35:18.240326 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:18.240284    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-flnj5" event={"ID":"5ed2dabe-863c-4c3f-9c21-ce551acf7712","Type":"ContainerStarted","Data":"8f103c1cdbb13272bdba4bc9d18edd556926444fc7b7f57589fcf0da4d5804a2"}
Sep 11 11:35:18.240823 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:18.240354    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-flnj5" event={"ID":"5ed2dabe-863c-4c3f-9c21-ce551acf7712","Type":"ContainerStarted","Data":"ffb05c68afeeed92520c025ed384c75e37f220fc729da285321fdec9ab239e4a"}
Sep 11 11:35:18.257380 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:18.257147    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-flnj5" podStartSLOduration=67.180186397 podStartE2EDuration="1m8.257126062s" totalImagesPullingTime="1.076939665s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:34:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:35:18.255847754 +0000 UTC m=+69.078307655" watchObservedRunningTime="2026-09-11 11:35:18.257126062 +0000 UTC m=+69.079585936"
Sep 11 11:35:18.292129 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:18.292091    2560 patch_prober.go:28] interesting pod/image-registry-84c7bcd7f9-fs264 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 11 11:35:18.292305 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:18.292152    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-84c7bcd7f9-fs264" podUID="1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 11:35:21.256611 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:21.256576    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mtjkj" event={"ID":"81901073-d576-4c23-bb13-e150254f32b7","Type":"ContainerStarted","Data":"17d3aba0e06be64280372a73c9cc8ae7765b2fe508ebf1dc68cce92d16b0c766"}
Sep 11 11:35:21.258045 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:21.258021    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5g8rf" event={"ID":"c74969dd-4205-4c53-9577-a6b387e33252","Type":"ContainerStarted","Data":"024ed5bc653f75bb9ce7ae09ea157fd5a25601f6e6eefec491f0788d19c3842b"}
Sep 11 11:35:21.258163 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:21.258147    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5g8rf"
Sep 11 11:35:21.273708 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:21.273667    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mtjkj" podStartSLOduration=66.652559126 podStartE2EDuration="1m11.273633664s" totalImagesPullingTime="4.621074538s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 11:34:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:35:21.272945962 +0000 UTC m=+72.095405835" watchObservedRunningTime="2026-09-11 11:35:21.273633664 +0000 UTC m=+72.096093536"
Sep 11 11:35:21.289893 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:21.289855    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5g8rf" podStartSLOduration=66.663876187 podStartE2EDuration="1m11.289842167s" totalImagesPullingTime="4.62596598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:34:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:35:21.289020814 +0000 UTC m=+72.111480706" watchObservedRunningTime="2026-09-11 11:35:21.289842167 +0000 UTC m=+72.112302082"
Sep 11 11:35:22.758634 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:22.758597    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-g2xm9"]
Sep 11 11:35:22.792275 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:22.792244    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-g2xm9"
Sep 11 11:35:22.798740 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:22.798719    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 11 11:35:22.800095 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:22.800076    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 11 11:35:22.800785 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:22.800759    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fcpz2\""
Sep 11 11:35:22.800907 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:22.800891    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 11 11:35:22.801165 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:22.801150    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 11 11:35:22.801342 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:22.801322    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 11 11:35:22.807752 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:22.807725    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 11 11:35:22.870459 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:22.870423    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6d20a32e-98a1-415f-9e47-901630a17e9c-sys\") pod \"node-exporter-g2xm9\" (UID: \"6d20a32e-98a1-415f-9e47-901630a17e9c\") " pod="openshift-monitoring/node-exporter-g2xm9"
Sep 11 11:35:22.870459 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:22.870458    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6d20a32e-98a1-415f-9e47-901630a17e9c-node-exporter-accelerators-collector-config\") pod \"node-exporter-g2xm9\" (UID: \"6d20a32e-98a1-415f-9e47-901630a17e9c\") " pod="openshift-monitoring/node-exporter-g2xm9"
Sep 11 11:35:22.870637 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:22.870492    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d20a32e-98a1-415f-9e47-901630a17e9c-metrics-client-ca\") pod \"node-exporter-g2xm9\" (UID: \"6d20a32e-98a1-415f-9e47-901630a17e9c\") " pod="openshift-monitoring/node-exporter-g2xm9"
Sep 11 11:35:22.870637 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:22.870547    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6d20a32e-98a1-415f-9e47-901630a17e9c-root\") pod \"node-exporter-g2xm9\" (UID: \"6d20a32e-98a1-415f-9e47-901630a17e9c\") " pod="openshift-monitoring/node-exporter-g2xm9"
Sep 11 11:35:22.870637 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:22.870588    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6d20a32e-98a1-415f-9e47-901630a17e9c-node-exporter-textfile\") pod \"node-exporter-g2xm9\" (UID: \"6d20a32e-98a1-415f-9e47-901630a17e9c\") " pod="openshift-monitoring/node-exporter-g2xm9"
Sep 11 11:35:22.870637 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:22.870613    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6d20a32e-98a1-415f-9e47-901630a17e9c-node-exporter-tls\") pod \"node-exporter-g2xm9\" (UID: \"6d20a32e-98a1-415f-9e47-901630a17e9c\") " pod="openshift-monitoring/node-exporter-g2xm9"
Sep 11 11:35:22.870778 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:22.870667    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d20a32e-98a1-415f-9e47-901630a17e9c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g2xm9\" (UID: \"6d20a32e-98a1-415f-9e47-901630a17e9c\") " pod="openshift-monitoring/node-exporter-g2xm9"
Sep 11 11:35:22.870778 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:22.870686    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjhl5\" (UniqueName: \"kubernetes.io/projected/6d20a32e-98a1-415f-9e47-901630a17e9c-kube-api-access-vjhl5\") pod \"node-exporter-g2xm9\" (UID: \"6d20a32e-98a1-415f-9e47-901630a17e9c\") " pod="openshift-monitoring/node-exporter-g2xm9"
Sep 11 11:35:22.870778 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:22.870726    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6d20a32e-98a1-415f-9e47-901630a17e9c-node-exporter-wtmp\") pod \"node-exporter-g2xm9\" (UID: \"6d20a32e-98a1-415f-9e47-901630a17e9c\") " pod="openshift-monitoring/node-exporter-g2xm9"
Sep 11 11:35:22.971786 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:22.971748    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d20a32e-98a1-415f-9e47-901630a17e9c-metrics-client-ca\") pod \"node-exporter-g2xm9\" (UID: \"6d20a32e-98a1-415f-9e47-901630a17e9c\") " pod="openshift-monitoring/node-exporter-g2xm9"
Sep 11 11:35:22.971786 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:22.971801    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6d20a32e-98a1-415f-9e47-901630a17e9c-root\") pod \"node-exporter-g2xm9\" (UID: \"6d20a32e-98a1-415f-9e47-901630a17e9c\") " pod="openshift-monitoring/node-exporter-g2xm9"
Sep 11 11:35:22.972041 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:22.971821    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6d20a32e-98a1-415f-9e47-901630a17e9c-node-exporter-textfile\") pod \"node-exporter-g2xm9\" (UID: \"6d20a32e-98a1-415f-9e47-901630a17e9c\") " pod="openshift-monitoring/node-exporter-g2xm9"
Sep 11 11:35:22.972041 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:22.971838    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6d20a32e-98a1-415f-9e47-901630a17e9c-node-exporter-tls\") pod \"node-exporter-g2xm9\" (UID: \"6d20a32e-98a1-415f-9e47-901630a17e9c\") " pod="openshift-monitoring/node-exporter-g2xm9"
Sep 11 11:35:22.972041 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:22.971860    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d20a32e-98a1-415f-9e47-901630a17e9c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g2xm9\" (UID: \"6d20a32e-98a1-415f-9e47-901630a17e9c\") " pod="openshift-monitoring/node-exporter-g2xm9"
Sep 11 11:35:22.972041 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:22.971887    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjhl5\" (UniqueName: \"kubernetes.io/projected/6d20a32e-98a1-415f-9e47-901630a17e9c-kube-api-access-vjhl5\") pod \"node-exporter-g2xm9\" (UID: \"6d20a32e-98a1-415f-9e47-901630a17e9c\") " pod="openshift-monitoring/node-exporter-g2xm9"
Sep 11 11:35:22.972041 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:22.971888    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6d20a32e-98a1-415f-9e47-901630a17e9c-root\") pod \"node-exporter-g2xm9\" (UID: \"6d20a32e-98a1-415f-9e47-901630a17e9c\") " pod="openshift-monitoring/node-exporter-g2xm9"
Sep 11 11:35:22.972041 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:22.971918    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6d20a32e-98a1-415f-9e47-901630a17e9c-node-exporter-wtmp\") pod \"node-exporter-g2xm9\" (UID: \"6d20a32e-98a1-415f-9e47-901630a17e9c\") " pod="openshift-monitoring/node-exporter-g2xm9"
Sep 11 11:35:22.972041 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:22.971962    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6d20a32e-98a1-415f-9e47-901630a17e9c-sys\") pod \"node-exporter-g2xm9\" (UID: \"6d20a32e-98a1-415f-9e47-901630a17e9c\") " pod="openshift-monitoring/node-exporter-g2xm9"
Sep 11 11:35:22.972041 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:35:22.971968    2560 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 11 11:35:22.972041 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:22.971986    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6d20a32e-98a1-415f-9e47-901630a17e9c-node-exporter-accelerators-collector-config\") pod \"node-exporter-g2xm9\" (UID: \"6d20a32e-98a1-415f-9e47-901630a17e9c\") " pod="openshift-monitoring/node-exporter-g2xm9"
Sep 11 11:35:22.972041 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:35:22.972034    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d20a32e-98a1-415f-9e47-901630a17e9c-node-exporter-tls podName:6d20a32e-98a1-415f-9e47-901630a17e9c nodeName:}" failed. No retries permitted until 2026-09-11 11:35:23.472012224 +0000 UTC m=+74.294472096 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/6d20a32e-98a1-415f-9e47-901630a17e9c-node-exporter-tls") pod "node-exporter-g2xm9" (UID: "6d20a32e-98a1-415f-9e47-901630a17e9c") : secret "node-exporter-tls" not found
Sep 11 11:35:22.972507 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:22.972271    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6d20a32e-98a1-415f-9e47-901630a17e9c-node-exporter-wtmp\") pod \"node-exporter-g2xm9\" (UID: \"6d20a32e-98a1-415f-9e47-901630a17e9c\") " pod="openshift-monitoring/node-exporter-g2xm9"
Sep 11 11:35:22.972507 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:22.972310    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6d20a32e-98a1-415f-9e47-901630a17e9c-node-exporter-textfile\") pod \"node-exporter-g2xm9\" (UID: \"6d20a32e-98a1-415f-9e47-901630a17e9c\") " pod="openshift-monitoring/node-exporter-g2xm9"
Sep 11 11:35:22.972507 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:22.972342    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6d20a32e-98a1-415f-9e47-901630a17e9c-sys\") pod \"node-exporter-g2xm9\" (UID: \"6d20a32e-98a1-415f-9e47-901630a17e9c\") " pod="openshift-monitoring/node-exporter-g2xm9"
Sep 11 11:35:22.972507 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:22.972478    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d20a32e-98a1-415f-9e47-901630a17e9c-metrics-client-ca\") pod \"node-exporter-g2xm9\" (UID: \"6d20a32e-98a1-415f-9e47-901630a17e9c\") " pod="openshift-monitoring/node-exporter-g2xm9"
Sep 11 11:35:22.972774 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:22.972754    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6d20a32e-98a1-415f-9e47-901630a17e9c-node-exporter-accelerators-collector-config\") pod \"node-exporter-g2xm9\" (UID: \"6d20a32e-98a1-415f-9e47-901630a17e9c\") " pod="openshift-monitoring/node-exporter-g2xm9"
Sep 11 11:35:22.974333 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:22.974310    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d20a32e-98a1-415f-9e47-901630a17e9c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g2xm9\" (UID: \"6d20a32e-98a1-415f-9e47-901630a17e9c\") " pod="openshift-monitoring/node-exporter-g2xm9"
Sep 11 11:35:23.005908 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:23.005879    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjhl5\" (UniqueName: \"kubernetes.io/projected/6d20a32e-98a1-415f-9e47-901630a17e9c-kube-api-access-vjhl5\") pod \"node-exporter-g2xm9\" (UID: \"6d20a32e-98a1-415f-9e47-901630a17e9c\") " pod="openshift-monitoring/node-exporter-g2xm9"
Sep 11 11:35:23.476345 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:23.476308    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6d20a32e-98a1-415f-9e47-901630a17e9c-node-exporter-tls\") pod \"node-exporter-g2xm9\" (UID: \"6d20a32e-98a1-415f-9e47-901630a17e9c\") " pod="openshift-monitoring/node-exporter-g2xm9"
Sep 11 11:35:23.478802 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:23.478781    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6d20a32e-98a1-415f-9e47-901630a17e9c-node-exporter-tls\") pod \"node-exporter-g2xm9\" (UID: \"6d20a32e-98a1-415f-9e47-901630a17e9c\") " pod="openshift-monitoring/node-exporter-g2xm9"
Sep 11 11:35:23.702293 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:23.702249    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-g2xm9"
Sep 11 11:35:23.714106 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:35:23.714077    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d20a32e_98a1_415f_9e47_901630a17e9c.slice/crio-0040e8722a1b5d45cd78469e62c7104cd4d3696983964c42d6268af29d87aeea WatchSource:0}: Error finding container 0040e8722a1b5d45cd78469e62c7104cd4d3696983964c42d6268af29d87aeea: Status 404 returned error can't find the container with id 0040e8722a1b5d45cd78469e62c7104cd4d3696983964c42d6268af29d87aeea
Sep 11 11:35:24.270798 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:24.270754    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g2xm9" event={"ID":"6d20a32e-98a1-415f-9e47-901630a17e9c","Type":"ContainerStarted","Data":"0040e8722a1b5d45cd78469e62c7104cd4d3696983964c42d6268af29d87aeea"}
Sep 11 11:35:25.275475 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:25.275437    2560 generic.go:356] "Generic (PLEG): container finished" podID="6d20a32e-98a1-415f-9e47-901630a17e9c" containerID="2c41f1c18fa3477fdd116d17187ba9d0115f58a15d28abe64fa709a08ce709f7" exitCode=0
Sep 11 11:35:25.275856 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:25.275519    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g2xm9" event={"ID":"6d20a32e-98a1-415f-9e47-901630a17e9c","Type":"ContainerDied","Data":"2c41f1c18fa3477fdd116d17187ba9d0115f58a15d28abe64fa709a08ce709f7"}
Sep 11 11:35:26.281218 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:26.281181    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g2xm9" event={"ID":"6d20a32e-98a1-415f-9e47-901630a17e9c","Type":"ContainerStarted","Data":"7ae5bbf2b3e05015fe5a83017b83d8cffe5231e0ac543df83727714f3c5af120"}
Sep 11 11:35:26.281581 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:26.281239    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g2xm9" event={"ID":"6d20a32e-98a1-415f-9e47-901630a17e9c","Type":"ContainerStarted","Data":"e65a23e95e1fa2ab387698a085b1df724ec38a9abda6656c19cbac8590226404"}
Sep 11 11:35:26.304077 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:26.304027    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-g2xm9" podStartSLOduration=3.336999706 podStartE2EDuration="4.304011066s" totalImagesPullingTime="905.736599ms" totalInitContainerRuntime="61.274761ms" isStatefulPod=true podCreationTimestamp="2026-09-11 11:35:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:35:26.30249936 +0000 UTC m=+77.124959253" watchObservedRunningTime="2026-09-11 11:35:26.304011066 +0000 UTC m=+77.126470939"
Sep 11 11:35:28.288409 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:28.288384    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-84c7bcd7f9-fs264"
Sep 11 11:35:30.195551 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:30.195516    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-bbd5d68d4-ht82m"
Sep 11 11:35:33.302631 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:33.302503    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-84c7bcd7f9-fs264" podUID="1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2" containerName="registry" containerID="cri-o://481c719a92f9964ea6e2835db4f9e9e9f04774b62b4c2779126224c76a68b619" gracePeriod=30
Sep 11 11:35:33.544211 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:33.544175    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84c7bcd7f9-fs264"
Sep 11 11:35:33.653139 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:33.653043    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-installation-pull-secrets\") pod \"1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2\" (UID: \"1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2\") "
Sep 11 11:35:33.653139 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:33.653087    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-image-registry-private-configuration\") pod \"1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2\" (UID: \"1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2\") "
Sep 11 11:35:33.653139 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:33.653127    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-bound-sa-token\") pod \"1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2\" (UID: \"1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2\") "
Sep 11 11:35:33.653477 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:33.653154    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jd5zm\" (UniqueName: \"kubernetes.io/projected/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-kube-api-access-jd5zm\") pod \"1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2\" (UID: \"1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2\") "
Sep 11 11:35:33.653477 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:33.653184    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-trusted-ca\") pod \"1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2\" (UID: \"1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2\") "
Sep 11 11:35:33.653477 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:33.653225    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-registry-tls\") pod \"1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2\" (UID: \"1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2\") "
Sep 11 11:35:33.653477 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:33.653251    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-ca-trust-extracted\") pod \"1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2\" (UID: \"1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2\") "
Sep 11 11:35:33.653477 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:33.653301    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-registry-certificates\") pod \"1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2\" (UID: \"1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2\") "
Sep 11 11:35:33.654118 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:33.653637    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2" (UID: "1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 11:35:33.654118 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:33.653944    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2" (UID: "1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 11:35:33.656129 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:33.656095    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2" (UID: "1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 11:35:33.656246 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:33.656133    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2" (UID: "1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:35:33.656246 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:33.656226    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2" (UID: "1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:35:33.656353 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:33.656295    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-kube-api-access-jd5zm" (OuterVolumeSpecName: "kube-api-access-jd5zm") pod "1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2" (UID: "1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2"). InnerVolumeSpecName "kube-api-access-jd5zm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:35:33.656411 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:33.656389    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2" (UID: "1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 11:35:33.661798 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:33.661772    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2" (UID: "1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:35:33.754726 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:33.754689    2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-installation-pull-secrets\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:35:33.754726 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:33.754721    2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-image-registry-private-configuration\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:35:33.754726 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:33.754732    2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-bound-sa-token\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:35:33.754924 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:33.754742    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jd5zm\" (UniqueName: \"kubernetes.io/projected/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-kube-api-access-jd5zm\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:35:33.754924 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:33.754751    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-trusted-ca\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:35:33.754924 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:33.754758    2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-registry-tls\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:35:33.754924 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:33.754767    2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-ca-trust-extracted\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:35:33.754924 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:33.754775    2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2-registry-certificates\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:35:34.310104 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:34.310069    2560 generic.go:356] "Generic (PLEG): container finished" podID="1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2" containerID="481c719a92f9964ea6e2835db4f9e9e9f04774b62b4c2779126224c76a68b619" exitCode=0
Sep 11 11:35:34.310536 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:34.310115    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-84c7bcd7f9-fs264" event={"ID":"1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2","Type":"ContainerDied","Data":"481c719a92f9964ea6e2835db4f9e9e9f04774b62b4c2779126224c76a68b619"}
Sep 11 11:35:34.310536 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:34.310119    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84c7bcd7f9-fs264"
Sep 11 11:35:34.310536 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:34.310152    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-84c7bcd7f9-fs264" event={"ID":"1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2","Type":"ContainerDied","Data":"2a0fac1f8dc930b2a559845bebe53cc859d40f0aa1f41f310806834daa7f1b4c"}
Sep 11 11:35:34.310536 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:34.310173    2560 scope.go:117] "RemoveContainer" containerID="481c719a92f9964ea6e2835db4f9e9e9f04774b62b4c2779126224c76a68b619"
Sep 11 11:35:34.318523 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:34.318501    2560 scope.go:117] "RemoveContainer" containerID="481c719a92f9964ea6e2835db4f9e9e9f04774b62b4c2779126224c76a68b619"
Sep 11 11:35:34.318803 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:35:34.318784    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"481c719a92f9964ea6e2835db4f9e9e9f04774b62b4c2779126224c76a68b619\": container with ID starting with 481c719a92f9964ea6e2835db4f9e9e9f04774b62b4c2779126224c76a68b619 not found: ID does not exist" containerID="481c719a92f9964ea6e2835db4f9e9e9f04774b62b4c2779126224c76a68b619"
Sep 11 11:35:34.318855 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:34.318812    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"481c719a92f9964ea6e2835db4f9e9e9f04774b62b4c2779126224c76a68b619"} err="failed to get container status \"481c719a92f9964ea6e2835db4f9e9e9f04774b62b4c2779126224c76a68b619\": rpc error: code = NotFound desc = could not find container \"481c719a92f9964ea6e2835db4f9e9e9f04774b62b4c2779126224c76a68b619\": container with ID starting with 481c719a92f9964ea6e2835db4f9e9e9f04774b62b4c2779126224c76a68b619 not found: ID does not exist"
Sep 11 11:35:34.332034 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:34.332004    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-84c7bcd7f9-fs264"]
Sep 11 11:35:34.338778 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:34.338755    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-84c7bcd7f9-fs264"]
Sep 11 11:35:35.812454 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:35.812418    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2" path="/var/lib/kubelet/pods/1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2/volumes"
Sep 11 11:35:52.264120 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:35:52.264084    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5g8rf"
Sep 11 11:39:09.687443 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:39:09.687365    2560 kubelet.go:1648] "Image garbage collection succeeded"
Sep 11 11:39:40.010997 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:39:40.010956    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86f769d976-pkrjx"]
Sep 11 11:39:40.012447 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:39:40.011285    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2" containerName="registry"
Sep 11 11:39:40.012447 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:39:40.011303    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2" containerName="registry"
Sep 11 11:39:40.012447 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:39:40.011387    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b2c1aa9-0f50-4cfe-9e7a-40d74af056a2" containerName="registry"
Sep 11 11:39:40.013087 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:39:40.013035    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86f769d976-pkrjx"
Sep 11 11:39:40.016197 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:39:40.016152    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 11 11:39:40.016331 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:39:40.016218    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jxm97\""
Sep 11 11:39:40.016331 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:39:40.016271    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 11 11:39:40.016453 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:39:40.016442    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 11 11:39:40.016703 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:39:40.016687    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 11 11:39:40.038098 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:39:40.038063    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86f769d976-pkrjx"]
Sep 11 11:39:40.164930 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:39:40.164889    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/587f6a18-b839-4755-be10-c7526e719b7d-manifests\") pod \"opendatahub-operator-controller-manager-86f769d976-pkrjx\" (UID: \"587f6a18-b839-4755-be10-c7526e719b7d\") " pod="opendatahub/opendatahub-operator-controller-manager-86f769d976-pkrjx"
Sep 11 11:39:40.165098 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:39:40.164941    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/587f6a18-b839-4755-be10-c7526e719b7d-tmp\") pod \"opendatahub-operator-controller-manager-86f769d976-pkrjx\" (UID: \"587f6a18-b839-4755-be10-c7526e719b7d\") " pod="opendatahub/opendatahub-operator-controller-manager-86f769d976-pkrjx"
Sep 11 11:39:40.165098 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:39:40.164972    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/587f6a18-b839-4755-be10-c7526e719b7d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86f769d976-pkrjx\" (UID: \"587f6a18-b839-4755-be10-c7526e719b7d\") " pod="opendatahub/opendatahub-operator-controller-manager-86f769d976-pkrjx"
Sep 11 11:39:40.165098 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:39:40.165041    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jhkb\" (UniqueName: \"kubernetes.io/projected/587f6a18-b839-4755-be10-c7526e719b7d-kube-api-access-7jhkb\") pod \"opendatahub-operator-controller-manager-86f769d976-pkrjx\" (UID: \"587f6a18-b839-4755-be10-c7526e719b7d\") " pod="opendatahub/opendatahub-operator-controller-manager-86f769d976-pkrjx"
Sep 11 11:39:40.165098 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:39:40.165064    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/587f6a18-b839-4755-be10-c7526e719b7d-webhook-cert\") pod \"opendatahub-operator-controller-manager-86f769d976-pkrjx\" (UID: \"587f6a18-b839-4755-be10-c7526e719b7d\") " pod="opendatahub/opendatahub-operator-controller-manager-86f769d976-pkrjx"
Sep 11 11:39:40.265797 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:39:40.265699    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/587f6a18-b839-4755-be10-c7526e719b7d-tmp\") pod \"opendatahub-operator-controller-manager-86f769d976-pkrjx\" (UID: \"587f6a18-b839-4755-be10-c7526e719b7d\") " pod="opendatahub/opendatahub-operator-controller-manager-86f769d976-pkrjx"
Sep 11 11:39:40.265797 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:39:40.265742    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/587f6a18-b839-4755-be10-c7526e719b7d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86f769d976-pkrjx\" (UID: \"587f6a18-b839-4755-be10-c7526e719b7d\") " pod="opendatahub/opendatahub-operator-controller-manager-86f769d976-pkrjx"
Sep 11 11:39:40.265984 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:39:40.265870    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jhkb\" (UniqueName: \"kubernetes.io/projected/587f6a18-b839-4755-be10-c7526e719b7d-kube-api-access-7jhkb\") pod \"opendatahub-operator-controller-manager-86f769d976-pkrjx\" (UID: \"587f6a18-b839-4755-be10-c7526e719b7d\") " pod="opendatahub/opendatahub-operator-controller-manager-86f769d976-pkrjx"
Sep 11 11:39:40.265984 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:39:40.265915    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/587f6a18-b839-4755-be10-c7526e719b7d-webhook-cert\") pod \"opendatahub-operator-controller-manager-86f769d976-pkrjx\" (UID: \"587f6a18-b839-4755-be10-c7526e719b7d\") " pod="opendatahub/opendatahub-operator-controller-manager-86f769d976-pkrjx"
Sep 11 11:39:40.266091 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:39:40.265988    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/587f6a18-b839-4755-be10-c7526e719b7d-manifests\") pod \"opendatahub-operator-controller-manager-86f769d976-pkrjx\" (UID: \"587f6a18-b839-4755-be10-c7526e719b7d\") " pod="opendatahub/opendatahub-operator-controller-manager-86f769d976-pkrjx"
Sep 11 11:39:40.266330 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:39:40.266305    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/587f6a18-b839-4755-be10-c7526e719b7d-manifests\") pod \"opendatahub-operator-controller-manager-86f769d976-pkrjx\" (UID: \"587f6a18-b839-4755-be10-c7526e719b7d\") " pod="opendatahub/opendatahub-operator-controller-manager-86f769d976-pkrjx"
Sep 11 11:39:40.267992 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:39:40.267970    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/587f6a18-b839-4755-be10-c7526e719b7d-tmp\") pod \"opendatahub-operator-controller-manager-86f769d976-pkrjx\" (UID: \"587f6a18-b839-4755-be10-c7526e719b7d\") " pod="opendatahub/opendatahub-operator-controller-manager-86f769d976-pkrjx"
Sep 11 11:39:40.268256 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:39:40.268238    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/587f6a18-b839-4755-be10-c7526e719b7d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86f769d976-pkrjx\" (UID: \"587f6a18-b839-4755-be10-c7526e719b7d\") " pod="opendatahub/opendatahub-operator-controller-manager-86f769d976-pkrjx"
Sep 11 11:39:40.268329 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:39:40.268291    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/587f6a18-b839-4755-be10-c7526e719b7d-webhook-cert\") pod \"opendatahub-operator-controller-manager-86f769d976-pkrjx\" (UID: \"587f6a18-b839-4755-be10-c7526e719b7d\") " pod="opendatahub/opendatahub-operator-controller-manager-86f769d976-pkrjx"
Sep 11 11:39:40.283325 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:39:40.283297    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jhkb\" (UniqueName: \"kubernetes.io/projected/587f6a18-b839-4755-be10-c7526e719b7d-kube-api-access-7jhkb\") pod \"opendatahub-operator-controller-manager-86f769d976-pkrjx\" (UID: \"587f6a18-b839-4755-be10-c7526e719b7d\") " pod="opendatahub/opendatahub-operator-controller-manager-86f769d976-pkrjx"
Sep 11 11:39:40.323350 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:39:40.323316    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86f769d976-pkrjx"
Sep 11 11:39:40.600543 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:39:40.600517    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86f769d976-pkrjx"]
Sep 11 11:39:40.602746 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:39:40.602720    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod587f6a18_b839_4755_be10_c7526e719b7d.slice/crio-6e9aa625f65f95695743a3916a4807bfaa892a4705ddec4b85c42987641ae328 WatchSource:0}: Error finding container 6e9aa625f65f95695743a3916a4807bfaa892a4705ddec4b85c42987641ae328: Status 404 returned error can't find the container with id 6e9aa625f65f95695743a3916a4807bfaa892a4705ddec4b85c42987641ae328
Sep 11 11:39:40.604452 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:39:40.604436    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 11:39:41.102067 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:39:41.101955    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86f769d976-pkrjx" event={"ID":"587f6a18-b839-4755-be10-c7526e719b7d","Type":"ContainerStarted","Data":"6e9aa625f65f95695743a3916a4807bfaa892a4705ddec4b85c42987641ae328"}
Sep 11 11:39:44.115789 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:39:44.115746    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86f769d976-pkrjx" event={"ID":"587f6a18-b839-4755-be10-c7526e719b7d","Type":"ContainerStarted","Data":"af389e96c26a02637bf92d83af8615443e2be446e8026ae8303c80b4a02fe87b"}
Sep 11 11:39:45.121181 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:39:45.121145    2560 generic.go:356] "Generic (PLEG): container finished" podID="587f6a18-b839-4755-be10-c7526e719b7d" containerID="af389e96c26a02637bf92d83af8615443e2be446e8026ae8303c80b4a02fe87b" exitCode=0
Sep 11 11:39:45.121545 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:39:45.121193    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86f769d976-pkrjx" event={"ID":"587f6a18-b839-4755-be10-c7526e719b7d","Type":"ContainerDied","Data":"af389e96c26a02637bf92d83af8615443e2be446e8026ae8303c80b4a02fe87b"}
Sep 11 11:39:46.126189 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:39:46.126151    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86f769d976-pkrjx" event={"ID":"587f6a18-b839-4755-be10-c7526e719b7d","Type":"ContainerStarted","Data":"b8a7fd380359eade706c86bd47421c1eabdc2e01e6dde178209a4d6d60acad7d"}
Sep 11 11:39:46.126556 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:39:46.126304    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-86f769d976-pkrjx"
Sep 11 11:39:46.148115 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:39:46.148002    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-86f769d976-pkrjx" podStartSLOduration=2.788065403 podStartE2EDuration="7.147980757s" totalImagesPullingTime="3.269342668s" totalInitContainerRuntime="1.090572686s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:39:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:39:46.146935846 +0000 UTC m=+336.969395740" watchObservedRunningTime="2026-09-11 11:39:46.147980757 +0000 UTC m=+336.970440631"
Sep 11 11:39:57.131704 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:39:57.131669    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-86f769d976-pkrjx"
Sep 11 11:40:00.766967 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:00.766927    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-797c7d88fd-gm7jh"]
Sep 11 11:40:00.779580 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:00.779544    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-797c7d88fd-gm7jh"
Sep 11 11:40:00.782260 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:00.782235    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 11 11:40:00.782392 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:00.782312    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 11 11:40:00.783055 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:00.783031    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 11 11:40:00.783158 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:00.783059    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 11 11:40:00.792988 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:00.792961    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-797c7d88fd-gm7jh"]
Sep 11 11:40:00.918116 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:00.918085    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/988113db-47a5-464d-8092-03ca36bff4df-tls-certs\") pod \"kube-auth-proxy-797c7d88fd-gm7jh\" (UID: \"988113db-47a5-464d-8092-03ca36bff4df\") " pod="openshift-ingress/kube-auth-proxy-797c7d88fd-gm7jh"
Sep 11 11:40:00.918257 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:00.918123    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/988113db-47a5-464d-8092-03ca36bff4df-tmp\") pod \"kube-auth-proxy-797c7d88fd-gm7jh\" (UID: \"988113db-47a5-464d-8092-03ca36bff4df\") " pod="openshift-ingress/kube-auth-proxy-797c7d88fd-gm7jh"
Sep 11 11:40:00.918257 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:00.918153    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxhbw\" (UniqueName: \"kubernetes.io/projected/988113db-47a5-464d-8092-03ca36bff4df-kube-api-access-gxhbw\") pod \"kube-auth-proxy-797c7d88fd-gm7jh\" (UID: \"988113db-47a5-464d-8092-03ca36bff4df\") " pod="openshift-ingress/kube-auth-proxy-797c7d88fd-gm7jh"
Sep 11 11:40:01.019767 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:01.019005    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/988113db-47a5-464d-8092-03ca36bff4df-tmp\") pod \"kube-auth-proxy-797c7d88fd-gm7jh\" (UID: \"988113db-47a5-464d-8092-03ca36bff4df\") " pod="openshift-ingress/kube-auth-proxy-797c7d88fd-gm7jh"
Sep 11 11:40:01.019767 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:01.019087    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxhbw\" (UniqueName: \"kubernetes.io/projected/988113db-47a5-464d-8092-03ca36bff4df-kube-api-access-gxhbw\") pod \"kube-auth-proxy-797c7d88fd-gm7jh\" (UID: \"988113db-47a5-464d-8092-03ca36bff4df\") " pod="openshift-ingress/kube-auth-proxy-797c7d88fd-gm7jh"
Sep 11 11:40:01.019767 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:01.019157    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/988113db-47a5-464d-8092-03ca36bff4df-tls-certs\") pod \"kube-auth-proxy-797c7d88fd-gm7jh\" (UID: \"988113db-47a5-464d-8092-03ca36bff4df\") " pod="openshift-ingress/kube-auth-proxy-797c7d88fd-gm7jh"
Sep 11 11:40:01.023013 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:01.022670    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/988113db-47a5-464d-8092-03ca36bff4df-tls-certs\") pod \"kube-auth-proxy-797c7d88fd-gm7jh\" (UID: \"988113db-47a5-464d-8092-03ca36bff4df\") " pod="openshift-ingress/kube-auth-proxy-797c7d88fd-gm7jh"
Sep 11 11:40:01.024871 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:01.024843    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/988113db-47a5-464d-8092-03ca36bff4df-tmp\") pod \"kube-auth-proxy-797c7d88fd-gm7jh\" (UID: \"988113db-47a5-464d-8092-03ca36bff4df\") " pod="openshift-ingress/kube-auth-proxy-797c7d88fd-gm7jh"
Sep 11 11:40:01.043246 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:01.043226    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxhbw\" (UniqueName: \"kubernetes.io/projected/988113db-47a5-464d-8092-03ca36bff4df-kube-api-access-gxhbw\") pod \"kube-auth-proxy-797c7d88fd-gm7jh\" (UID: \"988113db-47a5-464d-8092-03ca36bff4df\") " pod="openshift-ingress/kube-auth-proxy-797c7d88fd-gm7jh"
Sep 11 11:40:01.089270 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:01.089238    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-797c7d88fd-gm7jh"
Sep 11 11:40:01.366663 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:01.366566    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-797c7d88fd-gm7jh"]
Sep 11 11:40:01.369676 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:40:01.369629    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod988113db_47a5_464d_8092_03ca36bff4df.slice/crio-4439aea92628b8d317b1cf81a591da374a25e18aabf2f61d79fb19f4a19e9541 WatchSource:0}: Error finding container 4439aea92628b8d317b1cf81a591da374a25e18aabf2f61d79fb19f4a19e9541: Status 404 returned error can't find the container with id 4439aea92628b8d317b1cf81a591da374a25e18aabf2f61d79fb19f4a19e9541
Sep 11 11:40:02.181358 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:02.181285    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-797c7d88fd-gm7jh" event={"ID":"988113db-47a5-464d-8092-03ca36bff4df","Type":"ContainerStarted","Data":"4439aea92628b8d317b1cf81a591da374a25e18aabf2f61d79fb19f4a19e9541"}
Sep 11 11:40:02.357121 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:02.357090    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8wgqs"]
Sep 11 11:40:02.360265 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:02.360239    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8wgqs"
Sep 11 11:40:02.362955 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:02.362929    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 11 11:40:02.363083 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:02.362959    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 11 11:40:02.363083 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:02.362987    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 11 11:40:02.363083 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:02.363028    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-tmhbh\""
Sep 11 11:40:02.363242 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:02.363133    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 11 11:40:02.381219 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:02.381121    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8wgqs"]
Sep 11 11:40:02.532805 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:02.532671    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tsnn\" (UniqueName: \"kubernetes.io/projected/cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b-kube-api-access-9tsnn\") pod \"istiod-openshift-gateway-7b7995d5cd-8wgqs\" (UID: \"cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8wgqs"
Sep 11 11:40:02.532805 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:02.532724    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-8wgqs\" (UID: \"cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8wgqs"
Sep 11 11:40:02.532805 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:02.532791    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-8wgqs\" (UID: \"cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8wgqs"
Sep 11 11:40:02.533078 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:02.532820    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-8wgqs\" (UID: \"cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8wgqs"
Sep 11 11:40:02.533078 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:02.532894    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-8wgqs\" (UID: \"cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8wgqs"
Sep 11 11:40:02.533078 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:02.532936    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-8wgqs\" (UID: \"cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8wgqs"
Sep 11 11:40:02.533078 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:02.532975    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-8wgqs\" (UID: \"cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8wgqs"
Sep 11 11:40:02.634038 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:02.633484    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-8wgqs\" (UID: \"cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8wgqs"
Sep 11 11:40:02.634038 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:02.633532    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-8wgqs\" (UID: \"cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8wgqs"
Sep 11 11:40:02.634038 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:02.633700    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-8wgqs\" (UID: \"cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8wgqs"
Sep 11 11:40:02.634038 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:02.633735    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-8wgqs\" (UID: \"cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8wgqs"
Sep 11 11:40:02.634038 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:02.633777    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-8wgqs\" (UID: \"cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8wgqs"
Sep 11 11:40:02.634038 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:02.633823    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tsnn\" (UniqueName: \"kubernetes.io/projected/cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b-kube-api-access-9tsnn\") pod \"istiod-openshift-gateway-7b7995d5cd-8wgqs\" (UID: \"cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8wgqs"
Sep 11 11:40:02.634038 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:02.633855    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-8wgqs\" (UID: \"cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8wgqs"
Sep 11 11:40:02.634750 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:02.634723    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-8wgqs\" (UID: \"cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8wgqs"
Sep 11 11:40:02.639453 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:02.639423    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-8wgqs\" (UID: \"cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8wgqs"
Sep 11 11:40:02.642590 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:02.642551    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-8wgqs\" (UID: \"cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8wgqs"
Sep 11 11:40:02.642987 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:02.642962    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-8wgqs\" (UID: \"cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8wgqs"
Sep 11 11:40:02.643260 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:02.643173    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tsnn\" (UniqueName: \"kubernetes.io/projected/cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b-kube-api-access-9tsnn\") pod \"istiod-openshift-gateway-7b7995d5cd-8wgqs\" (UID: \"cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8wgqs"
Sep 11 11:40:02.643664 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:02.643361    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-8wgqs\" (UID: \"cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8wgqs"
Sep 11 11:40:02.643836 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:02.643776    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-8wgqs\" (UID: \"cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8wgqs"
Sep 11 11:40:02.671676 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:02.671631    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8wgqs"
Sep 11 11:40:02.966445 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:02.966377    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8wgqs"]
Sep 11 11:40:02.969966 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:40:02.969938    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd46d6e0_9e52_49a4_a4b7_3f02d70ec36b.slice/crio-3bfc2e8eecf517c4f48f4fed7816f72650a4fb0b7c7b71228bfc0f5c5c39048a WatchSource:0}: Error finding container 3bfc2e8eecf517c4f48f4fed7816f72650a4fb0b7c7b71228bfc0f5c5c39048a: Status 404 returned error can't find the container with id 3bfc2e8eecf517c4f48f4fed7816f72650a4fb0b7c7b71228bfc0f5c5c39048a
Sep 11 11:40:03.187820 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:03.187771    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8wgqs" event={"ID":"cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b","Type":"ContainerStarted","Data":"3bfc2e8eecf517c4f48f4fed7816f72650a4fb0b7c7b71228bfc0f5c5c39048a"}
Sep 11 11:40:05.196611 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:05.196573    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-797c7d88fd-gm7jh" event={"ID":"988113db-47a5-464d-8092-03ca36bff4df","Type":"ContainerStarted","Data":"755ed7911745c351e430d5343a3e0fbc27a29093c8ef9850bfee9ce61e3ca4e1"}
Sep 11 11:40:05.211835 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:05.211780    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-797c7d88fd-gm7jh" podStartSLOduration=2.09223164 podStartE2EDuration="5.211756633s" totalImagesPullingTime="3.119524993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:40:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:40:05.2108187 +0000 UTC m=+356.033278583" watchObservedRunningTime="2026-09-11 11:40:05.211756633 +0000 UTC m=+356.034216506"
Sep 11 11:40:15.044944 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:15.044902    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:40:15.045256 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:15.044971    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:40:15.240555 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:15.240505    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8wgqs" event={"ID":"cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b","Type":"ContainerStarted","Data":"e9c5f76b2f3390a36ff2e7c036df2c8a3f1561ab82ccdf25504267a6ff92f0a8"}
Sep 11 11:40:15.240767 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:15.240631    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8wgqs"
Sep 11 11:40:15.271091 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:15.271029    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8wgqs" podStartSLOduration=1.198737389 podStartE2EDuration="13.271008298s" totalImagesPullingTime="12.072270909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:40:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:40:15.269688761 +0000 UTC m=+366.092148652" watchObservedRunningTime="2026-09-11 11:40:15.271008298 +0000 UTC m=+366.093468174"
Sep 11 11:40:16.247987 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:16.247941    2560 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-8wgqs container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 11:40:16.248562 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:16.248016    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8wgqs" podUID="cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 11:40:19.047004 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:19.046966    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-88gpc"]
Sep 11 11:40:19.050197 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:19.050169    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-88gpc"
Sep 11 11:40:19.084635 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:19.084609    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-88gpc"]
Sep 11 11:40:19.153296 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:19.153247    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e9071bd-3735-4e97-8e97-7e76ea0f5b8f-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-88gpc\" (UID: \"6e9071bd-3735-4e97-8e97-7e76ea0f5b8f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-88gpc"
Sep 11 11:40:19.153471 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:19.153315    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6e9071bd-3735-4e97-8e97-7e76ea0f5b8f-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-88gpc\" (UID: \"6e9071bd-3735-4e97-8e97-7e76ea0f5b8f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-88gpc"
Sep 11 11:40:19.153471 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:19.153352    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e9071bd-3735-4e97-8e97-7e76ea0f5b8f-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-88gpc\" (UID: \"6e9071bd-3735-4e97-8e97-7e76ea0f5b8f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-88gpc"
Sep 11 11:40:19.153471 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:19.153380    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6e9071bd-3735-4e97-8e97-7e76ea0f5b8f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-88gpc\" (UID: \"6e9071bd-3735-4e97-8e97-7e76ea0f5b8f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-88gpc"
Sep 11 11:40:19.153471 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:19.153421    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6e9071bd-3735-4e97-8e97-7e76ea0f5b8f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-88gpc\" (UID: \"6e9071bd-3735-4e97-8e97-7e76ea0f5b8f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-88gpc"
Sep 11 11:40:19.153471 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:19.153459    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f92ss\" (UniqueName: \"kubernetes.io/projected/6e9071bd-3735-4e97-8e97-7e76ea0f5b8f-kube-api-access-f92ss\") pod \"istiod-openshift-gateway-5677ccb49b-88gpc\" (UID: \"6e9071bd-3735-4e97-8e97-7e76ea0f5b8f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-88gpc"
Sep 11 11:40:19.153777 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:19.153520    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6e9071bd-3735-4e97-8e97-7e76ea0f5b8f-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-88gpc\" (UID: \"6e9071bd-3735-4e97-8e97-7e76ea0f5b8f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-88gpc"
Sep 11 11:40:19.247176 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:19.247141    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8wgqs"
Sep 11 11:40:19.254101 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:19.254078    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6e9071bd-3735-4e97-8e97-7e76ea0f5b8f-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-88gpc\" (UID: \"6e9071bd-3735-4e97-8e97-7e76ea0f5b8f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-88gpc"
Sep 11 11:40:19.254228 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:19.254116    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e9071bd-3735-4e97-8e97-7e76ea0f5b8f-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-88gpc\" (UID: \"6e9071bd-3735-4e97-8e97-7e76ea0f5b8f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-88gpc"
Sep 11 11:40:19.254228 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:19.254141    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6e9071bd-3735-4e97-8e97-7e76ea0f5b8f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-88gpc\" (UID: \"6e9071bd-3735-4e97-8e97-7e76ea0f5b8f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-88gpc"
Sep 11 11:40:19.254228 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:19.254163    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6e9071bd-3735-4e97-8e97-7e76ea0f5b8f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-88gpc\" (UID: \"6e9071bd-3735-4e97-8e97-7e76ea0f5b8f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-88gpc"
Sep 11 11:40:19.254228 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:19.254187    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f92ss\" (UniqueName: \"kubernetes.io/projected/6e9071bd-3735-4e97-8e97-7e76ea0f5b8f-kube-api-access-f92ss\") pod \"istiod-openshift-gateway-5677ccb49b-88gpc\" (UID: \"6e9071bd-3735-4e97-8e97-7e76ea0f5b8f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-88gpc"
Sep 11 11:40:19.254434 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:19.254416    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6e9071bd-3735-4e97-8e97-7e76ea0f5b8f-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-88gpc\" (UID: \"6e9071bd-3735-4e97-8e97-7e76ea0f5b8f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-88gpc"
Sep 11 11:40:19.254494 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:19.254483    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e9071bd-3735-4e97-8e97-7e76ea0f5b8f-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-88gpc\" (UID: \"6e9071bd-3735-4e97-8e97-7e76ea0f5b8f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-88gpc"
Sep 11 11:40:19.254912 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:19.254885    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6e9071bd-3735-4e97-8e97-7e76ea0f5b8f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-88gpc\" (UID: \"6e9071bd-3735-4e97-8e97-7e76ea0f5b8f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-88gpc"
Sep 11 11:40:19.256707 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:19.256662    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6e9071bd-3735-4e97-8e97-7e76ea0f5b8f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-88gpc\" (UID: \"6e9071bd-3735-4e97-8e97-7e76ea0f5b8f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-88gpc"
Sep 11 11:40:19.256834 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:19.256739    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6e9071bd-3735-4e97-8e97-7e76ea0f5b8f-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-88gpc\" (UID: \"6e9071bd-3735-4e97-8e97-7e76ea0f5b8f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-88gpc"
Sep 11 11:40:19.256898 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:19.256870    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6e9071bd-3735-4e97-8e97-7e76ea0f5b8f-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-88gpc\" (UID: \"6e9071bd-3735-4e97-8e97-7e76ea0f5b8f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-88gpc"
Sep 11 11:40:19.256898 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:19.256889    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e9071bd-3735-4e97-8e97-7e76ea0f5b8f-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-88gpc\" (UID: \"6e9071bd-3735-4e97-8e97-7e76ea0f5b8f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-88gpc"
Sep 11 11:40:19.264111 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:19.264089    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e9071bd-3735-4e97-8e97-7e76ea0f5b8f-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-88gpc\" (UID: \"6e9071bd-3735-4e97-8e97-7e76ea0f5b8f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-88gpc"
Sep 11 11:40:19.264212 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:19.264160    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f92ss\" (UniqueName: \"kubernetes.io/projected/6e9071bd-3735-4e97-8e97-7e76ea0f5b8f-kube-api-access-f92ss\") pod \"istiod-openshift-gateway-5677ccb49b-88gpc\" (UID: \"6e9071bd-3735-4e97-8e97-7e76ea0f5b8f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-88gpc"
Sep 11 11:40:19.359335 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:19.359270    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-88gpc"
Sep 11 11:40:19.655206 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:19.655181    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-88gpc"]
Sep 11 11:40:19.655968 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:40:19.655936    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e9071bd_3735_4e97_8e97_7e76ea0f5b8f.slice/crio-dadd06b475b40cc3155737f7c04b8da7a451d6b10f3b7f4d71b9ee8164b2c595 WatchSource:0}: Error finding container dadd06b475b40cc3155737f7c04b8da7a451d6b10f3b7f4d71b9ee8164b2c595: Status 404 returned error can't find the container with id dadd06b475b40cc3155737f7c04b8da7a451d6b10f3b7f4d71b9ee8164b2c595
Sep 11 11:40:19.658960 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:19.658927    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:40:19.659046 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:19.658988    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:40:20.261974 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:20.261936    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-88gpc" event={"ID":"6e9071bd-3735-4e97-8e97-7e76ea0f5b8f","Type":"ContainerStarted","Data":"fa6908fc3ccba46476d5e366469f8d8272f4fa127c04436d879c0ed6bacd0dba"}
Sep 11 11:40:20.262430 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:20.261998    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-88gpc" event={"ID":"6e9071bd-3735-4e97-8e97-7e76ea0f5b8f","Type":"ContainerStarted","Data":"dadd06b475b40cc3155737f7c04b8da7a451d6b10f3b7f4d71b9ee8164b2c595"}
Sep 11 11:40:20.262430 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:20.262343    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-88gpc"
Sep 11 11:40:20.264201 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:20.264165    2560 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-88gpc container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 11:40:20.264303 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:20.264232    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-88gpc" podUID="6e9071bd-3735-4e97-8e97-7e76ea0f5b8f" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 11:40:20.284609 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:20.284567    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-88gpc" podStartSLOduration=1.2845541059999999 podStartE2EDuration="1.284554106s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:40:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:40:20.283084689 +0000 UTC m=+371.105544583" watchObservedRunningTime="2026-09-11 11:40:20.284554106 +0000 UTC m=+371.107013978"
Sep 11 11:40:21.265779 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:21.265748    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-88gpc"
Sep 11 11:40:21.444546 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:21.444511    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8wgqs"]
Sep 11 11:40:21.444720 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:21.444700    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8wgqs" podUID="cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b" containerName="discovery" containerID="cri-o://e9c5f76b2f3390a36ff2e7c036df2c8a3f1561ab82ccdf25504267a6ff92f0a8" gracePeriod=30
Sep 11 11:40:21.677697 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:21.677674    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8wgqs"
Sep 11 11:40:21.775513 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:21.775478    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b-istio-csr-ca-configmap\") pod \"cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b\" (UID: \"cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b\") "
Sep 11 11:40:21.775513 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:21.775517    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b-istio-csr-dns-cert\") pod \"cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b\" (UID: \"cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b\") "
Sep 11 11:40:21.775764 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:21.775535    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b-istio-kubeconfig\") pod \"cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b\" (UID: \"cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b\") "
Sep 11 11:40:21.775764 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:21.775558    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9tsnn\" (UniqueName: \"kubernetes.io/projected/cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b-kube-api-access-9tsnn\") pod \"cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b\" (UID: \"cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b\") "
Sep 11 11:40:21.775764 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:21.775589    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b-local-certs\") pod \"cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b\" (UID: \"cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b\") "
Sep 11 11:40:21.776091 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:21.776060    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b" (UID: "cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 11:40:21.776167 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:21.776065    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b-cacerts\") pod \"cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b\" (UID: \"cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b\") "
Sep 11 11:40:21.776167 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:21.776133    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b-istio-token\") pod \"cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b\" (UID: \"cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b\") "
Sep 11 11:40:21.776373 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:21.776352    2560 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b-istio-csr-ca-configmap\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:40:21.778176 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:21.778150    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b" (UID: "cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 11:40:21.778425 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:21.778377    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b" (UID: "cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 11:40:21.778425 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:21.778401    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b-local-certs" (OuterVolumeSpecName: "local-certs") pod "cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b" (UID: "cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:40:21.778425 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:21.778401    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b-kube-api-access-9tsnn" (OuterVolumeSpecName: "kube-api-access-9tsnn") pod "cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b" (UID: "cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b"). InnerVolumeSpecName "kube-api-access-9tsnn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:40:21.778609 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:21.778484    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b-istio-token" (OuterVolumeSpecName: "istio-token") pod "cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b" (UID: "cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:40:21.778609 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:21.778583    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b-cacerts" (OuterVolumeSpecName: "cacerts") pod "cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b" (UID: "cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 11:40:21.877606 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:21.877569    2560 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b-istio-csr-dns-cert\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:40:21.877606 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:21.877598    2560 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b-istio-kubeconfig\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:40:21.877606 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:21.877611    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9tsnn\" (UniqueName: \"kubernetes.io/projected/cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b-kube-api-access-9tsnn\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:40:21.877860 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:21.877623    2560 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b-local-certs\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:40:21.877860 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:21.877635    2560 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b-cacerts\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:40:21.877860 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:21.877666    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b-istio-token\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:40:22.269139 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:22.269108    2560 generic.go:356] "Generic (PLEG): container finished" podID="cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b" containerID="e9c5f76b2f3390a36ff2e7c036df2c8a3f1561ab82ccdf25504267a6ff92f0a8" exitCode=0
Sep 11 11:40:22.269565 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:22.269150    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8wgqs"
Sep 11 11:40:22.269565 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:22.269197    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8wgqs" event={"ID":"cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b","Type":"ContainerDied","Data":"e9c5f76b2f3390a36ff2e7c036df2c8a3f1561ab82ccdf25504267a6ff92f0a8"}
Sep 11 11:40:22.269565 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:22.269251    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8wgqs" event={"ID":"cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b","Type":"ContainerDied","Data":"3bfc2e8eecf517c4f48f4fed7816f72650a4fb0b7c7b71228bfc0f5c5c39048a"}
Sep 11 11:40:22.269565 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:22.269282    2560 scope.go:117] "RemoveContainer" containerID="e9c5f76b2f3390a36ff2e7c036df2c8a3f1561ab82ccdf25504267a6ff92f0a8"
Sep 11 11:40:22.276980 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:22.276963    2560 scope.go:117] "RemoveContainer" containerID="e9c5f76b2f3390a36ff2e7c036df2c8a3f1561ab82ccdf25504267a6ff92f0a8"
Sep 11 11:40:22.277254 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:40:22.277234    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9c5f76b2f3390a36ff2e7c036df2c8a3f1561ab82ccdf25504267a6ff92f0a8\": container with ID starting with e9c5f76b2f3390a36ff2e7c036df2c8a3f1561ab82ccdf25504267a6ff92f0a8 not found: ID does not exist" containerID="e9c5f76b2f3390a36ff2e7c036df2c8a3f1561ab82ccdf25504267a6ff92f0a8"
Sep 11 11:40:22.277302 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:22.277260    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9c5f76b2f3390a36ff2e7c036df2c8a3f1561ab82ccdf25504267a6ff92f0a8"} err="failed to get container status \"e9c5f76b2f3390a36ff2e7c036df2c8a3f1561ab82ccdf25504267a6ff92f0a8\": rpc error: code = NotFound desc = could not find container \"e9c5f76b2f3390a36ff2e7c036df2c8a3f1561ab82ccdf25504267a6ff92f0a8\": container with ID starting with e9c5f76b2f3390a36ff2e7c036df2c8a3f1561ab82ccdf25504267a6ff92f0a8 not found: ID does not exist"
Sep 11 11:40:22.296710 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:22.296687    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8wgqs"]
Sep 11 11:40:22.310407 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:22.310384    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8wgqs"]
Sep 11 11:40:23.812294 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:40:23.812261    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b" path="/var/lib/kubelet/pods/cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b/volumes"
Sep 11 11:41:39.536280 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:41:39.536194    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-hdm99"]
Sep 11 11:41:39.536857 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:41:39.536587    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b" containerName="discovery"
Sep 11 11:41:39.536857 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:41:39.536607    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b" containerName="discovery"
Sep 11 11:41:39.536857 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:41:39.536681    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd46d6e0-9e52-49a4-a4b7-3f02d70ec36b" containerName="discovery"
Sep 11 11:41:39.539357 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:41:39.539337    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-hdm99"
Sep 11 11:41:39.542235 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:41:39.542210    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 11 11:41:39.542347 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:41:39.542303    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-wk2kp\""
Sep 11 11:41:39.542422 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:41:39.542364    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 11 11:41:39.552764 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:41:39.552740    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-hdm99"]
Sep 11 11:41:39.656571 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:41:39.656531    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpkmj\" (UniqueName: \"kubernetes.io/projected/51f4220d-8e53-4eab-a7a8-6fd6b4c3bbba-kube-api-access-hpkmj\") pod \"authorino-operator-76b478bd78-hdm99\" (UID: \"51f4220d-8e53-4eab-a7a8-6fd6b4c3bbba\") " pod="kuadrant-system/authorino-operator-76b478bd78-hdm99"
Sep 11 11:41:39.757189 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:41:39.757158    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpkmj\" (UniqueName: \"kubernetes.io/projected/51f4220d-8e53-4eab-a7a8-6fd6b4c3bbba-kube-api-access-hpkmj\") pod \"authorino-operator-76b478bd78-hdm99\" (UID: \"51f4220d-8e53-4eab-a7a8-6fd6b4c3bbba\") " pod="kuadrant-system/authorino-operator-76b478bd78-hdm99"
Sep 11 11:41:39.766098 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:41:39.766076    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpkmj\" (UniqueName: \"kubernetes.io/projected/51f4220d-8e53-4eab-a7a8-6fd6b4c3bbba-kube-api-access-hpkmj\") pod \"authorino-operator-76b478bd78-hdm99\" (UID: \"51f4220d-8e53-4eab-a7a8-6fd6b4c3bbba\") " pod="kuadrant-system/authorino-operator-76b478bd78-hdm99"
Sep 11 11:41:39.849206 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:41:39.849147    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-hdm99"
Sep 11 11:41:40.124640 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:41:40.124566    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-hdm99"]
Sep 11 11:41:40.134819 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:41:40.134792    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51f4220d_8e53_4eab_a7a8_6fd6b4c3bbba.slice/crio-18c0e4b987e4f0a58f873220076dc2ac09eec083c6828afc41ea50a1225ca64b WatchSource:0}: Error finding container 18c0e4b987e4f0a58f873220076dc2ac09eec083c6828afc41ea50a1225ca64b: Status 404 returned error can't find the container with id 18c0e4b987e4f0a58f873220076dc2ac09eec083c6828afc41ea50a1225ca64b
Sep 11 11:41:40.546237 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:41:40.546203    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-hdm99" event={"ID":"51f4220d-8e53-4eab-a7a8-6fd6b4c3bbba","Type":"ContainerStarted","Data":"18c0e4b987e4f0a58f873220076dc2ac09eec083c6828afc41ea50a1225ca64b"}
Sep 11 11:41:41.814926 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:41:41.814893    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-z6mdx"]
Sep 11 11:41:41.823455 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:41:41.823433    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-z6mdx"
Sep 11 11:41:41.825992 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:41:41.825969    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 11 11:41:41.826691 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:41:41.826670    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-jdvct\""
Sep 11 11:41:41.834583 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:41:41.834562    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-z6mdx"]
Sep 11 11:41:41.975710 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:41:41.975668    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lz4kx\" (UniqueName: \"kubernetes.io/projected/ba64a1a4-a385-4ba7-b33a-0003451e30c2-kube-api-access-lz4kx\") pod \"dns-operator-controller-manager-7b84cd7c9c-z6mdx\" (UID: \"ba64a1a4-a385-4ba7-b33a-0003451e30c2\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-z6mdx"
Sep 11 11:41:42.076442 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:41:42.076361    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz4kx\" (UniqueName: \"kubernetes.io/projected/ba64a1a4-a385-4ba7-b33a-0003451e30c2-kube-api-access-lz4kx\") pod \"dns-operator-controller-manager-7b84cd7c9c-z6mdx\" (UID: \"ba64a1a4-a385-4ba7-b33a-0003451e30c2\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-z6mdx"
Sep 11 11:41:42.084473 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:41:42.084441    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lz4kx\" (UniqueName: \"kubernetes.io/projected/ba64a1a4-a385-4ba7-b33a-0003451e30c2-kube-api-access-lz4kx\") pod \"dns-operator-controller-manager-7b84cd7c9c-z6mdx\" (UID: \"ba64a1a4-a385-4ba7-b33a-0003451e30c2\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-z6mdx"
Sep 11 11:41:42.135971 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:41:42.135938    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-z6mdx"
Sep 11 11:41:42.556113 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:41:42.556081    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-hdm99" event={"ID":"51f4220d-8e53-4eab-a7a8-6fd6b4c3bbba","Type":"ContainerStarted","Data":"d6fec770ae39ded176bff8be6e176920bf518ba28ff824c6243c234f1902b53d"}
Sep 11 11:41:42.556260 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:41:42.556218    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-hdm99"
Sep 11 11:41:42.576267 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:41:42.576214    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-hdm99" podStartSLOduration=1.318971954 podStartE2EDuration="3.576194668s" totalImagesPullingTime="2.257222714s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:41:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:41:42.57392857 +0000 UTC m=+453.396388461" watchObservedRunningTime="2026-09-11 11:41:42.576194668 +0000 UTC m=+453.398654542"
Sep 11 11:41:42.606950 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:41:42.606884    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-z6mdx"]
Sep 11 11:41:42.610489 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:41:42.610465    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba64a1a4_a385_4ba7_b33a_0003451e30c2.slice/crio-20cda834c29bad479f6e83ab7cf563f824bb85dd5f00fabd23448aa801471256 WatchSource:0}: Error finding container 20cda834c29bad479f6e83ab7cf563f824bb85dd5f00fabd23448aa801471256: Status 404 returned error can't find the container with id 20cda834c29bad479f6e83ab7cf563f824bb85dd5f00fabd23448aa801471256
Sep 11 11:41:43.564342 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:41:43.564289    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-z6mdx" event={"ID":"ba64a1a4-a385-4ba7-b33a-0003451e30c2","Type":"ContainerStarted","Data":"20cda834c29bad479f6e83ab7cf563f824bb85dd5f00fabd23448aa801471256"}
Sep 11 11:41:44.296733 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:41:44.296706    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-rpqfc"]
Sep 11 11:41:44.300869 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:41:44.300846    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rpqfc"
Sep 11 11:41:44.306494 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:41:44.306475    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-jfqd2\""
Sep 11 11:41:44.326960 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:41:44.326940    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-rpqfc"]
Sep 11 11:41:44.394930 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:41:44.394895    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsj4v\" (UniqueName: \"kubernetes.io/projected/65c79c50-83fe-4a39-8041-aa6338c32d54-kube-api-access-hsj4v\") pod \"limitador-operator-controller-manager-74495c69f8-rpqfc\" (UID: \"65c79c50-83fe-4a39-8041-aa6338c32d54\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rpqfc"
Sep 11 11:41:44.496336 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:41:44.496297    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsj4v\" (UniqueName: \"kubernetes.io/projected/65c79c50-83fe-4a39-8041-aa6338c32d54-kube-api-access-hsj4v\") pod \"limitador-operator-controller-manager-74495c69f8-rpqfc\" (UID: \"65c79c50-83fe-4a39-8041-aa6338c32d54\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rpqfc"
Sep 11 11:41:44.505201 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:41:44.505172    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsj4v\" (UniqueName: \"kubernetes.io/projected/65c79c50-83fe-4a39-8041-aa6338c32d54-kube-api-access-hsj4v\") pod \"limitador-operator-controller-manager-74495c69f8-rpqfc\" (UID: \"65c79c50-83fe-4a39-8041-aa6338c32d54\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rpqfc"
Sep 11 11:41:44.571311 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:41:44.571235    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-z6mdx" event={"ID":"ba64a1a4-a385-4ba7-b33a-0003451e30c2","Type":"ContainerStarted","Data":"d49f3c411f02ba51b8196f7e6f6abb04eab13c60598d4ee497ed8b8e8e0d5395"}
Sep 11 11:41:44.571679 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:41:44.571382    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-z6mdx"
Sep 11 11:41:44.608574 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:41:44.608519    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-z6mdx" podStartSLOduration=1.959629775 podStartE2EDuration="3.608502963s" totalImagesPullingTime="1.648873188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:41:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:41:44.607351287 +0000 UTC m=+455.429811174" watchObservedRunningTime="2026-09-11 11:41:44.608502963 +0000 UTC m=+455.430962836"
Sep 11 11:41:44.630463 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:41:44.630432    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rpqfc"
Sep 11 11:41:44.928564 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:41:44.928486    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-rpqfc"]
Sep 11 11:41:44.933477 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:41:44.933456    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65c79c50_83fe_4a39_8041_aa6338c32d54.slice/crio-c5f4aed6f67d60b71db401f238fb6a25d9b5bc68acdbdbc2cbc3197b5ea4e6e4 WatchSource:0}: Error finding container c5f4aed6f67d60b71db401f238fb6a25d9b5bc68acdbdbc2cbc3197b5ea4e6e4: Status 404 returned error can't find the container with id c5f4aed6f67d60b71db401f238fb6a25d9b5bc68acdbdbc2cbc3197b5ea4e6e4
Sep 11 11:41:45.576160 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:41:45.576115    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rpqfc" event={"ID":"65c79c50-83fe-4a39-8041-aa6338c32d54","Type":"ContainerStarted","Data":"c5f4aed6f67d60b71db401f238fb6a25d9b5bc68acdbdbc2cbc3197b5ea4e6e4"}
Sep 11 11:41:46.581386 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:41:46.581347    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rpqfc" event={"ID":"65c79c50-83fe-4a39-8041-aa6338c32d54","Type":"ContainerStarted","Data":"b5947bd2a2c689e77dc20929c551688c8e28a5463cdcddafcc4c4a20bfd028dd"}
Sep 11 11:41:46.581754 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:41:46.581525    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rpqfc"
Sep 11 11:41:46.608519 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:41:46.608467    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rpqfc" podStartSLOduration=1.078455873 podStartE2EDuration="2.608450915s" totalImagesPullingTime="1.529995042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:41:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:41:46.606544635 +0000 UTC m=+457.429004518" watchObservedRunningTime="2026-09-11 11:41:46.608450915 +0000 UTC m=+457.430910787"
Sep 11 11:41:53.566879 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:41:53.566844    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-hdm99"
Sep 11 11:41:55.578561 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:41:55.578530    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-z6mdx"
Sep 11 11:41:57.587529 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:41:57.587495    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rpqfc"
Sep 11 11:42:06.618193 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:42:06.618158    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-rpqfc"]
Sep 11 11:42:06.618669 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:42:06.618410    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rpqfc" podUID="65c79c50-83fe-4a39-8041-aa6338c32d54" containerName="manager" containerID="cri-o://b5947bd2a2c689e77dc20929c551688c8e28a5463cdcddafcc4c4a20bfd028dd" gracePeriod=2
Sep 11 11:42:06.630459 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:42:06.630433    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-rpqfc"]
Sep 11 11:42:06.643899 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:42:06.643864    2560 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"65c79c50-83fe-4a39-8041-aa6338c32d54\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-74495c69f8-rpqfc\": pods \"limitador-operator-controller-manager-74495c69f8-rpqfc\" not found" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rpqfc"
Sep 11 11:42:06.663038 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:42:06.663005    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-kr692"]
Sep 11 11:42:06.663429 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:42:06.663409    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65c79c50-83fe-4a39-8041-aa6338c32d54" containerName="manager"
Sep 11 11:42:06.663429 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:42:06.663431    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="65c79c50-83fe-4a39-8041-aa6338c32d54" containerName="manager"
Sep 11 11:42:06.663557 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:42:06.663517    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="65c79c50-83fe-4a39-8041-aa6338c32d54" containerName="manager"
Sep 11 11:42:06.670022 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:42:06.670005    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-kr692"
Sep 11 11:42:06.672600 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:42:06.672573    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-rpqfc\" is forbidden: User \"system:node:ip-10-0-142-230.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-230.ec2.internal' and this object" podUID="65c79c50-83fe-4a39-8041-aa6338c32d54" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rpqfc"
Sep 11 11:42:06.679739 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:42:06.679715    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-kr692"]
Sep 11 11:42:06.770770 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:42:06.770737    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmkk5\" (UniqueName: \"kubernetes.io/projected/065deae5-3e15-4793-9532-b51476aa85c8-kube-api-access-gmkk5\") pod \"limitador-operator-controller-manager-74495c69f8-kr692\" (UID: \"065deae5-3e15-4793-9532-b51476aa85c8\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-kr692"
Sep 11 11:42:06.850436 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:42:06.850414    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rpqfc"
Sep 11 11:42:06.853506 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:42:06.853483    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-rpqfc\" is forbidden: User \"system:node:ip-10-0-142-230.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-230.ec2.internal' and this object" podUID="65c79c50-83fe-4a39-8041-aa6338c32d54" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rpqfc"
Sep 11 11:42:06.871860 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:42:06.871814    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmkk5\" (UniqueName: \"kubernetes.io/projected/065deae5-3e15-4793-9532-b51476aa85c8-kube-api-access-gmkk5\") pod \"limitador-operator-controller-manager-74495c69f8-kr692\" (UID: \"065deae5-3e15-4793-9532-b51476aa85c8\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-kr692"
Sep 11 11:42:06.884420 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:42:06.884398    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmkk5\" (UniqueName: \"kubernetes.io/projected/065deae5-3e15-4793-9532-b51476aa85c8-kube-api-access-gmkk5\") pod \"limitador-operator-controller-manager-74495c69f8-kr692\" (UID: \"065deae5-3e15-4793-9532-b51476aa85c8\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-kr692"
Sep 11 11:42:06.972444 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:42:06.972409    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hsj4v\" (UniqueName: \"kubernetes.io/projected/65c79c50-83fe-4a39-8041-aa6338c32d54-kube-api-access-hsj4v\") pod \"65c79c50-83fe-4a39-8041-aa6338c32d54\" (UID: \"65c79c50-83fe-4a39-8041-aa6338c32d54\") "
Sep 11 11:42:06.974493 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:42:06.974472    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65c79c50-83fe-4a39-8041-aa6338c32d54-kube-api-access-hsj4v" (OuterVolumeSpecName: "kube-api-access-hsj4v") pod "65c79c50-83fe-4a39-8041-aa6338c32d54" (UID: "65c79c50-83fe-4a39-8041-aa6338c32d54"). InnerVolumeSpecName "kube-api-access-hsj4v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:42:07.017026 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:42:07.017000    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-kr692"
Sep 11 11:42:07.073849 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:42:07.073776    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hsj4v\" (UniqueName: \"kubernetes.io/projected/65c79c50-83fe-4a39-8041-aa6338c32d54-kube-api-access-hsj4v\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:42:07.290151 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:42:07.290119    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-kr692"]
Sep 11 11:42:07.293201 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:42:07.293174    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod065deae5_3e15_4793_9532_b51476aa85c8.slice/crio-922071898bf97d790d4c6e22f30de6eba2e5242256424d97ec0af4ef7568d52e WatchSource:0}: Error finding container 922071898bf97d790d4c6e22f30de6eba2e5242256424d97ec0af4ef7568d52e: Status 404 returned error can't find the container with id 922071898bf97d790d4c6e22f30de6eba2e5242256424d97ec0af4ef7568d52e
Sep 11 11:42:07.669775 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:42:07.669683    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-kr692" event={"ID":"065deae5-3e15-4793-9532-b51476aa85c8","Type":"ContainerStarted","Data":"75566382b60583357b6a89edb92e327f312ac142408b843e3c83afdf517ac381"}
Sep 11 11:42:07.669775 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:42:07.669747    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-kr692" event={"ID":"065deae5-3e15-4793-9532-b51476aa85c8","Type":"ContainerStarted","Data":"922071898bf97d790d4c6e22f30de6eba2e5242256424d97ec0af4ef7568d52e"}
Sep 11 11:42:07.669775 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:42:07.669777    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-kr692"
Sep 11 11:42:07.671009 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:42:07.670974    2560 generic.go:356] "Generic (PLEG): container finished" podID="65c79c50-83fe-4a39-8041-aa6338c32d54" containerID="b5947bd2a2c689e77dc20929c551688c8e28a5463cdcddafcc4c4a20bfd028dd" exitCode=0
Sep 11 11:42:07.671009 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:42:07.671008    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rpqfc"
Sep 11 11:42:07.671176 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:42:07.671035    2560 scope.go:117] "RemoveContainer" containerID="b5947bd2a2c689e77dc20929c551688c8e28a5463cdcddafcc4c4a20bfd028dd"
Sep 11 11:42:07.672248 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:42:07.671910    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-rpqfc\" is forbidden: User \"system:node:ip-10-0-142-230.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-230.ec2.internal' and this object" podUID="65c79c50-83fe-4a39-8041-aa6338c32d54" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rpqfc"
Sep 11 11:42:07.678880 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:42:07.678858    2560 scope.go:117] "RemoveContainer" containerID="b5947bd2a2c689e77dc20929c551688c8e28a5463cdcddafcc4c4a20bfd028dd"
Sep 11 11:42:07.679136 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:42:07.679118    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5947bd2a2c689e77dc20929c551688c8e28a5463cdcddafcc4c4a20bfd028dd\": container with ID starting with b5947bd2a2c689e77dc20929c551688c8e28a5463cdcddafcc4c4a20bfd028dd not found: ID does not exist" containerID="b5947bd2a2c689e77dc20929c551688c8e28a5463cdcddafcc4c4a20bfd028dd"
Sep 11 11:42:07.679194 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:42:07.679146    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5947bd2a2c689e77dc20929c551688c8e28a5463cdcddafcc4c4a20bfd028dd"} err="failed to get container status \"b5947bd2a2c689e77dc20929c551688c8e28a5463cdcddafcc4c4a20bfd028dd\": rpc error: code = NotFound desc = could not find container \"b5947bd2a2c689e77dc20929c551688c8e28a5463cdcddafcc4c4a20bfd028dd\": container with ID starting with b5947bd2a2c689e77dc20929c551688c8e28a5463cdcddafcc4c4a20bfd028dd not found: ID does not exist"
Sep 11 11:42:07.721562 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:42:07.721515    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-kr692" podStartSLOduration=1.721498724 podStartE2EDuration="1.721498724s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:42:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:42:07.720916506 +0000 UTC m=+478.543376410" watchObservedRunningTime="2026-09-11 11:42:07.721498724 +0000 UTC m=+478.543958596"
Sep 11 11:42:07.724408 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:42:07.724380    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-rpqfc\" is forbidden: User \"system:node:ip-10-0-142-230.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-230.ec2.internal' and this object" podUID="65c79c50-83fe-4a39-8041-aa6338c32d54" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rpqfc"
Sep 11 11:42:07.812548 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:42:07.812517    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65c79c50-83fe-4a39-8041-aa6338c32d54" path="/var/lib/kubelet/pods/65c79c50-83fe-4a39-8041-aa6338c32d54/volumes"
Sep 11 11:42:18.683958 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:42:18.683926    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-kr692"
Sep 11 11:42:22.850903 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:42:22.850870    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-95mx5"]
Sep 11 11:42:22.855201 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:42:22.855184    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-95mx5"
Sep 11 11:42:22.857448 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:42:22.857430    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-8dpsl\""
Sep 11 11:42:22.872205 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:42:22.872184    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-95mx5"]
Sep 11 11:42:22.990713 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:42:22.990680    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qf2jz\" (UniqueName: \"kubernetes.io/projected/26de7b73-7449-4702-ac08-80954d7ce5de-kube-api-access-qf2jz\") pod \"kuadrant-operator-controller-manager-5769f99d9f-95mx5\" (UID: \"26de7b73-7449-4702-ac08-80954d7ce5de\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-95mx5"
Sep 11 11:42:22.990872 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:42:22.990729    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/26de7b73-7449-4702-ac08-80954d7ce5de-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-95mx5\" (UID: \"26de7b73-7449-4702-ac08-80954d7ce5de\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-95mx5"
Sep 11 11:42:23.091815 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:42:23.091781    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf2jz\" (UniqueName: \"kubernetes.io/projected/26de7b73-7449-4702-ac08-80954d7ce5de-kube-api-access-qf2jz\") pod \"kuadrant-operator-controller-manager-5769f99d9f-95mx5\" (UID: \"26de7b73-7449-4702-ac08-80954d7ce5de\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-95mx5"
Sep 11 11:42:23.091977 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:42:23.091832    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/26de7b73-7449-4702-ac08-80954d7ce5de-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-95mx5\" (UID: \"26de7b73-7449-4702-ac08-80954d7ce5de\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-95mx5"
Sep 11 11:42:23.092240 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:42:23.092221    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/26de7b73-7449-4702-ac08-80954d7ce5de-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-95mx5\" (UID: \"26de7b73-7449-4702-ac08-80954d7ce5de\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-95mx5"
Sep 11 11:42:23.101941 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:42:23.101895    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qf2jz\" (UniqueName: \"kubernetes.io/projected/26de7b73-7449-4702-ac08-80954d7ce5de-kube-api-access-qf2jz\") pod \"kuadrant-operator-controller-manager-5769f99d9f-95mx5\" (UID: \"26de7b73-7449-4702-ac08-80954d7ce5de\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-95mx5"
Sep 11 11:42:23.164848 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:42:23.164812    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-95mx5"
Sep 11 11:42:23.448512 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:42:23.448432    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-95mx5"]
Sep 11 11:42:23.452557 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:42:23.452533    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26de7b73_7449_4702_ac08_80954d7ce5de.slice/crio-8b0f1d9ebbc7d3fb79fc325cf60a79a91b3dc92665587a5e8b6f21b51e3aad7a WatchSource:0}: Error finding container 8b0f1d9ebbc7d3fb79fc325cf60a79a91b3dc92665587a5e8b6f21b51e3aad7a: Status 404 returned error can't find the container with id 8b0f1d9ebbc7d3fb79fc325cf60a79a91b3dc92665587a5e8b6f21b51e3aad7a
Sep 11 11:42:23.746810 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:42:23.746774    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-95mx5" event={"ID":"26de7b73-7449-4702-ac08-80954d7ce5de","Type":"ContainerStarted","Data":"8b0f1d9ebbc7d3fb79fc325cf60a79a91b3dc92665587a5e8b6f21b51e3aad7a"}
Sep 11 11:42:29.772102 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:42:29.772064    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-95mx5" event={"ID":"26de7b73-7449-4702-ac08-80954d7ce5de","Type":"ContainerStarted","Data":"ca1f9ed43f866eb3b6121a5fc79564eebf22fe3c517a7cbbe3fabd3702dd743c"}
Sep 11 11:42:29.772514 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:42:29.772208    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-95mx5"
Sep 11 11:42:29.799542 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:42:29.799494    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-95mx5" podStartSLOduration=2.394848176 podStartE2EDuration="7.799479785s" totalImagesPullingTime="5.404631609s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:42:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:42:29.796802081 +0000 UTC m=+500.619261989" watchObservedRunningTime="2026-09-11 11:42:29.799479785 +0000 UTC m=+500.621939658"
Sep 11 11:42:40.779331 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:42:40.779299    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-95mx5"
Sep 11 11:44:24.521806 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:44:24.521771    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-4pv2g"]
Sep 11 11:44:24.524934 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:44:24.524918    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-4pv2g"
Sep 11 11:44:24.532030 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:44:24.532005    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-l2rbs\""
Sep 11 11:44:24.532437 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:44:24.532423    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 11 11:44:24.583444 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:44:24.583407    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-4pv2g"]
Sep 11 11:44:24.608922 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:44:24.608884    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdjpx\" (UniqueName: \"kubernetes.io/projected/176eb299-aee1-47f4-9140-a3907c7cbf95-kube-api-access-pdjpx\") pod \"payload-pre-processing-59fbc47bf8-4pv2g\" (UID: \"176eb299-aee1-47f4-9140-a3907c7cbf95\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-4pv2g"
Sep 11 11:44:24.609098 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:44:24.608931    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/176eb299-aee1-47f4-9140-a3907c7cbf95-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-4pv2g\" (UID: \"176eb299-aee1-47f4-9140-a3907c7cbf95\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-4pv2g"
Sep 11 11:44:24.709296 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:44:24.709263    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdjpx\" (UniqueName: \"kubernetes.io/projected/176eb299-aee1-47f4-9140-a3907c7cbf95-kube-api-access-pdjpx\") pod \"payload-pre-processing-59fbc47bf8-4pv2g\" (UID: \"176eb299-aee1-47f4-9140-a3907c7cbf95\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-4pv2g"
Sep 11 11:44:24.709476 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:44:24.709308    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/176eb299-aee1-47f4-9140-a3907c7cbf95-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-4pv2g\" (UID: \"176eb299-aee1-47f4-9140-a3907c7cbf95\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-4pv2g"
Sep 11 11:44:24.710036 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:44:24.710015    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/176eb299-aee1-47f4-9140-a3907c7cbf95-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-4pv2g\" (UID: \"176eb299-aee1-47f4-9140-a3907c7cbf95\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-4pv2g"
Sep 11 11:44:24.744107 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:44:24.744076    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdjpx\" (UniqueName: \"kubernetes.io/projected/176eb299-aee1-47f4-9140-a3907c7cbf95-kube-api-access-pdjpx\") pod \"payload-pre-processing-59fbc47bf8-4pv2g\" (UID: \"176eb299-aee1-47f4-9140-a3907c7cbf95\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-4pv2g"
Sep 11 11:44:24.835225 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:44:24.835140    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-4pv2g"
Sep 11 11:44:25.147391 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:44:25.147317    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-4pv2g"]
Sep 11 11:44:25.150634 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:44:25.150608    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod176eb299_aee1_47f4_9140_a3907c7cbf95.slice/crio-7c87b223da927cd2cbbd4040cfb2faae3c4bc08b6d27050dc1b29f8788a8ee96 WatchSource:0}: Error finding container 7c87b223da927cd2cbbd4040cfb2faae3c4bc08b6d27050dc1b29f8788a8ee96: Status 404 returned error can't find the container with id 7c87b223da927cd2cbbd4040cfb2faae3c4bc08b6d27050dc1b29f8788a8ee96
Sep 11 11:44:25.251206 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:44:25.251174    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-4pv2g" event={"ID":"176eb299-aee1-47f4-9140-a3907c7cbf95","Type":"ContainerStarted","Data":"7c87b223da927cd2cbbd4040cfb2faae3c4bc08b6d27050dc1b29f8788a8ee96"}
Sep 11 11:44:28.269238 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:44:28.269192    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-4pv2g" event={"ID":"176eb299-aee1-47f4-9140-a3907c7cbf95","Type":"ContainerStarted","Data":"6338a79879b173a5fae451d14f4a486bbbf8f9df24e71a73e99c7c99b5c46cac"}
Sep 11 11:44:28.269697 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:44:28.269329    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-4pv2g"
Sep 11 11:44:28.303012 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:44:28.302961    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-4pv2g" podStartSLOduration=1.9356737499999999 podStartE2EDuration="4.302946667s" totalImagesPullingTime="2.367272917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:44:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:44:28.302137203 +0000 UTC m=+619.124597098" watchObservedRunningTime="2026-09-11 11:44:28.302946667 +0000 UTC m=+619.125406540"
Sep 11 11:44:39.275810 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:44:39.275731    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-4pv2g"
Sep 11 11:45:00.153280 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:00.153245    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29818785-j67d9"]
Sep 11 11:45:00.156437 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:00.156418    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818785-j67d9"
Sep 11 11:45:00.158789 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:00.158767    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f46tj\""
Sep 11 11:45:00.164845 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:00.164820    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29818785-j67d9"]
Sep 11 11:45:00.166362 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:00.166345    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818785-j67d9"
Sep 11 11:45:00.441631 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:00.441494    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29818785-j67d9"]
Sep 11 11:45:00.444126 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:45:00.444099    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod243cce38_2368_414d_a88b_69096577c4a2.slice/crio-381ff815c794c8b5ba40eb61fe51339ebae35117096f1208d7d77672f532af14 WatchSource:0}: Error finding container 381ff815c794c8b5ba40eb61fe51339ebae35117096f1208d7d77672f532af14: Status 404 returned error can't find the container with id 381ff815c794c8b5ba40eb61fe51339ebae35117096f1208d7d77672f532af14
Sep 11 11:45:00.446146 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:00.446130    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 11:45:01.399494 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:01.399455    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818785-j67d9" event={"ID":"243cce38-2368-414d-a88b-69096577c4a2","Type":"ContainerStarted","Data":"381ff815c794c8b5ba40eb61fe51339ebae35117096f1208d7d77672f532af14"}
Sep 11 11:45:04.414573 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:04.414536    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818785-j67d9" event={"ID":"243cce38-2368-414d-a88b-69096577c4a2","Type":"ContainerStarted","Data":"a4e955f1d05ea16adab81633b6cde400188878d72229dbf6483dccda19fb4b0b"}
Sep 11 11:45:04.443529 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:04.443477    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818785-j67d9" podStartSLOduration=1.373017731 podStartE2EDuration="4.443460241s" totalImagesPullingTime="3.07044251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:45:04.442451064 +0000 UTC m=+655.264910958" watchObservedRunningTime="2026-09-11 11:45:04.443460241 +0000 UTC m=+655.265920113"
Sep 11 11:45:05.420037 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:05.420004    2560 generic.go:356] "Generic (PLEG): container finished" podID="243cce38-2368-414d-a88b-69096577c4a2" containerID="a4e955f1d05ea16adab81633b6cde400188878d72229dbf6483dccda19fb4b0b" exitCode=0
Sep 11 11:45:05.420497 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:05.420083    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818785-j67d9" event={"ID":"243cce38-2368-414d-a88b-69096577c4a2","Type":"ContainerDied","Data":"a4e955f1d05ea16adab81633b6cde400188878d72229dbf6483dccda19fb4b0b"}
Sep 11 11:45:06.548497 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:06.548474    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818785-j67d9"
Sep 11 11:45:07.429390 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:07.429359    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818785-j67d9"
Sep 11 11:45:07.429390 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:07.429366    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818785-j67d9" event={"ID":"243cce38-2368-414d-a88b-69096577c4a2","Type":"ContainerDied","Data":"381ff815c794c8b5ba40eb61fe51339ebae35117096f1208d7d77672f532af14"}
Sep 11 11:45:07.429591 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:07.429415    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="381ff815c794c8b5ba40eb61fe51339ebae35117096f1208d7d77672f532af14"
Sep 11 11:45:19.628965 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:19.628927    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rx466"]
Sep 11 11:45:19.629345 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:19.629223    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="243cce38-2368-414d-a88b-69096577c4a2" containerName="cleanup"
Sep 11 11:45:19.629345 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:19.629235    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="243cce38-2368-414d-a88b-69096577c4a2" containerName="cleanup"
Sep 11 11:45:19.629345 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:19.629284    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="243cce38-2368-414d-a88b-69096577c4a2" containerName="cleanup"
Sep 11 11:45:19.632190 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:19.632163    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rx466"
Sep 11 11:45:19.635224 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:19.634816    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 11 11:45:19.635224 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:19.635056    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-7cwhz\""
Sep 11 11:45:19.635443 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:19.635428    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 11 11:45:19.635513 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:19.635474    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 11 11:45:19.649638 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:19.649602    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rx466"]
Sep 11 11:45:19.728057 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:19.728016    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kxnh\" (UniqueName: \"kubernetes.io/projected/8043b841-3487-4648-9b20-4bb82c6d069d-kube-api-access-6kxnh\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rx466\" (UID: \"8043b841-3487-4648-9b20-4bb82c6d069d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rx466"
Sep 11 11:45:19.728244 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:19.728066    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8043b841-3487-4648-9b20-4bb82c6d069d-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rx466\" (UID: \"8043b841-3487-4648-9b20-4bb82c6d069d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rx466"
Sep 11 11:45:19.728244 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:19.728093    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8043b841-3487-4648-9b20-4bb82c6d069d-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rx466\" (UID: \"8043b841-3487-4648-9b20-4bb82c6d069d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rx466"
Sep 11 11:45:19.728244 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:19.728184    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8043b841-3487-4648-9b20-4bb82c6d069d-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rx466\" (UID: \"8043b841-3487-4648-9b20-4bb82c6d069d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rx466"
Sep 11 11:45:19.728244 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:19.728219    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8043b841-3487-4648-9b20-4bb82c6d069d-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rx466\" (UID: \"8043b841-3487-4648-9b20-4bb82c6d069d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rx466"
Sep 11 11:45:19.728244 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:19.728243    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8043b841-3487-4648-9b20-4bb82c6d069d-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rx466\" (UID: \"8043b841-3487-4648-9b20-4bb82c6d069d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rx466"
Sep 11 11:45:19.828779 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:19.828744    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8043b841-3487-4648-9b20-4bb82c6d069d-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rx466\" (UID: \"8043b841-3487-4648-9b20-4bb82c6d069d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rx466"
Sep 11 11:45:19.828779 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:19.828781    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8043b841-3487-4648-9b20-4bb82c6d069d-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rx466\" (UID: \"8043b841-3487-4648-9b20-4bb82c6d069d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rx466"
Sep 11 11:45:19.828989 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:19.828804    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8043b841-3487-4648-9b20-4bb82c6d069d-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rx466\" (UID: \"8043b841-3487-4648-9b20-4bb82c6d069d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rx466"
Sep 11 11:45:19.828989 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:19.828836    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kxnh\" (UniqueName: \"kubernetes.io/projected/8043b841-3487-4648-9b20-4bb82c6d069d-kube-api-access-6kxnh\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rx466\" (UID: \"8043b841-3487-4648-9b20-4bb82c6d069d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rx466"
Sep 11 11:45:19.828989 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:19.828869    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8043b841-3487-4648-9b20-4bb82c6d069d-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rx466\" (UID: \"8043b841-3487-4648-9b20-4bb82c6d069d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rx466"
Sep 11 11:45:19.828989 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:19.828895    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8043b841-3487-4648-9b20-4bb82c6d069d-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rx466\" (UID: \"8043b841-3487-4648-9b20-4bb82c6d069d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rx466"
Sep 11 11:45:19.829245 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:19.829219    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8043b841-3487-4648-9b20-4bb82c6d069d-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rx466\" (UID: \"8043b841-3487-4648-9b20-4bb82c6d069d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rx466"
Sep 11 11:45:19.829290 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:19.829269    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8043b841-3487-4648-9b20-4bb82c6d069d-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rx466\" (UID: \"8043b841-3487-4648-9b20-4bb82c6d069d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rx466"
Sep 11 11:45:19.829351 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:19.829311    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8043b841-3487-4648-9b20-4bb82c6d069d-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rx466\" (UID: \"8043b841-3487-4648-9b20-4bb82c6d069d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rx466"
Sep 11 11:45:19.831112 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:19.831090    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8043b841-3487-4648-9b20-4bb82c6d069d-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rx466\" (UID: \"8043b841-3487-4648-9b20-4bb82c6d069d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rx466"
Sep 11 11:45:19.831377 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:19.831357    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8043b841-3487-4648-9b20-4bb82c6d069d-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rx466\" (UID: \"8043b841-3487-4648-9b20-4bb82c6d069d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rx466"
Sep 11 11:45:19.837951 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:19.837925    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kxnh\" (UniqueName: \"kubernetes.io/projected/8043b841-3487-4648-9b20-4bb82c6d069d-kube-api-access-6kxnh\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rx466\" (UID: \"8043b841-3487-4648-9b20-4bb82c6d069d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rx466"
Sep 11 11:45:19.943264 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:19.943171    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rx466"
Sep 11 11:45:20.270153 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:20.270117    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rx466"]
Sep 11 11:45:20.275447 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:45:20.275411    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8043b841_3487_4648_9b20_4bb82c6d069d.slice/crio-8ad0410a7f9ed7b296404cb7092cc63fb86ea26b7bf74cf7b92302fc2819e94e WatchSource:0}: Error finding container 8ad0410a7f9ed7b296404cb7092cc63fb86ea26b7bf74cf7b92302fc2819e94e: Status 404 returned error can't find the container with id 8ad0410a7f9ed7b296404cb7092cc63fb86ea26b7bf74cf7b92302fc2819e94e
Sep 11 11:45:20.487224 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:20.487181    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rx466" event={"ID":"8043b841-3487-4648-9b20-4bb82c6d069d","Type":"ContainerStarted","Data":"8ad0410a7f9ed7b296404cb7092cc63fb86ea26b7bf74cf7b92302fc2819e94e"}
Sep 11 11:45:21.492726 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:21.492692    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rx466" event={"ID":"8043b841-3487-4648-9b20-4bb82c6d069d","Type":"ContainerStarted","Data":"7cf45535ec64f1fd13a13c2f3013097d41a5a539935771453800952b8c7a9899"}
Sep 11 11:45:21.516443 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:21.516342    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rx466" podStartSLOduration=1.547951674 podStartE2EDuration="2.516325162s" totalImagesPullingTime="968.373488ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:45:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:45:21.515694273 +0000 UTC m=+672.338154165" watchObservedRunningTime="2026-09-11 11:45:21.516325162 +0000 UTC m=+672.338785032"
Sep 11 11:45:29.943269 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:29.943230    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rx466"
Sep 11 11:45:29.943665 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:29.943290    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rx466"
Sep 11 11:45:29.955588 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:29.955564    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rx466"
Sep 11 11:45:30.541893 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:30.541865    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rx466"
Sep 11 11:45:46.977719 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:46.977682    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9nc6"]
Sep 11 11:45:46.981850 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:46.981832    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9nc6"
Sep 11 11:45:46.987505 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:46.987483    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 11 11:45:47.020415 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:47.020382    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9nc6"]
Sep 11 11:45:47.050161 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:47.050122    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/279659ab-2bae-4cd5-b20d-9278c514d965-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9nc6\" (UID: \"279659ab-2bae-4cd5-b20d-9278c514d965\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9nc6"
Sep 11 11:45:47.050161 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:47.050161    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/279659ab-2bae-4cd5-b20d-9278c514d965-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9nc6\" (UID: \"279659ab-2bae-4cd5-b20d-9278c514d965\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9nc6"
Sep 11 11:45:47.050378 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:47.050180    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/279659ab-2bae-4cd5-b20d-9278c514d965-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9nc6\" (UID: \"279659ab-2bae-4cd5-b20d-9278c514d965\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9nc6"
Sep 11 11:45:47.050378 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:47.050291    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/279659ab-2bae-4cd5-b20d-9278c514d965-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9nc6\" (UID: \"279659ab-2bae-4cd5-b20d-9278c514d965\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9nc6"
Sep 11 11:45:47.050378 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:47.050317    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7gpd\" (UniqueName: \"kubernetes.io/projected/279659ab-2bae-4cd5-b20d-9278c514d965-kube-api-access-r7gpd\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9nc6\" (UID: \"279659ab-2bae-4cd5-b20d-9278c514d965\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9nc6"
Sep 11 11:45:47.050378 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:47.050341    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/279659ab-2bae-4cd5-b20d-9278c514d965-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9nc6\" (UID: \"279659ab-2bae-4cd5-b20d-9278c514d965\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9nc6"
Sep 11 11:45:47.151106 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:47.151072    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/279659ab-2bae-4cd5-b20d-9278c514d965-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9nc6\" (UID: \"279659ab-2bae-4cd5-b20d-9278c514d965\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9nc6"
Sep 11 11:45:47.151299 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:47.151136    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/279659ab-2bae-4cd5-b20d-9278c514d965-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9nc6\" (UID: \"279659ab-2bae-4cd5-b20d-9278c514d965\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9nc6"
Sep 11 11:45:47.151299 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:47.151156    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/279659ab-2bae-4cd5-b20d-9278c514d965-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9nc6\" (UID: \"279659ab-2bae-4cd5-b20d-9278c514d965\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9nc6"
Sep 11 11:45:47.151299 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:47.151174    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/279659ab-2bae-4cd5-b20d-9278c514d965-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9nc6\" (UID: \"279659ab-2bae-4cd5-b20d-9278c514d965\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9nc6"
Sep 11 11:45:47.151299 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:47.151232    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/279659ab-2bae-4cd5-b20d-9278c514d965-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9nc6\" (UID: \"279659ab-2bae-4cd5-b20d-9278c514d965\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9nc6"
Sep 11 11:45:47.151299 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:47.151259    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7gpd\" (UniqueName: \"kubernetes.io/projected/279659ab-2bae-4cd5-b20d-9278c514d965-kube-api-access-r7gpd\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9nc6\" (UID: \"279659ab-2bae-4cd5-b20d-9278c514d965\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9nc6"
Sep 11 11:45:47.151661 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:47.151618    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/279659ab-2bae-4cd5-b20d-9278c514d965-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9nc6\" (UID: \"279659ab-2bae-4cd5-b20d-9278c514d965\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9nc6"
Sep 11 11:45:47.151773 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:47.151689    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/279659ab-2bae-4cd5-b20d-9278c514d965-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9nc6\" (UID: \"279659ab-2bae-4cd5-b20d-9278c514d965\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9nc6"
Sep 11 11:45:47.151773 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:47.151714    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/279659ab-2bae-4cd5-b20d-9278c514d965-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9nc6\" (UID: \"279659ab-2bae-4cd5-b20d-9278c514d965\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9nc6"
Sep 11 11:45:47.153630 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:47.153608    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/279659ab-2bae-4cd5-b20d-9278c514d965-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9nc6\" (UID: \"279659ab-2bae-4cd5-b20d-9278c514d965\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9nc6"
Sep 11 11:45:47.153792 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:47.153775    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/279659ab-2bae-4cd5-b20d-9278c514d965-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9nc6\" (UID: \"279659ab-2bae-4cd5-b20d-9278c514d965\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9nc6"
Sep 11 11:45:47.165060 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:47.165026    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7gpd\" (UniqueName: \"kubernetes.io/projected/279659ab-2bae-4cd5-b20d-9278c514d965-kube-api-access-r7gpd\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9nc6\" (UID: \"279659ab-2bae-4cd5-b20d-9278c514d965\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9nc6"
Sep 11 11:45:47.291870 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:47.291787    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9nc6"
Sep 11 11:45:47.575770 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:47.575743    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9nc6"]
Sep 11 11:45:47.577053 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:45:47.577022    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod279659ab_2bae_4cd5_b20d_9278c514d965.slice/crio-dfa367c5d9d99698fa08ff3a31a5d049f5d6f96d329b64bec0662a09886448e5 WatchSource:0}: Error finding container dfa367c5d9d99698fa08ff3a31a5d049f5d6f96d329b64bec0662a09886448e5: Status 404 returned error can't find the container with id dfa367c5d9d99698fa08ff3a31a5d049f5d6f96d329b64bec0662a09886448e5
Sep 11 11:45:47.600338 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:47.600309    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9nc6" event={"ID":"279659ab-2bae-4cd5-b20d-9278c514d965","Type":"ContainerStarted","Data":"dfa367c5d9d99698fa08ff3a31a5d049f5d6f96d329b64bec0662a09886448e5"}
Sep 11 11:45:48.606786 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:48.606691    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9nc6" event={"ID":"279659ab-2bae-4cd5-b20d-9278c514d965","Type":"ContainerStarted","Data":"8e0cfed15aada9d63bd33f0dc7817636013b0012e2d9fff794d3d9db0676d37d"}
Sep 11 11:45:57.292693 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:57.292642    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9nc6"
Sep 11 11:45:57.293073 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:57.292710    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9nc6"
Sep 11 11:45:57.305083 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:57.305052    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9nc6"
Sep 11 11:45:57.329830 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:57.329781    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9nc6" podStartSLOduration=11.150888468 podStartE2EDuration="11.329764031s" totalImagesPullingTime="178.875563ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:45:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:45:48.644820889 +0000 UTC m=+699.467280763" watchObservedRunningTime="2026-09-11 11:45:57.329764031 +0000 UTC m=+708.152223904"
Sep 11 11:45:57.655234 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:57.655141    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9nc6"
Sep 11 11:45:59.293907 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:59.293875    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-qkbk2"]
Sep 11 11:45:59.298237 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:59.298221    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qkbk2"
Sep 11 11:45:59.316919 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:59.316892    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 11 11:45:59.334736 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:59.334708    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-qkbk2"]
Sep 11 11:45:59.343685 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:59.343659    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpwmc\" (UniqueName: \"kubernetes.io/projected/685a0ca3-71d1-4330-b840-56817a0a2a65-kube-api-access-lpwmc\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qkbk2\" (UID: \"685a0ca3-71d1-4330-b840-56817a0a2a65\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qkbk2"
Sep 11 11:45:59.343805 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:59.343702    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/685a0ca3-71d1-4330-b840-56817a0a2a65-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qkbk2\" (UID: \"685a0ca3-71d1-4330-b840-56817a0a2a65\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qkbk2"
Sep 11 11:45:59.343805 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:59.343751    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/685a0ca3-71d1-4330-b840-56817a0a2a65-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qkbk2\" (UID: \"685a0ca3-71d1-4330-b840-56817a0a2a65\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qkbk2"
Sep 11 11:45:59.343805 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:59.343767    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/685a0ca3-71d1-4330-b840-56817a0a2a65-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qkbk2\" (UID: \"685a0ca3-71d1-4330-b840-56817a0a2a65\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qkbk2"
Sep 11 11:45:59.343908 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:59.343817    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/685a0ca3-71d1-4330-b840-56817a0a2a65-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qkbk2\" (UID: \"685a0ca3-71d1-4330-b840-56817a0a2a65\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qkbk2"
Sep 11 11:45:59.343908 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:59.343830    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/685a0ca3-71d1-4330-b840-56817a0a2a65-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qkbk2\" (UID: \"685a0ca3-71d1-4330-b840-56817a0a2a65\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qkbk2"
Sep 11 11:45:59.444958 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:59.444918    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/685a0ca3-71d1-4330-b840-56817a0a2a65-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qkbk2\" (UID: \"685a0ca3-71d1-4330-b840-56817a0a2a65\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qkbk2"
Sep 11 11:45:59.445149 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:59.444988    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/685a0ca3-71d1-4330-b840-56817a0a2a65-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qkbk2\" (UID: \"685a0ca3-71d1-4330-b840-56817a0a2a65\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qkbk2"
Sep 11 11:45:59.445149 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:59.445009    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/685a0ca3-71d1-4330-b840-56817a0a2a65-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qkbk2\" (UID: \"685a0ca3-71d1-4330-b840-56817a0a2a65\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qkbk2"
Sep 11 11:45:59.445149 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:59.445043    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/685a0ca3-71d1-4330-b840-56817a0a2a65-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qkbk2\" (UID: \"685a0ca3-71d1-4330-b840-56817a0a2a65\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qkbk2"
Sep 11 11:45:59.445149 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:59.445057    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/685a0ca3-71d1-4330-b840-56817a0a2a65-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qkbk2\" (UID: \"685a0ca3-71d1-4330-b840-56817a0a2a65\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qkbk2"
Sep 11 11:45:59.445346 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:59.445186    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpwmc\" (UniqueName: \"kubernetes.io/projected/685a0ca3-71d1-4330-b840-56817a0a2a65-kube-api-access-lpwmc\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qkbk2\" (UID: \"685a0ca3-71d1-4330-b840-56817a0a2a65\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qkbk2"
Sep 11 11:45:59.445418 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:59.445395    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/685a0ca3-71d1-4330-b840-56817a0a2a65-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qkbk2\" (UID: \"685a0ca3-71d1-4330-b840-56817a0a2a65\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qkbk2"
Sep 11 11:45:59.445475 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:59.445436    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/685a0ca3-71d1-4330-b840-56817a0a2a65-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qkbk2\" (UID: \"685a0ca3-71d1-4330-b840-56817a0a2a65\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qkbk2"
Sep 11 11:45:59.445526 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:59.445482    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/685a0ca3-71d1-4330-b840-56817a0a2a65-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qkbk2\" (UID: \"685a0ca3-71d1-4330-b840-56817a0a2a65\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qkbk2"
Sep 11 11:45:59.447304 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:59.447282    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/685a0ca3-71d1-4330-b840-56817a0a2a65-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qkbk2\" (UID: \"685a0ca3-71d1-4330-b840-56817a0a2a65\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qkbk2"
Sep 11 11:45:59.447628 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:59.447609    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/685a0ca3-71d1-4330-b840-56817a0a2a65-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qkbk2\" (UID: \"685a0ca3-71d1-4330-b840-56817a0a2a65\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qkbk2"
Sep 11 11:45:59.457685 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:59.457638    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpwmc\" (UniqueName: \"kubernetes.io/projected/685a0ca3-71d1-4330-b840-56817a0a2a65-kube-api-access-lpwmc\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qkbk2\" (UID: \"685a0ca3-71d1-4330-b840-56817a0a2a65\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qkbk2"
Sep 11 11:45:59.607821 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:59.607737    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qkbk2"
Sep 11 11:45:59.933637 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:45:59.933563    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-qkbk2"]
Sep 11 11:45:59.936447 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:45:59.936420    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod685a0ca3_71d1_4330_b840_56817a0a2a65.slice/crio-30ff69ca3b9385aed787fba10fa59add527357d9e86729c36442f0451d4121bb WatchSource:0}: Error finding container 30ff69ca3b9385aed787fba10fa59add527357d9e86729c36442f0451d4121bb: Status 404 returned error can't find the container with id 30ff69ca3b9385aed787fba10fa59add527357d9e86729c36442f0451d4121bb
Sep 11 11:46:00.658446 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:46:00.658411    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qkbk2" event={"ID":"685a0ca3-71d1-4330-b840-56817a0a2a65","Type":"ContainerStarted","Data":"bfe02cf4ffc283d1498885ed4d967e2f78692eb78b62687c2ea56df991619c46"}
Sep 11 11:46:00.658910 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:46:00.658491    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qkbk2" event={"ID":"685a0ca3-71d1-4330-b840-56817a0a2a65","Type":"ContainerStarted","Data":"30ff69ca3b9385aed787fba10fa59add527357d9e86729c36442f0451d4121bb"}
Sep 11 11:46:00.690472 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:46:00.690416    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qkbk2" podStartSLOduration=1.455321292 podStartE2EDuration="1.690397679s" totalImagesPullingTime="235.076387ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:45:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:46:00.68778251 +0000 UTC m=+711.510242403" watchObservedRunningTime="2026-09-11 11:46:00.690397679 +0000 UTC m=+711.512857548"
Sep 11 11:46:09.607946 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:46:09.607859    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qkbk2"
Sep 11 11:46:09.607946 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:46:09.607914    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qkbk2"
Sep 11 11:46:09.620562 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:46:09.620537    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qkbk2"
Sep 11 11:46:09.715087 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:46:09.715057    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qkbk2"
Sep 11 11:47:39.294063 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:39.293985    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-dbe0e7-6fb4d6c78-pthvd"]
Sep 11 11:47:39.296864 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:39.296848    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-dbe0e7-6fb4d6c78-pthvd"
Sep 11 11:47:39.299384 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:39.299360    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-dbe0e7-dockercfg-fxbl6\""
Sep 11 11:47:39.299506 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:39.299363    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-dbe0e7\""
Sep 11 11:47:39.313692 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:39.311449    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-dbe0e7-6fb4d6c78-pthvd"]
Sep 11 11:47:39.391617 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:39.391579    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/070aa3b2-5f7c-43f2-bd0c-836f78060ca5-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-dbe0e7-6fb4d6c78-pthvd\" (UID: \"070aa3b2-5f7c-43f2-bd0c-836f78060ca5\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-dbe0e7-6fb4d6c78-pthvd"
Sep 11 11:47:39.391805 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:39.391700    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvfgc\" (UniqueName: \"kubernetes.io/projected/070aa3b2-5f7c-43f2-bd0c-836f78060ca5-kube-api-access-cvfgc\") pod \"payload-pre-processing-e2e-inf-a-dbe0e7-6fb4d6c78-pthvd\" (UID: \"070aa3b2-5f7c-43f2-bd0c-836f78060ca5\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-dbe0e7-6fb4d6c78-pthvd"
Sep 11 11:47:39.492600 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:39.492558    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/070aa3b2-5f7c-43f2-bd0c-836f78060ca5-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-dbe0e7-6fb4d6c78-pthvd\" (UID: \"070aa3b2-5f7c-43f2-bd0c-836f78060ca5\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-dbe0e7-6fb4d6c78-pthvd"
Sep 11 11:47:39.492600 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:39.492605    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvfgc\" (UniqueName: \"kubernetes.io/projected/070aa3b2-5f7c-43f2-bd0c-836f78060ca5-kube-api-access-cvfgc\") pod \"payload-pre-processing-e2e-inf-a-dbe0e7-6fb4d6c78-pthvd\" (UID: \"070aa3b2-5f7c-43f2-bd0c-836f78060ca5\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-dbe0e7-6fb4d6c78-pthvd"
Sep 11 11:47:39.493293 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:39.493272    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/070aa3b2-5f7c-43f2-bd0c-836f78060ca5-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-dbe0e7-6fb4d6c78-pthvd\" (UID: \"070aa3b2-5f7c-43f2-bd0c-836f78060ca5\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-dbe0e7-6fb4d6c78-pthvd"
Sep 11 11:47:39.501373 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:39.501344    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvfgc\" (UniqueName: \"kubernetes.io/projected/070aa3b2-5f7c-43f2-bd0c-836f78060ca5-kube-api-access-cvfgc\") pod \"payload-pre-processing-e2e-inf-a-dbe0e7-6fb4d6c78-pthvd\" (UID: \"070aa3b2-5f7c-43f2-bd0c-836f78060ca5\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-dbe0e7-6fb4d6c78-pthvd"
Sep 11 11:47:39.607111 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:39.607006    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-dbe0e7-6fb4d6c78-pthvd"
Sep 11 11:47:39.908927 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:39.908741    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-dbe0e7-6fb4d6c78-pthvd"]
Sep 11 11:47:39.911597 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:47:39.911565    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod070aa3b2_5f7c_43f2_bd0c_836f78060ca5.slice/crio-36c5b2f1e884c5dc32a945838e1052c3f5f9218dc975edbed05e26542858e954 WatchSource:0}: Error finding container 36c5b2f1e884c5dc32a945838e1052c3f5f9218dc975edbed05e26542858e954: Status 404 returned error can't find the container with id 36c5b2f1e884c5dc32a945838e1052c3f5f9218dc975edbed05e26542858e954
Sep 11 11:47:40.091431 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:40.091394    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-dbe0e7-6fb4d6c78-pthvd" event={"ID":"070aa3b2-5f7c-43f2-bd0c-836f78060ca5","Type":"ContainerStarted","Data":"3be57d82bd2d2a9f104e4e882ecaf8db9fb1bf27c0c5ecb7b2befd2549df40d9"}
Sep 11 11:47:40.091589 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:40.091447    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-dbe0e7-6fb4d6c78-pthvd" event={"ID":"070aa3b2-5f7c-43f2-bd0c-836f78060ca5","Type":"ContainerStarted","Data":"36c5b2f1e884c5dc32a945838e1052c3f5f9218dc975edbed05e26542858e954"}
Sep 11 11:47:40.091589 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:40.091473    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-dbe0e7-6fb4d6c78-pthvd"
Sep 11 11:47:40.120641 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:40.120589    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-dbe0e7-6fb4d6c78-pthvd" podStartSLOduration=1.120572295 podStartE2EDuration="1.120572295s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:47:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:47:40.119428464 +0000 UTC m=+810.941888355" watchObservedRunningTime="2026-09-11 11:47:40.120572295 +0000 UTC m=+810.943032194"
Sep 11 11:47:46.874662 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:46.874613    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-bddd3ec1-dcf597479-fw2qc"]
Sep 11 11:47:46.878018 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:46.878000    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-bddd3ec1-dcf597479-fw2qc"
Sep 11 11:47:46.881415 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:46.881391    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-bddd3ec1-dockercfg-8k2vr\""
Sep 11 11:47:46.882044 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:46.882024    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-bddd3ec1\""
Sep 11 11:47:46.947160 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:46.947123    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-bddd3ec1-6d948c896b-g9992"]
Sep 11 11:47:46.950605 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:46.950582    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-bddd3ec1-6d948c896b-g9992"
Sep 11 11:47:46.955106 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:46.955079    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-bddd3ec1-dcf597479-fw2qc"]
Sep 11 11:47:46.957844 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:46.957810    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95a352b1-4a10-4409-bc32-0f9a046d4fbe-plugins-config-volume\") pod \"payload-processing-e2e-ait-bddd3ec1-dcf597479-fw2qc\" (UID: \"95a352b1-4a10-4409-bc32-0f9a046d4fbe\") " pod="openshift-ingress/payload-processing-e2e-ait-bddd3ec1-dcf597479-fw2qc"
Sep 11 11:47:46.958011 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:46.957858    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-482lc\" (UniqueName: \"kubernetes.io/projected/7b838c62-31f2-4f1c-a999-3501d3915f6b-kube-api-access-482lc\") pod \"payload-pre-processing-e2e-ait-bddd3ec1-6d948c896b-g9992\" (UID: \"7b838c62-31f2-4f1c-a999-3501d3915f6b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-bddd3ec1-6d948c896b-g9992"
Sep 11 11:47:46.958011 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:46.957888    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2b77n\" (UniqueName: \"kubernetes.io/projected/95a352b1-4a10-4409-bc32-0f9a046d4fbe-kube-api-access-2b77n\") pod \"payload-processing-e2e-ait-bddd3ec1-dcf597479-fw2qc\" (UID: \"95a352b1-4a10-4409-bc32-0f9a046d4fbe\") " pod="openshift-ingress/payload-processing-e2e-ait-bddd3ec1-dcf597479-fw2qc"
Sep 11 11:47:46.958011 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:46.957935    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b838c62-31f2-4f1c-a999-3501d3915f6b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-bddd3ec1-6d948c896b-g9992\" (UID: \"7b838c62-31f2-4f1c-a999-3501d3915f6b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-bddd3ec1-6d948c896b-g9992"
Sep 11 11:47:46.970498 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:46.970468    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-bddd3ec1-6d948c896b-g9992"]
Sep 11 11:47:47.058414 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:47.058381    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b838c62-31f2-4f1c-a999-3501d3915f6b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-bddd3ec1-6d948c896b-g9992\" (UID: \"7b838c62-31f2-4f1c-a999-3501d3915f6b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-bddd3ec1-6d948c896b-g9992"
Sep 11 11:47:47.058591 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:47.058451    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95a352b1-4a10-4409-bc32-0f9a046d4fbe-plugins-config-volume\") pod \"payload-processing-e2e-ait-bddd3ec1-dcf597479-fw2qc\" (UID: \"95a352b1-4a10-4409-bc32-0f9a046d4fbe\") " pod="openshift-ingress/payload-processing-e2e-ait-bddd3ec1-dcf597479-fw2qc"
Sep 11 11:47:47.058591 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:47.058473    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-482lc\" (UniqueName: \"kubernetes.io/projected/7b838c62-31f2-4f1c-a999-3501d3915f6b-kube-api-access-482lc\") pod \"payload-pre-processing-e2e-ait-bddd3ec1-6d948c896b-g9992\" (UID: \"7b838c62-31f2-4f1c-a999-3501d3915f6b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-bddd3ec1-6d948c896b-g9992"
Sep 11 11:47:47.058591 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:47.058493    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2b77n\" (UniqueName: \"kubernetes.io/projected/95a352b1-4a10-4409-bc32-0f9a046d4fbe-kube-api-access-2b77n\") pod \"payload-processing-e2e-ait-bddd3ec1-dcf597479-fw2qc\" (UID: \"95a352b1-4a10-4409-bc32-0f9a046d4fbe\") " pod="openshift-ingress/payload-processing-e2e-ait-bddd3ec1-dcf597479-fw2qc"
Sep 11 11:47:47.059179 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:47.059160    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95a352b1-4a10-4409-bc32-0f9a046d4fbe-plugins-config-volume\") pod \"payload-processing-e2e-ait-bddd3ec1-dcf597479-fw2qc\" (UID: \"95a352b1-4a10-4409-bc32-0f9a046d4fbe\") " pod="openshift-ingress/payload-processing-e2e-ait-bddd3ec1-dcf597479-fw2qc"
Sep 11 11:47:47.059527 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:47.059506    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b838c62-31f2-4f1c-a999-3501d3915f6b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-bddd3ec1-6d948c896b-g9992\" (UID: \"7b838c62-31f2-4f1c-a999-3501d3915f6b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-bddd3ec1-6d948c896b-g9992"
Sep 11 11:47:47.070255 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:47.070224    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2b77n\" (UniqueName: \"kubernetes.io/projected/95a352b1-4a10-4409-bc32-0f9a046d4fbe-kube-api-access-2b77n\") pod \"payload-processing-e2e-ait-bddd3ec1-dcf597479-fw2qc\" (UID: \"95a352b1-4a10-4409-bc32-0f9a046d4fbe\") " pod="openshift-ingress/payload-processing-e2e-ait-bddd3ec1-dcf597479-fw2qc"
Sep 11 11:47:47.070894 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:47.070870    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-482lc\" (UniqueName: \"kubernetes.io/projected/7b838c62-31f2-4f1c-a999-3501d3915f6b-kube-api-access-482lc\") pod \"payload-pre-processing-e2e-ait-bddd3ec1-6d948c896b-g9992\" (UID: \"7b838c62-31f2-4f1c-a999-3501d3915f6b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-bddd3ec1-6d948c896b-g9992"
Sep 11 11:47:47.188216 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:47.188121    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-bddd3ec1-dcf597479-fw2qc"
Sep 11 11:47:47.262582 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:47.262534    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-bddd3ec1-6d948c896b-g9992"
Sep 11 11:47:47.479561 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:47.479527    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-bddd3ec1-dcf597479-fw2qc"]
Sep 11 11:47:47.482395 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:47:47.482374    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95a352b1_4a10_4409_bc32_0f9a046d4fbe.slice/crio-277640fba873579ca5eba68883479d26ca36f3e78c6b151f67de0d6e036eb3c0 WatchSource:0}: Error finding container 277640fba873579ca5eba68883479d26ca36f3e78c6b151f67de0d6e036eb3c0: Status 404 returned error can't find the container with id 277640fba873579ca5eba68883479d26ca36f3e78c6b151f67de0d6e036eb3c0
Sep 11 11:47:47.545458 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:47.545427    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-bddd3ec1-6d948c896b-g9992"]
Sep 11 11:47:47.548192 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:47:47.548162    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b838c62_31f2_4f1c_a999_3501d3915f6b.slice/crio-bc8b627a68f2cb1ae80b7be4cb71a795ee1be4bb24cd4fd21301193a6943c94b WatchSource:0}: Error finding container bc8b627a68f2cb1ae80b7be4cb71a795ee1be4bb24cd4fd21301193a6943c94b: Status 404 returned error can't find the container with id bc8b627a68f2cb1ae80b7be4cb71a795ee1be4bb24cd4fd21301193a6943c94b
Sep 11 11:47:48.128118 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:48.128079    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-bddd3ec1-dcf597479-fw2qc" event={"ID":"95a352b1-4a10-4409-bc32-0f9a046d4fbe","Type":"ContainerStarted","Data":"407a969aa9e6e9f681c3cc131f2a7013ebf48ce478ccc44bd18ad9a65dfb7ea3"}
Sep 11 11:47:48.128594 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:48.128141    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-bddd3ec1-dcf597479-fw2qc" event={"ID":"95a352b1-4a10-4409-bc32-0f9a046d4fbe","Type":"ContainerStarted","Data":"277640fba873579ca5eba68883479d26ca36f3e78c6b151f67de0d6e036eb3c0"}
Sep 11 11:47:48.128594 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:48.128178    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-bddd3ec1-dcf597479-fw2qc"
Sep 11 11:47:48.129775 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:48.129753    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-bddd3ec1-6d948c896b-g9992" event={"ID":"7b838c62-31f2-4f1c-a999-3501d3915f6b","Type":"ContainerStarted","Data":"898104504ead5acb532aeda49948d2c3632c1e3fbdd8fc4d57c7cf034b4f3a8a"}
Sep 11 11:47:48.129896 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:48.129797    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-bddd3ec1-6d948c896b-g9992" event={"ID":"7b838c62-31f2-4f1c-a999-3501d3915f6b","Type":"ContainerStarted","Data":"bc8b627a68f2cb1ae80b7be4cb71a795ee1be4bb24cd4fd21301193a6943c94b"}
Sep 11 11:47:48.129896 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:48.129839    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-bddd3ec1-6d948c896b-g9992"
Sep 11 11:47:48.167204 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:48.167154    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-bddd3ec1-dcf597479-fw2qc" podStartSLOduration=2.167138981 podStartE2EDuration="2.167138981s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:47:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:47:48.152847715 +0000 UTC m=+818.975307632" watchObservedRunningTime="2026-09-11 11:47:48.167138981 +0000 UTC m=+818.989598854"
Sep 11 11:47:48.201142 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:48.201090    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-bddd3ec1-6d948c896b-g9992" podStartSLOduration=2.201072925 podStartE2EDuration="2.201072925s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:47:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:47:48.199311208 +0000 UTC m=+819.021771080" watchObservedRunningTime="2026-09-11 11:47:48.201072925 +0000 UTC m=+819.023532832"
Sep 11 11:47:49.488292 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:49.488255    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-5a5ab7-57646d9598-86hkt"]
Sep 11 11:47:49.491718 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:49.491701    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-5a5ab7-57646d9598-86hkt"
Sep 11 11:47:49.493968 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:49.493944    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-5a5ab7\""
Sep 11 11:47:49.505287 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:49.505264    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-5a5ab7-57646d9598-86hkt"]
Sep 11 11:47:49.525091 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:49.525051    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-5a5ab7-767fc89d4c-4dw6v"]
Sep 11 11:47:49.529390 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:49.529363    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-5a5ab7-767fc89d4c-4dw6v"
Sep 11 11:47:49.531111 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:49.531086    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-5a5ab7-767fc89d4c-4dw6v"]
Sep 11 11:47:49.531820 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:49.531804    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-5a5ab7-dockercfg-hfszz\""
Sep 11 11:47:49.587816 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:49.587785    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e85db8c-6aa2-483c-bdea-29897233195e-plugins-config-volume\") pod \"payload-processing-e2e-autores-5a5ab7-767fc89d4c-4dw6v\" (UID: \"2e85db8c-6aa2-483c-bdea-29897233195e\") " pod="openshift-ingress/payload-processing-e2e-autores-5a5ab7-767fc89d4c-4dw6v"
Sep 11 11:47:49.587981 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:49.587834    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ada94fbb-09f0-4b55-bf95-c297304e9593-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-5a5ab7-57646d9598-86hkt\" (UID: \"ada94fbb-09f0-4b55-bf95-c297304e9593\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-5a5ab7-57646d9598-86hkt"
Sep 11 11:47:49.587981 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:49.587912    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwcqz\" (UniqueName: \"kubernetes.io/projected/ada94fbb-09f0-4b55-bf95-c297304e9593-kube-api-access-mwcqz\") pod \"payload-pre-processing-e2e-autores-5a5ab7-57646d9598-86hkt\" (UID: \"ada94fbb-09f0-4b55-bf95-c297304e9593\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-5a5ab7-57646d9598-86hkt"
Sep 11 11:47:49.587981 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:49.587974    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z22lp\" (UniqueName: \"kubernetes.io/projected/2e85db8c-6aa2-483c-bdea-29897233195e-kube-api-access-z22lp\") pod \"payload-processing-e2e-autores-5a5ab7-767fc89d4c-4dw6v\" (UID: \"2e85db8c-6aa2-483c-bdea-29897233195e\") " pod="openshift-ingress/payload-processing-e2e-autores-5a5ab7-767fc89d4c-4dw6v"
Sep 11 11:47:49.689129 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:49.689095    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e85db8c-6aa2-483c-bdea-29897233195e-plugins-config-volume\") pod \"payload-processing-e2e-autores-5a5ab7-767fc89d4c-4dw6v\" (UID: \"2e85db8c-6aa2-483c-bdea-29897233195e\") " pod="openshift-ingress/payload-processing-e2e-autores-5a5ab7-767fc89d4c-4dw6v"
Sep 11 11:47:49.689342 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:49.689147    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ada94fbb-09f0-4b55-bf95-c297304e9593-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-5a5ab7-57646d9598-86hkt\" (UID: \"ada94fbb-09f0-4b55-bf95-c297304e9593\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-5a5ab7-57646d9598-86hkt"
Sep 11 11:47:49.689342 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:49.689179    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwcqz\" (UniqueName: \"kubernetes.io/projected/ada94fbb-09f0-4b55-bf95-c297304e9593-kube-api-access-mwcqz\") pod \"payload-pre-processing-e2e-autores-5a5ab7-57646d9598-86hkt\" (UID: \"ada94fbb-09f0-4b55-bf95-c297304e9593\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-5a5ab7-57646d9598-86hkt"
Sep 11 11:47:49.689342 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:49.689223    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z22lp\" (UniqueName: \"kubernetes.io/projected/2e85db8c-6aa2-483c-bdea-29897233195e-kube-api-access-z22lp\") pod \"payload-processing-e2e-autores-5a5ab7-767fc89d4c-4dw6v\" (UID: \"2e85db8c-6aa2-483c-bdea-29897233195e\") " pod="openshift-ingress/payload-processing-e2e-autores-5a5ab7-767fc89d4c-4dw6v"
Sep 11 11:47:49.689899 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:49.689879    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ada94fbb-09f0-4b55-bf95-c297304e9593-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-5a5ab7-57646d9598-86hkt\" (UID: \"ada94fbb-09f0-4b55-bf95-c297304e9593\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-5a5ab7-57646d9598-86hkt"
Sep 11 11:47:49.689980 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:49.689960    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e85db8c-6aa2-483c-bdea-29897233195e-plugins-config-volume\") pod \"payload-processing-e2e-autores-5a5ab7-767fc89d4c-4dw6v\" (UID: \"2e85db8c-6aa2-483c-bdea-29897233195e\") " pod="openshift-ingress/payload-processing-e2e-autores-5a5ab7-767fc89d4c-4dw6v"
Sep 11 11:47:49.697560 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:49.697530    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z22lp\" (UniqueName: \"kubernetes.io/projected/2e85db8c-6aa2-483c-bdea-29897233195e-kube-api-access-z22lp\") pod \"payload-processing-e2e-autores-5a5ab7-767fc89d4c-4dw6v\" (UID: \"2e85db8c-6aa2-483c-bdea-29897233195e\") " pod="openshift-ingress/payload-processing-e2e-autores-5a5ab7-767fc89d4c-4dw6v"
Sep 11 11:47:49.697694 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:49.697624    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwcqz\" (UniqueName: \"kubernetes.io/projected/ada94fbb-09f0-4b55-bf95-c297304e9593-kube-api-access-mwcqz\") pod \"payload-pre-processing-e2e-autores-5a5ab7-57646d9598-86hkt\" (UID: \"ada94fbb-09f0-4b55-bf95-c297304e9593\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-5a5ab7-57646d9598-86hkt"
Sep 11 11:47:49.803024 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:49.802928    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-5a5ab7-57646d9598-86hkt"
Sep 11 11:47:49.842313 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:49.842269    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-5a5ab7-767fc89d4c-4dw6v"
Sep 11 11:47:50.076640 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:50.076566    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-5a5ab7-57646d9598-86hkt"]
Sep 11 11:47:50.080215 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:47:50.080187    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podada94fbb_09f0_4b55_bf95_c297304e9593.slice/crio-7aaf771fd4568689efc3663a692c2dc89d82b7f1454205ef4e21cc71d84a5d30 WatchSource:0}: Error finding container 7aaf771fd4568689efc3663a692c2dc89d82b7f1454205ef4e21cc71d84a5d30: Status 404 returned error can't find the container with id 7aaf771fd4568689efc3663a692c2dc89d82b7f1454205ef4e21cc71d84a5d30
Sep 11 11:47:50.128266 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:50.128240    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-5a5ab7-767fc89d4c-4dw6v"]
Sep 11 11:47:50.130309 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:47:50.130276    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e85db8c_6aa2_483c_bdea_29897233195e.slice/crio-82b39293a67eba6f7cc319b7ebe816692aa9f70a2b955a98c5af3af515162610 WatchSource:0}: Error finding container 82b39293a67eba6f7cc319b7ebe816692aa9f70a2b955a98c5af3af515162610: Status 404 returned error can't find the container with id 82b39293a67eba6f7cc319b7ebe816692aa9f70a2b955a98c5af3af515162610
Sep 11 11:47:50.142262 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:50.142119    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-5a5ab7-57646d9598-86hkt" event={"ID":"ada94fbb-09f0-4b55-bf95-c297304e9593","Type":"ContainerStarted","Data":"7aaf771fd4568689efc3663a692c2dc89d82b7f1454205ef4e21cc71d84a5d30"}
Sep 11 11:47:50.143540 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:50.143513    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-5a5ab7-767fc89d4c-4dw6v" event={"ID":"2e85db8c-6aa2-483c-bdea-29897233195e","Type":"ContainerStarted","Data":"82b39293a67eba6f7cc319b7ebe816692aa9f70a2b955a98c5af3af515162610"}
Sep 11 11:47:51.097787 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:51.097748    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-dbe0e7-6fb4d6c78-pthvd"
Sep 11 11:47:51.151203 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:51.151158    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-5a5ab7-57646d9598-86hkt" event={"ID":"ada94fbb-09f0-4b55-bf95-c297304e9593","Type":"ContainerStarted","Data":"f85a7d6ba2038f382e36309df5c010d715c388b5028511e50a444353f8b1b2f2"}
Sep 11 11:47:51.151427 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:51.151407    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-5a5ab7-57646d9598-86hkt"
Sep 11 11:47:51.153003 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:51.152972    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-5a5ab7-767fc89d4c-4dw6v" event={"ID":"2e85db8c-6aa2-483c-bdea-29897233195e","Type":"ContainerStarted","Data":"5b5eace7231f6c1c39803aea1766c4871d36999c223c8e36bcd2a6b8280b54cd"}
Sep 11 11:47:51.153127 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:51.153050    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-5a5ab7-767fc89d4c-4dw6v"
Sep 11 11:47:51.174069 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:51.174017    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-autores-5a5ab7-57646d9598-86hkt" podStartSLOduration=2.173998846 podStartE2EDuration="2.173998846s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:47:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:47:51.169104086 +0000 UTC m=+821.991563960" watchObservedRunningTime="2026-09-11 11:47:51.173998846 +0000 UTC m=+821.996458722"
Sep 11 11:47:51.193401 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:51.193356    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-5a5ab7-767fc89d4c-4dw6v" podStartSLOduration=2.19334023 podStartE2EDuration="2.19334023s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:47:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:47:51.192195603 +0000 UTC m=+822.014655457" watchObservedRunningTime="2026-09-11 11:47:51.19334023 +0000 UTC m=+822.015800160"
Sep 11 11:47:59.136211 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:59.136176    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-bddd3ec1-dcf597479-fw2qc"
Sep 11 11:47:59.136686 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:47:59.136612    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-bddd3ec1-6d948c896b-g9992"
Sep 11 11:48:02.160016 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:02.159988    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-5a5ab7-767fc89d4c-4dw6v"
Sep 11 11:48:02.160400 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:02.160057    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-5a5ab7-57646d9598-86hkt"
Sep 11 11:48:08.214419 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:08.214370    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-c6bcf5-54fcb8ccbb-v2nr8"]
Sep 11 11:48:08.217758 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:08.217727    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c6bcf5-54fcb8ccbb-v2nr8"
Sep 11 11:48:08.222460 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:08.222431    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-c6bcf5\""
Sep 11 11:48:08.225947 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:08.225753    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-c6bcf5-54fcb8ccbb-v2nr8"]
Sep 11 11:48:08.355308 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:08.355272    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltgdf\" (UniqueName: \"kubernetes.io/projected/5b4a6ccc-31af-4331-86c4-d5ac54626ae3-kube-api-access-ltgdf\") pod \"payload-pre-processing-e2e-inf-b-c6bcf5-54fcb8ccbb-v2nr8\" (UID: \"5b4a6ccc-31af-4331-86c4-d5ac54626ae3\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c6bcf5-54fcb8ccbb-v2nr8"
Sep 11 11:48:08.355489 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:08.355327    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b4a6ccc-31af-4331-86c4-d5ac54626ae3-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-c6bcf5-54fcb8ccbb-v2nr8\" (UID: \"5b4a6ccc-31af-4331-86c4-d5ac54626ae3\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c6bcf5-54fcb8ccbb-v2nr8"
Sep 11 11:48:08.456540 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:08.456507    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b4a6ccc-31af-4331-86c4-d5ac54626ae3-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-c6bcf5-54fcb8ccbb-v2nr8\" (UID: \"5b4a6ccc-31af-4331-86c4-d5ac54626ae3\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c6bcf5-54fcb8ccbb-v2nr8"
Sep 11 11:48:08.456760 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:08.456600    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltgdf\" (UniqueName: \"kubernetes.io/projected/5b4a6ccc-31af-4331-86c4-d5ac54626ae3-kube-api-access-ltgdf\") pod \"payload-pre-processing-e2e-inf-b-c6bcf5-54fcb8ccbb-v2nr8\" (UID: \"5b4a6ccc-31af-4331-86c4-d5ac54626ae3\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c6bcf5-54fcb8ccbb-v2nr8"
Sep 11 11:48:08.457258 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:08.457238    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b4a6ccc-31af-4331-86c4-d5ac54626ae3-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-c6bcf5-54fcb8ccbb-v2nr8\" (UID: \"5b4a6ccc-31af-4331-86c4-d5ac54626ae3\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c6bcf5-54fcb8ccbb-v2nr8"
Sep 11 11:48:08.470570 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:08.470502    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltgdf\" (UniqueName: \"kubernetes.io/projected/5b4a6ccc-31af-4331-86c4-d5ac54626ae3-kube-api-access-ltgdf\") pod \"payload-pre-processing-e2e-inf-b-c6bcf5-54fcb8ccbb-v2nr8\" (UID: \"5b4a6ccc-31af-4331-86c4-d5ac54626ae3\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c6bcf5-54fcb8ccbb-v2nr8"
Sep 11 11:48:08.530169 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:08.530129    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c6bcf5-54fcb8ccbb-v2nr8"
Sep 11 11:48:08.803486 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:08.803402    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-c6bcf5-54fcb8ccbb-v2nr8"]
Sep 11 11:48:08.806088 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:48:08.806057    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b4a6ccc_31af_4331_86c4_d5ac54626ae3.slice/crio-42326851beb78b87bc0a0cf82ac8eaebafde5a98c1059baa442a109b11e13c59 WatchSource:0}: Error finding container 42326851beb78b87bc0a0cf82ac8eaebafde5a98c1059baa442a109b11e13c59: Status 404 returned error can't find the container with id 42326851beb78b87bc0a0cf82ac8eaebafde5a98c1059baa442a109b11e13c59
Sep 11 11:48:09.247149 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:09.247103    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c6bcf5-54fcb8ccbb-v2nr8" event={"ID":"5b4a6ccc-31af-4331-86c4-d5ac54626ae3","Type":"ContainerStarted","Data":"8fa39ec3488f81085888c314a9f9810fdb1f11a52cbb5ef94a4a01a0b88d5725"}
Sep 11 11:48:09.247583 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:09.247164    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c6bcf5-54fcb8ccbb-v2nr8" event={"ID":"5b4a6ccc-31af-4331-86c4-d5ac54626ae3","Type":"ContainerStarted","Data":"42326851beb78b87bc0a0cf82ac8eaebafde5a98c1059baa442a109b11e13c59"}
Sep 11 11:48:09.247583 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:09.247191    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c6bcf5-54fcb8ccbb-v2nr8"
Sep 11 11:48:09.285705 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:09.285635    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c6bcf5-54fcb8ccbb-v2nr8" podStartSLOduration=1.285614403 podStartE2EDuration="1.285614403s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:48:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:48:09.283683382 +0000 UTC m=+840.106143277" watchObservedRunningTime="2026-09-11 11:48:09.285614403 +0000 UTC m=+840.108074279"
Sep 11 11:48:15.375258 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:15.375223    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bddd3ec1-sccgw"]
Sep 11 11:48:15.379897 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:15.379865    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bddd3ec1-sccgw"
Sep 11 11:48:15.383824 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:15.383802    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f46tj\""
Sep 11 11:48:15.386302 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:15.386280    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 11:48:15.399586 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:15.399565    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bddd3ec1-sccgw"]
Sep 11 11:48:15.517514 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:15.517479    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6e76636-6f8a-4198-a765-e648409a80dd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-bddd3ec1-sccgw\" (UID: \"e6e76636-6f8a-4198-a765-e648409a80dd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bddd3ec1-sccgw"
Sep 11 11:48:15.618369 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:15.618330    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6e76636-6f8a-4198-a765-e648409a80dd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-bddd3ec1-sccgw\" (UID: \"e6e76636-6f8a-4198-a765-e648409a80dd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bddd3ec1-sccgw"
Sep 11 11:48:15.618965 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:15.618947    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6e76636-6f8a-4198-a765-e648409a80dd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-bddd3ec1-sccgw\" (UID: \"e6e76636-6f8a-4198-a765-e648409a80dd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bddd3ec1-sccgw"
Sep 11 11:48:15.690846 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:15.690763    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bddd3ec1-sccgw"
Sep 11 11:48:15.961897 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:15.961842    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bddd3ec1-sccgw"]
Sep 11 11:48:15.964120 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:48:15.964093    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6e76636_6f8a_4198_a765_e648409a80dd.slice/crio-2e4f6f853665b1b75e15d4bbc377f8408c322eece8a52af3288c79e10cb448dc WatchSource:0}: Error finding container 2e4f6f853665b1b75e15d4bbc377f8408c322eece8a52af3288c79e10cb448dc: Status 404 returned error can't find the container with id 2e4f6f853665b1b75e15d4bbc377f8408c322eece8a52af3288c79e10cb448dc
Sep 11 11:48:16.283531 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:16.283488    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bddd3ec1-sccgw" event={"ID":"e6e76636-6f8a-4198-a765-e648409a80dd","Type":"ContainerStarted","Data":"8717bba15ab044e21d708c86252928dd846a6f21de345ef3150874ad41dc7cbb"}
Sep 11 11:48:16.283730 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:16.283555    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bddd3ec1-sccgw" event={"ID":"e6e76636-6f8a-4198-a765-e648409a80dd","Type":"ContainerStarted","Data":"2e4f6f853665b1b75e15d4bbc377f8408c322eece8a52af3288c79e10cb448dc"}
Sep 11 11:48:16.305443 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:16.305384    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bddd3ec1-sccgw" podStartSLOduration=1.305367967 podStartE2EDuration="1.305367967s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:48:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:48:16.303167533 +0000 UTC m=+847.125627419" watchObservedRunningTime="2026-09-11 11:48:16.305367967 +0000 UTC m=+847.127827880"
Sep 11 11:48:17.289981 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:17.289948    2560 generic.go:356] "Generic (PLEG): container finished" podID="e6e76636-6f8a-4198-a765-e648409a80dd" containerID="8717bba15ab044e21d708c86252928dd846a6f21de345ef3150874ad41dc7cbb" exitCode=0
Sep 11 11:48:17.290350 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:17.290043    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bddd3ec1-sccgw" event={"ID":"e6e76636-6f8a-4198-a765-e648409a80dd","Type":"ContainerDied","Data":"8717bba15ab044e21d708c86252928dd846a6f21de345ef3150874ad41dc7cbb"}
Sep 11 11:48:18.426453 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:18.426429    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bddd3ec1-sccgw"
Sep 11 11:48:18.545461 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:18.545372    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6e76636-6f8a-4198-a765-e648409a80dd-maas-api-service-ca\") pod \"e6e76636-6f8a-4198-a765-e648409a80dd\" (UID: \"e6e76636-6f8a-4198-a765-e648409a80dd\") "
Sep 11 11:48:18.545753 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:18.545705    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6e76636-6f8a-4198-a765-e648409a80dd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e6e76636-6f8a-4198-a765-e648409a80dd" (UID: "e6e76636-6f8a-4198-a765-e648409a80dd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 11:48:18.646254 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:18.646218    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6e76636-6f8a-4198-a765-e648409a80dd-maas-api-service-ca\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:48:19.301718 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:19.301692    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bddd3ec1-sccgw"
Sep 11 11:48:19.301883 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:19.301691    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bddd3ec1-sccgw" event={"ID":"e6e76636-6f8a-4198-a765-e648409a80dd","Type":"ContainerDied","Data":"2e4f6f853665b1b75e15d4bbc377f8408c322eece8a52af3288c79e10cb448dc"}
Sep 11 11:48:19.301883 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:19.301813    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2e4f6f853665b1b75e15d4bbc377f8408c322eece8a52af3288c79e10cb448dc"
Sep 11 11:48:20.255382 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:20.255349    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c6bcf5-54fcb8ccbb-v2nr8"
Sep 11 11:48:26.740609 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:26.740572    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-bddd3ec1-dcf597479-fw2qc"]
Sep 11 11:48:26.740989 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:26.740861    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-bddd3ec1-dcf597479-fw2qc" podUID="95a352b1-4a10-4409-bc32-0f9a046d4fbe" containerName="payload-processing" containerID="cri-o://407a969aa9e6e9f681c3cc131f2a7013ebf48ce478ccc44bd18ad9a65dfb7ea3" gracePeriod=30
Sep 11 11:48:26.767890 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:26.767858    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-bddd3ec1-6d948c896b-g9992"]
Sep 11 11:48:26.768121 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:26.768096    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-bddd3ec1-6d948c896b-g9992" podUID="7b838c62-31f2-4f1c-a999-3501d3915f6b" containerName="payload-pre-processing" containerID="cri-o://898104504ead5acb532aeda49948d2c3632c1e3fbdd8fc4d57c7cf034b4f3a8a" gracePeriod=30
Sep 11 11:48:27.051365 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:27.051338    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-bddd3ec1-dcf597479-fw2qc"
Sep 11 11:48:27.054355 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:27.054331    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-bddd3ec1-6d948c896b-g9992"
Sep 11 11:48:27.177085 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:27.177050    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bddd3ec1-sccgw"]
Sep 11 11:48:27.180603 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:27.180573    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bddd3ec1-sccgw"]
Sep 11 11:48:27.218322 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:27.218287    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2b77n\" (UniqueName: \"kubernetes.io/projected/95a352b1-4a10-4409-bc32-0f9a046d4fbe-kube-api-access-2b77n\") pod \"95a352b1-4a10-4409-bc32-0f9a046d4fbe\" (UID: \"95a352b1-4a10-4409-bc32-0f9a046d4fbe\") "
Sep 11 11:48:27.218486 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:27.218342    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-482lc\" (UniqueName: \"kubernetes.io/projected/7b838c62-31f2-4f1c-a999-3501d3915f6b-kube-api-access-482lc\") pod \"7b838c62-31f2-4f1c-a999-3501d3915f6b\" (UID: \"7b838c62-31f2-4f1c-a999-3501d3915f6b\") "
Sep 11 11:48:27.218486 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:27.218375    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b838c62-31f2-4f1c-a999-3501d3915f6b-plugins-config-volume\") pod \"7b838c62-31f2-4f1c-a999-3501d3915f6b\" (UID: \"7b838c62-31f2-4f1c-a999-3501d3915f6b\") "
Sep 11 11:48:27.218579 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:27.218478    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95a352b1-4a10-4409-bc32-0f9a046d4fbe-plugins-config-volume\") pod \"95a352b1-4a10-4409-bc32-0f9a046d4fbe\" (UID: \"95a352b1-4a10-4409-bc32-0f9a046d4fbe\") "
Sep 11 11:48:27.218790 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:27.218764    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b838c62-31f2-4f1c-a999-3501d3915f6b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7b838c62-31f2-4f1c-a999-3501d3915f6b" (UID: "7b838c62-31f2-4f1c-a999-3501d3915f6b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 11:48:27.218888 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:27.218865    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95a352b1-4a10-4409-bc32-0f9a046d4fbe-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "95a352b1-4a10-4409-bc32-0f9a046d4fbe" (UID: "95a352b1-4a10-4409-bc32-0f9a046d4fbe"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 11:48:27.220504 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:27.220485    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95a352b1-4a10-4409-bc32-0f9a046d4fbe-kube-api-access-2b77n" (OuterVolumeSpecName: "kube-api-access-2b77n") pod "95a352b1-4a10-4409-bc32-0f9a046d4fbe" (UID: "95a352b1-4a10-4409-bc32-0f9a046d4fbe"). InnerVolumeSpecName "kube-api-access-2b77n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:48:27.220558 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:27.220513    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b838c62-31f2-4f1c-a999-3501d3915f6b-kube-api-access-482lc" (OuterVolumeSpecName: "kube-api-access-482lc") pod "7b838c62-31f2-4f1c-a999-3501d3915f6b" (UID: "7b838c62-31f2-4f1c-a999-3501d3915f6b"). InnerVolumeSpecName "kube-api-access-482lc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:48:27.320226 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:27.320147    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-482lc\" (UniqueName: \"kubernetes.io/projected/7b838c62-31f2-4f1c-a999-3501d3915f6b-kube-api-access-482lc\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:48:27.320226 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:27.320179    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b838c62-31f2-4f1c-a999-3501d3915f6b-plugins-config-volume\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:48:27.320226 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:27.320191    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95a352b1-4a10-4409-bc32-0f9a046d4fbe-plugins-config-volume\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:48:27.320226 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:27.320200    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2b77n\" (UniqueName: \"kubernetes.io/projected/95a352b1-4a10-4409-bc32-0f9a046d4fbe-kube-api-access-2b77n\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:48:27.340537 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:27.340500    2560 generic.go:356] "Generic (PLEG): container finished" podID="7b838c62-31f2-4f1c-a999-3501d3915f6b" containerID="898104504ead5acb532aeda49948d2c3632c1e3fbdd8fc4d57c7cf034b4f3a8a" exitCode=0
Sep 11 11:48:27.340728 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:27.340551    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-bddd3ec1-6d948c896b-g9992"
Sep 11 11:48:27.340728 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:27.340562    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-bddd3ec1-6d948c896b-g9992" event={"ID":"7b838c62-31f2-4f1c-a999-3501d3915f6b","Type":"ContainerDied","Data":"898104504ead5acb532aeda49948d2c3632c1e3fbdd8fc4d57c7cf034b4f3a8a"}
Sep 11 11:48:27.340728 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:27.340633    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-bddd3ec1-6d948c896b-g9992" event={"ID":"7b838c62-31f2-4f1c-a999-3501d3915f6b","Type":"ContainerDied","Data":"bc8b627a68f2cb1ae80b7be4cb71a795ee1be4bb24cd4fd21301193a6943c94b"}
Sep 11 11:48:27.340728 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:27.340693    2560 scope.go:117] "RemoveContainer" containerID="898104504ead5acb532aeda49948d2c3632c1e3fbdd8fc4d57c7cf034b4f3a8a"
Sep 11 11:48:27.342213 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:27.342162    2560 generic.go:356] "Generic (PLEG): container finished" podID="95a352b1-4a10-4409-bc32-0f9a046d4fbe" containerID="407a969aa9e6e9f681c3cc131f2a7013ebf48ce478ccc44bd18ad9a65dfb7ea3" exitCode=0
Sep 11 11:48:27.342213 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:27.342192    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-bddd3ec1-dcf597479-fw2qc" event={"ID":"95a352b1-4a10-4409-bc32-0f9a046d4fbe","Type":"ContainerDied","Data":"407a969aa9e6e9f681c3cc131f2a7013ebf48ce478ccc44bd18ad9a65dfb7ea3"}
Sep 11 11:48:27.342345 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:27.342216    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-bddd3ec1-dcf597479-fw2qc"
Sep 11 11:48:27.342345 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:27.342246    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-bddd3ec1-dcf597479-fw2qc" event={"ID":"95a352b1-4a10-4409-bc32-0f9a046d4fbe","Type":"ContainerDied","Data":"277640fba873579ca5eba68883479d26ca36f3e78c6b151f67de0d6e036eb3c0"}
Sep 11 11:48:27.350382 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:27.350356    2560 scope.go:117] "RemoveContainer" containerID="898104504ead5acb532aeda49948d2c3632c1e3fbdd8fc4d57c7cf034b4f3a8a"
Sep 11 11:48:27.350752 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:48:27.350726    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"898104504ead5acb532aeda49948d2c3632c1e3fbdd8fc4d57c7cf034b4f3a8a\": container with ID starting with 898104504ead5acb532aeda49948d2c3632c1e3fbdd8fc4d57c7cf034b4f3a8a not found: ID does not exist" containerID="898104504ead5acb532aeda49948d2c3632c1e3fbdd8fc4d57c7cf034b4f3a8a"
Sep 11 11:48:27.350858 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:27.350763    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"898104504ead5acb532aeda49948d2c3632c1e3fbdd8fc4d57c7cf034b4f3a8a"} err="failed to get container status \"898104504ead5acb532aeda49948d2c3632c1e3fbdd8fc4d57c7cf034b4f3a8a\": rpc error: code = NotFound desc = could not find container \"898104504ead5acb532aeda49948d2c3632c1e3fbdd8fc4d57c7cf034b4f3a8a\": container with ID starting with 898104504ead5acb532aeda49948d2c3632c1e3fbdd8fc4d57c7cf034b4f3a8a not found: ID does not exist"
Sep 11 11:48:27.350858 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:27.350785    2560 scope.go:117] "RemoveContainer" containerID="407a969aa9e6e9f681c3cc131f2a7013ebf48ce478ccc44bd18ad9a65dfb7ea3"
Sep 11 11:48:27.358698 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:27.358677    2560 scope.go:117] "RemoveContainer" containerID="407a969aa9e6e9f681c3cc131f2a7013ebf48ce478ccc44bd18ad9a65dfb7ea3"
Sep 11 11:48:27.358982 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:48:27.358964    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"407a969aa9e6e9f681c3cc131f2a7013ebf48ce478ccc44bd18ad9a65dfb7ea3\": container with ID starting with 407a969aa9e6e9f681c3cc131f2a7013ebf48ce478ccc44bd18ad9a65dfb7ea3 not found: ID does not exist" containerID="407a969aa9e6e9f681c3cc131f2a7013ebf48ce478ccc44bd18ad9a65dfb7ea3"
Sep 11 11:48:27.359046 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:27.358989    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"407a969aa9e6e9f681c3cc131f2a7013ebf48ce478ccc44bd18ad9a65dfb7ea3"} err="failed to get container status \"407a969aa9e6e9f681c3cc131f2a7013ebf48ce478ccc44bd18ad9a65dfb7ea3\": rpc error: code = NotFound desc = could not find container \"407a969aa9e6e9f681c3cc131f2a7013ebf48ce478ccc44bd18ad9a65dfb7ea3\": container with ID starting with 407a969aa9e6e9f681c3cc131f2a7013ebf48ce478ccc44bd18ad9a65dfb7ea3 not found: ID does not exist"
Sep 11 11:48:27.369212 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:27.369186    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-bddd3ec1-dcf597479-fw2qc"]
Sep 11 11:48:27.374502 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:27.374480    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-bddd3ec1-dcf597479-fw2qc"]
Sep 11 11:48:27.390096 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:27.390067    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-bddd3ec1-6d948c896b-g9992"]
Sep 11 11:48:27.394997 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:27.394975    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-bddd3ec1-6d948c896b-g9992"]
Sep 11 11:48:27.814173 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:27.814140    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b838c62-31f2-4f1c-a999-3501d3915f6b" path="/var/lib/kubelet/pods/7b838c62-31f2-4f1c-a999-3501d3915f6b/volumes"
Sep 11 11:48:27.814505 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:27.814495    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95a352b1-4a10-4409-bc32-0f9a046d4fbe" path="/var/lib/kubelet/pods/95a352b1-4a10-4409-bc32-0f9a046d4fbe/volumes"
Sep 11 11:48:27.814810 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:27.814797    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6e76636-6f8a-4198-a765-e648409a80dd" path="/var/lib/kubelet/pods/e6e76636-6f8a-4198-a765-e648409a80dd/volumes"
Sep 11 11:48:32.407616 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:32.407580    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-5fdde1a2-b766988bb-4g456"]
Sep 11 11:48:32.408000 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:32.407920    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95a352b1-4a10-4409-bc32-0f9a046d4fbe" containerName="payload-processing"
Sep 11 11:48:32.408000 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:32.407931    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="95a352b1-4a10-4409-bc32-0f9a046d4fbe" containerName="payload-processing"
Sep 11 11:48:32.408000 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:32.407946    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6e76636-6f8a-4198-a765-e648409a80dd" containerName="revoke-keys"
Sep 11 11:48:32.408000 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:32.407953    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6e76636-6f8a-4198-a765-e648409a80dd" containerName="revoke-keys"
Sep 11 11:48:32.408000 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:32.407962    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b838c62-31f2-4f1c-a999-3501d3915f6b" containerName="payload-pre-processing"
Sep 11 11:48:32.408000 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:32.407969    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b838c62-31f2-4f1c-a999-3501d3915f6b" containerName="payload-pre-processing"
Sep 11 11:48:32.408186 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:32.408022    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6e76636-6f8a-4198-a765-e648409a80dd" containerName="revoke-keys"
Sep 11 11:48:32.408186 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:32.408030    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="95a352b1-4a10-4409-bc32-0f9a046d4fbe" containerName="payload-processing"
Sep 11 11:48:32.408186 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:32.408038    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b838c62-31f2-4f1c-a999-3501d3915f6b" containerName="payload-pre-processing"
Sep 11 11:48:32.412202 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:32.412185    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5fdde1a2-b766988bb-4g456"
Sep 11 11:48:32.414680 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:32.414640    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-5fdde1a2\""
Sep 11 11:48:32.425457 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:32.425436    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-5fdde1a2-b766988bb-4g456"]
Sep 11 11:48:32.427396 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:32.427378    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-5fdde1a2-65c88db94b-tlvp7"]
Sep 11 11:48:32.430552 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:32.430534    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-5fdde1a2-65c88db94b-tlvp7"
Sep 11 11:48:32.433099 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:32.433077    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-5fdde1a2-dockercfg-49fwf\""
Sep 11 11:48:32.449511 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:32.449484    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-5fdde1a2-65c88db94b-tlvp7"]
Sep 11 11:48:32.460735 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:32.460710    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63e0d2b8-350b-4b3b-8c64-d26b53e6f9d0-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-5fdde1a2-b766988bb-4g456\" (UID: \"63e0d2b8-350b-4b3b-8c64-d26b53e6f9d0\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-5fdde1a2-b766988bb-4g456"
Sep 11 11:48:32.460852 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:32.460756    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad6ebaf4-4e74-48a6-8a64-804eb0619156-plugins-config-volume\") pod \"payload-processing-e2e-migrate-5fdde1a2-65c88db94b-tlvp7\" (UID: \"ad6ebaf4-4e74-48a6-8a64-804eb0619156\") " pod="openshift-ingress/payload-processing-e2e-migrate-5fdde1a2-65c88db94b-tlvp7"
Sep 11 11:48:32.460852 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:32.460830    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls9hj\" (UniqueName: \"kubernetes.io/projected/ad6ebaf4-4e74-48a6-8a64-804eb0619156-kube-api-access-ls9hj\") pod \"payload-processing-e2e-migrate-5fdde1a2-65c88db94b-tlvp7\" (UID: \"ad6ebaf4-4e74-48a6-8a64-804eb0619156\") " pod="openshift-ingress/payload-processing-e2e-migrate-5fdde1a2-65c88db94b-tlvp7"
Sep 11 11:48:32.460926 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:32.460900    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc88v\" (UniqueName: \"kubernetes.io/projected/63e0d2b8-350b-4b3b-8c64-d26b53e6f9d0-kube-api-access-lc88v\") pod \"payload-pre-processing-e2e-migrate-5fdde1a2-b766988bb-4g456\" (UID: \"63e0d2b8-350b-4b3b-8c64-d26b53e6f9d0\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-5fdde1a2-b766988bb-4g456"
Sep 11 11:48:32.562010 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:32.561974    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc88v\" (UniqueName: \"kubernetes.io/projected/63e0d2b8-350b-4b3b-8c64-d26b53e6f9d0-kube-api-access-lc88v\") pod \"payload-pre-processing-e2e-migrate-5fdde1a2-b766988bb-4g456\" (UID: \"63e0d2b8-350b-4b3b-8c64-d26b53e6f9d0\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-5fdde1a2-b766988bb-4g456"
Sep 11 11:48:32.562204 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:32.562028    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63e0d2b8-350b-4b3b-8c64-d26b53e6f9d0-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-5fdde1a2-b766988bb-4g456\" (UID: \"63e0d2b8-350b-4b3b-8c64-d26b53e6f9d0\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-5fdde1a2-b766988bb-4g456"
Sep 11 11:48:32.562204 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:32.562063    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad6ebaf4-4e74-48a6-8a64-804eb0619156-plugins-config-volume\") pod \"payload-processing-e2e-migrate-5fdde1a2-65c88db94b-tlvp7\" (UID: \"ad6ebaf4-4e74-48a6-8a64-804eb0619156\") " pod="openshift-ingress/payload-processing-e2e-migrate-5fdde1a2-65c88db94b-tlvp7"
Sep 11 11:48:32.562204 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:32.562086    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ls9hj\" (UniqueName: \"kubernetes.io/projected/ad6ebaf4-4e74-48a6-8a64-804eb0619156-kube-api-access-ls9hj\") pod \"payload-processing-e2e-migrate-5fdde1a2-65c88db94b-tlvp7\" (UID: \"ad6ebaf4-4e74-48a6-8a64-804eb0619156\") " pod="openshift-ingress/payload-processing-e2e-migrate-5fdde1a2-65c88db94b-tlvp7"
Sep 11 11:48:32.562823 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:32.562802    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad6ebaf4-4e74-48a6-8a64-804eb0619156-plugins-config-volume\") pod \"payload-processing-e2e-migrate-5fdde1a2-65c88db94b-tlvp7\" (UID: \"ad6ebaf4-4e74-48a6-8a64-804eb0619156\") " pod="openshift-ingress/payload-processing-e2e-migrate-5fdde1a2-65c88db94b-tlvp7"
Sep 11 11:48:32.562892 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:32.562857    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63e0d2b8-350b-4b3b-8c64-d26b53e6f9d0-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-5fdde1a2-b766988bb-4g456\" (UID: \"63e0d2b8-350b-4b3b-8c64-d26b53e6f9d0\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-5fdde1a2-b766988bb-4g456"
Sep 11 11:48:32.571045 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:32.571019    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc88v\" (UniqueName: \"kubernetes.io/projected/63e0d2b8-350b-4b3b-8c64-d26b53e6f9d0-kube-api-access-lc88v\") pod \"payload-pre-processing-e2e-migrate-5fdde1a2-b766988bb-4g456\" (UID: \"63e0d2b8-350b-4b3b-8c64-d26b53e6f9d0\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-5fdde1a2-b766988bb-4g456"
Sep 11 11:48:32.571179 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:32.571157    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls9hj\" (UniqueName: \"kubernetes.io/projected/ad6ebaf4-4e74-48a6-8a64-804eb0619156-kube-api-access-ls9hj\") pod \"payload-processing-e2e-migrate-5fdde1a2-65c88db94b-tlvp7\" (UID: \"ad6ebaf4-4e74-48a6-8a64-804eb0619156\") " pod="openshift-ingress/payload-processing-e2e-migrate-5fdde1a2-65c88db94b-tlvp7"
Sep 11 11:48:32.722746 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:32.722717    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5fdde1a2-b766988bb-4g456"
Sep 11 11:48:32.741104 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:32.741075    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-5fdde1a2-65c88db94b-tlvp7"
Sep 11 11:48:33.001770 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:33.001747    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-5fdde1a2-b766988bb-4g456"]
Sep 11 11:48:33.004321 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:48:33.004291    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63e0d2b8_350b_4b3b_8c64_d26b53e6f9d0.slice/crio-431176f136752df075e724c09297e1103a2c5dea572366f5ec12ecc45fac8bbd WatchSource:0}: Error finding container 431176f136752df075e724c09297e1103a2c5dea572366f5ec12ecc45fac8bbd: Status 404 returned error can't find the container with id 431176f136752df075e724c09297e1103a2c5dea572366f5ec12ecc45fac8bbd
Sep 11 11:48:33.033020 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:33.032968    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-5fdde1a2-65c88db94b-tlvp7"]
Sep 11 11:48:33.038729 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:48:33.038697    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad6ebaf4_4e74_48a6_8a64_804eb0619156.slice/crio-94c7963b1b6eba2ba7e2d201740588568eab8dbbb3fb73082420caf1a9d0cc90 WatchSource:0}: Error finding container 94c7963b1b6eba2ba7e2d201740588568eab8dbbb3fb73082420caf1a9d0cc90: Status 404 returned error can't find the container with id 94c7963b1b6eba2ba7e2d201740588568eab8dbbb3fb73082420caf1a9d0cc90
Sep 11 11:48:33.374932 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:33.374835    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5fdde1a2-b766988bb-4g456" event={"ID":"63e0d2b8-350b-4b3b-8c64-d26b53e6f9d0","Type":"ContainerStarted","Data":"c1b38cf56bd96af585bc47c0eee1e7b6c33be468de9cfc2bfffff19daa498a26"}
Sep 11 11:48:33.374932 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:33.374885    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5fdde1a2-b766988bb-4g456" event={"ID":"63e0d2b8-350b-4b3b-8c64-d26b53e6f9d0","Type":"ContainerStarted","Data":"431176f136752df075e724c09297e1103a2c5dea572366f5ec12ecc45fac8bbd"}
Sep 11 11:48:33.375144 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:33.374972    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5fdde1a2-b766988bb-4g456"
Sep 11 11:48:33.376658 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:33.376623    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-5fdde1a2-65c88db94b-tlvp7" event={"ID":"ad6ebaf4-4e74-48a6-8a64-804eb0619156","Type":"ContainerStarted","Data":"d6167179233a954efebc7a83812a4d600362257b59a0b8194360ba0bab7d37cc"}
Sep 11 11:48:33.376788 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:33.376685    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-5fdde1a2-65c88db94b-tlvp7"
Sep 11 11:48:33.376788 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:33.376702    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-5fdde1a2-65c88db94b-tlvp7" event={"ID":"ad6ebaf4-4e74-48a6-8a64-804eb0619156","Type":"ContainerStarted","Data":"94c7963b1b6eba2ba7e2d201740588568eab8dbbb3fb73082420caf1a9d0cc90"}
Sep 11 11:48:33.393261 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:33.393218    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5fdde1a2-b766988bb-4g456" podStartSLOduration=1.393204611 podStartE2EDuration="1.393204611s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:48:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:48:33.39119967 +0000 UTC m=+864.213659582" watchObservedRunningTime="2026-09-11 11:48:33.393204611 +0000 UTC m=+864.215664484"
Sep 11 11:48:33.410840 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:33.410794    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-5fdde1a2-65c88db94b-tlvp7" podStartSLOduration=1.410778664 podStartE2EDuration="1.410778664s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:48:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:48:33.408211947 +0000 UTC m=+864.230671833" watchObservedRunningTime="2026-09-11 11:48:33.410778664 +0000 UTC m=+864.233238537"
Sep 11 11:48:44.383490 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:44.383457    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-5fdde1a2-65c88db94b-tlvp7"
Sep 11 11:48:44.383883 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:44.383640    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5fdde1a2-b766988bb-4g456"
Sep 11 11:48:56.118556 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:56.118520    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5fdde1a2-gq6jv"]
Sep 11 11:48:56.122100 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:56.122084    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5fdde1a2-gq6jv"
Sep 11 11:48:56.124489 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:56.124471    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f46tj\""
Sep 11 11:48:56.124737 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:56.124719    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 11:48:56.134790 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:56.134768    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5fdde1a2-gq6jv"]
Sep 11 11:48:56.167287 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:56.167260    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5af3f6b-7c69-4382-b5f8-8376066ff33b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-5fdde1a2-gq6jv\" (UID: \"a5af3f6b-7c69-4382-b5f8-8376066ff33b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5fdde1a2-gq6jv"
Sep 11 11:48:56.268628 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:56.268591    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5af3f6b-7c69-4382-b5f8-8376066ff33b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-5fdde1a2-gq6jv\" (UID: \"a5af3f6b-7c69-4382-b5f8-8376066ff33b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5fdde1a2-gq6jv"
Sep 11 11:48:56.269214 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:56.269195    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5af3f6b-7c69-4382-b5f8-8376066ff33b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-5fdde1a2-gq6jv\" (UID: \"a5af3f6b-7c69-4382-b5f8-8376066ff33b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5fdde1a2-gq6jv"
Sep 11 11:48:56.457011 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:56.456927    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5fdde1a2-gq6jv"
Sep 11 11:48:56.727623 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:56.727597    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5fdde1a2-gq6jv"]
Sep 11 11:48:56.729793 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:48:56.729769    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5af3f6b_7c69_4382_b5f8_8376066ff33b.slice/crio-1552f57bfcc7fd47f52acb55d958df4c1e88a636e90dfef3679db7a9f015409e WatchSource:0}: Error finding container 1552f57bfcc7fd47f52acb55d958df4c1e88a636e90dfef3679db7a9f015409e: Status 404 returned error can't find the container with id 1552f57bfcc7fd47f52acb55d958df4c1e88a636e90dfef3679db7a9f015409e
Sep 11 11:48:57.493532 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:57.493501    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5fdde1a2-gq6jv" event={"ID":"a5af3f6b-7c69-4382-b5f8-8376066ff33b","Type":"ContainerStarted","Data":"d975a6184759659a72405a3db8b165abae4bc134ca5da45741414eb9e43df9a3"}
Sep 11 11:48:57.493919 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:57.493554    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5fdde1a2-gq6jv" event={"ID":"a5af3f6b-7c69-4382-b5f8-8376066ff33b","Type":"ContainerStarted","Data":"1552f57bfcc7fd47f52acb55d958df4c1e88a636e90dfef3679db7a9f015409e"}
Sep 11 11:48:57.512414 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:57.512359    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5fdde1a2-gq6jv" podStartSLOduration=1.5123440559999999 podStartE2EDuration="1.512344056s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:48:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:48:57.510151654 +0000 UTC m=+888.332611529" watchObservedRunningTime="2026-09-11 11:48:57.512344056 +0000 UTC m=+888.334803967"
Sep 11 11:48:58.500589 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:58.500546    2560 generic.go:356] "Generic (PLEG): container finished" podID="a5af3f6b-7c69-4382-b5f8-8376066ff33b" containerID="d975a6184759659a72405a3db8b165abae4bc134ca5da45741414eb9e43df9a3" exitCode=0
Sep 11 11:48:58.500999 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:58.500601    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5fdde1a2-gq6jv" event={"ID":"a5af3f6b-7c69-4382-b5f8-8376066ff33b","Type":"ContainerDied","Data":"d975a6184759659a72405a3db8b165abae4bc134ca5da45741414eb9e43df9a3"}
Sep 11 11:48:59.644034 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:59.644004    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5fdde1a2-gq6jv"
Sep 11 11:48:59.699100 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:59.699069    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5af3f6b-7c69-4382-b5f8-8376066ff33b-maas-api-service-ca\") pod \"a5af3f6b-7c69-4382-b5f8-8376066ff33b\" (UID: \"a5af3f6b-7c69-4382-b5f8-8376066ff33b\") "
Sep 11 11:48:59.699372 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:59.699351    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5af3f6b-7c69-4382-b5f8-8376066ff33b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a5af3f6b-7c69-4382-b5f8-8376066ff33b" (UID: "a5af3f6b-7c69-4382-b5f8-8376066ff33b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 11:48:59.800405 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:48:59.800325    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5af3f6b-7c69-4382-b5f8-8376066ff33b-maas-api-service-ca\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:49:00.511226 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:00.511199    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5fdde1a2-gq6jv"
Sep 11 11:49:00.511226 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:00.511215    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5fdde1a2-gq6jv" event={"ID":"a5af3f6b-7c69-4382-b5f8-8376066ff33b","Type":"ContainerDied","Data":"1552f57bfcc7fd47f52acb55d958df4c1e88a636e90dfef3679db7a9f015409e"}
Sep 11 11:49:00.511467 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:00.511258    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1552f57bfcc7fd47f52acb55d958df4c1e88a636e90dfef3679db7a9f015409e"
Sep 11 11:49:02.786209 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:02.786123    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-5fdde1a2-65c88db94b-tlvp7"]
Sep 11 11:49:02.786579 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:02.786443    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-5fdde1a2-65c88db94b-tlvp7" podUID="ad6ebaf4-4e74-48a6-8a64-804eb0619156" containerName="payload-processing" containerID="cri-o://d6167179233a954efebc7a83812a4d600362257b59a0b8194360ba0bab7d37cc" gracePeriod=30
Sep 11 11:49:02.795031 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:02.795002    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-5fdde1a2-b766988bb-4g456"]
Sep 11 11:49:02.796132 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:02.795538    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5fdde1a2-b766988bb-4g456" podUID="63e0d2b8-350b-4b3b-8c64-d26b53e6f9d0" containerName="payload-pre-processing" containerID="cri-o://c1b38cf56bd96af585bc47c0eee1e7b6c33be468de9cfc2bfffff19daa498a26" gracePeriod=30
Sep 11 11:49:02.968567 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:02.968506    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5fdde1a2-gq6jv"]
Sep 11 11:49:02.974861 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:02.974834    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5fdde1a2-gq6jv"]
Sep 11 11:49:03.037362 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:03.037303    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-5fdde1a2-65c88db94b-tlvp7"
Sep 11 11:49:03.075147 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:03.075125    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5fdde1a2-b766988bb-4g456"
Sep 11 11:49:03.130279 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:03.130244    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ls9hj\" (UniqueName: \"kubernetes.io/projected/ad6ebaf4-4e74-48a6-8a64-804eb0619156-kube-api-access-ls9hj\") pod \"ad6ebaf4-4e74-48a6-8a64-804eb0619156\" (UID: \"ad6ebaf4-4e74-48a6-8a64-804eb0619156\") "
Sep 11 11:49:03.130446 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:03.130335    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad6ebaf4-4e74-48a6-8a64-804eb0619156-plugins-config-volume\") pod \"ad6ebaf4-4e74-48a6-8a64-804eb0619156\" (UID: \"ad6ebaf4-4e74-48a6-8a64-804eb0619156\") "
Sep 11 11:49:03.130751 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:03.130727    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad6ebaf4-4e74-48a6-8a64-804eb0619156-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ad6ebaf4-4e74-48a6-8a64-804eb0619156" (UID: "ad6ebaf4-4e74-48a6-8a64-804eb0619156"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 11:49:03.133564 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:03.133531    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad6ebaf4-4e74-48a6-8a64-804eb0619156-kube-api-access-ls9hj" (OuterVolumeSpecName: "kube-api-access-ls9hj") pod "ad6ebaf4-4e74-48a6-8a64-804eb0619156" (UID: "ad6ebaf4-4e74-48a6-8a64-804eb0619156"). InnerVolumeSpecName "kube-api-access-ls9hj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:49:03.231830 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:03.231550    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63e0d2b8-350b-4b3b-8c64-d26b53e6f9d0-plugins-config-volume\") pod \"63e0d2b8-350b-4b3b-8c64-d26b53e6f9d0\" (UID: \"63e0d2b8-350b-4b3b-8c64-d26b53e6f9d0\") "
Sep 11 11:49:03.231830 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:03.231614    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lc88v\" (UniqueName: \"kubernetes.io/projected/63e0d2b8-350b-4b3b-8c64-d26b53e6f9d0-kube-api-access-lc88v\") pod \"63e0d2b8-350b-4b3b-8c64-d26b53e6f9d0\" (UID: \"63e0d2b8-350b-4b3b-8c64-d26b53e6f9d0\") "
Sep 11 11:49:03.235828 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:03.231948    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad6ebaf4-4e74-48a6-8a64-804eb0619156-plugins-config-volume\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:49:03.235828 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:03.231971    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ls9hj\" (UniqueName: \"kubernetes.io/projected/ad6ebaf4-4e74-48a6-8a64-804eb0619156-kube-api-access-ls9hj\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:49:03.235828 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:03.234511    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63e0d2b8-350b-4b3b-8c64-d26b53e6f9d0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "63e0d2b8-350b-4b3b-8c64-d26b53e6f9d0" (UID: "63e0d2b8-350b-4b3b-8c64-d26b53e6f9d0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 11:49:03.235828 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:03.234979    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63e0d2b8-350b-4b3b-8c64-d26b53e6f9d0-kube-api-access-lc88v" (OuterVolumeSpecName: "kube-api-access-lc88v") pod "63e0d2b8-350b-4b3b-8c64-d26b53e6f9d0" (UID: "63e0d2b8-350b-4b3b-8c64-d26b53e6f9d0"). InnerVolumeSpecName "kube-api-access-lc88v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:49:03.333073 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:03.332991    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lc88v\" (UniqueName: \"kubernetes.io/projected/63e0d2b8-350b-4b3b-8c64-d26b53e6f9d0-kube-api-access-lc88v\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:49:03.333073 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:03.333018    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63e0d2b8-350b-4b3b-8c64-d26b53e6f9d0-plugins-config-volume\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:49:03.527441 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:03.527397    2560 generic.go:356] "Generic (PLEG): container finished" podID="63e0d2b8-350b-4b3b-8c64-d26b53e6f9d0" containerID="c1b38cf56bd96af585bc47c0eee1e7b6c33be468de9cfc2bfffff19daa498a26" exitCode=0
Sep 11 11:49:03.527441 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:03.527444    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5fdde1a2-b766988bb-4g456"
Sep 11 11:49:03.527733 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:03.527486    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5fdde1a2-b766988bb-4g456" event={"ID":"63e0d2b8-350b-4b3b-8c64-d26b53e6f9d0","Type":"ContainerDied","Data":"c1b38cf56bd96af585bc47c0eee1e7b6c33be468de9cfc2bfffff19daa498a26"}
Sep 11 11:49:03.527733 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:03.527548    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5fdde1a2-b766988bb-4g456" event={"ID":"63e0d2b8-350b-4b3b-8c64-d26b53e6f9d0","Type":"ContainerDied","Data":"431176f136752df075e724c09297e1103a2c5dea572366f5ec12ecc45fac8bbd"}
Sep 11 11:49:03.527733 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:03.527576    2560 scope.go:117] "RemoveContainer" containerID="c1b38cf56bd96af585bc47c0eee1e7b6c33be468de9cfc2bfffff19daa498a26"
Sep 11 11:49:03.529002 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:03.528968    2560 generic.go:356] "Generic (PLEG): container finished" podID="ad6ebaf4-4e74-48a6-8a64-804eb0619156" containerID="d6167179233a954efebc7a83812a4d600362257b59a0b8194360ba0bab7d37cc" exitCode=0
Sep 11 11:49:03.529128 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:03.529009    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-5fdde1a2-65c88db94b-tlvp7"
Sep 11 11:49:03.529128 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:03.529043    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-5fdde1a2-65c88db94b-tlvp7" event={"ID":"ad6ebaf4-4e74-48a6-8a64-804eb0619156","Type":"ContainerDied","Data":"d6167179233a954efebc7a83812a4d600362257b59a0b8194360ba0bab7d37cc"}
Sep 11 11:49:03.529128 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:03.529084    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-5fdde1a2-65c88db94b-tlvp7" event={"ID":"ad6ebaf4-4e74-48a6-8a64-804eb0619156","Type":"ContainerDied","Data":"94c7963b1b6eba2ba7e2d201740588568eab8dbbb3fb73082420caf1a9d0cc90"}
Sep 11 11:49:03.536713 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:03.536635    2560 scope.go:117] "RemoveContainer" containerID="c1b38cf56bd96af585bc47c0eee1e7b6c33be468de9cfc2bfffff19daa498a26"
Sep 11 11:49:03.537264 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:49:03.536974    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1b38cf56bd96af585bc47c0eee1e7b6c33be468de9cfc2bfffff19daa498a26\": container with ID starting with c1b38cf56bd96af585bc47c0eee1e7b6c33be468de9cfc2bfffff19daa498a26 not found: ID does not exist" containerID="c1b38cf56bd96af585bc47c0eee1e7b6c33be468de9cfc2bfffff19daa498a26"
Sep 11 11:49:03.537264 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:03.537006    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1b38cf56bd96af585bc47c0eee1e7b6c33be468de9cfc2bfffff19daa498a26"} err="failed to get container status \"c1b38cf56bd96af585bc47c0eee1e7b6c33be468de9cfc2bfffff19daa498a26\": rpc error: code = NotFound desc = could not find container \"c1b38cf56bd96af585bc47c0eee1e7b6c33be468de9cfc2bfffff19daa498a26\": container with ID starting with c1b38cf56bd96af585bc47c0eee1e7b6c33be468de9cfc2bfffff19daa498a26 not found: ID does not exist"
Sep 11 11:49:03.537264 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:03.537028    2560 scope.go:117] "RemoveContainer" containerID="d6167179233a954efebc7a83812a4d600362257b59a0b8194360ba0bab7d37cc"
Sep 11 11:49:03.545905 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:03.545888    2560 scope.go:117] "RemoveContainer" containerID="d6167179233a954efebc7a83812a4d600362257b59a0b8194360ba0bab7d37cc"
Sep 11 11:49:03.546171 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:49:03.546152    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6167179233a954efebc7a83812a4d600362257b59a0b8194360ba0bab7d37cc\": container with ID starting with d6167179233a954efebc7a83812a4d600362257b59a0b8194360ba0bab7d37cc not found: ID does not exist" containerID="d6167179233a954efebc7a83812a4d600362257b59a0b8194360ba0bab7d37cc"
Sep 11 11:49:03.546235 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:03.546183    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6167179233a954efebc7a83812a4d600362257b59a0b8194360ba0bab7d37cc"} err="failed to get container status \"d6167179233a954efebc7a83812a4d600362257b59a0b8194360ba0bab7d37cc\": rpc error: code = NotFound desc = could not find container \"d6167179233a954efebc7a83812a4d600362257b59a0b8194360ba0bab7d37cc\": container with ID starting with d6167179233a954efebc7a83812a4d600362257b59a0b8194360ba0bab7d37cc not found: ID does not exist"
Sep 11 11:49:03.552771 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:03.552749    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-5fdde1a2-b766988bb-4g456"]
Sep 11 11:49:03.559348 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:03.559329    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-5fdde1a2-b766988bb-4g456"]
Sep 11 11:49:03.569164 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:03.569138    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-5fdde1a2-65c88db94b-tlvp7"]
Sep 11 11:49:03.575724 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:03.575705    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-5fdde1a2-65c88db94b-tlvp7"]
Sep 11 11:49:03.815567 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:03.815536    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63e0d2b8-350b-4b3b-8c64-d26b53e6f9d0" path="/var/lib/kubelet/pods/63e0d2b8-350b-4b3b-8c64-d26b53e6f9d0/volumes"
Sep 11 11:49:03.816061 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:03.816037    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5af3f6b-7c69-4382-b5f8-8376066ff33b" path="/var/lib/kubelet/pods/a5af3f6b-7c69-4382-b5f8-8376066ff33b/volumes"
Sep 11 11:49:03.816424 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:03.816404    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad6ebaf4-4e74-48a6-8a64-804eb0619156" path="/var/lib/kubelet/pods/ad6ebaf4-4e74-48a6-8a64-804eb0619156/volumes"
Sep 11 11:49:03.897508 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:03.897471    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf"]
Sep 11 11:49:03.897862 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:03.897848    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63e0d2b8-350b-4b3b-8c64-d26b53e6f9d0" containerName="payload-pre-processing"
Sep 11 11:49:03.897862 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:03.897863    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="63e0d2b8-350b-4b3b-8c64-d26b53e6f9d0" containerName="payload-pre-processing"
Sep 11 11:49:03.897951 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:03.897879    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5af3f6b-7c69-4382-b5f8-8376066ff33b" containerName="revoke-keys"
Sep 11 11:49:03.897951 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:03.897885    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5af3f6b-7c69-4382-b5f8-8376066ff33b" containerName="revoke-keys"
Sep 11 11:49:03.897951 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:03.897892    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad6ebaf4-4e74-48a6-8a64-804eb0619156" containerName="payload-processing"
Sep 11 11:49:03.897951 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:03.897898    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad6ebaf4-4e74-48a6-8a64-804eb0619156" containerName="payload-processing"
Sep 11 11:49:03.898086 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:03.897955    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="63e0d2b8-350b-4b3b-8c64-d26b53e6f9d0" containerName="payload-pre-processing"
Sep 11 11:49:03.898086 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:03.897964    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad6ebaf4-4e74-48a6-8a64-804eb0619156" containerName="payload-processing"
Sep 11 11:49:03.898086 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:03.897972    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5af3f6b-7c69-4382-b5f8-8376066ff33b" containerName="revoke-keys"
Sep 11 11:49:03.902596 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:03.902575    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf"
Sep 11 11:49:03.904972 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:03.904951    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-8ede8f25-openshift-default-dockercfg-bnqqm\""
Sep 11 11:49:03.913611 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:03.913586    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf"]
Sep 11 11:49:04.040619 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:04.040549    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b4b02e5-6bc6-4f09-a18e-5e008902993d-istio-podinfo\") pod \"e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf\" (UID: \"3b4b02e5-6bc6-4f09-a18e-5e008902993d\") " pod="openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf"
Sep 11 11:49:04.040851 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:04.040760    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b4b02e5-6bc6-4f09-a18e-5e008902993d-workload-socket\") pod \"e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf\" (UID: \"3b4b02e5-6bc6-4f09-a18e-5e008902993d\") " pod="openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf"
Sep 11 11:49:04.040851 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:04.040821    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b4b02e5-6bc6-4f09-a18e-5e008902993d-istiod-ca-cert\") pod \"e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf\" (UID: \"3b4b02e5-6bc6-4f09-a18e-5e008902993d\") " pod="openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf"
Sep 11 11:49:04.040970 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:04.040950    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b4b02e5-6bc6-4f09-a18e-5e008902993d-istio-envoy\") pod \"e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf\" (UID: \"3b4b02e5-6bc6-4f09-a18e-5e008902993d\") " pod="openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf"
Sep 11 11:49:04.041103 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:04.041045    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b4b02e5-6bc6-4f09-a18e-5e008902993d-credential-socket\") pod \"e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf\" (UID: \"3b4b02e5-6bc6-4f09-a18e-5e008902993d\") " pod="openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf"
Sep 11 11:49:04.041246 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:04.041161    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b4b02e5-6bc6-4f09-a18e-5e008902993d-workload-certs\") pod \"e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf\" (UID: \"3b4b02e5-6bc6-4f09-a18e-5e008902993d\") " pod="openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf"
Sep 11 11:49:04.041246 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:04.041198    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b4b02e5-6bc6-4f09-a18e-5e008902993d-istio-token\") pod \"e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf\" (UID: \"3b4b02e5-6bc6-4f09-a18e-5e008902993d\") " pod="openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf"
Sep 11 11:49:04.041246 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:04.041225    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b4b02e5-6bc6-4f09-a18e-5e008902993d-istio-data\") pod \"e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf\" (UID: \"3b4b02e5-6bc6-4f09-a18e-5e008902993d\") " pod="openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf"
Sep 11 11:49:04.041405 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:04.041331    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-km2q5\" (UniqueName: \"kubernetes.io/projected/3b4b02e5-6bc6-4f09-a18e-5e008902993d-kube-api-access-km2q5\") pod \"e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf\" (UID: \"3b4b02e5-6bc6-4f09-a18e-5e008902993d\") " pod="openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf"
Sep 11 11:49:04.142202 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:04.142112    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b4b02e5-6bc6-4f09-a18e-5e008902993d-workload-socket\") pod \"e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf\" (UID: \"3b4b02e5-6bc6-4f09-a18e-5e008902993d\") " pod="openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf"
Sep 11 11:49:04.142202 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:04.142152    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b4b02e5-6bc6-4f09-a18e-5e008902993d-istiod-ca-cert\") pod \"e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf\" (UID: \"3b4b02e5-6bc6-4f09-a18e-5e008902993d\") " pod="openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf"
Sep 11 11:49:04.142202 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:04.142183    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b4b02e5-6bc6-4f09-a18e-5e008902993d-istio-envoy\") pod \"e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf\" (UID: \"3b4b02e5-6bc6-4f09-a18e-5e008902993d\") " pod="openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf"
Sep 11 11:49:04.142496 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:04.142216    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b4b02e5-6bc6-4f09-a18e-5e008902993d-credential-socket\") pod \"e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf\" (UID: \"3b4b02e5-6bc6-4f09-a18e-5e008902993d\") " pod="openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf"
Sep 11 11:49:04.142496 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:04.142247    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b4b02e5-6bc6-4f09-a18e-5e008902993d-workload-certs\") pod \"e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf\" (UID: \"3b4b02e5-6bc6-4f09-a18e-5e008902993d\") " pod="openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf"
Sep 11 11:49:04.142496 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:04.142277    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b4b02e5-6bc6-4f09-a18e-5e008902993d-istio-token\") pod \"e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf\" (UID: \"3b4b02e5-6bc6-4f09-a18e-5e008902993d\") " pod="openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf"
Sep 11 11:49:04.142496 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:04.142302    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b4b02e5-6bc6-4f09-a18e-5e008902993d-istio-data\") pod \"e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf\" (UID: \"3b4b02e5-6bc6-4f09-a18e-5e008902993d\") " pod="openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf"
Sep 11 11:49:04.142732 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:04.142520    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-km2q5\" (UniqueName: \"kubernetes.io/projected/3b4b02e5-6bc6-4f09-a18e-5e008902993d-kube-api-access-km2q5\") pod \"e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf\" (UID: \"3b4b02e5-6bc6-4f09-a18e-5e008902993d\") " pod="openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf"
Sep 11 11:49:04.142732 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:04.142559    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b4b02e5-6bc6-4f09-a18e-5e008902993d-workload-socket\") pod \"e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf\" (UID: \"3b4b02e5-6bc6-4f09-a18e-5e008902993d\") " pod="openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf"
Sep 11 11:49:04.142732 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:04.142585    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b4b02e5-6bc6-4f09-a18e-5e008902993d-istio-podinfo\") pod \"e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf\" (UID: \"3b4b02e5-6bc6-4f09-a18e-5e008902993d\") " pod="openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf"
Sep 11 11:49:04.142941 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:04.142911    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b4b02e5-6bc6-4f09-a18e-5e008902993d-workload-certs\") pod \"e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf\" (UID: \"3b4b02e5-6bc6-4f09-a18e-5e008902993d\") " pod="openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf"
Sep 11 11:49:04.143062 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:04.143046    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b4b02e5-6bc6-4f09-a18e-5e008902993d-istiod-ca-cert\") pod \"e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf\" (UID: \"3b4b02e5-6bc6-4f09-a18e-5e008902993d\") " pod="openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf"
Sep 11 11:49:04.143132 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:04.143098    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b4b02e5-6bc6-4f09-a18e-5e008902993d-istio-data\") pod \"e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf\" (UID: \"3b4b02e5-6bc6-4f09-a18e-5e008902993d\") " pod="openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf"
Sep 11 11:49:04.143238 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:04.143217    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b4b02e5-6bc6-4f09-a18e-5e008902993d-credential-socket\") pod \"e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf\" (UID: \"3b4b02e5-6bc6-4f09-a18e-5e008902993d\") " pod="openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf"
Sep 11 11:49:04.145126 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:04.145102    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b4b02e5-6bc6-4f09-a18e-5e008902993d-istio-envoy\") pod \"e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf\" (UID: \"3b4b02e5-6bc6-4f09-a18e-5e008902993d\") " pod="openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf"
Sep 11 11:49:04.145226 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:04.145205    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b4b02e5-6bc6-4f09-a18e-5e008902993d-istio-podinfo\") pod \"e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf\" (UID: \"3b4b02e5-6bc6-4f09-a18e-5e008902993d\") " pod="openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf"
Sep 11 11:49:04.159468 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:04.159382    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b4b02e5-6bc6-4f09-a18e-5e008902993d-istio-token\") pod \"e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf\" (UID: \"3b4b02e5-6bc6-4f09-a18e-5e008902993d\") " pod="openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf"
Sep 11 11:49:04.159874 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:04.159854    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-km2q5\" (UniqueName: \"kubernetes.io/projected/3b4b02e5-6bc6-4f09-a18e-5e008902993d-kube-api-access-km2q5\") pod \"e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf\" (UID: \"3b4b02e5-6bc6-4f09-a18e-5e008902993d\") " pod="openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf"
Sep 11 11:49:04.214558 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:04.214511    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf"
Sep 11 11:49:04.497701 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:04.497674    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf"]
Sep 11 11:49:04.500429 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:49:04.500398    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b4b02e5_6bc6_4f09_a18e_5e008902993d.slice/crio-a689daf168fdce872f0025cd0c2d6d52de7663f9e7d3332acf2a030e5ab2cab7 WatchSource:0}: Error finding container a689daf168fdce872f0025cd0c2d6d52de7663f9e7d3332acf2a030e5ab2cab7: Status 404 returned error can't find the container with id a689daf168fdce872f0025cd0c2d6d52de7663f9e7d3332acf2a030e5ab2cab7
Sep 11 11:49:04.534871 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:04.534824    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf" event={"ID":"3b4b02e5-6bc6-4f09-a18e-5e008902993d","Type":"ContainerStarted","Data":"a689daf168fdce872f0025cd0c2d6d52de7663f9e7d3332acf2a030e5ab2cab7"}
Sep 11 11:49:07.065980 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:07.065945    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:49:07.066250 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:07.066012    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:49:07.066250 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:07.066044    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:49:07.556053 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:07.556020    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf" event={"ID":"3b4b02e5-6bc6-4f09-a18e-5e008902993d","Type":"ContainerStarted","Data":"b735b2a4a0743c3749a9fedd7cd75705eab5fc9033f5fb57b15f7cf8684cd09a"}
Sep 11 11:49:07.579424 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:07.579372    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf" podStartSLOduration=2.0164567350000002 podStartE2EDuration="4.579357423s" totalImagesPullingTime="2.562900688s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:49:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:49:07.578290393 +0000 UTC m=+898.400750292" watchObservedRunningTime="2026-09-11 11:49:07.579357423 +0000 UTC m=+898.401817367"
Sep 11 11:49:08.215202 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:08.215168    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf"
Sep 11 11:49:08.220579 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:08.220552    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf"
Sep 11 11:49:08.561406 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:08.561310    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf"
Sep 11 11:49:08.562128 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:08.562105    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf"
Sep 11 11:49:10.722939 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:10.722905    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-8ede8f25-85f89fc58-nwnvv"]
Sep 11 11:49:10.728245 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:10.728227    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-8ede8f25-85f89fc58-nwnvv"
Sep 11 11:49:10.730881 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:10.730856    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-8ede8f25-dockercfg-gsqjp\""
Sep 11 11:49:10.731009 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:10.730954    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-8ede8f25\""
Sep 11 11:49:10.738064 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:10.738031    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-8ede8f25-85f89fc58-nwnvv"]
Sep 11 11:49:10.746297 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:10.746272    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8ede8f25-69d98567c-wn6xv"]
Sep 11 11:49:10.750238 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:10.750219    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-8ede8f25-69d98567c-wn6xv"
Sep 11 11:49:10.765287 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:10.765262    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8ede8f25-69d98567c-wn6xv"]
Sep 11 11:49:10.902747 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:10.902709    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36119578-4f87-40b5-bd3e-790c82e98113-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-8ede8f25-85f89fc58-nwnvv\" (UID: \"36119578-4f87-40b5-bd3e-790c82e98113\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-8ede8f25-85f89fc58-nwnvv"
Sep 11 11:49:10.902921 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:10.902766    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x89tl\" (UniqueName: \"kubernetes.io/projected/e68a61af-efb4-4df7-9a6f-8a7d9bd513d2-kube-api-access-x89tl\") pod \"payload-processing-e2e-ait-8ede8f25-69d98567c-wn6xv\" (UID: \"e68a61af-efb4-4df7-9a6f-8a7d9bd513d2\") " pod="openshift-ingress/payload-processing-e2e-ait-8ede8f25-69d98567c-wn6xv"
Sep 11 11:49:10.902921 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:10.902834    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e68a61af-efb4-4df7-9a6f-8a7d9bd513d2-plugins-config-volume\") pod \"payload-processing-e2e-ait-8ede8f25-69d98567c-wn6xv\" (UID: \"e68a61af-efb4-4df7-9a6f-8a7d9bd513d2\") " pod="openshift-ingress/payload-processing-e2e-ait-8ede8f25-69d98567c-wn6xv"
Sep 11 11:49:10.902921 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:10.902884    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llsmj\" (UniqueName: \"kubernetes.io/projected/36119578-4f87-40b5-bd3e-790c82e98113-kube-api-access-llsmj\") pod \"payload-pre-processing-e2e-ait-8ede8f25-85f89fc58-nwnvv\" (UID: \"36119578-4f87-40b5-bd3e-790c82e98113\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-8ede8f25-85f89fc58-nwnvv"
Sep 11 11:49:11.003668 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:11.003560    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36119578-4f87-40b5-bd3e-790c82e98113-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-8ede8f25-85f89fc58-nwnvv\" (UID: \"36119578-4f87-40b5-bd3e-790c82e98113\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-8ede8f25-85f89fc58-nwnvv"
Sep 11 11:49:11.003668 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:11.003626    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x89tl\" (UniqueName: \"kubernetes.io/projected/e68a61af-efb4-4df7-9a6f-8a7d9bd513d2-kube-api-access-x89tl\") pod \"payload-processing-e2e-ait-8ede8f25-69d98567c-wn6xv\" (UID: \"e68a61af-efb4-4df7-9a6f-8a7d9bd513d2\") " pod="openshift-ingress/payload-processing-e2e-ait-8ede8f25-69d98567c-wn6xv"
Sep 11 11:49:11.003861 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:11.003689    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e68a61af-efb4-4df7-9a6f-8a7d9bd513d2-plugins-config-volume\") pod \"payload-processing-e2e-ait-8ede8f25-69d98567c-wn6xv\" (UID: \"e68a61af-efb4-4df7-9a6f-8a7d9bd513d2\") " pod="openshift-ingress/payload-processing-e2e-ait-8ede8f25-69d98567c-wn6xv"
Sep 11 11:49:11.003861 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:11.003729    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llsmj\" (UniqueName: \"kubernetes.io/projected/36119578-4f87-40b5-bd3e-790c82e98113-kube-api-access-llsmj\") pod \"payload-pre-processing-e2e-ait-8ede8f25-85f89fc58-nwnvv\" (UID: \"36119578-4f87-40b5-bd3e-790c82e98113\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-8ede8f25-85f89fc58-nwnvv"
Sep 11 11:49:11.004411 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:11.004389    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e68a61af-efb4-4df7-9a6f-8a7d9bd513d2-plugins-config-volume\") pod \"payload-processing-e2e-ait-8ede8f25-69d98567c-wn6xv\" (UID: \"e68a61af-efb4-4df7-9a6f-8a7d9bd513d2\") " pod="openshift-ingress/payload-processing-e2e-ait-8ede8f25-69d98567c-wn6xv"
Sep 11 11:49:11.004597 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:11.004579    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36119578-4f87-40b5-bd3e-790c82e98113-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-8ede8f25-85f89fc58-nwnvv\" (UID: \"36119578-4f87-40b5-bd3e-790c82e98113\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-8ede8f25-85f89fc58-nwnvv"
Sep 11 11:49:11.012970 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:11.012944    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llsmj\" (UniqueName: \"kubernetes.io/projected/36119578-4f87-40b5-bd3e-790c82e98113-kube-api-access-llsmj\") pod \"payload-pre-processing-e2e-ait-8ede8f25-85f89fc58-nwnvv\" (UID: \"36119578-4f87-40b5-bd3e-790c82e98113\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-8ede8f25-85f89fc58-nwnvv"
Sep 11 11:49:11.013081 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:11.012957    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x89tl\" (UniqueName: \"kubernetes.io/projected/e68a61af-efb4-4df7-9a6f-8a7d9bd513d2-kube-api-access-x89tl\") pod \"payload-processing-e2e-ait-8ede8f25-69d98567c-wn6xv\" (UID: \"e68a61af-efb4-4df7-9a6f-8a7d9bd513d2\") " pod="openshift-ingress/payload-processing-e2e-ait-8ede8f25-69d98567c-wn6xv"
Sep 11 11:49:11.041057 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:11.041023    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-8ede8f25-85f89fc58-nwnvv"
Sep 11 11:49:11.061254 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:11.061216    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-8ede8f25-69d98567c-wn6xv"
Sep 11 11:49:11.319637 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:11.319550    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-8ede8f25-85f89fc58-nwnvv"]
Sep 11 11:49:11.323032 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:49:11.323003    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36119578_4f87_40b5_bd3e_790c82e98113.slice/crio-62a71ddf9ad25e9211082400814928ecf3f83e27499249f6d7ae253b5c9568f6 WatchSource:0}: Error finding container 62a71ddf9ad25e9211082400814928ecf3f83e27499249f6d7ae253b5c9568f6: Status 404 returned error can't find the container with id 62a71ddf9ad25e9211082400814928ecf3f83e27499249f6d7ae253b5c9568f6
Sep 11 11:49:11.343324 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:11.343275    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8ede8f25-69d98567c-wn6xv"]
Sep 11 11:49:11.352831 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:49:11.352800    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode68a61af_efb4_4df7_9a6f_8a7d9bd513d2.slice/crio-457a0e020956e8d11d749767935fec15edf65f5a3512349ed23ef8ccc64e992c WatchSource:0}: Error finding container 457a0e020956e8d11d749767935fec15edf65f5a3512349ed23ef8ccc64e992c: Status 404 returned error can't find the container with id 457a0e020956e8d11d749767935fec15edf65f5a3512349ed23ef8ccc64e992c
Sep 11 11:49:11.581430 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:11.581348    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-8ede8f25-85f89fc58-nwnvv" event={"ID":"36119578-4f87-40b5-bd3e-790c82e98113","Type":"ContainerStarted","Data":"0b842f40ffeebb36de3c58f30cc9d928db5734e30e545820624491b420e4c289"}
Sep 11 11:49:11.581430 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:11.581397    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-8ede8f25-85f89fc58-nwnvv" event={"ID":"36119578-4f87-40b5-bd3e-790c82e98113","Type":"ContainerStarted","Data":"62a71ddf9ad25e9211082400814928ecf3f83e27499249f6d7ae253b5c9568f6"}
Sep 11 11:49:11.581644 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:11.581520    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-8ede8f25-85f89fc58-nwnvv"
Sep 11 11:49:11.583111 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:11.583081    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-8ede8f25-69d98567c-wn6xv" event={"ID":"e68a61af-efb4-4df7-9a6f-8a7d9bd513d2","Type":"ContainerStarted","Data":"00fbdd1e7b16f3dc757594e3656ef100a88ec63f6e2d7710e1dd1dede0a42d45"}
Sep 11 11:49:11.583218 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:11.583127    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-8ede8f25-69d98567c-wn6xv" event={"ID":"e68a61af-efb4-4df7-9a6f-8a7d9bd513d2","Type":"ContainerStarted","Data":"457a0e020956e8d11d749767935fec15edf65f5a3512349ed23ef8ccc64e992c"}
Sep 11 11:49:11.583218 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:11.583156    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-8ede8f25-69d98567c-wn6xv"
Sep 11 11:49:11.600443 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:11.600387    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-8ede8f25-85f89fc58-nwnvv" podStartSLOduration=1.6003690270000002 podStartE2EDuration="1.600369027s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:49:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:49:11.599436448 +0000 UTC m=+902.421896363" watchObservedRunningTime="2026-09-11 11:49:11.600369027 +0000 UTC m=+902.422828900"
Sep 11 11:49:11.621562 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:11.621501    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-8ede8f25-69d98567c-wn6xv" podStartSLOduration=1.621479909 podStartE2EDuration="1.621479909s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:49:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:49:11.618747843 +0000 UTC m=+902.441207756" watchObservedRunningTime="2026-09-11 11:49:11.621479909 +0000 UTC m=+902.443939783"
Sep 11 11:49:22.590281 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:22.590238    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-8ede8f25-85f89fc58-nwnvv"
Sep 11 11:49:22.590794 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:22.590321    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-8ede8f25-69d98567c-wn6xv"
Sep 11 11:49:24.602862 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:24.602816    2560 patch_prober.go:28] interesting pod/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 11:49:24.603283 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:24.602908    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf" podUID="3b4b02e5-6bc6-4f09-a18e-5e008902993d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 11:49:26.656899 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:26.656863    2560 generic.go:356] "Generic (PLEG): container finished" podID="3b4b02e5-6bc6-4f09-a18e-5e008902993d" containerID="b735b2a4a0743c3749a9fedd7cd75705eab5fc9033f5fb57b15f7cf8684cd09a" exitCode=0
Sep 11 11:49:26.657414 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:26.656944    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf" event={"ID":"3b4b02e5-6bc6-4f09-a18e-5e008902993d","Type":"ContainerDied","Data":"b735b2a4a0743c3749a9fedd7cd75705eab5fc9033f5fb57b15f7cf8684cd09a"}
Sep 11 11:49:26.657483 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:26.657452    2560 scope.go:117] "RemoveContainer" containerID="b735b2a4a0743c3749a9fedd7cd75705eab5fc9033f5fb57b15f7cf8684cd09a"
Sep 11 11:49:26.658663 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:26.658619    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:49:26.658771 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:26.658704    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:49:26.658771 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:26.658735    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:49:27.666885 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:27.666850    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf" event={"ID":"3b4b02e5-6bc6-4f09-a18e-5e008902993d","Type":"ContainerStarted","Data":"e56608dd9261eb5e5b2014d5895b792e86e67717e8ff61b8e737822e6958cad1"}
Sep 11 11:49:28.215579 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:28.215543    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf"
Sep 11 11:49:28.215810 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:28.215786    2560 patch_prober.go:28] interesting pod/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Sep 11 11:49:28.215877 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:28.215857    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf" podUID="3b4b02e5-6bc6-4f09-a18e-5e008902993d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Sep 11 11:49:29.215038 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:29.215007    2560 patch_prober.go:28] interesting pod/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Sep 11 11:49:29.215409 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:29.215058    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf" podUID="3b4b02e5-6bc6-4f09-a18e-5e008902993d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Sep 11 11:49:30.215269 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:30.215232    2560 patch_prober.go:28] interesting pod/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Sep 11 11:49:30.215674 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:30.215290    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf" podUID="3b4b02e5-6bc6-4f09-a18e-5e008902993d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Sep 11 11:49:31.216005 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:31.215968    2560 patch_prober.go:28] interesting pod/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Sep 11 11:49:31.216388 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:31.216030    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf" podUID="3b4b02e5-6bc6-4f09-a18e-5e008902993d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Sep 11 11:49:32.215277 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:32.215236    2560 patch_prober.go:28] interesting pod/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Sep 11 11:49:32.215458 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:32.215306    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf" podUID="3b4b02e5-6bc6-4f09-a18e-5e008902993d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Sep 11 11:49:33.237573 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:33.237522    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf"
Sep 11 11:49:33.238139 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:33.238119    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf"
Sep 11 11:49:33.239447 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:33.239424    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf"
Sep 11 11:49:34.727782 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:34.727755    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8ede8f25-qsncl"]
Sep 11 11:49:34.730259 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:34.730240    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8ede8f25-qsncl"
Sep 11 11:49:34.733008 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:34.732982    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 11:49:34.733713 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:34.733694    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f46tj\""
Sep 11 11:49:34.739848 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:34.739822    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8ede8f25-qsncl"]
Sep 11 11:49:34.816016 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:34.815977    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/205cd788-4ef0-46e8-892e-1597107a9bbb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8ede8f25-qsncl\" (UID: \"205cd788-4ef0-46e8-892e-1597107a9bbb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8ede8f25-qsncl"
Sep 11 11:49:34.916998 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:34.916967    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/205cd788-4ef0-46e8-892e-1597107a9bbb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8ede8f25-qsncl\" (UID: \"205cd788-4ef0-46e8-892e-1597107a9bbb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8ede8f25-qsncl"
Sep 11 11:49:34.917573 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:34.917554    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/205cd788-4ef0-46e8-892e-1597107a9bbb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8ede8f25-qsncl\" (UID: \"205cd788-4ef0-46e8-892e-1597107a9bbb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8ede8f25-qsncl"
Sep 11 11:49:35.042037 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:35.041942    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8ede8f25-qsncl"
Sep 11 11:49:35.310849 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:35.310772    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8ede8f25-qsncl"]
Sep 11 11:49:35.314077 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:49:35.314042    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod205cd788_4ef0_46e8_892e_1597107a9bbb.slice/crio-5a50e0dab34963c9e73dc8149f302fec054bb8f05fade5461e6d342d54a6b55c WatchSource:0}: Error finding container 5a50e0dab34963c9e73dc8149f302fec054bb8f05fade5461e6d342d54a6b55c: Status 404 returned error can't find the container with id 5a50e0dab34963c9e73dc8149f302fec054bb8f05fade5461e6d342d54a6b55c
Sep 11 11:49:35.709799 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:35.709709    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8ede8f25-qsncl" event={"ID":"205cd788-4ef0-46e8-892e-1597107a9bbb","Type":"ContainerStarted","Data":"5a50e0dab34963c9e73dc8149f302fec054bb8f05fade5461e6d342d54a6b55c"}
Sep 11 11:49:36.716832 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:36.716793    2560 generic.go:356] "Generic (PLEG): container finished" podID="205cd788-4ef0-46e8-892e-1597107a9bbb" containerID="8e2aba37b35e0b0f275bddfda144234c8fd4e470754dc9266616d2c129e9133a" exitCode=0
Sep 11 11:49:36.717206 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:36.716875    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8ede8f25-qsncl" event={"ID":"205cd788-4ef0-46e8-892e-1597107a9bbb","Type":"ContainerDied","Data":"8e2aba37b35e0b0f275bddfda144234c8fd4e470754dc9266616d2c129e9133a"}
Sep 11 11:49:37.852507 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:37.852482    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8ede8f25-qsncl"
Sep 11 11:49:37.946330 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:37.946297    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/205cd788-4ef0-46e8-892e-1597107a9bbb-maas-api-service-ca\") pod \"205cd788-4ef0-46e8-892e-1597107a9bbb\" (UID: \"205cd788-4ef0-46e8-892e-1597107a9bbb\") "
Sep 11 11:49:37.946707 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:37.946683    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/205cd788-4ef0-46e8-892e-1597107a9bbb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "205cd788-4ef0-46e8-892e-1597107a9bbb" (UID: "205cd788-4ef0-46e8-892e-1597107a9bbb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 11:49:38.047665 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:38.047556    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/205cd788-4ef0-46e8-892e-1597107a9bbb-maas-api-service-ca\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:49:38.728473 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:38.728437    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8ede8f25-qsncl"
Sep 11 11:49:38.728473 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:38.728444    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8ede8f25-qsncl" event={"ID":"205cd788-4ef0-46e8-892e-1597107a9bbb","Type":"ContainerDied","Data":"5a50e0dab34963c9e73dc8149f302fec054bb8f05fade5461e6d342d54a6b55c"}
Sep 11 11:49:38.728700 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:38.728486    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5a50e0dab34963c9e73dc8149f302fec054bb8f05fade5461e6d342d54a6b55c"
Sep 11 11:49:40.850547 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:40.850512    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8ede8f25-69d98567c-wn6xv"]
Sep 11 11:49:40.851011 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:40.850817    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-8ede8f25-69d98567c-wn6xv" podUID="e68a61af-efb4-4df7-9a6f-8a7d9bd513d2" containerName="payload-processing" containerID="cri-o://00fbdd1e7b16f3dc757594e3656ef100a88ec63f6e2d7710e1dd1dede0a42d45" gracePeriod=30
Sep 11 11:49:40.864217 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:40.864188    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-8ede8f25-85f89fc58-nwnvv"]
Sep 11 11:49:40.864414 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:40.864389    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-8ede8f25-85f89fc58-nwnvv" podUID="36119578-4f87-40b5-bd3e-790c82e98113" containerName="payload-pre-processing" containerID="cri-o://0b842f40ffeebb36de3c58f30cc9d928db5734e30e545820624491b420e4c289" gracePeriod=30
Sep 11 11:49:41.048609 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:41.048575    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8ede8f25-qsncl"]
Sep 11 11:49:41.052181 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:41.052148    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8ede8f25-qsncl"]
Sep 11 11:49:41.136722 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:41.136694    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-8ede8f25-69d98567c-wn6xv"
Sep 11 11:49:41.139698 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:41.139676    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-8ede8f25-85f89fc58-nwnvv"
Sep 11 11:49:41.175159 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:41.175127    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-llsmj\" (UniqueName: \"kubernetes.io/projected/36119578-4f87-40b5-bd3e-790c82e98113-kube-api-access-llsmj\") pod \"36119578-4f87-40b5-bd3e-790c82e98113\" (UID: \"36119578-4f87-40b5-bd3e-790c82e98113\") "
Sep 11 11:49:41.175383 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:41.175177    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36119578-4f87-40b5-bd3e-790c82e98113-plugins-config-volume\") pod \"36119578-4f87-40b5-bd3e-790c82e98113\" (UID: \"36119578-4f87-40b5-bd3e-790c82e98113\") "
Sep 11 11:49:41.175383 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:41.175211    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e68a61af-efb4-4df7-9a6f-8a7d9bd513d2-plugins-config-volume\") pod \"e68a61af-efb4-4df7-9a6f-8a7d9bd513d2\" (UID: \"e68a61af-efb4-4df7-9a6f-8a7d9bd513d2\") "
Sep 11 11:49:41.175383 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:41.175341    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x89tl\" (UniqueName: \"kubernetes.io/projected/e68a61af-efb4-4df7-9a6f-8a7d9bd513d2-kube-api-access-x89tl\") pod \"e68a61af-efb4-4df7-9a6f-8a7d9bd513d2\" (UID: \"e68a61af-efb4-4df7-9a6f-8a7d9bd513d2\") "
Sep 11 11:49:41.175826 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:41.175780    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36119578-4f87-40b5-bd3e-790c82e98113-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "36119578-4f87-40b5-bd3e-790c82e98113" (UID: "36119578-4f87-40b5-bd3e-790c82e98113"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 11:49:41.175826 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:41.175816    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e68a61af-efb4-4df7-9a6f-8a7d9bd513d2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e68a61af-efb4-4df7-9a6f-8a7d9bd513d2" (UID: "e68a61af-efb4-4df7-9a6f-8a7d9bd513d2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 11:49:41.177609 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:41.177572    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36119578-4f87-40b5-bd3e-790c82e98113-kube-api-access-llsmj" (OuterVolumeSpecName: "kube-api-access-llsmj") pod "36119578-4f87-40b5-bd3e-790c82e98113" (UID: "36119578-4f87-40b5-bd3e-790c82e98113"). InnerVolumeSpecName "kube-api-access-llsmj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:49:41.177957 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:41.177932    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e68a61af-efb4-4df7-9a6f-8a7d9bd513d2-kube-api-access-x89tl" (OuterVolumeSpecName: "kube-api-access-x89tl") pod "e68a61af-efb4-4df7-9a6f-8a7d9bd513d2" (UID: "e68a61af-efb4-4df7-9a6f-8a7d9bd513d2"). InnerVolumeSpecName "kube-api-access-x89tl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:49:41.276368 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:41.276335    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-llsmj\" (UniqueName: \"kubernetes.io/projected/36119578-4f87-40b5-bd3e-790c82e98113-kube-api-access-llsmj\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:49:41.276368 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:41.276366    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36119578-4f87-40b5-bd3e-790c82e98113-plugins-config-volume\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:49:41.276606 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:41.276380    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e68a61af-efb4-4df7-9a6f-8a7d9bd513d2-plugins-config-volume\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:49:41.276606 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:41.276392    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x89tl\" (UniqueName: \"kubernetes.io/projected/e68a61af-efb4-4df7-9a6f-8a7d9bd513d2-kube-api-access-x89tl\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:49:41.744357 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:41.744320    2560 generic.go:356] "Generic (PLEG): container finished" podID="36119578-4f87-40b5-bd3e-790c82e98113" containerID="0b842f40ffeebb36de3c58f30cc9d928db5734e30e545820624491b420e4c289" exitCode=0
Sep 11 11:49:41.744546 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:41.744378    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-8ede8f25-85f89fc58-nwnvv"
Sep 11 11:49:41.744546 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:41.744411    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-8ede8f25-85f89fc58-nwnvv" event={"ID":"36119578-4f87-40b5-bd3e-790c82e98113","Type":"ContainerDied","Data":"0b842f40ffeebb36de3c58f30cc9d928db5734e30e545820624491b420e4c289"}
Sep 11 11:49:41.744546 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:41.744476    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-8ede8f25-85f89fc58-nwnvv" event={"ID":"36119578-4f87-40b5-bd3e-790c82e98113","Type":"ContainerDied","Data":"62a71ddf9ad25e9211082400814928ecf3f83e27499249f6d7ae253b5c9568f6"}
Sep 11 11:49:41.744546 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:41.744508    2560 scope.go:117] "RemoveContainer" containerID="0b842f40ffeebb36de3c58f30cc9d928db5734e30e545820624491b420e4c289"
Sep 11 11:49:41.745874 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:41.745848    2560 generic.go:356] "Generic (PLEG): container finished" podID="e68a61af-efb4-4df7-9a6f-8a7d9bd513d2" containerID="00fbdd1e7b16f3dc757594e3656ef100a88ec63f6e2d7710e1dd1dede0a42d45" exitCode=0
Sep 11 11:49:41.746008 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:41.745892    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-8ede8f25-69d98567c-wn6xv"
Sep 11 11:49:41.746008 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:41.745939    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-8ede8f25-69d98567c-wn6xv" event={"ID":"e68a61af-efb4-4df7-9a6f-8a7d9bd513d2","Type":"ContainerDied","Data":"00fbdd1e7b16f3dc757594e3656ef100a88ec63f6e2d7710e1dd1dede0a42d45"}
Sep 11 11:49:41.746008 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:41.745987    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-8ede8f25-69d98567c-wn6xv" event={"ID":"e68a61af-efb4-4df7-9a6f-8a7d9bd513d2","Type":"ContainerDied","Data":"457a0e020956e8d11d749767935fec15edf65f5a3512349ed23ef8ccc64e992c"}
Sep 11 11:49:41.756242 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:41.756200    2560 scope.go:117] "RemoveContainer" containerID="0b842f40ffeebb36de3c58f30cc9d928db5734e30e545820624491b420e4c289"
Sep 11 11:49:41.756595 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:49:41.756568    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b842f40ffeebb36de3c58f30cc9d928db5734e30e545820624491b420e4c289\": container with ID starting with 0b842f40ffeebb36de3c58f30cc9d928db5734e30e545820624491b420e4c289 not found: ID does not exist" containerID="0b842f40ffeebb36de3c58f30cc9d928db5734e30e545820624491b420e4c289"
Sep 11 11:49:41.756694 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:41.756605    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b842f40ffeebb36de3c58f30cc9d928db5734e30e545820624491b420e4c289"} err="failed to get container status \"0b842f40ffeebb36de3c58f30cc9d928db5734e30e545820624491b420e4c289\": rpc error: code = NotFound desc = could not find container \"0b842f40ffeebb36de3c58f30cc9d928db5734e30e545820624491b420e4c289\": container with ID starting with 0b842f40ffeebb36de3c58f30cc9d928db5734e30e545820624491b420e4c289 not found: ID does not exist"
Sep 11 11:49:41.756694 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:41.756628    2560 scope.go:117] "RemoveContainer" containerID="00fbdd1e7b16f3dc757594e3656ef100a88ec63f6e2d7710e1dd1dede0a42d45"
Sep 11 11:49:41.764402 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:41.764387    2560 scope.go:117] "RemoveContainer" containerID="00fbdd1e7b16f3dc757594e3656ef100a88ec63f6e2d7710e1dd1dede0a42d45"
Sep 11 11:49:41.764672 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:49:41.764639    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00fbdd1e7b16f3dc757594e3656ef100a88ec63f6e2d7710e1dd1dede0a42d45\": container with ID starting with 00fbdd1e7b16f3dc757594e3656ef100a88ec63f6e2d7710e1dd1dede0a42d45 not found: ID does not exist" containerID="00fbdd1e7b16f3dc757594e3656ef100a88ec63f6e2d7710e1dd1dede0a42d45"
Sep 11 11:49:41.764723 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:41.764679    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00fbdd1e7b16f3dc757594e3656ef100a88ec63f6e2d7710e1dd1dede0a42d45"} err="failed to get container status \"00fbdd1e7b16f3dc757594e3656ef100a88ec63f6e2d7710e1dd1dede0a42d45\": rpc error: code = NotFound desc = could not find container \"00fbdd1e7b16f3dc757594e3656ef100a88ec63f6e2d7710e1dd1dede0a42d45\": container with ID starting with 00fbdd1e7b16f3dc757594e3656ef100a88ec63f6e2d7710e1dd1dede0a42d45 not found: ID does not exist"
Sep 11 11:49:41.774801 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:41.774780    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-8ede8f25-85f89fc58-nwnvv"]
Sep 11 11:49:41.782634 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:41.782612    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-8ede8f25-85f89fc58-nwnvv"]
Sep 11 11:49:41.793511 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:41.793473    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8ede8f25-69d98567c-wn6xv"]
Sep 11 11:49:41.802629 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:41.802602    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8ede8f25-69d98567c-wn6xv"]
Sep 11 11:49:41.812995 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:41.812975    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="205cd788-4ef0-46e8-892e-1597107a9bbb" path="/var/lib/kubelet/pods/205cd788-4ef0-46e8-892e-1597107a9bbb/volumes"
Sep 11 11:49:41.813333 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:41.813321    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36119578-4f87-40b5-bd3e-790c82e98113" path="/var/lib/kubelet/pods/36119578-4f87-40b5-bd3e-790c82e98113/volumes"
Sep 11 11:49:41.813635 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:41.813624    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e68a61af-efb4-4df7-9a6f-8a7d9bd513d2" path="/var/lib/kubelet/pods/e68a61af-efb4-4df7-9a6f-8a7d9bd513d2/volumes"
Sep 11 11:49:42.277411 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:42.277375    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf"]
Sep 11 11:49:42.277953 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:42.277575    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf" podUID="3b4b02e5-6bc6-4f09-a18e-5e008902993d" containerName="istio-proxy" containerID="cri-o://e56608dd9261eb5e5b2014d5895b792e86e67717e8ff61b8e737822e6958cad1" gracePeriod=30
Sep 11 11:49:43.033700 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:43.033669    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2"]
Sep 11 11:49:43.034043 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:43.034030    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="205cd788-4ef0-46e8-892e-1597107a9bbb" containerName="revoke-keys"
Sep 11 11:49:43.034108 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:43.034044    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="205cd788-4ef0-46e8-892e-1597107a9bbb" containerName="revoke-keys"
Sep 11 11:49:43.034108 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:43.034066    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36119578-4f87-40b5-bd3e-790c82e98113" containerName="payload-pre-processing"
Sep 11 11:49:43.034108 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:43.034071    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="36119578-4f87-40b5-bd3e-790c82e98113" containerName="payload-pre-processing"
Sep 11 11:49:43.034108 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:43.034078    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e68a61af-efb4-4df7-9a6f-8a7d9bd513d2" containerName="payload-processing"
Sep 11 11:49:43.034108 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:43.034084    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e68a61af-efb4-4df7-9a6f-8a7d9bd513d2" containerName="payload-processing"
Sep 11 11:49:43.034374 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:43.034133    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="36119578-4f87-40b5-bd3e-790c82e98113" containerName="payload-pre-processing"
Sep 11 11:49:43.034374 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:43.034140    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e68a61af-efb4-4df7-9a6f-8a7d9bd513d2" containerName="payload-processing"
Sep 11 11:49:43.034374 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:43.034147    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="205cd788-4ef0-46e8-892e-1597107a9bbb" containerName="revoke-keys"
Sep 11 11:49:43.038681 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:43.038659    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2"
Sep 11 11:49:43.041293 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:43.041269    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-d507e5c9-openshift-default-dockercfg-r4t8x\""
Sep 11 11:49:43.053705 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:43.051379    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2"]
Sep 11 11:49:43.091739 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:43.091708    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqcp8\" (UniqueName: \"kubernetes.io/projected/1a9ff703-2252-456b-a9c1-8d066a8c12fe-kube-api-access-bqcp8\") pod \"e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2\" (UID: \"1a9ff703-2252-456b-a9c1-8d066a8c12fe\") " pod="openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2"
Sep 11 11:49:43.091894 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:43.091749    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a9ff703-2252-456b-a9c1-8d066a8c12fe-istio-podinfo\") pod \"e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2\" (UID: \"1a9ff703-2252-456b-a9c1-8d066a8c12fe\") " pod="openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2"
Sep 11 11:49:43.091894 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:43.091846    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a9ff703-2252-456b-a9c1-8d066a8c12fe-workload-socket\") pod \"e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2\" (UID: \"1a9ff703-2252-456b-a9c1-8d066a8c12fe\") " pod="openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2"
Sep 11 11:49:43.091969 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:43.091900    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a9ff703-2252-456b-a9c1-8d066a8c12fe-istio-envoy\") pod \"e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2\" (UID: \"1a9ff703-2252-456b-a9c1-8d066a8c12fe\") " pod="openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2"
Sep 11 11:49:43.091969 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:43.091953    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a9ff703-2252-456b-a9c1-8d066a8c12fe-workload-certs\") pod \"e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2\" (UID: \"1a9ff703-2252-456b-a9c1-8d066a8c12fe\") " pod="openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2"
Sep 11 11:49:43.092031 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:43.091983    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a9ff703-2252-456b-a9c1-8d066a8c12fe-istio-data\") pod \"e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2\" (UID: \"1a9ff703-2252-456b-a9c1-8d066a8c12fe\") " pod="openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2"
Sep 11 11:49:43.092031 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:43.092023    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a9ff703-2252-456b-a9c1-8d066a8c12fe-credential-socket\") pod \"e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2\" (UID: \"1a9ff703-2252-456b-a9c1-8d066a8c12fe\") " pod="openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2"
Sep 11 11:49:43.092096 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:43.092057    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a9ff703-2252-456b-a9c1-8d066a8c12fe-istio-token\") pod \"e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2\" (UID: \"1a9ff703-2252-456b-a9c1-8d066a8c12fe\") " pod="openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2"
Sep 11 11:49:43.092096 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:43.092079    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a9ff703-2252-456b-a9c1-8d066a8c12fe-istiod-ca-cert\") pod \"e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2\" (UID: \"1a9ff703-2252-456b-a9c1-8d066a8c12fe\") " pod="openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2"
Sep 11 11:49:43.193075 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:43.193040    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a9ff703-2252-456b-a9c1-8d066a8c12fe-workload-certs\") pod \"e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2\" (UID: \"1a9ff703-2252-456b-a9c1-8d066a8c12fe\") " pod="openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2"
Sep 11 11:49:43.193301 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:43.193084    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a9ff703-2252-456b-a9c1-8d066a8c12fe-istio-data\") pod \"e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2\" (UID: \"1a9ff703-2252-456b-a9c1-8d066a8c12fe\") " pod="openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2"
Sep 11 11:49:43.193301 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:43.193125    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a9ff703-2252-456b-a9c1-8d066a8c12fe-credential-socket\") pod \"e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2\" (UID: \"1a9ff703-2252-456b-a9c1-8d066a8c12fe\") " pod="openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2"
Sep 11 11:49:43.193301 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:43.193155    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a9ff703-2252-456b-a9c1-8d066a8c12fe-istio-token\") pod \"e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2\" (UID: \"1a9ff703-2252-456b-a9c1-8d066a8c12fe\") " pod="openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2"
Sep 11 11:49:43.193301 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:43.193255    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a9ff703-2252-456b-a9c1-8d066a8c12fe-istiod-ca-cert\") pod \"e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2\" (UID: \"1a9ff703-2252-456b-a9c1-8d066a8c12fe\") " pod="openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2"
Sep 11 11:49:43.193542 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:43.193336    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqcp8\" (UniqueName: \"kubernetes.io/projected/1a9ff703-2252-456b-a9c1-8d066a8c12fe-kube-api-access-bqcp8\") pod \"e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2\" (UID: \"1a9ff703-2252-456b-a9c1-8d066a8c12fe\") " pod="openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2"
Sep 11 11:49:43.193542 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:43.193376    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a9ff703-2252-456b-a9c1-8d066a8c12fe-istio-podinfo\") pod \"e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2\" (UID: \"1a9ff703-2252-456b-a9c1-8d066a8c12fe\") " pod="openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2"
Sep 11 11:49:43.193542 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:43.193422    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a9ff703-2252-456b-a9c1-8d066a8c12fe-workload-socket\") pod \"e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2\" (UID: \"1a9ff703-2252-456b-a9c1-8d066a8c12fe\") " pod="openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2"
Sep 11 11:49:43.193542 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:43.193468    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a9ff703-2252-456b-a9c1-8d066a8c12fe-istio-envoy\") pod \"e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2\" (UID: \"1a9ff703-2252-456b-a9c1-8d066a8c12fe\") " pod="openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2"
Sep 11 11:49:43.193542 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:43.193482    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a9ff703-2252-456b-a9c1-8d066a8c12fe-workload-certs\") pod \"e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2\" (UID: \"1a9ff703-2252-456b-a9c1-8d066a8c12fe\") " pod="openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2"
Sep 11 11:49:43.194008 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:43.193979    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a9ff703-2252-456b-a9c1-8d066a8c12fe-istiod-ca-cert\") pod \"e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2\" (UID: \"1a9ff703-2252-456b-a9c1-8d066a8c12fe\") " pod="openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2"
Sep 11 11:49:43.194106 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:43.194083    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a9ff703-2252-456b-a9c1-8d066a8c12fe-istio-data\") pod \"e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2\" (UID: \"1a9ff703-2252-456b-a9c1-8d066a8c12fe\") " pod="openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2"
Sep 11 11:49:43.194252 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:43.194231    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a9ff703-2252-456b-a9c1-8d066a8c12fe-workload-socket\") pod \"e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2\" (UID: \"1a9ff703-2252-456b-a9c1-8d066a8c12fe\") " pod="openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2"
Sep 11 11:49:43.194422 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:43.194395    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a9ff703-2252-456b-a9c1-8d066a8c12fe-credential-socket\") pod \"e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2\" (UID: \"1a9ff703-2252-456b-a9c1-8d066a8c12fe\") " pod="openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2"
Sep 11 11:49:43.196023 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:43.196003    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a9ff703-2252-456b-a9c1-8d066a8c12fe-istio-envoy\") pod \"e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2\" (UID: \"1a9ff703-2252-456b-a9c1-8d066a8c12fe\") " pod="openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2"
Sep 11 11:49:43.196316 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:43.196292    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a9ff703-2252-456b-a9c1-8d066a8c12fe-istio-podinfo\") pod \"e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2\" (UID: \"1a9ff703-2252-456b-a9c1-8d066a8c12fe\") " pod="openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2"
Sep 11 11:49:43.201044 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:43.201022    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a9ff703-2252-456b-a9c1-8d066a8c12fe-istio-token\") pod \"e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2\" (UID: \"1a9ff703-2252-456b-a9c1-8d066a8c12fe\") " pod="openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2"
Sep 11 11:49:43.201577 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:43.201551    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqcp8\" (UniqueName: \"kubernetes.io/projected/1a9ff703-2252-456b-a9c1-8d066a8c12fe-kube-api-access-bqcp8\") pod \"e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2\" (UID: \"1a9ff703-2252-456b-a9c1-8d066a8c12fe\") " pod="openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2"
Sep 11 11:49:43.353117 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:43.353008    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2"
Sep 11 11:49:43.630827 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:43.630802    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2"]
Sep 11 11:49:43.632916 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:49:43.632888    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a9ff703_2252_456b_a9c1_8d066a8c12fe.slice/crio-b84874160da1fe49d4cc88fc41e6eccd77b99d55b543d3f3598284cfc035919a WatchSource:0}: Error finding container b84874160da1fe49d4cc88fc41e6eccd77b99d55b543d3f3598284cfc035919a: Status 404 returned error can't find the container with id b84874160da1fe49d4cc88fc41e6eccd77b99d55b543d3f3598284cfc035919a
Sep 11 11:49:43.635284 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:43.635244    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:49:43.635365 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:43.635327    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:49:43.635403 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:43.635373    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:49:43.760989 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:43.760946    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2" event={"ID":"1a9ff703-2252-456b-a9c1-8d066a8c12fe","Type":"ContainerStarted","Data":"95658bbea38ce2c44532285c7d843515bbc21fe02a056411882703b1beeb62f7"}
Sep 11 11:49:43.761149 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:43.761021    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2" event={"ID":"1a9ff703-2252-456b-a9c1-8d066a8c12fe","Type":"ContainerStarted","Data":"b84874160da1fe49d4cc88fc41e6eccd77b99d55b543d3f3598284cfc035919a"}
Sep 11 11:49:43.780900 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:43.780840    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2" podStartSLOduration=0.780819512 podStartE2EDuration="780.819512ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:49:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:49:43.780782967 +0000 UTC m=+934.603242861" watchObservedRunningTime="2026-09-11 11:49:43.780819512 +0000 UTC m=+934.603279411"
Sep 11 11:49:44.353607 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:44.353564    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2"
Sep 11 11:49:44.358737 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:44.358715    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2"
Sep 11 11:49:44.766939 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:44.766905    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2"
Sep 11 11:49:44.767843 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:44.767824    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2"
Sep 11 11:49:45.753680 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:45.753634    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-5a5ab7-767fc89d4c-4dw6v"]
Sep 11 11:49:45.754137 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:45.753866    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-5a5ab7-767fc89d4c-4dw6v" podUID="2e85db8c-6aa2-483c-bdea-29897233195e" containerName="payload-processing" containerID="cri-o://5b5eace7231f6c1c39803aea1766c4871d36999c223c8e36bcd2a6b8280b54cd" gracePeriod=30
Sep 11 11:49:45.765606 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:45.765581    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-5a5ab7-57646d9598-86hkt"]
Sep 11 11:49:45.766017 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:45.765969    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-autores-5a5ab7-57646d9598-86hkt" podUID="ada94fbb-09f0-4b55-bf95-c297304e9593" containerName="payload-pre-processing" containerID="cri-o://f85a7d6ba2038f382e36309df5c010d715c388b5028511e50a444353f8b1b2f2" gracePeriod=30
Sep 11 11:49:46.016573 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:46.016548    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-5a5ab7-767fc89d4c-4dw6v"
Sep 11 11:49:46.049923 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:46.049896    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-5a5ab7-57646d9598-86hkt"
Sep 11 11:49:46.127482 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:46.127446    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z22lp\" (UniqueName: \"kubernetes.io/projected/2e85db8c-6aa2-483c-bdea-29897233195e-kube-api-access-z22lp\") pod \"2e85db8c-6aa2-483c-bdea-29897233195e\" (UID: \"2e85db8c-6aa2-483c-bdea-29897233195e\") "
Sep 11 11:49:46.127681 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:46.127494    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ada94fbb-09f0-4b55-bf95-c297304e9593-plugins-config-volume\") pod \"ada94fbb-09f0-4b55-bf95-c297304e9593\" (UID: \"ada94fbb-09f0-4b55-bf95-c297304e9593\") "
Sep 11 11:49:46.127681 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:46.127512    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwcqz\" (UniqueName: \"kubernetes.io/projected/ada94fbb-09f0-4b55-bf95-c297304e9593-kube-api-access-mwcqz\") pod \"ada94fbb-09f0-4b55-bf95-c297304e9593\" (UID: \"ada94fbb-09f0-4b55-bf95-c297304e9593\") "
Sep 11 11:49:46.127681 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:46.127539    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e85db8c-6aa2-483c-bdea-29897233195e-plugins-config-volume\") pod \"2e85db8c-6aa2-483c-bdea-29897233195e\" (UID: \"2e85db8c-6aa2-483c-bdea-29897233195e\") "
Sep 11 11:49:46.127971 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:46.127936    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e85db8c-6aa2-483c-bdea-29897233195e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2e85db8c-6aa2-483c-bdea-29897233195e" (UID: "2e85db8c-6aa2-483c-bdea-29897233195e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 11:49:46.128314 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:46.128282    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ada94fbb-09f0-4b55-bf95-c297304e9593-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ada94fbb-09f0-4b55-bf95-c297304e9593" (UID: "ada94fbb-09f0-4b55-bf95-c297304e9593"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 11:49:46.129896 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:46.129872    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ada94fbb-09f0-4b55-bf95-c297304e9593-kube-api-access-mwcqz" (OuterVolumeSpecName: "kube-api-access-mwcqz") pod "ada94fbb-09f0-4b55-bf95-c297304e9593" (UID: "ada94fbb-09f0-4b55-bf95-c297304e9593"). InnerVolumeSpecName "kube-api-access-mwcqz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:49:46.130079 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:46.130059    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e85db8c-6aa2-483c-bdea-29897233195e-kube-api-access-z22lp" (OuterVolumeSpecName: "kube-api-access-z22lp") pod "2e85db8c-6aa2-483c-bdea-29897233195e" (UID: "2e85db8c-6aa2-483c-bdea-29897233195e"). InnerVolumeSpecName "kube-api-access-z22lp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:49:46.229138 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:46.229104    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z22lp\" (UniqueName: \"kubernetes.io/projected/2e85db8c-6aa2-483c-bdea-29897233195e-kube-api-access-z22lp\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:49:46.229138 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:46.229132    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ada94fbb-09f0-4b55-bf95-c297304e9593-plugins-config-volume\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:49:46.229138 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:46.229141    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwcqz\" (UniqueName: \"kubernetes.io/projected/ada94fbb-09f0-4b55-bf95-c297304e9593-kube-api-access-mwcqz\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:49:46.229138 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:46.229149    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e85db8c-6aa2-483c-bdea-29897233195e-plugins-config-volume\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:49:46.780694 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:46.780638    2560 generic.go:356] "Generic (PLEG): container finished" podID="ada94fbb-09f0-4b55-bf95-c297304e9593" containerID="f85a7d6ba2038f382e36309df5c010d715c388b5028511e50a444353f8b1b2f2" exitCode=0
Sep 11 11:49:46.780694 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:46.780687    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-5a5ab7-57646d9598-86hkt"
Sep 11 11:49:46.781130 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:46.780688    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-5a5ab7-57646d9598-86hkt" event={"ID":"ada94fbb-09f0-4b55-bf95-c297304e9593","Type":"ContainerDied","Data":"f85a7d6ba2038f382e36309df5c010d715c388b5028511e50a444353f8b1b2f2"}
Sep 11 11:49:46.781130 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:46.780773    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-5a5ab7-57646d9598-86hkt" event={"ID":"ada94fbb-09f0-4b55-bf95-c297304e9593","Type":"ContainerDied","Data":"7aaf771fd4568689efc3663a692c2dc89d82b7f1454205ef4e21cc71d84a5d30"}
Sep 11 11:49:46.781130 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:46.780797    2560 scope.go:117] "RemoveContainer" containerID="f85a7d6ba2038f382e36309df5c010d715c388b5028511e50a444353f8b1b2f2"
Sep 11 11:49:46.782389 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:46.782364    2560 generic.go:356] "Generic (PLEG): container finished" podID="2e85db8c-6aa2-483c-bdea-29897233195e" containerID="5b5eace7231f6c1c39803aea1766c4871d36999c223c8e36bcd2a6b8280b54cd" exitCode=0
Sep 11 11:49:46.782475 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:46.782413    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-5a5ab7-767fc89d4c-4dw6v"
Sep 11 11:49:46.782475 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:46.782451    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-5a5ab7-767fc89d4c-4dw6v" event={"ID":"2e85db8c-6aa2-483c-bdea-29897233195e","Type":"ContainerDied","Data":"5b5eace7231f6c1c39803aea1766c4871d36999c223c8e36bcd2a6b8280b54cd"}
Sep 11 11:49:46.782566 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:46.782509    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-5a5ab7-767fc89d4c-4dw6v" event={"ID":"2e85db8c-6aa2-483c-bdea-29897233195e","Type":"ContainerDied","Data":"82b39293a67eba6f7cc319b7ebe816692aa9f70a2b955a98c5af3af515162610"}
Sep 11 11:49:46.791083 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:46.791067    2560 scope.go:117] "RemoveContainer" containerID="f85a7d6ba2038f382e36309df5c010d715c388b5028511e50a444353f8b1b2f2"
Sep 11 11:49:46.791385 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:49:46.791362    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f85a7d6ba2038f382e36309df5c010d715c388b5028511e50a444353f8b1b2f2\": container with ID starting with f85a7d6ba2038f382e36309df5c010d715c388b5028511e50a444353f8b1b2f2 not found: ID does not exist" containerID="f85a7d6ba2038f382e36309df5c010d715c388b5028511e50a444353f8b1b2f2"
Sep 11 11:49:46.791451 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:46.791398    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f85a7d6ba2038f382e36309df5c010d715c388b5028511e50a444353f8b1b2f2"} err="failed to get container status \"f85a7d6ba2038f382e36309df5c010d715c388b5028511e50a444353f8b1b2f2\": rpc error: code = NotFound desc = could not find container \"f85a7d6ba2038f382e36309df5c010d715c388b5028511e50a444353f8b1b2f2\": container with ID starting with f85a7d6ba2038f382e36309df5c010d715c388b5028511e50a444353f8b1b2f2 not found: ID does not exist"
Sep 11 11:49:46.791451 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:46.791422    2560 scope.go:117] "RemoveContainer" containerID="5b5eace7231f6c1c39803aea1766c4871d36999c223c8e36bcd2a6b8280b54cd"
Sep 11 11:49:46.799195 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:46.799179    2560 scope.go:117] "RemoveContainer" containerID="5b5eace7231f6c1c39803aea1766c4871d36999c223c8e36bcd2a6b8280b54cd"
Sep 11 11:49:46.799437 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:49:46.799419    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b5eace7231f6c1c39803aea1766c4871d36999c223c8e36bcd2a6b8280b54cd\": container with ID starting with 5b5eace7231f6c1c39803aea1766c4871d36999c223c8e36bcd2a6b8280b54cd not found: ID does not exist" containerID="5b5eace7231f6c1c39803aea1766c4871d36999c223c8e36bcd2a6b8280b54cd"
Sep 11 11:49:46.799489 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:46.799442    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b5eace7231f6c1c39803aea1766c4871d36999c223c8e36bcd2a6b8280b54cd"} err="failed to get container status \"5b5eace7231f6c1c39803aea1766c4871d36999c223c8e36bcd2a6b8280b54cd\": rpc error: code = NotFound desc = could not find container \"5b5eace7231f6c1c39803aea1766c4871d36999c223c8e36bcd2a6b8280b54cd\": container with ID starting with 5b5eace7231f6c1c39803aea1766c4871d36999c223c8e36bcd2a6b8280b54cd not found: ID does not exist"
Sep 11 11:49:46.806612 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:46.806589    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-5a5ab7-57646d9598-86hkt"]
Sep 11 11:49:46.812290 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:46.812270    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-5a5ab7-57646d9598-86hkt"]
Sep 11 11:49:46.825346 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:46.825323    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-5a5ab7-767fc89d4c-4dw6v"]
Sep 11 11:49:46.832143 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:46.832122    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-5a5ab7-767fc89d4c-4dw6v"]
Sep 11 11:49:46.965523 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:46.965490    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-d507e5c9-b98569698-wdnzd"]
Sep 11 11:49:46.965859 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:46.965846    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ada94fbb-09f0-4b55-bf95-c297304e9593" containerName="payload-pre-processing"
Sep 11 11:49:46.965859 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:46.965859    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ada94fbb-09f0-4b55-bf95-c297304e9593" containerName="payload-pre-processing"
Sep 11 11:49:46.965950 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:46.965873    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e85db8c-6aa2-483c-bdea-29897233195e" containerName="payload-processing"
Sep 11 11:49:46.965950 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:46.965878    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e85db8c-6aa2-483c-bdea-29897233195e" containerName="payload-processing"
Sep 11 11:49:46.965950 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:46.965934    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e85db8c-6aa2-483c-bdea-29897233195e" containerName="payload-processing"
Sep 11 11:49:46.965950 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:46.965941    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ada94fbb-09f0-4b55-bf95-c297304e9593" containerName="payload-pre-processing"
Sep 11 11:49:46.970280 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:46.970259    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-d507e5c9-b98569698-wdnzd"
Sep 11 11:49:46.972958 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:46.972939    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-d507e5c9\""
Sep 11 11:49:46.980344 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:46.980321    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-d507e5c9-b98569698-wdnzd"]
Sep 11 11:49:46.991053 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:46.991030    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-d507e5c9-6c5769f777-lbq85"]
Sep 11 11:49:46.994823 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:46.994802    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-d507e5c9-6c5769f777-lbq85"
Sep 11 11:49:46.996990 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:46.996973    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-d507e5c9-dockercfg-ql8rr\""
Sep 11 11:49:47.003171 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.003149    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-d507e5c9-6c5769f777-lbq85"]
Sep 11 11:49:47.036359 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.036264    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01f4bf40-445f-4370-9535-31f0fd0c1095-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-d507e5c9-b98569698-wdnzd\" (UID: \"01f4bf40-445f-4370-9535-31f0fd0c1095\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-d507e5c9-b98569698-wdnzd"
Sep 11 11:49:47.036359 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.036345    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzb26\" (UniqueName: \"kubernetes.io/projected/01f4bf40-445f-4370-9535-31f0fd0c1095-kube-api-access-nzb26\") pod \"payload-pre-processing-e2e-derive-d507e5c9-b98569698-wdnzd\" (UID: \"01f4bf40-445f-4370-9535-31f0fd0c1095\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-d507e5c9-b98569698-wdnzd"
Sep 11 11:49:47.137526 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.137487    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01f4bf40-445f-4370-9535-31f0fd0c1095-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-d507e5c9-b98569698-wdnzd\" (UID: \"01f4bf40-445f-4370-9535-31f0fd0c1095\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-d507e5c9-b98569698-wdnzd"
Sep 11 11:49:47.137709 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.137637    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzb26\" (UniqueName: \"kubernetes.io/projected/01f4bf40-445f-4370-9535-31f0fd0c1095-kube-api-access-nzb26\") pod \"payload-pre-processing-e2e-derive-d507e5c9-b98569698-wdnzd\" (UID: \"01f4bf40-445f-4370-9535-31f0fd0c1095\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-d507e5c9-b98569698-wdnzd"
Sep 11 11:49:47.137709 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.137686    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqs86\" (UniqueName: \"kubernetes.io/projected/eec3fe3f-d30a-4528-a4c1-432122cb00b7-kube-api-access-cqs86\") pod \"payload-processing-e2e-derive-d507e5c9-6c5769f777-lbq85\" (UID: \"eec3fe3f-d30a-4528-a4c1-432122cb00b7\") " pod="openshift-ingress/payload-processing-e2e-derive-d507e5c9-6c5769f777-lbq85"
Sep 11 11:49:47.137793 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.137709    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eec3fe3f-d30a-4528-a4c1-432122cb00b7-plugins-config-volume\") pod \"payload-processing-e2e-derive-d507e5c9-6c5769f777-lbq85\" (UID: \"eec3fe3f-d30a-4528-a4c1-432122cb00b7\") " pod="openshift-ingress/payload-processing-e2e-derive-d507e5c9-6c5769f777-lbq85"
Sep 11 11:49:47.138764 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.138742    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01f4bf40-445f-4370-9535-31f0fd0c1095-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-d507e5c9-b98569698-wdnzd\" (UID: \"01f4bf40-445f-4370-9535-31f0fd0c1095\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-d507e5c9-b98569698-wdnzd"
Sep 11 11:49:47.146107 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.146083    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzb26\" (UniqueName: \"kubernetes.io/projected/01f4bf40-445f-4370-9535-31f0fd0c1095-kube-api-access-nzb26\") pod \"payload-pre-processing-e2e-derive-d507e5c9-b98569698-wdnzd\" (UID: \"01f4bf40-445f-4370-9535-31f0fd0c1095\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-d507e5c9-b98569698-wdnzd"
Sep 11 11:49:47.238702 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.238639    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqs86\" (UniqueName: \"kubernetes.io/projected/eec3fe3f-d30a-4528-a4c1-432122cb00b7-kube-api-access-cqs86\") pod \"payload-processing-e2e-derive-d507e5c9-6c5769f777-lbq85\" (UID: \"eec3fe3f-d30a-4528-a4c1-432122cb00b7\") " pod="openshift-ingress/payload-processing-e2e-derive-d507e5c9-6c5769f777-lbq85"
Sep 11 11:49:47.238867 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.238717    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eec3fe3f-d30a-4528-a4c1-432122cb00b7-plugins-config-volume\") pod \"payload-processing-e2e-derive-d507e5c9-6c5769f777-lbq85\" (UID: \"eec3fe3f-d30a-4528-a4c1-432122cb00b7\") " pod="openshift-ingress/payload-processing-e2e-derive-d507e5c9-6c5769f777-lbq85"
Sep 11 11:49:47.239400 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.239378    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eec3fe3f-d30a-4528-a4c1-432122cb00b7-plugins-config-volume\") pod \"payload-processing-e2e-derive-d507e5c9-6c5769f777-lbq85\" (UID: \"eec3fe3f-d30a-4528-a4c1-432122cb00b7\") " pod="openshift-ingress/payload-processing-e2e-derive-d507e5c9-6c5769f777-lbq85"
Sep 11 11:49:47.251099 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.251064    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqs86\" (UniqueName: \"kubernetes.io/projected/eec3fe3f-d30a-4528-a4c1-432122cb00b7-kube-api-access-cqs86\") pod \"payload-processing-e2e-derive-d507e5c9-6c5769f777-lbq85\" (UID: \"eec3fe3f-d30a-4528-a4c1-432122cb00b7\") " pod="openshift-ingress/payload-processing-e2e-derive-d507e5c9-6c5769f777-lbq85"
Sep 11 11:49:47.281184 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.281155    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-d507e5c9-b98569698-wdnzd"
Sep 11 11:49:47.307911 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.307887    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-d507e5c9-6c5769f777-lbq85"
Sep 11 11:49:47.514328 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.514303    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf"
Sep 11 11:49:47.564229 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.564147    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-d507e5c9-b98569698-wdnzd"]
Sep 11 11:49:47.567564 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:49:47.567540    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01f4bf40_445f_4370_9535_31f0fd0c1095.slice/crio-c08e9a1b7a5f343af8b67fdb16ba844ce6b0ee78a87da735038ccaa7a50e9efe WatchSource:0}: Error finding container c08e9a1b7a5f343af8b67fdb16ba844ce6b0ee78a87da735038ccaa7a50e9efe: Status 404 returned error can't find the container with id c08e9a1b7a5f343af8b67fdb16ba844ce6b0ee78a87da735038ccaa7a50e9efe
Sep 11 11:49:47.600157 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.600136    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-d507e5c9-6c5769f777-lbq85"]
Sep 11 11:49:47.601964 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:49:47.601937    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeec3fe3f_d30a_4528_a4c1_432122cb00b7.slice/crio-c910dd7d4bea267eb0750708698a801f9602e4601c492468cedc1c8af126f0db WatchSource:0}: Error finding container c910dd7d4bea267eb0750708698a801f9602e4601c492468cedc1c8af126f0db: Status 404 returned error can't find the container with id c910dd7d4bea267eb0750708698a801f9602e4601c492468cedc1c8af126f0db
Sep 11 11:49:47.642280 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.642248    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b4b02e5-6bc6-4f09-a18e-5e008902993d-istio-podinfo\") pod \"3b4b02e5-6bc6-4f09-a18e-5e008902993d\" (UID: \"3b4b02e5-6bc6-4f09-a18e-5e008902993d\") "
Sep 11 11:49:47.642603 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.642359    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b4b02e5-6bc6-4f09-a18e-5e008902993d-credential-socket\") pod \"3b4b02e5-6bc6-4f09-a18e-5e008902993d\" (UID: \"3b4b02e5-6bc6-4f09-a18e-5e008902993d\") "
Sep 11 11:49:47.642603 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.642388    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b4b02e5-6bc6-4f09-a18e-5e008902993d-istio-token\") pod \"3b4b02e5-6bc6-4f09-a18e-5e008902993d\" (UID: \"3b4b02e5-6bc6-4f09-a18e-5e008902993d\") "
Sep 11 11:49:47.642603 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.642417    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b4b02e5-6bc6-4f09-a18e-5e008902993d-workload-certs\") pod \"3b4b02e5-6bc6-4f09-a18e-5e008902993d\" (UID: \"3b4b02e5-6bc6-4f09-a18e-5e008902993d\") "
Sep 11 11:49:47.642603 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.642444    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b4b02e5-6bc6-4f09-a18e-5e008902993d-workload-socket\") pod \"3b4b02e5-6bc6-4f09-a18e-5e008902993d\" (UID: \"3b4b02e5-6bc6-4f09-a18e-5e008902993d\") "
Sep 11 11:49:47.642603 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.642473    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b4b02e5-6bc6-4f09-a18e-5e008902993d-istiod-ca-cert\") pod \"3b4b02e5-6bc6-4f09-a18e-5e008902993d\" (UID: \"3b4b02e5-6bc6-4f09-a18e-5e008902993d\") "
Sep 11 11:49:47.642603 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.642548    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b4b02e5-6bc6-4f09-a18e-5e008902993d-istio-envoy\") pod \"3b4b02e5-6bc6-4f09-a18e-5e008902993d\" (UID: \"3b4b02e5-6bc6-4f09-a18e-5e008902993d\") "
Sep 11 11:49:47.642603 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.642573    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b4b02e5-6bc6-4f09-a18e-5e008902993d-istio-data\") pod \"3b4b02e5-6bc6-4f09-a18e-5e008902993d\" (UID: \"3b4b02e5-6bc6-4f09-a18e-5e008902993d\") "
Sep 11 11:49:47.642603 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.642601    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-km2q5\" (UniqueName: \"kubernetes.io/projected/3b4b02e5-6bc6-4f09-a18e-5e008902993d-kube-api-access-km2q5\") pod \"3b4b02e5-6bc6-4f09-a18e-5e008902993d\" (UID: \"3b4b02e5-6bc6-4f09-a18e-5e008902993d\") "
Sep 11 11:49:47.643164 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.643078    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b4b02e5-6bc6-4f09-a18e-5e008902993d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3b4b02e5-6bc6-4f09-a18e-5e008902993d" (UID: "3b4b02e5-6bc6-4f09-a18e-5e008902993d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:49:47.643345 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.643322    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b4b02e5-6bc6-4f09-a18e-5e008902993d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3b4b02e5-6bc6-4f09-a18e-5e008902993d" (UID: "3b4b02e5-6bc6-4f09-a18e-5e008902993d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 11:49:47.643426 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.643388    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b4b02e5-6bc6-4f09-a18e-5e008902993d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3b4b02e5-6bc6-4f09-a18e-5e008902993d" (UID: "3b4b02e5-6bc6-4f09-a18e-5e008902993d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:49:47.643490 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.643445    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b4b02e5-6bc6-4f09-a18e-5e008902993d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3b4b02e5-6bc6-4f09-a18e-5e008902993d" (UID: "3b4b02e5-6bc6-4f09-a18e-5e008902993d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:49:47.643680 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.643626    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b4b02e5-6bc6-4f09-a18e-5e008902993d-istio-data" (OuterVolumeSpecName: "istio-data") pod "3b4b02e5-6bc6-4f09-a18e-5e008902993d" (UID: "3b4b02e5-6bc6-4f09-a18e-5e008902993d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:49:47.644944 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.644881    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3b4b02e5-6bc6-4f09-a18e-5e008902993d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3b4b02e5-6bc6-4f09-a18e-5e008902993d" (UID: "3b4b02e5-6bc6-4f09-a18e-5e008902993d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 11:49:47.645365 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.645296    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b4b02e5-6bc6-4f09-a18e-5e008902993d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3b4b02e5-6bc6-4f09-a18e-5e008902993d" (UID: "3b4b02e5-6bc6-4f09-a18e-5e008902993d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:49:47.645497 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.645471    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b4b02e5-6bc6-4f09-a18e-5e008902993d-kube-api-access-km2q5" (OuterVolumeSpecName: "kube-api-access-km2q5") pod "3b4b02e5-6bc6-4f09-a18e-5e008902993d" (UID: "3b4b02e5-6bc6-4f09-a18e-5e008902993d"). InnerVolumeSpecName "kube-api-access-km2q5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:49:47.645558 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.645542    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b4b02e5-6bc6-4f09-a18e-5e008902993d-istio-token" (OuterVolumeSpecName: "istio-token") pod "3b4b02e5-6bc6-4f09-a18e-5e008902993d" (UID: "3b4b02e5-6bc6-4f09-a18e-5e008902993d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:49:47.743606 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.743568    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b4b02e5-6bc6-4f09-a18e-5e008902993d-istio-podinfo\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:49:47.743606 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.743599    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b4b02e5-6bc6-4f09-a18e-5e008902993d-credential-socket\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:49:47.743606 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.743612    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b4b02e5-6bc6-4f09-a18e-5e008902993d-istio-token\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:49:47.743853 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.743624    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b4b02e5-6bc6-4f09-a18e-5e008902993d-workload-certs\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:49:47.743853 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.743635    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b4b02e5-6bc6-4f09-a18e-5e008902993d-workload-socket\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:49:47.743853 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.743660    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b4b02e5-6bc6-4f09-a18e-5e008902993d-istiod-ca-cert\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:49:47.743853 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.743671    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b4b02e5-6bc6-4f09-a18e-5e008902993d-istio-envoy\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:49:47.743853 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.743681    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b4b02e5-6bc6-4f09-a18e-5e008902993d-istio-data\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:49:47.743853 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.743693    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-km2q5\" (UniqueName: \"kubernetes.io/projected/3b4b02e5-6bc6-4f09-a18e-5e008902993d-kube-api-access-km2q5\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:49:47.790689 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.790639    2560 generic.go:356] "Generic (PLEG): container finished" podID="3b4b02e5-6bc6-4f09-a18e-5e008902993d" containerID="e56608dd9261eb5e5b2014d5895b792e86e67717e8ff61b8e737822e6958cad1" exitCode=0
Sep 11 11:49:47.791112 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.790700    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf"
Sep 11 11:49:47.791112 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.790690    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf" event={"ID":"3b4b02e5-6bc6-4f09-a18e-5e008902993d","Type":"ContainerDied","Data":"e56608dd9261eb5e5b2014d5895b792e86e67717e8ff61b8e737822e6958cad1"}
Sep 11 11:49:47.791112 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.790817    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf" event={"ID":"3b4b02e5-6bc6-4f09-a18e-5e008902993d","Type":"ContainerDied","Data":"a689daf168fdce872f0025cd0c2d6d52de7663f9e7d3332acf2a030e5ab2cab7"}
Sep 11 11:49:47.791112 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.790862    2560 scope.go:117] "RemoveContainer" containerID="e56608dd9261eb5e5b2014d5895b792e86e67717e8ff61b8e737822e6958cad1"
Sep 11 11:49:47.793007 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.792986    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-d507e5c9-6c5769f777-lbq85" event={"ID":"eec3fe3f-d30a-4528-a4c1-432122cb00b7","Type":"ContainerStarted","Data":"7eb95592873c99b059ea7f7590ea56653850ff93d54c09981b74a23e6c87dd09"}
Sep 11 11:49:47.793118 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.793040    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-d507e5c9-6c5769f777-lbq85" event={"ID":"eec3fe3f-d30a-4528-a4c1-432122cb00b7","Type":"ContainerStarted","Data":"c910dd7d4bea267eb0750708698a801f9602e4601c492468cedc1c8af126f0db"}
Sep 11 11:49:47.793118 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.793086    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-d507e5c9-6c5769f777-lbq85"
Sep 11 11:49:47.794979 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.794956    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-d507e5c9-b98569698-wdnzd" event={"ID":"01f4bf40-445f-4370-9535-31f0fd0c1095","Type":"ContainerStarted","Data":"e4ac836a1d06498eb85008370218c76bc7d58f8359481e87a751f7e44fa33675"}
Sep 11 11:49:47.795103 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.794998    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-d507e5c9-b98569698-wdnzd" event={"ID":"01f4bf40-445f-4370-9535-31f0fd0c1095","Type":"ContainerStarted","Data":"c08e9a1b7a5f343af8b67fdb16ba844ce6b0ee78a87da735038ccaa7a50e9efe"}
Sep 11 11:49:47.795103 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.795067    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-d507e5c9-b98569698-wdnzd"
Sep 11 11:49:47.800490 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.800468    2560 scope.go:117] "RemoveContainer" containerID="b735b2a4a0743c3749a9fedd7cd75705eab5fc9033f5fb57b15f7cf8684cd09a"
Sep 11 11:49:47.808248 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.808226    2560 scope.go:117] "RemoveContainer" containerID="e56608dd9261eb5e5b2014d5895b792e86e67717e8ff61b8e737822e6958cad1"
Sep 11 11:49:47.808518 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:49:47.808497    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e56608dd9261eb5e5b2014d5895b792e86e67717e8ff61b8e737822e6958cad1\": container with ID starting with e56608dd9261eb5e5b2014d5895b792e86e67717e8ff61b8e737822e6958cad1 not found: ID does not exist" containerID="e56608dd9261eb5e5b2014d5895b792e86e67717e8ff61b8e737822e6958cad1"
Sep 11 11:49:47.808583 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.808527    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e56608dd9261eb5e5b2014d5895b792e86e67717e8ff61b8e737822e6958cad1"} err="failed to get container status \"e56608dd9261eb5e5b2014d5895b792e86e67717e8ff61b8e737822e6958cad1\": rpc error: code = NotFound desc = could not find container \"e56608dd9261eb5e5b2014d5895b792e86e67717e8ff61b8e737822e6958cad1\": container with ID starting with e56608dd9261eb5e5b2014d5895b792e86e67717e8ff61b8e737822e6958cad1 not found: ID does not exist"
Sep 11 11:49:47.808583 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.808542    2560 scope.go:117] "RemoveContainer" containerID="b735b2a4a0743c3749a9fedd7cd75705eab5fc9033f5fb57b15f7cf8684cd09a"
Sep 11 11:49:47.808872 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:49:47.808852    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b735b2a4a0743c3749a9fedd7cd75705eab5fc9033f5fb57b15f7cf8684cd09a\": container with ID starting with b735b2a4a0743c3749a9fedd7cd75705eab5fc9033f5fb57b15f7cf8684cd09a not found: ID does not exist" containerID="b735b2a4a0743c3749a9fedd7cd75705eab5fc9033f5fb57b15f7cf8684cd09a"
Sep 11 11:49:47.808919 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.808878    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b735b2a4a0743c3749a9fedd7cd75705eab5fc9033f5fb57b15f7cf8684cd09a"} err="failed to get container status \"b735b2a4a0743c3749a9fedd7cd75705eab5fc9033f5fb57b15f7cf8684cd09a\": rpc error: code = NotFound desc = could not find container \"b735b2a4a0743c3749a9fedd7cd75705eab5fc9033f5fb57b15f7cf8684cd09a\": container with ID starting with b735b2a4a0743c3749a9fedd7cd75705eab5fc9033f5fb57b15f7cf8684cd09a not found: ID does not exist"
Sep 11 11:49:47.814416 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.814369    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e85db8c-6aa2-483c-bdea-29897233195e" path="/var/lib/kubelet/pods/2e85db8c-6aa2-483c-bdea-29897233195e/volumes"
Sep 11 11:49:47.814739 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.814726    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ada94fbb-09f0-4b55-bf95-c297304e9593" path="/var/lib/kubelet/pods/ada94fbb-09f0-4b55-bf95-c297304e9593/volumes"
Sep 11 11:49:47.818829 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.818787    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-d507e5c9-b98569698-wdnzd" podStartSLOduration=1.818775542 podStartE2EDuration="1.818775542s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:49:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:49:47.817079787 +0000 UTC m=+938.639539696" watchObservedRunningTime="2026-09-11 11:49:47.818775542 +0000 UTC m=+938.641235471"
Sep 11 11:49:47.857012 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.856956    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-d507e5c9-6c5769f777-lbq85" podStartSLOduration=1.856935232 podStartE2EDuration="1.856935232s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:49:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:49:47.854744663 +0000 UTC m=+938.677204537" watchObservedRunningTime="2026-09-11 11:49:47.856935232 +0000 UTC m=+938.679395106"
Sep 11 11:49:47.875931 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.875896    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf"]
Sep 11 11:49:47.882995 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:47.882959    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-8ede8f25-openshift-default-7cc7947754-b8hrf"]
Sep 11 11:49:49.812916 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:49.812884    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b4b02e5-6bc6-4f09-a18e-5e008902993d" path="/var/lib/kubelet/pods/3b4b02e5-6bc6-4f09-a18e-5e008902993d/volumes"
Sep 11 11:49:58.804928 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:58.804897    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-d507e5c9-b98569698-wdnzd"
Sep 11 11:49:58.805395 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:49:58.805182    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-d507e5c9-6c5769f777-lbq85"
Sep 11 11:50:00.127956 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:00.127910    2560 patch_prober.go:28] interesting pod/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": read tcp 10.133.0.2:53330->10.133.0.43:15021: read: connection reset by peer" start-of-body=
Sep 11 11:50:00.128373 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:00.128003    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2" podUID="1a9ff703-2252-456b-a9c1-8d066a8c12fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": read tcp 10.133.0.2:53330->10.133.0.43:15021: read: connection reset by peer"
Sep 11 11:50:00.865794 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:00.865754    2560 generic.go:356] "Generic (PLEG): container finished" podID="1a9ff703-2252-456b-a9c1-8d066a8c12fe" containerID="95658bbea38ce2c44532285c7d843515bbc21fe02a056411882703b1beeb62f7" exitCode=0
Sep 11 11:50:00.865966 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:00.865827    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2" event={"ID":"1a9ff703-2252-456b-a9c1-8d066a8c12fe","Type":"ContainerDied","Data":"95658bbea38ce2c44532285c7d843515bbc21fe02a056411882703b1beeb62f7"}
Sep 11 11:50:00.866221 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:00.866205    2560 scope.go:117] "RemoveContainer" containerID="95658bbea38ce2c44532285c7d843515bbc21fe02a056411882703b1beeb62f7"
Sep 11 11:50:00.867268 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:00.867244    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:50:00.867321 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:00.867306    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:50:00.867356 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:00.867334    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:50:01.873305 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:01.873267    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2" event={"ID":"1a9ff703-2252-456b-a9c1-8d066a8c12fe","Type":"ContainerStarted","Data":"4f70f26366e45bd30316bfa03cf4e4da928d0dc0b542ffbd6ed477e17f411fe7"}
Sep 11 11:50:02.353882 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:02.353836    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2"
Sep 11 11:50:02.354181 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:02.354149    2560 patch_prober.go:28] interesting pod/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 11 11:50:02.354273 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:02.354221    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2" podUID="1a9ff703-2252-456b-a9c1-8d066a8c12fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 11 11:50:03.353961 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:03.353919    2560 patch_prober.go:28] interesting pod/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 11 11:50:03.354548 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:03.354510    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2" podUID="1a9ff703-2252-456b-a9c1-8d066a8c12fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 11 11:50:04.354483 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:04.354444    2560 patch_prober.go:28] interesting pod/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 11 11:50:04.355091 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:04.355054    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2" podUID="1a9ff703-2252-456b-a9c1-8d066a8c12fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 11 11:50:05.354186 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:05.354145    2560 patch_prober.go:28] interesting pod/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 11 11:50:05.354492 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:05.354461    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2" podUID="1a9ff703-2252-456b-a9c1-8d066a8c12fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 11 11:50:06.354094 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:06.354054    2560 patch_prober.go:28] interesting pod/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 11 11:50:06.354711 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:06.354676    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2" podUID="1a9ff703-2252-456b-a9c1-8d066a8c12fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 11 11:50:07.367861 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:07.367828    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2"
Sep 11 11:50:07.368334 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:07.368276    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2"
Sep 11 11:50:07.369146 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:07.369124    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2"
Sep 11 11:50:10.007177 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:10.007146    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d507e5c9-8fwpn"]
Sep 11 11:50:10.007540 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:10.007500    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b4b02e5-6bc6-4f09-a18e-5e008902993d" containerName="istio-proxy"
Sep 11 11:50:10.007540 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:10.007511    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b4b02e5-6bc6-4f09-a18e-5e008902993d" containerName="istio-proxy"
Sep 11 11:50:10.007540 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:10.007527    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b4b02e5-6bc6-4f09-a18e-5e008902993d" containerName="istio-proxy"
Sep 11 11:50:10.007540 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:10.007533    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b4b02e5-6bc6-4f09-a18e-5e008902993d" containerName="istio-proxy"
Sep 11 11:50:10.007705 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:10.007593    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b4b02e5-6bc6-4f09-a18e-5e008902993d" containerName="istio-proxy"
Sep 11 11:50:10.011812 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:10.011793    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d507e5c9-8fwpn"
Sep 11 11:50:10.014020 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:10.013998    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f46tj\""
Sep 11 11:50:10.014143 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:10.014020    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 11:50:10.018221 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:10.018195    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d507e5c9-8fwpn"]
Sep 11 11:50:10.037061 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:10.036976    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/edb633c9-65fb-49bb-90bb-c74fed62ed2f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-d507e5c9-8fwpn\" (UID: \"edb633c9-65fb-49bb-90bb-c74fed62ed2f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d507e5c9-8fwpn"
Sep 11 11:50:10.138184 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:10.138145    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/edb633c9-65fb-49bb-90bb-c74fed62ed2f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-d507e5c9-8fwpn\" (UID: \"edb633c9-65fb-49bb-90bb-c74fed62ed2f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d507e5c9-8fwpn"
Sep 11 11:50:10.139014 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:10.138989    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/edb633c9-65fb-49bb-90bb-c74fed62ed2f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-d507e5c9-8fwpn\" (UID: \"edb633c9-65fb-49bb-90bb-c74fed62ed2f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d507e5c9-8fwpn"
Sep 11 11:50:10.324317 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:10.324236    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d507e5c9-8fwpn"
Sep 11 11:50:10.594934 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:10.594905    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d507e5c9-8fwpn"]
Sep 11 11:50:10.597517 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:50:10.597491    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedb633c9_65fb_49bb_90bb_c74fed62ed2f.slice/crio-dec8b6e551b54a6d814e666e0511d3e2580d68d3374f3563366d2cc2aec975e6 WatchSource:0}: Error finding container dec8b6e551b54a6d814e666e0511d3e2580d68d3374f3563366d2cc2aec975e6: Status 404 returned error can't find the container with id dec8b6e551b54a6d814e666e0511d3e2580d68d3374f3563366d2cc2aec975e6
Sep 11 11:50:10.918000 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:10.917901    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d507e5c9-8fwpn" event={"ID":"edb633c9-65fb-49bb-90bb-c74fed62ed2f","Type":"ContainerStarted","Data":"4eb0b94a8fd25a76a4735ed2d955c626e2f98f01af6bb544266c2dd9966dd4ac"}
Sep 11 11:50:10.918000 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:10.917972    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d507e5c9-8fwpn" event={"ID":"edb633c9-65fb-49bb-90bb-c74fed62ed2f","Type":"ContainerStarted","Data":"dec8b6e551b54a6d814e666e0511d3e2580d68d3374f3563366d2cc2aec975e6"}
Sep 11 11:50:10.936071 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:10.936008    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d507e5c9-8fwpn" podStartSLOduration=1.9359853889999998 podStartE2EDuration="1.935985389s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:50:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:50:10.934063894 +0000 UTC m=+961.756523789" watchObservedRunningTime="2026-09-11 11:50:10.935985389 +0000 UTC m=+961.758445263"
Sep 11 11:50:11.925025 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:11.924990    2560 generic.go:356] "Generic (PLEG): container finished" podID="edb633c9-65fb-49bb-90bb-c74fed62ed2f" containerID="4eb0b94a8fd25a76a4735ed2d955c626e2f98f01af6bb544266c2dd9966dd4ac" exitCode=0
Sep 11 11:50:11.925428 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:11.925082    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d507e5c9-8fwpn" event={"ID":"edb633c9-65fb-49bb-90bb-c74fed62ed2f","Type":"ContainerDied","Data":"4eb0b94a8fd25a76a4735ed2d955c626e2f98f01af6bb544266c2dd9966dd4ac"}
Sep 11 11:50:13.062020 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:13.061984    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d507e5c9-8fwpn"
Sep 11 11:50:13.164403 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:13.164367    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/edb633c9-65fb-49bb-90bb-c74fed62ed2f-maas-api-service-ca\") pod \"edb633c9-65fb-49bb-90bb-c74fed62ed2f\" (UID: \"edb633c9-65fb-49bb-90bb-c74fed62ed2f\") "
Sep 11 11:50:13.164773 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:13.164750    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edb633c9-65fb-49bb-90bb-c74fed62ed2f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "edb633c9-65fb-49bb-90bb-c74fed62ed2f" (UID: "edb633c9-65fb-49bb-90bb-c74fed62ed2f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 11:50:13.265416 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:13.265381    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/edb633c9-65fb-49bb-90bb-c74fed62ed2f-maas-api-service-ca\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:50:13.937656 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:13.937627    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d507e5c9-8fwpn"
Sep 11 11:50:13.937867 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:13.937674    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d507e5c9-8fwpn" event={"ID":"edb633c9-65fb-49bb-90bb-c74fed62ed2f","Type":"ContainerDied","Data":"dec8b6e551b54a6d814e666e0511d3e2580d68d3374f3563366d2cc2aec975e6"}
Sep 11 11:50:13.937867 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:13.937727    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dec8b6e551b54a6d814e666e0511d3e2580d68d3374f3563366d2cc2aec975e6"
Sep 11 11:50:15.069475 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:15.069445    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r"]
Sep 11 11:50:15.069872 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:15.069858    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edb633c9-65fb-49bb-90bb-c74fed62ed2f" containerName="revoke-keys"
Sep 11 11:50:15.069915 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:15.069875    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="edb633c9-65fb-49bb-90bb-c74fed62ed2f" containerName="revoke-keys"
Sep 11 11:50:15.069952 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:15.069926    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b4b02e5-6bc6-4f09-a18e-5e008902993d" containerName="istio-proxy"
Sep 11 11:50:15.069952 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:15.069935    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="edb633c9-65fb-49bb-90bb-c74fed62ed2f" containerName="revoke-keys"
Sep 11 11:50:15.072876 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:15.072849    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r"
Sep 11 11:50:15.075303 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:15.075284    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-c92551-openshift-default-dockercfg-qcfzg\""
Sep 11 11:50:15.086869 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:15.086846    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r"]
Sep 11 11:50:15.183998 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:15.183959    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8-istio-token\") pod \"e2e-explicit-c92551-openshift-default-78cccc897b-nts4r\" (UID: \"c997cea8-a4f6-4f11-b8b1-ed2781bae6c8\") " pod="openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r"
Sep 11 11:50:15.184264 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:15.184236    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8-istiod-ca-cert\") pod \"e2e-explicit-c92551-openshift-default-78cccc897b-nts4r\" (UID: \"c997cea8-a4f6-4f11-b8b1-ed2781bae6c8\") " pod="openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r"
Sep 11 11:50:15.184407 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:15.184306    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8-istio-data\") pod \"e2e-explicit-c92551-openshift-default-78cccc897b-nts4r\" (UID: \"c997cea8-a4f6-4f11-b8b1-ed2781bae6c8\") " pod="openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r"
Sep 11 11:50:15.184407 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:15.184331    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8-istio-podinfo\") pod \"e2e-explicit-c92551-openshift-default-78cccc897b-nts4r\" (UID: \"c997cea8-a4f6-4f11-b8b1-ed2781bae6c8\") " pod="openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r"
Sep 11 11:50:15.184407 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:15.184360    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8-istio-envoy\") pod \"e2e-explicit-c92551-openshift-default-78cccc897b-nts4r\" (UID: \"c997cea8-a4f6-4f11-b8b1-ed2781bae6c8\") " pod="openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r"
Sep 11 11:50:15.184567 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:15.184484    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn668\" (UniqueName: \"kubernetes.io/projected/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8-kube-api-access-hn668\") pod \"e2e-explicit-c92551-openshift-default-78cccc897b-nts4r\" (UID: \"c997cea8-a4f6-4f11-b8b1-ed2781bae6c8\") " pod="openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r"
Sep 11 11:50:15.184567 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:15.184532    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8-workload-socket\") pod \"e2e-explicit-c92551-openshift-default-78cccc897b-nts4r\" (UID: \"c997cea8-a4f6-4f11-b8b1-ed2781bae6c8\") " pod="openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r"
Sep 11 11:50:15.184698 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:15.184605    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8-credential-socket\") pod \"e2e-explicit-c92551-openshift-default-78cccc897b-nts4r\" (UID: \"c997cea8-a4f6-4f11-b8b1-ed2781bae6c8\") " pod="openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r"
Sep 11 11:50:15.184698 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:15.184632    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8-workload-certs\") pod \"e2e-explicit-c92551-openshift-default-78cccc897b-nts4r\" (UID: \"c997cea8-a4f6-4f11-b8b1-ed2781bae6c8\") " pod="openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r"
Sep 11 11:50:15.285186 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:15.285148    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hn668\" (UniqueName: \"kubernetes.io/projected/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8-kube-api-access-hn668\") pod \"e2e-explicit-c92551-openshift-default-78cccc897b-nts4r\" (UID: \"c997cea8-a4f6-4f11-b8b1-ed2781bae6c8\") " pod="openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r"
Sep 11 11:50:15.285186 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:15.285187    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8-workload-socket\") pod \"e2e-explicit-c92551-openshift-default-78cccc897b-nts4r\" (UID: \"c997cea8-a4f6-4f11-b8b1-ed2781bae6c8\") " pod="openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r"
Sep 11 11:50:15.285443 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:15.285220    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8-credential-socket\") pod \"e2e-explicit-c92551-openshift-default-78cccc897b-nts4r\" (UID: \"c997cea8-a4f6-4f11-b8b1-ed2781bae6c8\") " pod="openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r"
Sep 11 11:50:15.285443 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:15.285241    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8-workload-certs\") pod \"e2e-explicit-c92551-openshift-default-78cccc897b-nts4r\" (UID: \"c997cea8-a4f6-4f11-b8b1-ed2781bae6c8\") " pod="openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r"
Sep 11 11:50:15.285443 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:15.285283    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8-istio-token\") pod \"e2e-explicit-c92551-openshift-default-78cccc897b-nts4r\" (UID: \"c997cea8-a4f6-4f11-b8b1-ed2781bae6c8\") " pod="openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r"
Sep 11 11:50:15.285443 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:15.285317    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8-istiod-ca-cert\") pod \"e2e-explicit-c92551-openshift-default-78cccc897b-nts4r\" (UID: \"c997cea8-a4f6-4f11-b8b1-ed2781bae6c8\") " pod="openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r"
Sep 11 11:50:15.285443 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:15.285363    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8-istio-data\") pod \"e2e-explicit-c92551-openshift-default-78cccc897b-nts4r\" (UID: \"c997cea8-a4f6-4f11-b8b1-ed2781bae6c8\") " pod="openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r"
Sep 11 11:50:15.285443 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:15.285387    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8-istio-podinfo\") pod \"e2e-explicit-c92551-openshift-default-78cccc897b-nts4r\" (UID: \"c997cea8-a4f6-4f11-b8b1-ed2781bae6c8\") " pod="openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r"
Sep 11 11:50:15.285443 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:15.285412    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8-istio-envoy\") pod \"e2e-explicit-c92551-openshift-default-78cccc897b-nts4r\" (UID: \"c997cea8-a4f6-4f11-b8b1-ed2781bae6c8\") " pod="openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r"
Sep 11 11:50:15.285823 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:15.285693    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8-workload-socket\") pod \"e2e-explicit-c92551-openshift-default-78cccc897b-nts4r\" (UID: \"c997cea8-a4f6-4f11-b8b1-ed2781bae6c8\") " pod="openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r"
Sep 11 11:50:15.285823 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:15.285770    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8-credential-socket\") pod \"e2e-explicit-c92551-openshift-default-78cccc897b-nts4r\" (UID: \"c997cea8-a4f6-4f11-b8b1-ed2781bae6c8\") " pod="openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r"
Sep 11 11:50:15.285894 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:15.285825    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8-istio-data\") pod \"e2e-explicit-c92551-openshift-default-78cccc897b-nts4r\" (UID: \"c997cea8-a4f6-4f11-b8b1-ed2781bae6c8\") " pod="openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r"
Sep 11 11:50:15.285894 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:15.285866    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8-workload-certs\") pod \"e2e-explicit-c92551-openshift-default-78cccc897b-nts4r\" (UID: \"c997cea8-a4f6-4f11-b8b1-ed2781bae6c8\") " pod="openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r"
Sep 11 11:50:15.286066 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:15.286048    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8-istiod-ca-cert\") pod \"e2e-explicit-c92551-openshift-default-78cccc897b-nts4r\" (UID: \"c997cea8-a4f6-4f11-b8b1-ed2781bae6c8\") " pod="openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r"
Sep 11 11:50:15.287719 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:15.287699    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8-istio-envoy\") pod \"e2e-explicit-c92551-openshift-default-78cccc897b-nts4r\" (UID: \"c997cea8-a4f6-4f11-b8b1-ed2781bae6c8\") " pod="openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r"
Sep 11 11:50:15.287947 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:15.287928    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8-istio-podinfo\") pod \"e2e-explicit-c92551-openshift-default-78cccc897b-nts4r\" (UID: \"c997cea8-a4f6-4f11-b8b1-ed2781bae6c8\") " pod="openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r"
Sep 11 11:50:15.295157 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:15.295135    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8-istio-token\") pod \"e2e-explicit-c92551-openshift-default-78cccc897b-nts4r\" (UID: \"c997cea8-a4f6-4f11-b8b1-ed2781bae6c8\") " pod="openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r"
Sep 11 11:50:15.295404 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:15.295382    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn668\" (UniqueName: \"kubernetes.io/projected/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8-kube-api-access-hn668\") pod \"e2e-explicit-c92551-openshift-default-78cccc897b-nts4r\" (UID: \"c997cea8-a4f6-4f11-b8b1-ed2781bae6c8\") " pod="openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r"
Sep 11 11:50:15.383532 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:15.383446    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r"
Sep 11 11:50:15.662257 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:15.662233    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r"]
Sep 11 11:50:15.664053 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:50:15.664025    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc997cea8_a4f6_4f11_b8b1_ed2781bae6c8.slice/crio-9f915fcec7f6ee8647cc4b15c73dd4067058ec7e1418884f77a0bb38db8b311e WatchSource:0}: Error finding container 9f915fcec7f6ee8647cc4b15c73dd4067058ec7e1418884f77a0bb38db8b311e: Status 404 returned error can't find the container with id 9f915fcec7f6ee8647cc4b15c73dd4067058ec7e1418884f77a0bb38db8b311e
Sep 11 11:50:15.666366 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:15.666332    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:50:15.666466 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:15.666414    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:50:15.666466 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:15.666458    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:50:15.952684 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:15.952579    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r" event={"ID":"c997cea8-a4f6-4f11-b8b1-ed2781bae6c8","Type":"ContainerStarted","Data":"5a5302994abe9a7142cefbc73745deb03aa6a2f1470ba1e1ecf2ad71d161c47b"}
Sep 11 11:50:15.952684 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:15.952643    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r" event={"ID":"c997cea8-a4f6-4f11-b8b1-ed2781bae6c8","Type":"ContainerStarted","Data":"9f915fcec7f6ee8647cc4b15c73dd4067058ec7e1418884f77a0bb38db8b311e"}
Sep 11 11:50:15.975372 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:15.975326    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r" podStartSLOduration=0.975308919 podStartE2EDuration="975.308919ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:50:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:50:15.973837862 +0000 UTC m=+966.796297747" watchObservedRunningTime="2026-09-11 11:50:15.975308919 +0000 UTC m=+966.797768792"
Sep 11 11:50:16.384132 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:16.384097    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r"
Sep 11 11:50:16.389041 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:16.389017    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r"
Sep 11 11:50:16.919320 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:16.919286    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-d507e5c9-6c5769f777-lbq85"]
Sep 11 11:50:16.919563 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:16.919530    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-d507e5c9-6c5769f777-lbq85" podUID="eec3fe3f-d30a-4528-a4c1-432122cb00b7" containerName="payload-processing" containerID="cri-o://7eb95592873c99b059ea7f7590ea56653850ff93d54c09981b74a23e6c87dd09" gracePeriod=30
Sep 11 11:50:16.926604 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:16.926578    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-d507e5c9-b98569698-wdnzd"]
Sep 11 11:50:16.926838 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:16.926815    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-d507e5c9-b98569698-wdnzd" podUID="01f4bf40-445f-4370-9535-31f0fd0c1095" containerName="payload-pre-processing" containerID="cri-o://e4ac836a1d06498eb85008370218c76bc7d58f8359481e87a751f7e44fa33675" gracePeriod=30
Sep 11 11:50:16.958334 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:16.958304    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r"
Sep 11 11:50:16.959390 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:16.959364    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r"
Sep 11 11:50:17.145247 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:17.145192    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d507e5c9-8fwpn"]
Sep 11 11:50:17.156999 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:17.156967    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d507e5c9-8fwpn"]
Sep 11 11:50:17.205454 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:17.205433    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-d507e5c9-6c5769f777-lbq85"
Sep 11 11:50:17.208035 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:17.208015    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-d507e5c9-b98569698-wdnzd"
Sep 11 11:50:17.301131 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:17.301099    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cqs86\" (UniqueName: \"kubernetes.io/projected/eec3fe3f-d30a-4528-a4c1-432122cb00b7-kube-api-access-cqs86\") pod \"eec3fe3f-d30a-4528-a4c1-432122cb00b7\" (UID: \"eec3fe3f-d30a-4528-a4c1-432122cb00b7\") "
Sep 11 11:50:17.301307 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:17.301161    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eec3fe3f-d30a-4528-a4c1-432122cb00b7-plugins-config-volume\") pod \"eec3fe3f-d30a-4528-a4c1-432122cb00b7\" (UID: \"eec3fe3f-d30a-4528-a4c1-432122cb00b7\") "
Sep 11 11:50:17.301739 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:17.301712    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01f4bf40-445f-4370-9535-31f0fd0c1095-plugins-config-volume\") pod \"01f4bf40-445f-4370-9535-31f0fd0c1095\" (UID: \"01f4bf40-445f-4370-9535-31f0fd0c1095\") "
Sep 11 11:50:17.301841 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:17.301732    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eec3fe3f-d30a-4528-a4c1-432122cb00b7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "eec3fe3f-d30a-4528-a4c1-432122cb00b7" (UID: "eec3fe3f-d30a-4528-a4c1-432122cb00b7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 11:50:17.301841 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:17.301822    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzb26\" (UniqueName: \"kubernetes.io/projected/01f4bf40-445f-4370-9535-31f0fd0c1095-kube-api-access-nzb26\") pod \"01f4bf40-445f-4370-9535-31f0fd0c1095\" (UID: \"01f4bf40-445f-4370-9535-31f0fd0c1095\") "
Sep 11 11:50:17.301909 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:17.301882    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2"]
Sep 11 11:50:17.302089 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:17.302072    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eec3fe3f-d30a-4528-a4c1-432122cb00b7-plugins-config-volume\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:50:17.302140 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:17.302089    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2" podUID="1a9ff703-2252-456b-a9c1-8d066a8c12fe" containerName="istio-proxy" containerID="cri-o://4f70f26366e45bd30316bfa03cf4e4da928d0dc0b542ffbd6ed477e17f411fe7" gracePeriod=30
Sep 11 11:50:17.302254 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:17.302231    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01f4bf40-445f-4370-9535-31f0fd0c1095-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "01f4bf40-445f-4370-9535-31f0fd0c1095" (UID: "01f4bf40-445f-4370-9535-31f0fd0c1095"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 11:50:17.304395 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:17.304367    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eec3fe3f-d30a-4528-a4c1-432122cb00b7-kube-api-access-cqs86" (OuterVolumeSpecName: "kube-api-access-cqs86") pod "eec3fe3f-d30a-4528-a4c1-432122cb00b7" (UID: "eec3fe3f-d30a-4528-a4c1-432122cb00b7"). InnerVolumeSpecName "kube-api-access-cqs86". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:50:17.304594 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:17.304572    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01f4bf40-445f-4370-9535-31f0fd0c1095-kube-api-access-nzb26" (OuterVolumeSpecName: "kube-api-access-nzb26") pod "01f4bf40-445f-4370-9535-31f0fd0c1095" (UID: "01f4bf40-445f-4370-9535-31f0fd0c1095"). InnerVolumeSpecName "kube-api-access-nzb26". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:50:17.403585 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:17.403459    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzb26\" (UniqueName: \"kubernetes.io/projected/01f4bf40-445f-4370-9535-31f0fd0c1095-kube-api-access-nzb26\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:50:17.403585 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:17.403493    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cqs86\" (UniqueName: \"kubernetes.io/projected/eec3fe3f-d30a-4528-a4c1-432122cb00b7-kube-api-access-cqs86\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:50:17.403585 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:17.403511    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01f4bf40-445f-4370-9535-31f0fd0c1095-plugins-config-volume\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:50:17.813908 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:17.813872    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edb633c9-65fb-49bb-90bb-c74fed62ed2f" path="/var/lib/kubelet/pods/edb633c9-65fb-49bb-90bb-c74fed62ed2f/volumes"
Sep 11 11:50:17.964317 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:17.964275    2560 generic.go:356] "Generic (PLEG): container finished" podID="eec3fe3f-d30a-4528-a4c1-432122cb00b7" containerID="7eb95592873c99b059ea7f7590ea56653850ff93d54c09981b74a23e6c87dd09" exitCode=0
Sep 11 11:50:17.964498 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:17.964342    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-d507e5c9-6c5769f777-lbq85"
Sep 11 11:50:17.964498 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:17.964353    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-d507e5c9-6c5769f777-lbq85" event={"ID":"eec3fe3f-d30a-4528-a4c1-432122cb00b7","Type":"ContainerDied","Data":"7eb95592873c99b059ea7f7590ea56653850ff93d54c09981b74a23e6c87dd09"}
Sep 11 11:50:17.964498 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:17.964412    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-d507e5c9-6c5769f777-lbq85" event={"ID":"eec3fe3f-d30a-4528-a4c1-432122cb00b7","Type":"ContainerDied","Data":"c910dd7d4bea267eb0750708698a801f9602e4601c492468cedc1c8af126f0db"}
Sep 11 11:50:17.964498 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:17.964444    2560 scope.go:117] "RemoveContainer" containerID="7eb95592873c99b059ea7f7590ea56653850ff93d54c09981b74a23e6c87dd09"
Sep 11 11:50:17.965905 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:17.965832    2560 generic.go:356] "Generic (PLEG): container finished" podID="01f4bf40-445f-4370-9535-31f0fd0c1095" containerID="e4ac836a1d06498eb85008370218c76bc7d58f8359481e87a751f7e44fa33675" exitCode=0
Sep 11 11:50:17.965961 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:17.965902    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-d507e5c9-b98569698-wdnzd"
Sep 11 11:50:17.965961 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:17.965928    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-d507e5c9-b98569698-wdnzd" event={"ID":"01f4bf40-445f-4370-9535-31f0fd0c1095","Type":"ContainerDied","Data":"e4ac836a1d06498eb85008370218c76bc7d58f8359481e87a751f7e44fa33675"}
Sep 11 11:50:17.966046 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:17.965970    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-d507e5c9-b98569698-wdnzd" event={"ID":"01f4bf40-445f-4370-9535-31f0fd0c1095","Type":"ContainerDied","Data":"c08e9a1b7a5f343af8b67fdb16ba844ce6b0ee78a87da735038ccaa7a50e9efe"}
Sep 11 11:50:17.973595 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:17.973574    2560 scope.go:117] "RemoveContainer" containerID="7eb95592873c99b059ea7f7590ea56653850ff93d54c09981b74a23e6c87dd09"
Sep 11 11:50:17.973967 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:50:17.973934    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7eb95592873c99b059ea7f7590ea56653850ff93d54c09981b74a23e6c87dd09\": container with ID starting with 7eb95592873c99b059ea7f7590ea56653850ff93d54c09981b74a23e6c87dd09 not found: ID does not exist" containerID="7eb95592873c99b059ea7f7590ea56653850ff93d54c09981b74a23e6c87dd09"
Sep 11 11:50:17.974088 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:17.973971    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7eb95592873c99b059ea7f7590ea56653850ff93d54c09981b74a23e6c87dd09"} err="failed to get container status \"7eb95592873c99b059ea7f7590ea56653850ff93d54c09981b74a23e6c87dd09\": rpc error: code = NotFound desc = could not find container \"7eb95592873c99b059ea7f7590ea56653850ff93d54c09981b74a23e6c87dd09\": container with ID starting with 7eb95592873c99b059ea7f7590ea56653850ff93d54c09981b74a23e6c87dd09 not found: ID does not exist"
Sep 11 11:50:17.974088 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:17.973987    2560 scope.go:117] "RemoveContainer" containerID="e4ac836a1d06498eb85008370218c76bc7d58f8359481e87a751f7e44fa33675"
Sep 11 11:50:17.982119 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:17.982102    2560 scope.go:117] "RemoveContainer" containerID="e4ac836a1d06498eb85008370218c76bc7d58f8359481e87a751f7e44fa33675"
Sep 11 11:50:17.982524 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:50:17.982498    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4ac836a1d06498eb85008370218c76bc7d58f8359481e87a751f7e44fa33675\": container with ID starting with e4ac836a1d06498eb85008370218c76bc7d58f8359481e87a751f7e44fa33675 not found: ID does not exist" containerID="e4ac836a1d06498eb85008370218c76bc7d58f8359481e87a751f7e44fa33675"
Sep 11 11:50:17.982590 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:17.982533    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4ac836a1d06498eb85008370218c76bc7d58f8359481e87a751f7e44fa33675"} err="failed to get container status \"e4ac836a1d06498eb85008370218c76bc7d58f8359481e87a751f7e44fa33675\": rpc error: code = NotFound desc = could not find container \"e4ac836a1d06498eb85008370218c76bc7d58f8359481e87a751f7e44fa33675\": container with ID starting with e4ac836a1d06498eb85008370218c76bc7d58f8359481e87a751f7e44fa33675 not found: ID does not exist"
Sep 11 11:50:17.994758 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:17.994736    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-d507e5c9-b98569698-wdnzd"]
Sep 11 11:50:18.006166 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:18.006141    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-d507e5c9-b98569698-wdnzd"]
Sep 11 11:50:18.017058 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:18.017033    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-d507e5c9-6c5769f777-lbq85"]
Sep 11 11:50:18.021506 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:18.021485    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-d507e5c9-6c5769f777-lbq85"]
Sep 11 11:50:19.814994 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:19.814960    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01f4bf40-445f-4370-9535-31f0fd0c1095" path="/var/lib/kubelet/pods/01f4bf40-445f-4370-9535-31f0fd0c1095/volumes"
Sep 11 11:50:19.815491 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:19.815471    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eec3fe3f-d30a-4528-a4c1-432122cb00b7" path="/var/lib/kubelet/pods/eec3fe3f-d30a-4528-a4c1-432122cb00b7/volumes"
Sep 11 11:50:19.942021 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:19.941990    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-c92551-6b5cd9cc58-b76z6"]
Sep 11 11:50:19.942468 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:19.942437    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01f4bf40-445f-4370-9535-31f0fd0c1095" containerName="payload-pre-processing"
Sep 11 11:50:19.942468 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:19.942459    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="01f4bf40-445f-4370-9535-31f0fd0c1095" containerName="payload-pre-processing"
Sep 11 11:50:19.942687 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:19.942484    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eec3fe3f-d30a-4528-a4c1-432122cb00b7" containerName="payload-processing"
Sep 11 11:50:19.942687 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:19.942492    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="eec3fe3f-d30a-4528-a4c1-432122cb00b7" containerName="payload-processing"
Sep 11 11:50:19.942687 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:19.942572    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="eec3fe3f-d30a-4528-a4c1-432122cb00b7" containerName="payload-processing"
Sep 11 11:50:19.942687 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:19.942586    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="01f4bf40-445f-4370-9535-31f0fd0c1095" containerName="payload-pre-processing"
Sep 11 11:50:19.947260 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:19.947236    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c92551-6b5cd9cc58-b76z6"
Sep 11 11:50:19.949545 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:19.949527    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-c92551\""
Sep 11 11:50:19.954021 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:19.953982    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-c92551-6b5cd9cc58-b76z6"]
Sep 11 11:50:20.026800 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:20.026763    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e5b5575a-2f4e-4344-865a-d99bfe0e9e94-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-c92551-6b5cd9cc58-b76z6\" (UID: \"e5b5575a-2f4e-4344-865a-d99bfe0e9e94\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-c92551-6b5cd9cc58-b76z6"
Sep 11 11:50:20.027058 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:20.026837    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdcqx\" (UniqueName: \"kubernetes.io/projected/e5b5575a-2f4e-4344-865a-d99bfe0e9e94-kube-api-access-hdcqx\") pod \"payload-pre-processing-e2e-explicit-c92551-6b5cd9cc58-b76z6\" (UID: \"e5b5575a-2f4e-4344-865a-d99bfe0e9e94\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-c92551-6b5cd9cc58-b76z6"
Sep 11 11:50:20.082160 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:20.082075    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-c92551-74b9699877-fvwdx"]
Sep 11 11:50:20.086099 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:20.086072    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-c92551-74b9699877-fvwdx"
Sep 11 11:50:20.088584 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:20.088549    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-c92551-dockercfg-996jp\""
Sep 11 11:50:20.099093 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:20.099056    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-c92551-74b9699877-fvwdx"]
Sep 11 11:50:20.127770 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:20.127738    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e5b5575a-2f4e-4344-865a-d99bfe0e9e94-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-c92551-6b5cd9cc58-b76z6\" (UID: \"e5b5575a-2f4e-4344-865a-d99bfe0e9e94\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-c92551-6b5cd9cc58-b76z6"
Sep 11 11:50:20.127957 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:20.127820    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkggt\" (UniqueName: \"kubernetes.io/projected/cd8c67fe-cfc8-49ba-9d82-8aa36054362c-kube-api-access-vkggt\") pod \"payload-processing-e2e-explicit-c92551-74b9699877-fvwdx\" (UID: \"cd8c67fe-cfc8-49ba-9d82-8aa36054362c\") " pod="openshift-ingress/payload-processing-e2e-explicit-c92551-74b9699877-fvwdx"
Sep 11 11:50:20.127957 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:20.127844    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdcqx\" (UniqueName: \"kubernetes.io/projected/e5b5575a-2f4e-4344-865a-d99bfe0e9e94-kube-api-access-hdcqx\") pod \"payload-pre-processing-e2e-explicit-c92551-6b5cd9cc58-b76z6\" (UID: \"e5b5575a-2f4e-4344-865a-d99bfe0e9e94\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-c92551-6b5cd9cc58-b76z6"
Sep 11 11:50:20.127957 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:20.127890    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd8c67fe-cfc8-49ba-9d82-8aa36054362c-plugins-config-volume\") pod \"payload-processing-e2e-explicit-c92551-74b9699877-fvwdx\" (UID: \"cd8c67fe-cfc8-49ba-9d82-8aa36054362c\") " pod="openshift-ingress/payload-processing-e2e-explicit-c92551-74b9699877-fvwdx"
Sep 11 11:50:20.128534 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:20.128510    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e5b5575a-2f4e-4344-865a-d99bfe0e9e94-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-c92551-6b5cd9cc58-b76z6\" (UID: \"e5b5575a-2f4e-4344-865a-d99bfe0e9e94\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-c92551-6b5cd9cc58-b76z6"
Sep 11 11:50:20.137245 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:20.137217    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdcqx\" (UniqueName: \"kubernetes.io/projected/e5b5575a-2f4e-4344-865a-d99bfe0e9e94-kube-api-access-hdcqx\") pod \"payload-pre-processing-e2e-explicit-c92551-6b5cd9cc58-b76z6\" (UID: \"e5b5575a-2f4e-4344-865a-d99bfe0e9e94\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-c92551-6b5cd9cc58-b76z6"
Sep 11 11:50:20.228993 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:20.228943    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkggt\" (UniqueName: \"kubernetes.io/projected/cd8c67fe-cfc8-49ba-9d82-8aa36054362c-kube-api-access-vkggt\") pod \"payload-processing-e2e-explicit-c92551-74b9699877-fvwdx\" (UID: \"cd8c67fe-cfc8-49ba-9d82-8aa36054362c\") " pod="openshift-ingress/payload-processing-e2e-explicit-c92551-74b9699877-fvwdx"
Sep 11 11:50:20.229137 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:20.229027    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd8c67fe-cfc8-49ba-9d82-8aa36054362c-plugins-config-volume\") pod \"payload-processing-e2e-explicit-c92551-74b9699877-fvwdx\" (UID: \"cd8c67fe-cfc8-49ba-9d82-8aa36054362c\") " pod="openshift-ingress/payload-processing-e2e-explicit-c92551-74b9699877-fvwdx"
Sep 11 11:50:20.229767 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:20.229748    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd8c67fe-cfc8-49ba-9d82-8aa36054362c-plugins-config-volume\") pod \"payload-processing-e2e-explicit-c92551-74b9699877-fvwdx\" (UID: \"cd8c67fe-cfc8-49ba-9d82-8aa36054362c\") " pod="openshift-ingress/payload-processing-e2e-explicit-c92551-74b9699877-fvwdx"
Sep 11 11:50:20.237954 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:20.237918    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkggt\" (UniqueName: \"kubernetes.io/projected/cd8c67fe-cfc8-49ba-9d82-8aa36054362c-kube-api-access-vkggt\") pod \"payload-processing-e2e-explicit-c92551-74b9699877-fvwdx\" (UID: \"cd8c67fe-cfc8-49ba-9d82-8aa36054362c\") " pod="openshift-ingress/payload-processing-e2e-explicit-c92551-74b9699877-fvwdx"
Sep 11 11:50:20.260842 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:20.260813    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c92551-6b5cd9cc58-b76z6"
Sep 11 11:50:20.401385 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:20.401299    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-c92551-74b9699877-fvwdx"
Sep 11 11:50:20.534132 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:20.534105    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-c92551-6b5cd9cc58-b76z6"]
Sep 11 11:50:20.536439 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:50:20.536398    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5b5575a_2f4e_4344_865a_d99bfe0e9e94.slice/crio-32b0b91078df4a8269eb1c39d54ba11d6bd2ab850eae4152af9ff495620c6f6b WatchSource:0}: Error finding container 32b0b91078df4a8269eb1c39d54ba11d6bd2ab850eae4152af9ff495620c6f6b: Status 404 returned error can't find the container with id 32b0b91078df4a8269eb1c39d54ba11d6bd2ab850eae4152af9ff495620c6f6b
Sep 11 11:50:20.675147 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:20.675122    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-c92551-74b9699877-fvwdx"]
Sep 11 11:50:20.676686 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:50:20.676637    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd8c67fe_cfc8_49ba_9d82_8aa36054362c.slice/crio-e0c5c3690468cb0098a851b42f1ad7048aa784ca36839ce08d08f7ba088f44f8 WatchSource:0}: Error finding container e0c5c3690468cb0098a851b42f1ad7048aa784ca36839ce08d08f7ba088f44f8: Status 404 returned error can't find the container with id e0c5c3690468cb0098a851b42f1ad7048aa784ca36839ce08d08f7ba088f44f8
Sep 11 11:50:20.983260 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:20.983213    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-c92551-74b9699877-fvwdx" event={"ID":"cd8c67fe-cfc8-49ba-9d82-8aa36054362c","Type":"ContainerStarted","Data":"ee355a14a2c37433c7c32304470034a09186386bd72670bf56401383c9bee64a"}
Sep 11 11:50:20.983732 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:20.983313    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-c92551-74b9699877-fvwdx" event={"ID":"cd8c67fe-cfc8-49ba-9d82-8aa36054362c","Type":"ContainerStarted","Data":"e0c5c3690468cb0098a851b42f1ad7048aa784ca36839ce08d08f7ba088f44f8"}
Sep 11 11:50:20.983732 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:20.983346    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-c92551-74b9699877-fvwdx"
Sep 11 11:50:20.985088 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:20.985057    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c92551-6b5cd9cc58-b76z6" event={"ID":"e5b5575a-2f4e-4344-865a-d99bfe0e9e94","Type":"ContainerStarted","Data":"ea2731fd82074975dcc3b51bccb706240ed58a26cfdfdd05178819413bb1760d"}
Sep 11 11:50:20.985222 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:20.985105    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c92551-6b5cd9cc58-b76z6" event={"ID":"e5b5575a-2f4e-4344-865a-d99bfe0e9e94","Type":"ContainerStarted","Data":"32b0b91078df4a8269eb1c39d54ba11d6bd2ab850eae4152af9ff495620c6f6b"}
Sep 11 11:50:20.985222 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:20.985143    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c92551-6b5cd9cc58-b76z6"
Sep 11 11:50:21.000532 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:21.000489    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-c92551-74b9699877-fvwdx" podStartSLOduration=1.000473934 podStartE2EDuration="1.000473934s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:50:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:50:20.999133261 +0000 UTC m=+971.821593142" watchObservedRunningTime="2026-09-11 11:50:21.000473934 +0000 UTC m=+971.822933844"
Sep 11 11:50:21.020036 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:21.019995    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c92551-6b5cd9cc58-b76z6" podStartSLOduration=2.019982313 podStartE2EDuration="2.019982313s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:50:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:50:21.018771327 +0000 UTC m=+971.841231228" watchObservedRunningTime="2026-09-11 11:50:21.019982313 +0000 UTC m=+971.842442187"
Sep 11 11:50:22.370295 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:22.370260    2560 patch_prober.go:28] interesting pod/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 11 11:50:22.370639 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:22.370328    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2" podUID="1a9ff703-2252-456b-a9c1-8d066a8c12fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 11 11:50:22.553672 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:22.553621    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2"
Sep 11 11:50:22.653188 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:22.653096    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a9ff703-2252-456b-a9c1-8d066a8c12fe-istiod-ca-cert\") pod \"1a9ff703-2252-456b-a9c1-8d066a8c12fe\" (UID: \"1a9ff703-2252-456b-a9c1-8d066a8c12fe\") "
Sep 11 11:50:22.653188 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:22.653152    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a9ff703-2252-456b-a9c1-8d066a8c12fe-istio-podinfo\") pod \"1a9ff703-2252-456b-a9c1-8d066a8c12fe\" (UID: \"1a9ff703-2252-456b-a9c1-8d066a8c12fe\") "
Sep 11 11:50:22.653420 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:22.653215    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a9ff703-2252-456b-a9c1-8d066a8c12fe-workload-socket\") pod \"1a9ff703-2252-456b-a9c1-8d066a8c12fe\" (UID: \"1a9ff703-2252-456b-a9c1-8d066a8c12fe\") "
Sep 11 11:50:22.653420 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:22.653247    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a9ff703-2252-456b-a9c1-8d066a8c12fe-credential-socket\") pod \"1a9ff703-2252-456b-a9c1-8d066a8c12fe\" (UID: \"1a9ff703-2252-456b-a9c1-8d066a8c12fe\") "
Sep 11 11:50:22.653515 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:22.653391    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a9ff703-2252-456b-a9c1-8d066a8c12fe-workload-certs\") pod \"1a9ff703-2252-456b-a9c1-8d066a8c12fe\" (UID: \"1a9ff703-2252-456b-a9c1-8d066a8c12fe\") "
Sep 11 11:50:22.653515 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:22.653458    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a9ff703-2252-456b-a9c1-8d066a8c12fe-istio-data\") pod \"1a9ff703-2252-456b-a9c1-8d066a8c12fe\" (UID: \"1a9ff703-2252-456b-a9c1-8d066a8c12fe\") "
Sep 11 11:50:22.653619 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:22.653535    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a9ff703-2252-456b-a9c1-8d066a8c12fe-istio-token\") pod \"1a9ff703-2252-456b-a9c1-8d066a8c12fe\" (UID: \"1a9ff703-2252-456b-a9c1-8d066a8c12fe\") "
Sep 11 11:50:22.653619 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:22.653547    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a9ff703-2252-456b-a9c1-8d066a8c12fe-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1a9ff703-2252-456b-a9c1-8d066a8c12fe" (UID: "1a9ff703-2252-456b-a9c1-8d066a8c12fe"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:50:22.653619 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:22.653577    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a9ff703-2252-456b-a9c1-8d066a8c12fe-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1a9ff703-2252-456b-a9c1-8d066a8c12fe" (UID: "1a9ff703-2252-456b-a9c1-8d066a8c12fe"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 11:50:22.653619 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:22.653610    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqcp8\" (UniqueName: \"kubernetes.io/projected/1a9ff703-2252-456b-a9c1-8d066a8c12fe-kube-api-access-bqcp8\") pod \"1a9ff703-2252-456b-a9c1-8d066a8c12fe\" (UID: \"1a9ff703-2252-456b-a9c1-8d066a8c12fe\") "
Sep 11 11:50:22.653846 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:22.653637    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a9ff703-2252-456b-a9c1-8d066a8c12fe-istio-envoy\") pod \"1a9ff703-2252-456b-a9c1-8d066a8c12fe\" (UID: \"1a9ff703-2252-456b-a9c1-8d066a8c12fe\") "
Sep 11 11:50:22.653846 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:22.653672    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a9ff703-2252-456b-a9c1-8d066a8c12fe-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1a9ff703-2252-456b-a9c1-8d066a8c12fe" (UID: "1a9ff703-2252-456b-a9c1-8d066a8c12fe"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:50:22.653846 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:22.653700    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a9ff703-2252-456b-a9c1-8d066a8c12fe-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1a9ff703-2252-456b-a9c1-8d066a8c12fe" (UID: "1a9ff703-2252-456b-a9c1-8d066a8c12fe"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:50:22.653846 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:22.653778    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a9ff703-2252-456b-a9c1-8d066a8c12fe-istio-data" (OuterVolumeSpecName: "istio-data") pod "1a9ff703-2252-456b-a9c1-8d066a8c12fe" (UID: "1a9ff703-2252-456b-a9c1-8d066a8c12fe"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:50:22.654021 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:22.653927    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a9ff703-2252-456b-a9c1-8d066a8c12fe-workload-socket\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:50:22.654021 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:22.653939    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a9ff703-2252-456b-a9c1-8d066a8c12fe-credential-socket\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:50:22.654021 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:22.653948    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a9ff703-2252-456b-a9c1-8d066a8c12fe-workload-certs\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:50:22.654021 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:22.653956    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a9ff703-2252-456b-a9c1-8d066a8c12fe-istio-data\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:50:22.654021 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:22.653963    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a9ff703-2252-456b-a9c1-8d066a8c12fe-istiod-ca-cert\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:50:22.655584 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:22.655561    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1a9ff703-2252-456b-a9c1-8d066a8c12fe-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1a9ff703-2252-456b-a9c1-8d066a8c12fe" (UID: "1a9ff703-2252-456b-a9c1-8d066a8c12fe"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 11:50:22.655723 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:22.655685    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a9ff703-2252-456b-a9c1-8d066a8c12fe-kube-api-access-bqcp8" (OuterVolumeSpecName: "kube-api-access-bqcp8") pod "1a9ff703-2252-456b-a9c1-8d066a8c12fe" (UID: "1a9ff703-2252-456b-a9c1-8d066a8c12fe"). InnerVolumeSpecName "kube-api-access-bqcp8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:50:22.655769 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:22.655711    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a9ff703-2252-456b-a9c1-8d066a8c12fe-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1a9ff703-2252-456b-a9c1-8d066a8c12fe" (UID: "1a9ff703-2252-456b-a9c1-8d066a8c12fe"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:50:22.655769 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:22.655730    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a9ff703-2252-456b-a9c1-8d066a8c12fe-istio-token" (OuterVolumeSpecName: "istio-token") pod "1a9ff703-2252-456b-a9c1-8d066a8c12fe" (UID: "1a9ff703-2252-456b-a9c1-8d066a8c12fe"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:50:22.754914 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:22.754875    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a9ff703-2252-456b-a9c1-8d066a8c12fe-istio-podinfo\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:50:22.754914 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:22.754906    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a9ff703-2252-456b-a9c1-8d066a8c12fe-istio-token\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:50:22.754914 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:22.754915    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqcp8\" (UniqueName: \"kubernetes.io/projected/1a9ff703-2252-456b-a9c1-8d066a8c12fe-kube-api-access-bqcp8\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:50:22.754914 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:22.754924    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a9ff703-2252-456b-a9c1-8d066a8c12fe-istio-envoy\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:50:22.996932 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:22.996894    2560 generic.go:356] "Generic (PLEG): container finished" podID="1a9ff703-2252-456b-a9c1-8d066a8c12fe" containerID="4f70f26366e45bd30316bfa03cf4e4da928d0dc0b542ffbd6ed477e17f411fe7" exitCode=0
Sep 11 11:50:22.997074 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:22.996945    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2"
Sep 11 11:50:22.997074 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:22.996975    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2" event={"ID":"1a9ff703-2252-456b-a9c1-8d066a8c12fe","Type":"ContainerDied","Data":"4f70f26366e45bd30316bfa03cf4e4da928d0dc0b542ffbd6ed477e17f411fe7"}
Sep 11 11:50:22.997074 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:22.997032    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2" event={"ID":"1a9ff703-2252-456b-a9c1-8d066a8c12fe","Type":"ContainerDied","Data":"b84874160da1fe49d4cc88fc41e6eccd77b99d55b543d3f3598284cfc035919a"}
Sep 11 11:50:22.997074 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:22.997054    2560 scope.go:117] "RemoveContainer" containerID="4f70f26366e45bd30316bfa03cf4e4da928d0dc0b542ffbd6ed477e17f411fe7"
Sep 11 11:50:23.006555 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:23.006538    2560 scope.go:117] "RemoveContainer" containerID="95658bbea38ce2c44532285c7d843515bbc21fe02a056411882703b1beeb62f7"
Sep 11 11:50:23.014120 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:23.014104    2560 scope.go:117] "RemoveContainer" containerID="4f70f26366e45bd30316bfa03cf4e4da928d0dc0b542ffbd6ed477e17f411fe7"
Sep 11 11:50:23.014379 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:50:23.014360    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f70f26366e45bd30316bfa03cf4e4da928d0dc0b542ffbd6ed477e17f411fe7\": container with ID starting with 4f70f26366e45bd30316bfa03cf4e4da928d0dc0b542ffbd6ed477e17f411fe7 not found: ID does not exist" containerID="4f70f26366e45bd30316bfa03cf4e4da928d0dc0b542ffbd6ed477e17f411fe7"
Sep 11 11:50:23.014442 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:23.014391    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f70f26366e45bd30316bfa03cf4e4da928d0dc0b542ffbd6ed477e17f411fe7"} err="failed to get container status \"4f70f26366e45bd30316bfa03cf4e4da928d0dc0b542ffbd6ed477e17f411fe7\": rpc error: code = NotFound desc = could not find container \"4f70f26366e45bd30316bfa03cf4e4da928d0dc0b542ffbd6ed477e17f411fe7\": container with ID starting with 4f70f26366e45bd30316bfa03cf4e4da928d0dc0b542ffbd6ed477e17f411fe7 not found: ID does not exist"
Sep 11 11:50:23.014442 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:23.014414    2560 scope.go:117] "RemoveContainer" containerID="95658bbea38ce2c44532285c7d843515bbc21fe02a056411882703b1beeb62f7"
Sep 11 11:50:23.014697 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:50:23.014680    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95658bbea38ce2c44532285c7d843515bbc21fe02a056411882703b1beeb62f7\": container with ID starting with 95658bbea38ce2c44532285c7d843515bbc21fe02a056411882703b1beeb62f7 not found: ID does not exist" containerID="95658bbea38ce2c44532285c7d843515bbc21fe02a056411882703b1beeb62f7"
Sep 11 11:50:23.014747 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:23.014704    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95658bbea38ce2c44532285c7d843515bbc21fe02a056411882703b1beeb62f7"} err="failed to get container status \"95658bbea38ce2c44532285c7d843515bbc21fe02a056411882703b1beeb62f7\": rpc error: code = NotFound desc = could not find container \"95658bbea38ce2c44532285c7d843515bbc21fe02a056411882703b1beeb62f7\": container with ID starting with 95658bbea38ce2c44532285c7d843515bbc21fe02a056411882703b1beeb62f7 not found: ID does not exist"
Sep 11 11:50:23.017569 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:23.017549    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2"]
Sep 11 11:50:23.023925 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:23.023904    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-d507e5c9-openshift-default-6fcc584b88-kcld2"]
Sep 11 11:50:23.814064 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:23.814033    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a9ff703-2252-456b-a9c1-8d066a8c12fe" path="/var/lib/kubelet/pods/1a9ff703-2252-456b-a9c1-8d066a8c12fe/volumes"
Sep 11 11:50:31.993080 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:31.992996    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-c92551-74b9699877-fvwdx"
Sep 11 11:50:31.993466 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:31.993082    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c92551-6b5cd9cc58-b76z6"
Sep 11 11:50:33.000809 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:33.000768    2560 patch_prober.go:28] interesting pod/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 11:50:33.001193 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:33.000837    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r" podUID="c997cea8-a4f6-4f11-b8b1-ed2781bae6c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 11:50:34.052330 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:34.052297    2560 generic.go:356] "Generic (PLEG): container finished" podID="c997cea8-a4f6-4f11-b8b1-ed2781bae6c8" containerID="5a5302994abe9a7142cefbc73745deb03aa6a2f1470ba1e1ecf2ad71d161c47b" exitCode=0
Sep 11 11:50:34.052775 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:34.052369    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r" event={"ID":"c997cea8-a4f6-4f11-b8b1-ed2781bae6c8","Type":"ContainerDied","Data":"5a5302994abe9a7142cefbc73745deb03aa6a2f1470ba1e1ecf2ad71d161c47b"}
Sep 11 11:50:34.052775 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:34.052765    2560 scope.go:117] "RemoveContainer" containerID="5a5302994abe9a7142cefbc73745deb03aa6a2f1470ba1e1ecf2ad71d161c47b"
Sep 11 11:50:34.053794 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:34.053770    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:50:34.053857 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:34.053833    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:50:34.053892 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:34.053864    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:50:35.062317 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:35.062276    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r" event={"ID":"c997cea8-a4f6-4f11-b8b1-ed2781bae6c8","Type":"ContainerStarted","Data":"48cfb761cd26a64749d2240d2c15a252cdf169944d6412184945b475109c12db"}
Sep 11 11:50:35.384134 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:35.384011    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r"
Sep 11 11:50:35.384322 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:35.384231    2560 patch_prober.go:28] interesting pod/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 11 11:50:35.384322 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:35.384290    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r" podUID="c997cea8-a4f6-4f11-b8b1-ed2781bae6c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 11 11:50:36.384372 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:36.384334    2560 patch_prober.go:28] interesting pod/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 11 11:50:36.384795 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:36.384393    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r" podUID="c997cea8-a4f6-4f11-b8b1-ed2781bae6c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 11 11:50:37.383889 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:37.383854    2560 patch_prober.go:28] interesting pod/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 11 11:50:37.384072 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:37.383915    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r" podUID="c997cea8-a4f6-4f11-b8b1-ed2781bae6c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 11 11:50:38.384827 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:38.384787    2560 patch_prober.go:28] interesting pod/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 11 11:50:38.385227 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:38.384848    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r" podUID="c997cea8-a4f6-4f11-b8b1-ed2781bae6c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 11 11:50:39.383857 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:39.383820    2560 patch_prober.go:28] interesting pod/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 11 11:50:39.384040 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:39.383874    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r" podUID="c997cea8-a4f6-4f11-b8b1-ed2781bae6c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 11 11:50:40.388907 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:40.388871    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r"
Sep 11 11:50:40.389324 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:40.389277    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r"
Sep 11 11:50:40.390094 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:50:40.390073    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r"
Sep 11 11:51:13.945567 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:13.945524    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c92551-8qpjc"]
Sep 11 11:51:13.946075 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:13.946057    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a9ff703-2252-456b-a9c1-8d066a8c12fe" containerName="istio-proxy"
Sep 11 11:51:13.946134 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:13.946078    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a9ff703-2252-456b-a9c1-8d066a8c12fe" containerName="istio-proxy"
Sep 11 11:51:13.946134 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:13.946092    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a9ff703-2252-456b-a9c1-8d066a8c12fe" containerName="istio-proxy"
Sep 11 11:51:13.946134 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:13.946103    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a9ff703-2252-456b-a9c1-8d066a8c12fe" containerName="istio-proxy"
Sep 11 11:51:13.946229 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:13.946207    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a9ff703-2252-456b-a9c1-8d066a8c12fe" containerName="istio-proxy"
Sep 11 11:51:13.946229 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:13.946220    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a9ff703-2252-456b-a9c1-8d066a8c12fe" containerName="istio-proxy"
Sep 11 11:51:13.950879 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:13.950861    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c92551-8qpjc"
Sep 11 11:51:13.953868 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:13.953837    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f46tj\""
Sep 11 11:51:13.954541 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:13.954518    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 11:51:13.955398 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:13.955371    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c92551-8qpjc"]
Sep 11 11:51:14.000220 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:14.000173    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eed83cb6-d29b-4cd3-928f-4cc786c64d7f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-c92551-8qpjc\" (UID: \"eed83cb6-d29b-4cd3-928f-4cc786c64d7f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c92551-8qpjc"
Sep 11 11:51:14.100872 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:14.100832    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eed83cb6-d29b-4cd3-928f-4cc786c64d7f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-c92551-8qpjc\" (UID: \"eed83cb6-d29b-4cd3-928f-4cc786c64d7f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c92551-8qpjc"
Sep 11 11:51:14.101466 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:14.101447    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eed83cb6-d29b-4cd3-928f-4cc786c64d7f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-c92551-8qpjc\" (UID: \"eed83cb6-d29b-4cd3-928f-4cc786c64d7f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c92551-8qpjc"
Sep 11 11:51:14.264623 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:14.264584    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c92551-8qpjc"
Sep 11 11:51:14.544424 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:14.544396    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c92551-8qpjc"]
Sep 11 11:51:14.545598 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:51:14.545561    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeed83cb6_d29b_4cd3_928f_4cc786c64d7f.slice/crio-3e2785a1454002604240f4b3bc346de9c432a5b646668f9e424dfc4b669393fa WatchSource:0}: Error finding container 3e2785a1454002604240f4b3bc346de9c432a5b646668f9e424dfc4b669393fa: Status 404 returned error can't find the container with id 3e2785a1454002604240f4b3bc346de9c432a5b646668f9e424dfc4b669393fa
Sep 11 11:51:15.261151 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:15.261118    2560 generic.go:356] "Generic (PLEG): container finished" podID="eed83cb6-d29b-4cd3-928f-4cc786c64d7f" containerID="acd10fb652b3662465f986f61a662f7a98f8f729a5c809ac5f0c38539c0a8cc3" exitCode=0
Sep 11 11:51:15.261562 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:15.261203    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c92551-8qpjc" event={"ID":"eed83cb6-d29b-4cd3-928f-4cc786c64d7f","Type":"ContainerDied","Data":"acd10fb652b3662465f986f61a662f7a98f8f729a5c809ac5f0c38539c0a8cc3"}
Sep 11 11:51:15.261562 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:15.261308    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c92551-8qpjc" event={"ID":"eed83cb6-d29b-4cd3-928f-4cc786c64d7f","Type":"ContainerStarted","Data":"3e2785a1454002604240f4b3bc346de9c432a5b646668f9e424dfc4b669393fa"}
Sep 11 11:51:16.395058 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:16.395031    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c92551-8qpjc"
Sep 11 11:51:16.521962 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:16.521872    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eed83cb6-d29b-4cd3-928f-4cc786c64d7f-maas-api-service-ca\") pod \"eed83cb6-d29b-4cd3-928f-4cc786c64d7f\" (UID: \"eed83cb6-d29b-4cd3-928f-4cc786c64d7f\") "
Sep 11 11:51:16.522296 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:16.522271    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eed83cb6-d29b-4cd3-928f-4cc786c64d7f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "eed83cb6-d29b-4cd3-928f-4cc786c64d7f" (UID: "eed83cb6-d29b-4cd3-928f-4cc786c64d7f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 11:51:16.622991 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:16.622956    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eed83cb6-d29b-4cd3-928f-4cc786c64d7f-maas-api-service-ca\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:51:17.271773 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:17.271746    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c92551-8qpjc"
Sep 11 11:51:17.271947 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:17.271771    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c92551-8qpjc" event={"ID":"eed83cb6-d29b-4cd3-928f-4cc786c64d7f","Type":"ContainerDied","Data":"3e2785a1454002604240f4b3bc346de9c432a5b646668f9e424dfc4b669393fa"}
Sep 11 11:51:17.271947 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:17.271820    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3e2785a1454002604240f4b3bc346de9c432a5b646668f9e424dfc4b669393fa"
Sep 11 11:51:24.507825 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:24.507793    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-c92551-74b9699877-fvwdx"]
Sep 11 11:51:24.508368 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:24.508050    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-c92551-74b9699877-fvwdx" podUID="cd8c67fe-cfc8-49ba-9d82-8aa36054362c" containerName="payload-processing" containerID="cri-o://ee355a14a2c37433c7c32304470034a09186386bd72670bf56401383c9bee64a" gracePeriod=30
Sep 11 11:51:24.514202 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:24.514176    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-c92551-6b5cd9cc58-b76z6"]
Sep 11 11:51:24.514405 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:24.514372    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c92551-6b5cd9cc58-b76z6" podUID="e5b5575a-2f4e-4344-865a-d99bfe0e9e94" containerName="payload-pre-processing" containerID="cri-o://ea2731fd82074975dcc3b51bccb706240ed58a26cfdfdd05178819413bb1760d" gracePeriod=30
Sep 11 11:51:24.683561 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:24.683503    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c92551-8qpjc"]
Sep 11 11:51:24.687851 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:24.687793    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c92551-8qpjc"]
Sep 11 11:51:24.786567 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:24.786545    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-c92551-74b9699877-fvwdx"
Sep 11 11:51:24.789225 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:24.789207    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c92551-6b5cd9cc58-b76z6"
Sep 11 11:51:24.899462 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:24.899433    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hdcqx\" (UniqueName: \"kubernetes.io/projected/e5b5575a-2f4e-4344-865a-d99bfe0e9e94-kube-api-access-hdcqx\") pod \"e5b5575a-2f4e-4344-865a-d99bfe0e9e94\" (UID: \"e5b5575a-2f4e-4344-865a-d99bfe0e9e94\") "
Sep 11 11:51:24.899683 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:24.899487    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e5b5575a-2f4e-4344-865a-d99bfe0e9e94-plugins-config-volume\") pod \"e5b5575a-2f4e-4344-865a-d99bfe0e9e94\" (UID: \"e5b5575a-2f4e-4344-865a-d99bfe0e9e94\") "
Sep 11 11:51:24.899683 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:24.899526    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vkggt\" (UniqueName: \"kubernetes.io/projected/cd8c67fe-cfc8-49ba-9d82-8aa36054362c-kube-api-access-vkggt\") pod \"cd8c67fe-cfc8-49ba-9d82-8aa36054362c\" (UID: \"cd8c67fe-cfc8-49ba-9d82-8aa36054362c\") "
Sep 11 11:51:24.899683 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:24.899542    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd8c67fe-cfc8-49ba-9d82-8aa36054362c-plugins-config-volume\") pod \"cd8c67fe-cfc8-49ba-9d82-8aa36054362c\" (UID: \"cd8c67fe-cfc8-49ba-9d82-8aa36054362c\") "
Sep 11 11:51:24.899994 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:24.899963    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5b5575a-2f4e-4344-865a-d99bfe0e9e94-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e5b5575a-2f4e-4344-865a-d99bfe0e9e94" (UID: "e5b5575a-2f4e-4344-865a-d99bfe0e9e94"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 11:51:24.899994 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:24.899980    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd8c67fe-cfc8-49ba-9d82-8aa36054362c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cd8c67fe-cfc8-49ba-9d82-8aa36054362c" (UID: "cd8c67fe-cfc8-49ba-9d82-8aa36054362c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 11:51:24.907178 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:24.907103    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd8c67fe-cfc8-49ba-9d82-8aa36054362c-kube-api-access-vkggt" (OuterVolumeSpecName: "kube-api-access-vkggt") pod "cd8c67fe-cfc8-49ba-9d82-8aa36054362c" (UID: "cd8c67fe-cfc8-49ba-9d82-8aa36054362c"). InnerVolumeSpecName "kube-api-access-vkggt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:51:24.907178 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:24.907171    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5b5575a-2f4e-4344-865a-d99bfe0e9e94-kube-api-access-hdcqx" (OuterVolumeSpecName: "kube-api-access-hdcqx") pod "e5b5575a-2f4e-4344-865a-d99bfe0e9e94" (UID: "e5b5575a-2f4e-4344-865a-d99bfe0e9e94"). InnerVolumeSpecName "kube-api-access-hdcqx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:51:25.000918 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:25.000889    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hdcqx\" (UniqueName: \"kubernetes.io/projected/e5b5575a-2f4e-4344-865a-d99bfe0e9e94-kube-api-access-hdcqx\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:51:25.000918 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:25.000911    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e5b5575a-2f4e-4344-865a-d99bfe0e9e94-plugins-config-volume\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:51:25.000918 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:25.000921    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vkggt\" (UniqueName: \"kubernetes.io/projected/cd8c67fe-cfc8-49ba-9d82-8aa36054362c-kube-api-access-vkggt\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:51:25.001099 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:25.000929    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd8c67fe-cfc8-49ba-9d82-8aa36054362c-plugins-config-volume\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:51:25.310670 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:25.310611    2560 generic.go:356] "Generic (PLEG): container finished" podID="cd8c67fe-cfc8-49ba-9d82-8aa36054362c" containerID="ee355a14a2c37433c7c32304470034a09186386bd72670bf56401383c9bee64a" exitCode=0
Sep 11 11:51:25.310859 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:25.310692    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-c92551-74b9699877-fvwdx"
Sep 11 11:51:25.310859 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:25.310692    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-c92551-74b9699877-fvwdx" event={"ID":"cd8c67fe-cfc8-49ba-9d82-8aa36054362c","Type":"ContainerDied","Data":"ee355a14a2c37433c7c32304470034a09186386bd72670bf56401383c9bee64a"}
Sep 11 11:51:25.310859 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:25.310851    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-c92551-74b9699877-fvwdx" event={"ID":"cd8c67fe-cfc8-49ba-9d82-8aa36054362c","Type":"ContainerDied","Data":"e0c5c3690468cb0098a851b42f1ad7048aa784ca36839ce08d08f7ba088f44f8"}
Sep 11 11:51:25.310998 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:25.310887    2560 scope.go:117] "RemoveContainer" containerID="ee355a14a2c37433c7c32304470034a09186386bd72670bf56401383c9bee64a"
Sep 11 11:51:25.312249 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:25.312225    2560 generic.go:356] "Generic (PLEG): container finished" podID="e5b5575a-2f4e-4344-865a-d99bfe0e9e94" containerID="ea2731fd82074975dcc3b51bccb706240ed58a26cfdfdd05178819413bb1760d" exitCode=0
Sep 11 11:51:25.312340 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:25.312255    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c92551-6b5cd9cc58-b76z6" event={"ID":"e5b5575a-2f4e-4344-865a-d99bfe0e9e94","Type":"ContainerDied","Data":"ea2731fd82074975dcc3b51bccb706240ed58a26cfdfdd05178819413bb1760d"}
Sep 11 11:51:25.312340 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:25.312289    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c92551-6b5cd9cc58-b76z6"
Sep 11 11:51:25.312340 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:25.312304    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c92551-6b5cd9cc58-b76z6" event={"ID":"e5b5575a-2f4e-4344-865a-d99bfe0e9e94","Type":"ContainerDied","Data":"32b0b91078df4a8269eb1c39d54ba11d6bd2ab850eae4152af9ff495620c6f6b"}
Sep 11 11:51:25.322838 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:25.322814    2560 scope.go:117] "RemoveContainer" containerID="ee355a14a2c37433c7c32304470034a09186386bd72670bf56401383c9bee64a"
Sep 11 11:51:25.323216 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:51:25.323180    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee355a14a2c37433c7c32304470034a09186386bd72670bf56401383c9bee64a\": container with ID starting with ee355a14a2c37433c7c32304470034a09186386bd72670bf56401383c9bee64a not found: ID does not exist" containerID="ee355a14a2c37433c7c32304470034a09186386bd72670bf56401383c9bee64a"
Sep 11 11:51:25.323298 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:25.323227    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee355a14a2c37433c7c32304470034a09186386bd72670bf56401383c9bee64a"} err="failed to get container status \"ee355a14a2c37433c7c32304470034a09186386bd72670bf56401383c9bee64a\": rpc error: code = NotFound desc = could not find container \"ee355a14a2c37433c7c32304470034a09186386bd72670bf56401383c9bee64a\": container with ID starting with ee355a14a2c37433c7c32304470034a09186386bd72670bf56401383c9bee64a not found: ID does not exist"
Sep 11 11:51:25.323298 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:25.323253    2560 scope.go:117] "RemoveContainer" containerID="ea2731fd82074975dcc3b51bccb706240ed58a26cfdfdd05178819413bb1760d"
Sep 11 11:51:25.331257 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:25.331240    2560 scope.go:117] "RemoveContainer" containerID="ea2731fd82074975dcc3b51bccb706240ed58a26cfdfdd05178819413bb1760d"
Sep 11 11:51:25.331547 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:51:25.331527    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea2731fd82074975dcc3b51bccb706240ed58a26cfdfdd05178819413bb1760d\": container with ID starting with ea2731fd82074975dcc3b51bccb706240ed58a26cfdfdd05178819413bb1760d not found: ID does not exist" containerID="ea2731fd82074975dcc3b51bccb706240ed58a26cfdfdd05178819413bb1760d"
Sep 11 11:51:25.331628 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:25.331551    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea2731fd82074975dcc3b51bccb706240ed58a26cfdfdd05178819413bb1760d"} err="failed to get container status \"ea2731fd82074975dcc3b51bccb706240ed58a26cfdfdd05178819413bb1760d\": rpc error: code = NotFound desc = could not find container \"ea2731fd82074975dcc3b51bccb706240ed58a26cfdfdd05178819413bb1760d\": container with ID starting with ea2731fd82074975dcc3b51bccb706240ed58a26cfdfdd05178819413bb1760d not found: ID does not exist"
Sep 11 11:51:25.337526 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:25.337508    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-c92551-6b5cd9cc58-b76z6"]
Sep 11 11:51:25.341901 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:25.341881    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-c92551-6b5cd9cc58-b76z6"]
Sep 11 11:51:25.352214 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:25.352190    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-c92551-74b9699877-fvwdx"]
Sep 11 11:51:25.356272 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:25.356248    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-c92551-74b9699877-fvwdx"]
Sep 11 11:51:25.813700 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:25.813667    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd8c67fe-cfc8-49ba-9d82-8aa36054362c" path="/var/lib/kubelet/pods/cd8c67fe-cfc8-49ba-9d82-8aa36054362c/volumes"
Sep 11 11:51:25.814075 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:25.814024    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5b5575a-2f4e-4344-865a-d99bfe0e9e94" path="/var/lib/kubelet/pods/e5b5575a-2f4e-4344-865a-d99bfe0e9e94/volumes"
Sep 11 11:51:25.814302 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:25.814290    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eed83cb6-d29b-4cd3-928f-4cc786c64d7f" path="/var/lib/kubelet/pods/eed83cb6-d29b-4cd3-928f-4cc786c64d7f/volumes"
Sep 11 11:51:31.595882 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:31.595847    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r"]
Sep 11 11:51:31.596662 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:31.596591    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r" podUID="c997cea8-a4f6-4f11-b8b1-ed2781bae6c8" containerName="istio-proxy" containerID="cri-o://48cfb761cd26a64749d2240d2c15a252cdf169944d6412184945b475109c12db" gracePeriod=30
Sep 11 11:51:32.366702 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:32.366670    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-4503d2-openshift-default-769c747cb-5f76k"]
Sep 11 11:51:32.367150 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:32.367136    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd8c67fe-cfc8-49ba-9d82-8aa36054362c" containerName="payload-processing"
Sep 11 11:51:32.367196 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:32.367153    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd8c67fe-cfc8-49ba-9d82-8aa36054362c" containerName="payload-processing"
Sep 11 11:51:32.367196 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:32.367164    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5b5575a-2f4e-4344-865a-d99bfe0e9e94" containerName="payload-pre-processing"
Sep 11 11:51:32.367196 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:32.367173    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5b5575a-2f4e-4344-865a-d99bfe0e9e94" containerName="payload-pre-processing"
Sep 11 11:51:32.367621 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:32.367199    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eed83cb6-d29b-4cd3-928f-4cc786c64d7f" containerName="revoke-keys"
Sep 11 11:51:32.367621 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:32.367208    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="eed83cb6-d29b-4cd3-928f-4cc786c64d7f" containerName="revoke-keys"
Sep 11 11:51:32.367621 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:32.367281    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="eed83cb6-d29b-4cd3-928f-4cc786c64d7f" containerName="revoke-keys"
Sep 11 11:51:32.367621 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:32.367290    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd8c67fe-cfc8-49ba-9d82-8aa36054362c" containerName="payload-processing"
Sep 11 11:51:32.367621 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:32.367301    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5b5575a-2f4e-4344-865a-d99bfe0e9e94" containerName="payload-pre-processing"
Sep 11 11:51:32.372073 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:32.372053    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-4503d2-openshift-default-769c747cb-5f76k"
Sep 11 11:51:32.374898 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:32.374874    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-4503d2-openshift-default-dockercfg-4774w\""
Sep 11 11:51:32.385810 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:32.385788    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-4503d2-openshift-default-769c747cb-5f76k"]
Sep 11 11:51:32.463888 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:32.463849    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f70de565-a6b9-4cfa-9687-7df54fda1f61-workload-certs\") pod \"e2e-noten-4503d2-openshift-default-769c747cb-5f76k\" (UID: \"f70de565-a6b9-4cfa-9687-7df54fda1f61\") " pod="openshift-ingress/e2e-noten-4503d2-openshift-default-769c747cb-5f76k"
Sep 11 11:51:32.464047 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:32.463907    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f70de565-a6b9-4cfa-9687-7df54fda1f61-istio-envoy\") pod \"e2e-noten-4503d2-openshift-default-769c747cb-5f76k\" (UID: \"f70de565-a6b9-4cfa-9687-7df54fda1f61\") " pod="openshift-ingress/e2e-noten-4503d2-openshift-default-769c747cb-5f76k"
Sep 11 11:51:32.464047 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:32.463959    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f70de565-a6b9-4cfa-9687-7df54fda1f61-istio-podinfo\") pod \"e2e-noten-4503d2-openshift-default-769c747cb-5f76k\" (UID: \"f70de565-a6b9-4cfa-9687-7df54fda1f61\") " pod="openshift-ingress/e2e-noten-4503d2-openshift-default-769c747cb-5f76k"
Sep 11 11:51:32.464047 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:32.464020    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f70de565-a6b9-4cfa-9687-7df54fda1f61-istio-token\") pod \"e2e-noten-4503d2-openshift-default-769c747cb-5f76k\" (UID: \"f70de565-a6b9-4cfa-9687-7df54fda1f61\") " pod="openshift-ingress/e2e-noten-4503d2-openshift-default-769c747cb-5f76k"
Sep 11 11:51:32.464236 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:32.464060    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zkdp\" (UniqueName: \"kubernetes.io/projected/f70de565-a6b9-4cfa-9687-7df54fda1f61-kube-api-access-4zkdp\") pod \"e2e-noten-4503d2-openshift-default-769c747cb-5f76k\" (UID: \"f70de565-a6b9-4cfa-9687-7df54fda1f61\") " pod="openshift-ingress/e2e-noten-4503d2-openshift-default-769c747cb-5f76k"
Sep 11 11:51:32.464236 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:32.464104    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f70de565-a6b9-4cfa-9687-7df54fda1f61-workload-socket\") pod \"e2e-noten-4503d2-openshift-default-769c747cb-5f76k\" (UID: \"f70de565-a6b9-4cfa-9687-7df54fda1f61\") " pod="openshift-ingress/e2e-noten-4503d2-openshift-default-769c747cb-5f76k"
Sep 11 11:51:32.464236 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:32.464151    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f70de565-a6b9-4cfa-9687-7df54fda1f61-istiod-ca-cert\") pod \"e2e-noten-4503d2-openshift-default-769c747cb-5f76k\" (UID: \"f70de565-a6b9-4cfa-9687-7df54fda1f61\") " pod="openshift-ingress/e2e-noten-4503d2-openshift-default-769c747cb-5f76k"
Sep 11 11:51:32.464236 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:32.464223    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f70de565-a6b9-4cfa-9687-7df54fda1f61-credential-socket\") pod \"e2e-noten-4503d2-openshift-default-769c747cb-5f76k\" (UID: \"f70de565-a6b9-4cfa-9687-7df54fda1f61\") " pod="openshift-ingress/e2e-noten-4503d2-openshift-default-769c747cb-5f76k"
Sep 11 11:51:32.464388 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:32.464250    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f70de565-a6b9-4cfa-9687-7df54fda1f61-istio-data\") pod \"e2e-noten-4503d2-openshift-default-769c747cb-5f76k\" (UID: \"f70de565-a6b9-4cfa-9687-7df54fda1f61\") " pod="openshift-ingress/e2e-noten-4503d2-openshift-default-769c747cb-5f76k"
Sep 11 11:51:32.565179 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:32.565151    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zkdp\" (UniqueName: \"kubernetes.io/projected/f70de565-a6b9-4cfa-9687-7df54fda1f61-kube-api-access-4zkdp\") pod \"e2e-noten-4503d2-openshift-default-769c747cb-5f76k\" (UID: \"f70de565-a6b9-4cfa-9687-7df54fda1f61\") " pod="openshift-ingress/e2e-noten-4503d2-openshift-default-769c747cb-5f76k"
Sep 11 11:51:32.565370 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:32.565187    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f70de565-a6b9-4cfa-9687-7df54fda1f61-workload-socket\") pod \"e2e-noten-4503d2-openshift-default-769c747cb-5f76k\" (UID: \"f70de565-a6b9-4cfa-9687-7df54fda1f61\") " pod="openshift-ingress/e2e-noten-4503d2-openshift-default-769c747cb-5f76k"
Sep 11 11:51:32.565370 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:32.565212    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f70de565-a6b9-4cfa-9687-7df54fda1f61-istiod-ca-cert\") pod \"e2e-noten-4503d2-openshift-default-769c747cb-5f76k\" (UID: \"f70de565-a6b9-4cfa-9687-7df54fda1f61\") " pod="openshift-ingress/e2e-noten-4503d2-openshift-default-769c747cb-5f76k"
Sep 11 11:51:32.565370 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:32.565242    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f70de565-a6b9-4cfa-9687-7df54fda1f61-credential-socket\") pod \"e2e-noten-4503d2-openshift-default-769c747cb-5f76k\" (UID: \"f70de565-a6b9-4cfa-9687-7df54fda1f61\") " pod="openshift-ingress/e2e-noten-4503d2-openshift-default-769c747cb-5f76k"
Sep 11 11:51:32.565370 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:32.565258    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f70de565-a6b9-4cfa-9687-7df54fda1f61-istio-data\") pod \"e2e-noten-4503d2-openshift-default-769c747cb-5f76k\" (UID: \"f70de565-a6b9-4cfa-9687-7df54fda1f61\") " pod="openshift-ingress/e2e-noten-4503d2-openshift-default-769c747cb-5f76k"
Sep 11 11:51:32.565370 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:32.565296    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f70de565-a6b9-4cfa-9687-7df54fda1f61-workload-certs\") pod \"e2e-noten-4503d2-openshift-default-769c747cb-5f76k\" (UID: \"f70de565-a6b9-4cfa-9687-7df54fda1f61\") " pod="openshift-ingress/e2e-noten-4503d2-openshift-default-769c747cb-5f76k"
Sep 11 11:51:32.565370 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:32.565329    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f70de565-a6b9-4cfa-9687-7df54fda1f61-istio-envoy\") pod \"e2e-noten-4503d2-openshift-default-769c747cb-5f76k\" (UID: \"f70de565-a6b9-4cfa-9687-7df54fda1f61\") " pod="openshift-ingress/e2e-noten-4503d2-openshift-default-769c747cb-5f76k"
Sep 11 11:51:32.565738 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:32.565532    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f70de565-a6b9-4cfa-9687-7df54fda1f61-istio-podinfo\") pod \"e2e-noten-4503d2-openshift-default-769c747cb-5f76k\" (UID: \"f70de565-a6b9-4cfa-9687-7df54fda1f61\") " pod="openshift-ingress/e2e-noten-4503d2-openshift-default-769c747cb-5f76k"
Sep 11 11:51:32.565738 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:32.565594    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f70de565-a6b9-4cfa-9687-7df54fda1f61-istio-token\") pod \"e2e-noten-4503d2-openshift-default-769c747cb-5f76k\" (UID: \"f70de565-a6b9-4cfa-9687-7df54fda1f61\") " pod="openshift-ingress/e2e-noten-4503d2-openshift-default-769c747cb-5f76k"
Sep 11 11:51:32.565738 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:32.565602    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f70de565-a6b9-4cfa-9687-7df54fda1f61-workload-socket\") pod \"e2e-noten-4503d2-openshift-default-769c747cb-5f76k\" (UID: \"f70de565-a6b9-4cfa-9687-7df54fda1f61\") " pod="openshift-ingress/e2e-noten-4503d2-openshift-default-769c747cb-5f76k"
Sep 11 11:51:32.565738 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:32.565705    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f70de565-a6b9-4cfa-9687-7df54fda1f61-credential-socket\") pod \"e2e-noten-4503d2-openshift-default-769c747cb-5f76k\" (UID: \"f70de565-a6b9-4cfa-9687-7df54fda1f61\") " pod="openshift-ingress/e2e-noten-4503d2-openshift-default-769c747cb-5f76k"
Sep 11 11:51:32.565956 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:32.565770    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f70de565-a6b9-4cfa-9687-7df54fda1f61-istio-data\") pod \"e2e-noten-4503d2-openshift-default-769c747cb-5f76k\" (UID: \"f70de565-a6b9-4cfa-9687-7df54fda1f61\") " pod="openshift-ingress/e2e-noten-4503d2-openshift-default-769c747cb-5f76k"
Sep 11 11:51:32.565956 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:32.565812    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f70de565-a6b9-4cfa-9687-7df54fda1f61-workload-certs\") pod \"e2e-noten-4503d2-openshift-default-769c747cb-5f76k\" (UID: \"f70de565-a6b9-4cfa-9687-7df54fda1f61\") " pod="openshift-ingress/e2e-noten-4503d2-openshift-default-769c747cb-5f76k"
Sep 11 11:51:32.566057 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:32.565981    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f70de565-a6b9-4cfa-9687-7df54fda1f61-istiod-ca-cert\") pod \"e2e-noten-4503d2-openshift-default-769c747cb-5f76k\" (UID: \"f70de565-a6b9-4cfa-9687-7df54fda1f61\") " pod="openshift-ingress/e2e-noten-4503d2-openshift-default-769c747cb-5f76k"
Sep 11 11:51:32.567923 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:32.567902    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f70de565-a6b9-4cfa-9687-7df54fda1f61-istio-podinfo\") pod \"e2e-noten-4503d2-openshift-default-769c747cb-5f76k\" (UID: \"f70de565-a6b9-4cfa-9687-7df54fda1f61\") " pod="openshift-ingress/e2e-noten-4503d2-openshift-default-769c747cb-5f76k"
Sep 11 11:51:32.568030 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:32.567998    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f70de565-a6b9-4cfa-9687-7df54fda1f61-istio-envoy\") pod \"e2e-noten-4503d2-openshift-default-769c747cb-5f76k\" (UID: \"f70de565-a6b9-4cfa-9687-7df54fda1f61\") " pod="openshift-ingress/e2e-noten-4503d2-openshift-default-769c747cb-5f76k"
Sep 11 11:51:32.572865 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:32.572841    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zkdp\" (UniqueName: \"kubernetes.io/projected/f70de565-a6b9-4cfa-9687-7df54fda1f61-kube-api-access-4zkdp\") pod \"e2e-noten-4503d2-openshift-default-769c747cb-5f76k\" (UID: \"f70de565-a6b9-4cfa-9687-7df54fda1f61\") " pod="openshift-ingress/e2e-noten-4503d2-openshift-default-769c747cb-5f76k"
Sep 11 11:51:32.572982 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:32.572915    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f70de565-a6b9-4cfa-9687-7df54fda1f61-istio-token\") pod \"e2e-noten-4503d2-openshift-default-769c747cb-5f76k\" (UID: \"f70de565-a6b9-4cfa-9687-7df54fda1f61\") " pod="openshift-ingress/e2e-noten-4503d2-openshift-default-769c747cb-5f76k"
Sep 11 11:51:32.683906 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:32.683825    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-4503d2-openshift-default-769c747cb-5f76k"
Sep 11 11:51:32.965034 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:32.964971    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-4503d2-openshift-default-769c747cb-5f76k"]
Sep 11 11:51:32.967820 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:51:32.967795    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf70de565_a6b9_4cfa_9687_7df54fda1f61.slice/crio-a6898fc16943b7831898f3c3b752c49455e9b8091206cd4807bf9279c17ddf04 WatchSource:0}: Error finding container a6898fc16943b7831898f3c3b752c49455e9b8091206cd4807bf9279c17ddf04: Status 404 returned error can't find the container with id a6898fc16943b7831898f3c3b752c49455e9b8091206cd4807bf9279c17ddf04
Sep 11 11:51:32.970092 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:32.970062    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:51:32.970167 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:32.970135    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:51:32.970167 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:32.970162    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:51:33.354751 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:33.354637    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-4503d2-openshift-default-769c747cb-5f76k" event={"ID":"f70de565-a6b9-4cfa-9687-7df54fda1f61","Type":"ContainerStarted","Data":"4c51e1be2650be18e92a615db7c8e4473b4741211363803ff085160c733c5659"}
Sep 11 11:51:33.354751 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:33.354730    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-4503d2-openshift-default-769c747cb-5f76k" event={"ID":"f70de565-a6b9-4cfa-9687-7df54fda1f61","Type":"ContainerStarted","Data":"a6898fc16943b7831898f3c3b752c49455e9b8091206cd4807bf9279c17ddf04"}
Sep 11 11:51:33.375230 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:33.375183    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-4503d2-openshift-default-769c747cb-5f76k" podStartSLOduration=1.375166701 podStartE2EDuration="1.375166701s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:51:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:51:33.373236962 +0000 UTC m=+1044.195696834" watchObservedRunningTime="2026-09-11 11:51:33.375166701 +0000 UTC m=+1044.197626572"
Sep 11 11:51:33.684873 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:33.684795    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-4503d2-openshift-default-769c747cb-5f76k"
Sep 11 11:51:34.689607 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:34.689574    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-4503d2-openshift-default-769c747cb-5f76k"
Sep 11 11:51:35.364067 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:35.364026    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-4503d2-openshift-default-769c747cb-5f76k"
Sep 11 11:51:35.365094 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:35.365074    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-4503d2-openshift-default-769c747cb-5f76k"
Sep 11 11:51:36.755317 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:36.755295    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r"
Sep 11 11:51:36.899913 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:36.899828    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8-istio-podinfo\") pod \"c997cea8-a4f6-4f11-b8b1-ed2781bae6c8\" (UID: \"c997cea8-a4f6-4f11-b8b1-ed2781bae6c8\") "
Sep 11 11:51:36.899913 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:36.899867    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8-credential-socket\") pod \"c997cea8-a4f6-4f11-b8b1-ed2781bae6c8\" (UID: \"c997cea8-a4f6-4f11-b8b1-ed2781bae6c8\") "
Sep 11 11:51:36.900096 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:36.899922    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8-istiod-ca-cert\") pod \"c997cea8-a4f6-4f11-b8b1-ed2781bae6c8\" (UID: \"c997cea8-a4f6-4f11-b8b1-ed2781bae6c8\") "
Sep 11 11:51:36.900096 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:36.899940    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8-istio-data\") pod \"c997cea8-a4f6-4f11-b8b1-ed2781bae6c8\" (UID: \"c997cea8-a4f6-4f11-b8b1-ed2781bae6c8\") "
Sep 11 11:51:36.900096 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:36.899967    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8-istio-token\") pod \"c997cea8-a4f6-4f11-b8b1-ed2781bae6c8\" (UID: \"c997cea8-a4f6-4f11-b8b1-ed2781bae6c8\") "
Sep 11 11:51:36.900096 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:36.900013    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8-workload-certs\") pod \"c997cea8-a4f6-4f11-b8b1-ed2781bae6c8\" (UID: \"c997cea8-a4f6-4f11-b8b1-ed2781bae6c8\") "
Sep 11 11:51:36.900096 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:36.900051    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8-istio-envoy\") pod \"c997cea8-a4f6-4f11-b8b1-ed2781bae6c8\" (UID: \"c997cea8-a4f6-4f11-b8b1-ed2781bae6c8\") "
Sep 11 11:51:36.900096 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:36.900081    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hn668\" (UniqueName: \"kubernetes.io/projected/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8-kube-api-access-hn668\") pod \"c997cea8-a4f6-4f11-b8b1-ed2781bae6c8\" (UID: \"c997cea8-a4f6-4f11-b8b1-ed2781bae6c8\") "
Sep 11 11:51:36.900470 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:36.900105    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8-workload-socket\") pod \"c997cea8-a4f6-4f11-b8b1-ed2781bae6c8\" (UID: \"c997cea8-a4f6-4f11-b8b1-ed2781bae6c8\") "
Sep 11 11:51:36.900470 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:36.900263    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c997cea8-a4f6-4f11-b8b1-ed2781bae6c8" (UID: "c997cea8-a4f6-4f11-b8b1-ed2781bae6c8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:51:36.900470 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:36.900279    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8-istio-data" (OuterVolumeSpecName: "istio-data") pod "c997cea8-a4f6-4f11-b8b1-ed2781bae6c8" (UID: "c997cea8-a4f6-4f11-b8b1-ed2781bae6c8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:51:36.900470 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:36.900349    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c997cea8-a4f6-4f11-b8b1-ed2781bae6c8" (UID: "c997cea8-a4f6-4f11-b8b1-ed2781bae6c8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 11:51:36.900470 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:36.900431    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8-istio-data\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:51:36.900470 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:36.900448    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8-credential-socket\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:51:36.900470 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:36.900456    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c997cea8-a4f6-4f11-b8b1-ed2781bae6c8" (UID: "c997cea8-a4f6-4f11-b8b1-ed2781bae6c8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:51:36.900831 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:36.900509    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c997cea8-a4f6-4f11-b8b1-ed2781bae6c8" (UID: "c997cea8-a4f6-4f11-b8b1-ed2781bae6c8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:51:36.902126 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:36.902101    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8-istio-token" (OuterVolumeSpecName: "istio-token") pod "c997cea8-a4f6-4f11-b8b1-ed2781bae6c8" (UID: "c997cea8-a4f6-4f11-b8b1-ed2781bae6c8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:51:36.902233 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:36.902133    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c997cea8-a4f6-4f11-b8b1-ed2781bae6c8" (UID: "c997cea8-a4f6-4f11-b8b1-ed2781bae6c8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 11:51:36.902233 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:36.902206    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8-kube-api-access-hn668" (OuterVolumeSpecName: "kube-api-access-hn668") pod "c997cea8-a4f6-4f11-b8b1-ed2781bae6c8" (UID: "c997cea8-a4f6-4f11-b8b1-ed2781bae6c8"). InnerVolumeSpecName "kube-api-access-hn668". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:51:36.903273 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:36.903250    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c997cea8-a4f6-4f11-b8b1-ed2781bae6c8" (UID: "c997cea8-a4f6-4f11-b8b1-ed2781bae6c8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:51:37.001477 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:37.001442    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8-istio-podinfo\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:51:37.001477 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:37.001471    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8-istiod-ca-cert\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:51:37.001477 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:37.001482    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8-istio-token\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:51:37.001731 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:37.001490    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8-workload-certs\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:51:37.001731 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:37.001498    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8-istio-envoy\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:51:37.001731 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:37.001507    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hn668\" (UniqueName: \"kubernetes.io/projected/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8-kube-api-access-hn668\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:51:37.001731 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:37.001516    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8-workload-socket\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:51:37.375775 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:37.375739    2560 generic.go:356] "Generic (PLEG): container finished" podID="c997cea8-a4f6-4f11-b8b1-ed2781bae6c8" containerID="48cfb761cd26a64749d2240d2c15a252cdf169944d6412184945b475109c12db" exitCode=0
Sep 11 11:51:37.375946 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:37.375788    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r"
Sep 11 11:51:37.375946 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:37.375817    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r" event={"ID":"c997cea8-a4f6-4f11-b8b1-ed2781bae6c8","Type":"ContainerDied","Data":"48cfb761cd26a64749d2240d2c15a252cdf169944d6412184945b475109c12db"}
Sep 11 11:51:37.375946 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:37.375866    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r" event={"ID":"c997cea8-a4f6-4f11-b8b1-ed2781bae6c8","Type":"ContainerDied","Data":"9f915fcec7f6ee8647cc4b15c73dd4067058ec7e1418884f77a0bb38db8b311e"}
Sep 11 11:51:37.375946 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:37.375888    2560 scope.go:117] "RemoveContainer" containerID="48cfb761cd26a64749d2240d2c15a252cdf169944d6412184945b475109c12db"
Sep 11 11:51:37.385696 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:37.385679    2560 scope.go:117] "RemoveContainer" containerID="5a5302994abe9a7142cefbc73745deb03aa6a2f1470ba1e1ecf2ad71d161c47b"
Sep 11 11:51:37.393089 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:37.393071    2560 scope.go:117] "RemoveContainer" containerID="48cfb761cd26a64749d2240d2c15a252cdf169944d6412184945b475109c12db"
Sep 11 11:51:37.393340 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:51:37.393322    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48cfb761cd26a64749d2240d2c15a252cdf169944d6412184945b475109c12db\": container with ID starting with 48cfb761cd26a64749d2240d2c15a252cdf169944d6412184945b475109c12db not found: ID does not exist" containerID="48cfb761cd26a64749d2240d2c15a252cdf169944d6412184945b475109c12db"
Sep 11 11:51:37.393398 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:37.393349    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48cfb761cd26a64749d2240d2c15a252cdf169944d6412184945b475109c12db"} err="failed to get container status \"48cfb761cd26a64749d2240d2c15a252cdf169944d6412184945b475109c12db\": rpc error: code = NotFound desc = could not find container \"48cfb761cd26a64749d2240d2c15a252cdf169944d6412184945b475109c12db\": container with ID starting with 48cfb761cd26a64749d2240d2c15a252cdf169944d6412184945b475109c12db not found: ID does not exist"
Sep 11 11:51:37.393398 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:37.393365    2560 scope.go:117] "RemoveContainer" containerID="5a5302994abe9a7142cefbc73745deb03aa6a2f1470ba1e1ecf2ad71d161c47b"
Sep 11 11:51:37.393592 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:51:37.393579    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a5302994abe9a7142cefbc73745deb03aa6a2f1470ba1e1ecf2ad71d161c47b\": container with ID starting with 5a5302994abe9a7142cefbc73745deb03aa6a2f1470ba1e1ecf2ad71d161c47b not found: ID does not exist" containerID="5a5302994abe9a7142cefbc73745deb03aa6a2f1470ba1e1ecf2ad71d161c47b"
Sep 11 11:51:37.393633 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:37.393594    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a5302994abe9a7142cefbc73745deb03aa6a2f1470ba1e1ecf2ad71d161c47b"} err="failed to get container status \"5a5302994abe9a7142cefbc73745deb03aa6a2f1470ba1e1ecf2ad71d161c47b\": rpc error: code = NotFound desc = could not find container \"5a5302994abe9a7142cefbc73745deb03aa6a2f1470ba1e1ecf2ad71d161c47b\": container with ID starting with 5a5302994abe9a7142cefbc73745deb03aa6a2f1470ba1e1ecf2ad71d161c47b not found: ID does not exist"
Sep 11 11:51:37.398242 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:37.398220    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r"]
Sep 11 11:51:37.402338 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:37.402315    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-c92551-openshift-default-78cccc897b-nts4r"]
Sep 11 11:51:37.813607 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:37.813577    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c997cea8-a4f6-4f11-b8b1-ed2781bae6c8" path="/var/lib/kubelet/pods/c997cea8-a4f6-4f11-b8b1-ed2781bae6c8/volumes"
Sep 11 11:51:54.037642 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:54.037608    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w"]
Sep 11 11:51:54.038549 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:54.038527    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c997cea8-a4f6-4f11-b8b1-ed2781bae6c8" containerName="istio-proxy"
Sep 11 11:51:54.038677 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:54.038551    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c997cea8-a4f6-4f11-b8b1-ed2781bae6c8" containerName="istio-proxy"
Sep 11 11:51:54.038677 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:54.038579    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c997cea8-a4f6-4f11-b8b1-ed2781bae6c8" containerName="istio-proxy"
Sep 11 11:51:54.038677 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:54.038589    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c997cea8-a4f6-4f11-b8b1-ed2781bae6c8" containerName="istio-proxy"
Sep 11 11:51:54.038858 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:54.038693    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c997cea8-a4f6-4f11-b8b1-ed2781bae6c8" containerName="istio-proxy"
Sep 11 11:51:54.043706 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:54.043680    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w"
Sep 11 11:51:54.046624 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:54.046599    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-5745b581-openshift-default-dockercfg-zp5wq\""
Sep 11 11:51:54.059938 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:54.059916    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w"]
Sep 11 11:51:54.140960 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:54.140909    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrc5b\" (UniqueName: \"kubernetes.io/projected/8604a408-5e18-4650-9bfd-7e715d8e1819-kube-api-access-zrc5b\") pod \"e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w\" (UID: \"8604a408-5e18-4650-9bfd-7e715d8e1819\") " pod="openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w"
Sep 11 11:51:54.141153 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:54.140970    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8604a408-5e18-4650-9bfd-7e715d8e1819-workload-certs\") pod \"e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w\" (UID: \"8604a408-5e18-4650-9bfd-7e715d8e1819\") " pod="openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w"
Sep 11 11:51:54.141153 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:54.141032    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8604a408-5e18-4650-9bfd-7e715d8e1819-istiod-ca-cert\") pod \"e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w\" (UID: \"8604a408-5e18-4650-9bfd-7e715d8e1819\") " pod="openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w"
Sep 11 11:51:54.141153 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:54.141074    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8604a408-5e18-4650-9bfd-7e715d8e1819-workload-socket\") pod \"e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w\" (UID: \"8604a408-5e18-4650-9bfd-7e715d8e1819\") " pod="openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w"
Sep 11 11:51:54.141343 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:54.141148    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8604a408-5e18-4650-9bfd-7e715d8e1819-credential-socket\") pod \"e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w\" (UID: \"8604a408-5e18-4650-9bfd-7e715d8e1819\") " pod="openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w"
Sep 11 11:51:54.141343 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:54.141202    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8604a408-5e18-4650-9bfd-7e715d8e1819-istio-data\") pod \"e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w\" (UID: \"8604a408-5e18-4650-9bfd-7e715d8e1819\") " pod="openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w"
Sep 11 11:51:54.141343 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:54.141273    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8604a408-5e18-4650-9bfd-7e715d8e1819-istio-token\") pod \"e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w\" (UID: \"8604a408-5e18-4650-9bfd-7e715d8e1819\") " pod="openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w"
Sep 11 11:51:54.141343 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:54.141301    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8604a408-5e18-4650-9bfd-7e715d8e1819-istio-envoy\") pod \"e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w\" (UID: \"8604a408-5e18-4650-9bfd-7e715d8e1819\") " pod="openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w"
Sep 11 11:51:54.141584 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:54.141348    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8604a408-5e18-4650-9bfd-7e715d8e1819-istio-podinfo\") pod \"e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w\" (UID: \"8604a408-5e18-4650-9bfd-7e715d8e1819\") " pod="openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w"
Sep 11 11:51:54.242409 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:54.242373    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8604a408-5e18-4650-9bfd-7e715d8e1819-istio-token\") pod \"e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w\" (UID: \"8604a408-5e18-4650-9bfd-7e715d8e1819\") " pod="openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w"
Sep 11 11:51:54.242409 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:54.242410    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8604a408-5e18-4650-9bfd-7e715d8e1819-istio-envoy\") pod \"e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w\" (UID: \"8604a408-5e18-4650-9bfd-7e715d8e1819\") " pod="openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w"
Sep 11 11:51:54.242685 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:54.242439    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8604a408-5e18-4650-9bfd-7e715d8e1819-istio-podinfo\") pod \"e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w\" (UID: \"8604a408-5e18-4650-9bfd-7e715d8e1819\") " pod="openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w"
Sep 11 11:51:54.242685 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:54.242599    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrc5b\" (UniqueName: \"kubernetes.io/projected/8604a408-5e18-4650-9bfd-7e715d8e1819-kube-api-access-zrc5b\") pod \"e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w\" (UID: \"8604a408-5e18-4650-9bfd-7e715d8e1819\") " pod="openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w"
Sep 11 11:51:54.242977 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:54.242950    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8604a408-5e18-4650-9bfd-7e715d8e1819-workload-certs\") pod \"e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w\" (UID: \"8604a408-5e18-4650-9bfd-7e715d8e1819\") " pod="openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w"
Sep 11 11:51:54.243116 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:54.243003    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8604a408-5e18-4650-9bfd-7e715d8e1819-istiod-ca-cert\") pod \"e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w\" (UID: \"8604a408-5e18-4650-9bfd-7e715d8e1819\") " pod="openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w"
Sep 11 11:51:54.243116 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:54.243051    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8604a408-5e18-4650-9bfd-7e715d8e1819-workload-socket\") pod \"e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w\" (UID: \"8604a408-5e18-4650-9bfd-7e715d8e1819\") " pod="openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w"
Sep 11 11:51:54.243116 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:54.243088    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8604a408-5e18-4650-9bfd-7e715d8e1819-credential-socket\") pod \"e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w\" (UID: \"8604a408-5e18-4650-9bfd-7e715d8e1819\") " pod="openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w"
Sep 11 11:51:54.243361 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:54.243333    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8604a408-5e18-4650-9bfd-7e715d8e1819-workload-certs\") pod \"e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w\" (UID: \"8604a408-5e18-4650-9bfd-7e715d8e1819\") " pod="openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w"
Sep 11 11:51:54.243508 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:54.243391    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8604a408-5e18-4650-9bfd-7e715d8e1819-workload-socket\") pod \"e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w\" (UID: \"8604a408-5e18-4650-9bfd-7e715d8e1819\") " pod="openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w"
Sep 11 11:51:54.243758 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:54.243713    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8604a408-5e18-4650-9bfd-7e715d8e1819-credential-socket\") pod \"e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w\" (UID: \"8604a408-5e18-4650-9bfd-7e715d8e1819\") " pod="openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w"
Sep 11 11:51:54.243875 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:54.243828    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8604a408-5e18-4650-9bfd-7e715d8e1819-istiod-ca-cert\") pod \"e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w\" (UID: \"8604a408-5e18-4650-9bfd-7e715d8e1819\") " pod="openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w"
Sep 11 11:51:54.243968 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:54.243944    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8604a408-5e18-4650-9bfd-7e715d8e1819-istio-data\") pod \"e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w\" (UID: \"8604a408-5e18-4650-9bfd-7e715d8e1819\") " pod="openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w"
Sep 11 11:51:54.244059 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:54.243960    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8604a408-5e18-4650-9bfd-7e715d8e1819-istio-data\") pod \"e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w\" (UID: \"8604a408-5e18-4650-9bfd-7e715d8e1819\") " pod="openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w"
Sep 11 11:51:54.245123 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:54.245103    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8604a408-5e18-4650-9bfd-7e715d8e1819-istio-envoy\") pod \"e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w\" (UID: \"8604a408-5e18-4650-9bfd-7e715d8e1819\") " pod="openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w"
Sep 11 11:51:54.245231 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:54.245215    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8604a408-5e18-4650-9bfd-7e715d8e1819-istio-podinfo\") pod \"e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w\" (UID: \"8604a408-5e18-4650-9bfd-7e715d8e1819\") " pod="openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w"
Sep 11 11:51:54.250570 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:54.250543    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8604a408-5e18-4650-9bfd-7e715d8e1819-istio-token\") pod \"e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w\" (UID: \"8604a408-5e18-4650-9bfd-7e715d8e1819\") " pod="openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w"
Sep 11 11:51:54.250838 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:54.250816    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrc5b\" (UniqueName: \"kubernetes.io/projected/8604a408-5e18-4650-9bfd-7e715d8e1819-kube-api-access-zrc5b\") pod \"e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w\" (UID: \"8604a408-5e18-4650-9bfd-7e715d8e1819\") " pod="openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w"
Sep 11 11:51:54.355957 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:54.355875    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w"
Sep 11 11:51:54.635255 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:54.635229    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w"]
Sep 11 11:51:54.637380 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:51:54.637327    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8604a408_5e18_4650_9bfd_7e715d8e1819.slice/crio-2365557ee03acae7a60baffb70d7c92eec6058789a111e3da56821d6eac13cb4 WatchSource:0}: Error finding container 2365557ee03acae7a60baffb70d7c92eec6058789a111e3da56821d6eac13cb4: Status 404 returned error can't find the container with id 2365557ee03acae7a60baffb70d7c92eec6058789a111e3da56821d6eac13cb4
Sep 11 11:51:54.641286 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:54.641232    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:51:54.641426 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:54.641320    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:51:54.641426 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:54.641365    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:51:55.467214 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:55.467183    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w" event={"ID":"8604a408-5e18-4650-9bfd-7e715d8e1819","Type":"ContainerStarted","Data":"60fd29c50821d4f00458e8710bc76576af596232c5e25e93a05c8045b89f75ac"}
Sep 11 11:51:55.467633 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:55.467231    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w" event={"ID":"8604a408-5e18-4650-9bfd-7e715d8e1819","Type":"ContainerStarted","Data":"2365557ee03acae7a60baffb70d7c92eec6058789a111e3da56821d6eac13cb4"}
Sep 11 11:51:55.495067 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:55.495017    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w" podStartSLOduration=1.495002123 podStartE2EDuration="1.495002123s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:51:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:51:55.492509968 +0000 UTC m=+1066.314969841" watchObservedRunningTime="2026-09-11 11:51:55.495002123 +0000 UTC m=+1066.317462048"
Sep 11 11:51:56.356179 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:56.356139    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w"
Sep 11 11:51:56.361372 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:56.361345    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w"
Sep 11 11:51:56.471583 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:56.471551    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w"
Sep 11 11:51:56.472579 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:56.472558    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w"
Sep 11 11:51:59.354628 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:59.354588    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-5745b581-7bbfd7b95c-mvvl2"]
Sep 11 11:51:59.355165 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:59.355146    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c997cea8-a4f6-4f11-b8b1-ed2781bae6c8" containerName="istio-proxy"
Sep 11 11:51:59.358120 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:59.358100    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-5745b581-7bbfd7b95c-mvvl2"
Sep 11 11:51:59.362760 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:59.362741    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-5745b581\""
Sep 11 11:51:59.363091 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:59.363066    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-5745b581-dockercfg-kxp6k\""
Sep 11 11:51:59.371251 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:59.371229    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-5745b581-7bbfd7b95c-mvvl2"]
Sep 11 11:51:59.386607 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:59.386582    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plvlr\" (UniqueName: \"kubernetes.io/projected/dcb8922d-a417-44d7-a374-7e9056cd669b-kube-api-access-plvlr\") pod \"payload-processing-e2e-mt-5745b581-7bbfd7b95c-mvvl2\" (UID: \"dcb8922d-a417-44d7-a374-7e9056cd669b\") " pod="openshift-ingress/payload-processing-e2e-mt-5745b581-7bbfd7b95c-mvvl2"
Sep 11 11:51:59.386739 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:59.386634    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dcb8922d-a417-44d7-a374-7e9056cd669b-plugins-config-volume\") pod \"payload-processing-e2e-mt-5745b581-7bbfd7b95c-mvvl2\" (UID: \"dcb8922d-a417-44d7-a374-7e9056cd669b\") " pod="openshift-ingress/payload-processing-e2e-mt-5745b581-7bbfd7b95c-mvvl2"
Sep 11 11:51:59.428600 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:59.428573    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-5745b581-7c7d5cdf94-prfdw"]
Sep 11 11:51:59.431773 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:59.431758    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-5745b581-7c7d5cdf94-prfdw"
Sep 11 11:51:59.446443 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:59.446419    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-5745b581-7c7d5cdf94-prfdw"]
Sep 11 11:51:59.487274 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:59.487242    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3363afee-86ab-420d-86f4-fbc70e9c0941-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-5745b581-7c7d5cdf94-prfdw\" (UID: \"3363afee-86ab-420d-86f4-fbc70e9c0941\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-5745b581-7c7d5cdf94-prfdw"
Sep 11 11:51:59.487505 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:59.487281    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plvlr\" (UniqueName: \"kubernetes.io/projected/dcb8922d-a417-44d7-a374-7e9056cd669b-kube-api-access-plvlr\") pod \"payload-processing-e2e-mt-5745b581-7bbfd7b95c-mvvl2\" (UID: \"dcb8922d-a417-44d7-a374-7e9056cd669b\") " pod="openshift-ingress/payload-processing-e2e-mt-5745b581-7bbfd7b95c-mvvl2"
Sep 11 11:51:59.487505 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:59.487305    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz9nk\" (UniqueName: \"kubernetes.io/projected/3363afee-86ab-420d-86f4-fbc70e9c0941-kube-api-access-kz9nk\") pod \"payload-pre-processing-e2e-mt-5745b581-7c7d5cdf94-prfdw\" (UID: \"3363afee-86ab-420d-86f4-fbc70e9c0941\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-5745b581-7c7d5cdf94-prfdw"
Sep 11 11:51:59.487505 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:59.487424    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dcb8922d-a417-44d7-a374-7e9056cd669b-plugins-config-volume\") pod \"payload-processing-e2e-mt-5745b581-7bbfd7b95c-mvvl2\" (UID: \"dcb8922d-a417-44d7-a374-7e9056cd669b\") " pod="openshift-ingress/payload-processing-e2e-mt-5745b581-7bbfd7b95c-mvvl2"
Sep 11 11:51:59.488103 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:59.488082    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dcb8922d-a417-44d7-a374-7e9056cd669b-plugins-config-volume\") pod \"payload-processing-e2e-mt-5745b581-7bbfd7b95c-mvvl2\" (UID: \"dcb8922d-a417-44d7-a374-7e9056cd669b\") " pod="openshift-ingress/payload-processing-e2e-mt-5745b581-7bbfd7b95c-mvvl2"
Sep 11 11:51:59.510173 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:59.510146    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plvlr\" (UniqueName: \"kubernetes.io/projected/dcb8922d-a417-44d7-a374-7e9056cd669b-kube-api-access-plvlr\") pod \"payload-processing-e2e-mt-5745b581-7bbfd7b95c-mvvl2\" (UID: \"dcb8922d-a417-44d7-a374-7e9056cd669b\") " pod="openshift-ingress/payload-processing-e2e-mt-5745b581-7bbfd7b95c-mvvl2"
Sep 11 11:51:59.588853 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:59.588823    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3363afee-86ab-420d-86f4-fbc70e9c0941-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-5745b581-7c7d5cdf94-prfdw\" (UID: \"3363afee-86ab-420d-86f4-fbc70e9c0941\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-5745b581-7c7d5cdf94-prfdw"
Sep 11 11:51:59.589024 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:59.588866    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kz9nk\" (UniqueName: \"kubernetes.io/projected/3363afee-86ab-420d-86f4-fbc70e9c0941-kube-api-access-kz9nk\") pod \"payload-pre-processing-e2e-mt-5745b581-7c7d5cdf94-prfdw\" (UID: \"3363afee-86ab-420d-86f4-fbc70e9c0941\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-5745b581-7c7d5cdf94-prfdw"
Sep 11 11:51:59.589496 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:59.589477    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3363afee-86ab-420d-86f4-fbc70e9c0941-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-5745b581-7c7d5cdf94-prfdw\" (UID: \"3363afee-86ab-420d-86f4-fbc70e9c0941\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-5745b581-7c7d5cdf94-prfdw"
Sep 11 11:51:59.597390 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:59.597361    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz9nk\" (UniqueName: \"kubernetes.io/projected/3363afee-86ab-420d-86f4-fbc70e9c0941-kube-api-access-kz9nk\") pod \"payload-pre-processing-e2e-mt-5745b581-7c7d5cdf94-prfdw\" (UID: \"3363afee-86ab-420d-86f4-fbc70e9c0941\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-5745b581-7c7d5cdf94-prfdw"
Sep 11 11:51:59.668688 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:59.668575    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-5745b581-7bbfd7b95c-mvvl2"
Sep 11 11:51:59.741023 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:59.740991    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-5745b581-7c7d5cdf94-prfdw"
Sep 11 11:51:59.946546 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:51:59.946516    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-5745b581-7bbfd7b95c-mvvl2"]
Sep 11 11:51:59.949135 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:51:59.949111    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcb8922d_a417_44d7_a374_7e9056cd669b.slice/crio-3e3d46652830e7964ea14053e1127e84d298bf3dd6d8a0d0e981d2d456418b1c WatchSource:0}: Error finding container 3e3d46652830e7964ea14053e1127e84d298bf3dd6d8a0d0e981d2d456418b1c: Status 404 returned error can't find the container with id 3e3d46652830e7964ea14053e1127e84d298bf3dd6d8a0d0e981d2d456418b1c
Sep 11 11:52:00.017964 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:00.017936    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-5745b581-7c7d5cdf94-prfdw"]
Sep 11 11:52:00.019324 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:52:00.019283    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3363afee_86ab_420d_86f4_fbc70e9c0941.slice/crio-7098a8b6d139ea8d369f30d48d3a6db72c0a05099f14d77f9138525fce7ec5cf WatchSource:0}: Error finding container 7098a8b6d139ea8d369f30d48d3a6db72c0a05099f14d77f9138525fce7ec5cf: Status 404 returned error can't find the container with id 7098a8b6d139ea8d369f30d48d3a6db72c0a05099f14d77f9138525fce7ec5cf
Sep 11 11:52:00.497716 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:00.495924    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-5745b581-7c7d5cdf94-prfdw" event={"ID":"3363afee-86ab-420d-86f4-fbc70e9c0941","Type":"ContainerStarted","Data":"c46de073ca33910da6b3d71a166e66be9a35da44869c77f6ac75a292dddcde63"}
Sep 11 11:52:00.497716 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:00.496036    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-5745b581-7c7d5cdf94-prfdw" event={"ID":"3363afee-86ab-420d-86f4-fbc70e9c0941","Type":"ContainerStarted","Data":"7098a8b6d139ea8d369f30d48d3a6db72c0a05099f14d77f9138525fce7ec5cf"}
Sep 11 11:52:00.497716 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:00.496628    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-5745b581-7c7d5cdf94-prfdw"
Sep 11 11:52:00.499074 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:00.499035    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-5745b581-7bbfd7b95c-mvvl2" event={"ID":"dcb8922d-a417-44d7-a374-7e9056cd669b","Type":"ContainerStarted","Data":"d51246b8a024de429c520e854bf73f0586bce26562daaaa1eb26a534777888f4"}
Sep 11 11:52:00.499162 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:00.499087    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-5745b581-7bbfd7b95c-mvvl2" event={"ID":"dcb8922d-a417-44d7-a374-7e9056cd669b","Type":"ContainerStarted","Data":"3e3d46652830e7964ea14053e1127e84d298bf3dd6d8a0d0e981d2d456418b1c"}
Sep 11 11:52:00.499162 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:00.499116    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-5745b581-7bbfd7b95c-mvvl2"
Sep 11 11:52:00.527022 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:00.526973    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-5745b581-7c7d5cdf94-prfdw" podStartSLOduration=1.5269577970000001 podStartE2EDuration="1.526957797s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:51:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:52:00.52640067 +0000 UTC m=+1071.348860543" watchObservedRunningTime="2026-09-11 11:52:00.526957797 +0000 UTC m=+1071.349417670"
Sep 11 11:52:00.562865 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:00.562814    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-5745b581-7bbfd7b95c-mvvl2" podStartSLOduration=1.562798548 podStartE2EDuration="1.562798548s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:51:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:52:00.561759515 +0000 UTC m=+1071.384219415" watchObservedRunningTime="2026-09-11 11:52:00.562798548 +0000 UTC m=+1071.385258421"
Sep 11 11:52:11.506259 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:11.506220    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-5745b581-7c7d5cdf94-prfdw"
Sep 11 11:52:11.506676 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:11.506314    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-5745b581-7bbfd7b95c-mvvl2"
Sep 11 11:52:12.513822 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:12.513774    2560 patch_prober.go:28] interesting pod/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 11:52:12.514226 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:12.513844    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w" podUID="8604a408-5e18-4650-9bfd-7e715d8e1819" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 11:52:13.576427 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:13.576337    2560 generic.go:356] "Generic (PLEG): container finished" podID="8604a408-5e18-4650-9bfd-7e715d8e1819" containerID="60fd29c50821d4f00458e8710bc76576af596232c5e25e93a05c8045b89f75ac" exitCode=0
Sep 11 11:52:13.576427 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:13.576392    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w" event={"ID":"8604a408-5e18-4650-9bfd-7e715d8e1819","Type":"ContainerDied","Data":"60fd29c50821d4f00458e8710bc76576af596232c5e25e93a05c8045b89f75ac"}
Sep 11 11:52:13.576885 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:13.576754    2560 scope.go:117] "RemoveContainer" containerID="60fd29c50821d4f00458e8710bc76576af596232c5e25e93a05c8045b89f75ac"
Sep 11 11:52:13.577806 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:13.577775    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:52:13.577872 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:13.577853    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:52:13.577908 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:13.577888    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:52:14.583389 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:14.583358    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w" event={"ID":"8604a408-5e18-4650-9bfd-7e715d8e1819","Type":"ContainerStarted","Data":"7a77cc94f5b495018b94dc781fd9928f971ee43d7637e1553412d2f509e27fe5"}
Sep 11 11:52:15.357067 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:15.357027    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w"
Sep 11 11:52:15.357281 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:15.357158    2560 patch_prober.go:28] interesting pod/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 11 11:52:15.357281 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:15.357202    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w" podUID="8604a408-5e18-4650-9bfd-7e715d8e1819" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 11 11:52:16.367927 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:16.362091    2560 patch_prober.go:28] interesting pod/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 11 11:52:16.367927 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:16.362172    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w" podUID="8604a408-5e18-4650-9bfd-7e715d8e1819" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 11 11:52:16.699851 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:16.699772    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-4503d2-openshift-default-769c747cb-5f76k"]
Sep 11 11:52:16.699999 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:16.699982    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-4503d2-openshift-default-769c747cb-5f76k" podUID="f70de565-a6b9-4cfa-9687-7df54fda1f61" containerName="istio-proxy" containerID="cri-o://4c51e1be2650be18e92a615db7c8e4473b4741211363803ff085160c733c5659" gracePeriod=30
Sep 11 11:52:17.357281 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:17.356828    2560 patch_prober.go:28] interesting pod/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 11 11:52:17.357281 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:17.356896    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w" podUID="8604a408-5e18-4650-9bfd-7e715d8e1819" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 11 11:52:18.357158 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:18.356701    2560 patch_prober.go:28] interesting pod/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 11 11:52:18.357158 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:18.356770    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w" podUID="8604a408-5e18-4650-9bfd-7e715d8e1819" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 11 11:52:19.357311 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:19.357271    2560 patch_prober.go:28] interesting pod/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 11 11:52:19.357945 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:19.357911    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w" podUID="8604a408-5e18-4650-9bfd-7e715d8e1819" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 11 11:52:20.359763 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:20.359730    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w"
Sep 11 11:52:20.360129 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:20.359998    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w"
Sep 11 11:52:20.360798 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:20.360780    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w"
Sep 11 11:52:20.366222 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:20.366197    2560 patch_prober.go:28] interesting pod/e2e-noten-4503d2-openshift-default-769c747cb-5f76k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 11:52:20.366342 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:20.366245    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-noten-4503d2-openshift-default-769c747cb-5f76k" podUID="f70de565-a6b9-4cfa-9687-7df54fda1f61" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 11:52:21.948786 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:21.948753    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-4503d2-openshift-default-769c747cb-5f76k"
Sep 11 11:52:22.097037 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:22.096999    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f70de565-a6b9-4cfa-9687-7df54fda1f61-istio-podinfo\") pod \"f70de565-a6b9-4cfa-9687-7df54fda1f61\" (UID: \"f70de565-a6b9-4cfa-9687-7df54fda1f61\") "
Sep 11 11:52:22.097234 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:22.097071    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f70de565-a6b9-4cfa-9687-7df54fda1f61-credential-socket\") pod \"f70de565-a6b9-4cfa-9687-7df54fda1f61\" (UID: \"f70de565-a6b9-4cfa-9687-7df54fda1f61\") "
Sep 11 11:52:22.097234 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:22.097107    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zkdp\" (UniqueName: \"kubernetes.io/projected/f70de565-a6b9-4cfa-9687-7df54fda1f61-kube-api-access-4zkdp\") pod \"f70de565-a6b9-4cfa-9687-7df54fda1f61\" (UID: \"f70de565-a6b9-4cfa-9687-7df54fda1f61\") "
Sep 11 11:52:22.097234 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:22.097129    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f70de565-a6b9-4cfa-9687-7df54fda1f61-workload-certs\") pod \"f70de565-a6b9-4cfa-9687-7df54fda1f61\" (UID: \"f70de565-a6b9-4cfa-9687-7df54fda1f61\") "
Sep 11 11:52:22.097234 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:22.097153    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f70de565-a6b9-4cfa-9687-7df54fda1f61-istio-envoy\") pod \"f70de565-a6b9-4cfa-9687-7df54fda1f61\" (UID: \"f70de565-a6b9-4cfa-9687-7df54fda1f61\") "
Sep 11 11:52:22.097234 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:22.097170    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f70de565-a6b9-4cfa-9687-7df54fda1f61-istio-token\") pod \"f70de565-a6b9-4cfa-9687-7df54fda1f61\" (UID: \"f70de565-a6b9-4cfa-9687-7df54fda1f61\") "
Sep 11 11:52:22.097234 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:22.097226    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f70de565-a6b9-4cfa-9687-7df54fda1f61-workload-socket\") pod \"f70de565-a6b9-4cfa-9687-7df54fda1f61\" (UID: \"f70de565-a6b9-4cfa-9687-7df54fda1f61\") "
Sep 11 11:52:22.097556 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:22.097255    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f70de565-a6b9-4cfa-9687-7df54fda1f61-istiod-ca-cert\") pod \"f70de565-a6b9-4cfa-9687-7df54fda1f61\" (UID: \"f70de565-a6b9-4cfa-9687-7df54fda1f61\") "
Sep 11 11:52:22.097556 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:22.097292    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f70de565-a6b9-4cfa-9687-7df54fda1f61-istio-data\") pod \"f70de565-a6b9-4cfa-9687-7df54fda1f61\" (UID: \"f70de565-a6b9-4cfa-9687-7df54fda1f61\") "
Sep 11 11:52:22.097556 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:22.097478    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f70de565-a6b9-4cfa-9687-7df54fda1f61-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f70de565-a6b9-4cfa-9687-7df54fda1f61" (UID: "f70de565-a6b9-4cfa-9687-7df54fda1f61"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:52:22.097556 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:22.097494    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f70de565-a6b9-4cfa-9687-7df54fda1f61-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f70de565-a6b9-4cfa-9687-7df54fda1f61" (UID: "f70de565-a6b9-4cfa-9687-7df54fda1f61"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:52:22.097806 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:22.097712    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f70de565-a6b9-4cfa-9687-7df54fda1f61-istio-data" (OuterVolumeSpecName: "istio-data") pod "f70de565-a6b9-4cfa-9687-7df54fda1f61" (UID: "f70de565-a6b9-4cfa-9687-7df54fda1f61"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:52:22.097865 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:22.097841    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f70de565-a6b9-4cfa-9687-7df54fda1f61-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f70de565-a6b9-4cfa-9687-7df54fda1f61" (UID: "f70de565-a6b9-4cfa-9687-7df54fda1f61"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:52:22.098013 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:22.097994    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f70de565-a6b9-4cfa-9687-7df54fda1f61-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f70de565-a6b9-4cfa-9687-7df54fda1f61" (UID: "f70de565-a6b9-4cfa-9687-7df54fda1f61"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 11:52:22.099348 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:22.099325    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f70de565-a6b9-4cfa-9687-7df54fda1f61-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f70de565-a6b9-4cfa-9687-7df54fda1f61" (UID: "f70de565-a6b9-4cfa-9687-7df54fda1f61"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:52:22.099418 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:22.099354    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f70de565-a6b9-4cfa-9687-7df54fda1f61-istio-token" (OuterVolumeSpecName: "istio-token") pod "f70de565-a6b9-4cfa-9687-7df54fda1f61" (UID: "f70de565-a6b9-4cfa-9687-7df54fda1f61"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:52:22.099627 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:22.099601    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f70de565-a6b9-4cfa-9687-7df54fda1f61-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f70de565-a6b9-4cfa-9687-7df54fda1f61" (UID: "f70de565-a6b9-4cfa-9687-7df54fda1f61"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 11:52:22.099627 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:22.099611    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f70de565-a6b9-4cfa-9687-7df54fda1f61-kube-api-access-4zkdp" (OuterVolumeSpecName: "kube-api-access-4zkdp") pod "f70de565-a6b9-4cfa-9687-7df54fda1f61" (UID: "f70de565-a6b9-4cfa-9687-7df54fda1f61"). InnerVolumeSpecName "kube-api-access-4zkdp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:52:22.198694 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:22.198637    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f70de565-a6b9-4cfa-9687-7df54fda1f61-workload-socket\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:52:22.198694 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:22.198689    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f70de565-a6b9-4cfa-9687-7df54fda1f61-istiod-ca-cert\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:52:22.198694 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:22.198700    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f70de565-a6b9-4cfa-9687-7df54fda1f61-istio-data\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:52:22.198927 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:22.198708    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f70de565-a6b9-4cfa-9687-7df54fda1f61-istio-podinfo\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:52:22.198927 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:22.198717    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f70de565-a6b9-4cfa-9687-7df54fda1f61-credential-socket\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:52:22.198927 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:22.198727    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zkdp\" (UniqueName: \"kubernetes.io/projected/f70de565-a6b9-4cfa-9687-7df54fda1f61-kube-api-access-4zkdp\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:52:22.198927 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:22.198735    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f70de565-a6b9-4cfa-9687-7df54fda1f61-workload-certs\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:52:22.198927 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:22.198743    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f70de565-a6b9-4cfa-9687-7df54fda1f61-istio-envoy\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:52:22.198927 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:22.198750    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f70de565-a6b9-4cfa-9687-7df54fda1f61-istio-token\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:52:22.622349 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:22.622315    2560 generic.go:356] "Generic (PLEG): container finished" podID="f70de565-a6b9-4cfa-9687-7df54fda1f61" containerID="4c51e1be2650be18e92a615db7c8e4473b4741211363803ff085160c733c5659" exitCode=0
Sep 11 11:52:22.622586 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:22.622367    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-4503d2-openshift-default-769c747cb-5f76k"
Sep 11 11:52:22.622586 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:22.622392    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-4503d2-openshift-default-769c747cb-5f76k" event={"ID":"f70de565-a6b9-4cfa-9687-7df54fda1f61","Type":"ContainerDied","Data":"4c51e1be2650be18e92a615db7c8e4473b4741211363803ff085160c733c5659"}
Sep 11 11:52:22.622586 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:22.622432    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-4503d2-openshift-default-769c747cb-5f76k" event={"ID":"f70de565-a6b9-4cfa-9687-7df54fda1f61","Type":"ContainerDied","Data":"a6898fc16943b7831898f3c3b752c49455e9b8091206cd4807bf9279c17ddf04"}
Sep 11 11:52:22.622586 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:22.622454    2560 scope.go:117] "RemoveContainer" containerID="4c51e1be2650be18e92a615db7c8e4473b4741211363803ff085160c733c5659"
Sep 11 11:52:22.632125 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:22.632110    2560 scope.go:117] "RemoveContainer" containerID="4c51e1be2650be18e92a615db7c8e4473b4741211363803ff085160c733c5659"
Sep 11 11:52:22.632400 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:52:22.632379    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c51e1be2650be18e92a615db7c8e4473b4741211363803ff085160c733c5659\": container with ID starting with 4c51e1be2650be18e92a615db7c8e4473b4741211363803ff085160c733c5659 not found: ID does not exist" containerID="4c51e1be2650be18e92a615db7c8e4473b4741211363803ff085160c733c5659"
Sep 11 11:52:22.632467 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:22.632408    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c51e1be2650be18e92a615db7c8e4473b4741211363803ff085160c733c5659"} err="failed to get container status \"4c51e1be2650be18e92a615db7c8e4473b4741211363803ff085160c733c5659\": rpc error: code = NotFound desc = could not find container \"4c51e1be2650be18e92a615db7c8e4473b4741211363803ff085160c733c5659\": container with ID starting with 4c51e1be2650be18e92a615db7c8e4473b4741211363803ff085160c733c5659 not found: ID does not exist"
Sep 11 11:52:22.646030 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:22.646004    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-4503d2-openshift-default-769c747cb-5f76k"]
Sep 11 11:52:22.648748 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:22.648723    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-4503d2-openshift-default-769c747cb-5f76k"]
Sep 11 11:52:23.813827 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:23.813791    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f70de565-a6b9-4cfa-9687-7df54fda1f61" path="/var/lib/kubelet/pods/f70de565-a6b9-4cfa-9687-7df54fda1f61/volumes"
Sep 11 11:52:24.409526 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:24.409491    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-dbe0e7-t6pwk"]
Sep 11 11:52:24.409858 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:24.409845    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f70de565-a6b9-4cfa-9687-7df54fda1f61" containerName="istio-proxy"
Sep 11 11:52:24.409858 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:24.409860    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f70de565-a6b9-4cfa-9687-7df54fda1f61" containerName="istio-proxy"
Sep 11 11:52:24.409962 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:24.409944    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f70de565-a6b9-4cfa-9687-7df54fda1f61" containerName="istio-proxy"
Sep 11 11:52:24.414291 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:24.414271    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-dbe0e7-t6pwk"
Sep 11 11:52:24.418021 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:24.418001    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 11:52:24.418129 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:24.418046    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f46tj\""
Sep 11 11:52:24.421898 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:24.421870    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-dbe0e7-t6pwk"]
Sep 11 11:52:24.517316 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:24.517284    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfcd0f9d-1d02-4934-8713-6bbfc4cbe128-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-dbe0e7-t6pwk\" (UID: \"dfcd0f9d-1d02-4934-8713-6bbfc4cbe128\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-dbe0e7-t6pwk"
Sep 11 11:52:24.617922 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:24.617886    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfcd0f9d-1d02-4934-8713-6bbfc4cbe128-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-dbe0e7-t6pwk\" (UID: \"dfcd0f9d-1d02-4934-8713-6bbfc4cbe128\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-dbe0e7-t6pwk"
Sep 11 11:52:24.618503 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:24.618482    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfcd0f9d-1d02-4934-8713-6bbfc4cbe128-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-dbe0e7-t6pwk\" (UID: \"dfcd0f9d-1d02-4934-8713-6bbfc4cbe128\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-dbe0e7-t6pwk"
Sep 11 11:52:24.726206 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:24.726172    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-dbe0e7-t6pwk"
Sep 11 11:52:24.996583 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:24.996512    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-dbe0e7-t6pwk"]
Sep 11 11:52:24.999704 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:52:24.999675    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfcd0f9d_1d02_4934_8713_6bbfc4cbe128.slice/crio-b9b07fd2c63b5868cb03b03cd0aa6de5323d7fcc85c12799699989f02a206b1c WatchSource:0}: Error finding container b9b07fd2c63b5868cb03b03cd0aa6de5323d7fcc85c12799699989f02a206b1c: Status 404 returned error can't find the container with id b9b07fd2c63b5868cb03b03cd0aa6de5323d7fcc85c12799699989f02a206b1c
Sep 11 11:52:25.641581 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:25.641486    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-dbe0e7-t6pwk" event={"ID":"dfcd0f9d-1d02-4934-8713-6bbfc4cbe128","Type":"ContainerStarted","Data":"7cde8d621a6be61f0b1b4e69f11faad3c09c34543ce4a2891a8c35544c9510e3"}
Sep 11 11:52:25.641581 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:25.641544    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-dbe0e7-t6pwk" event={"ID":"dfcd0f9d-1d02-4934-8713-6bbfc4cbe128","Type":"ContainerStarted","Data":"b9b07fd2c63b5868cb03b03cd0aa6de5323d7fcc85c12799699989f02a206b1c"}
Sep 11 11:52:25.657810 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:25.657766    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-dbe0e7-t6pwk" podStartSLOduration=1.657752265 podStartE2EDuration="1.657752265s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:52:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:52:25.656119272 +0000 UTC m=+1096.478579176" watchObservedRunningTime="2026-09-11 11:52:25.657752265 +0000 UTC m=+1096.480212137"
Sep 11 11:52:26.649248 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:26.649213    2560 generic.go:356] "Generic (PLEG): container finished" podID="dfcd0f9d-1d02-4934-8713-6bbfc4cbe128" containerID="7cde8d621a6be61f0b1b4e69f11faad3c09c34543ce4a2891a8c35544c9510e3" exitCode=0
Sep 11 11:52:26.649769 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:26.649277    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-dbe0e7-t6pwk" event={"ID":"dfcd0f9d-1d02-4934-8713-6bbfc4cbe128","Type":"ContainerDied","Data":"7cde8d621a6be61f0b1b4e69f11faad3c09c34543ce4a2891a8c35544c9510e3"}
Sep 11 11:52:27.776848 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:27.776821    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-dbe0e7-t6pwk"
Sep 11 11:52:27.844556 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:27.844525    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfcd0f9d-1d02-4934-8713-6bbfc4cbe128-maas-api-service-ca\") pod \"dfcd0f9d-1d02-4934-8713-6bbfc4cbe128\" (UID: \"dfcd0f9d-1d02-4934-8713-6bbfc4cbe128\") "
Sep 11 11:52:27.844988 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:27.844960    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dfcd0f9d-1d02-4934-8713-6bbfc4cbe128-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "dfcd0f9d-1d02-4934-8713-6bbfc4cbe128" (UID: "dfcd0f9d-1d02-4934-8713-6bbfc4cbe128"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 11:52:27.945693 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:27.945602    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfcd0f9d-1d02-4934-8713-6bbfc4cbe128-maas-api-service-ca\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:52:28.661440 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:28.661404    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-dbe0e7-t6pwk" event={"ID":"dfcd0f9d-1d02-4934-8713-6bbfc4cbe128","Type":"ContainerDied","Data":"b9b07fd2c63b5868cb03b03cd0aa6de5323d7fcc85c12799699989f02a206b1c"}
Sep 11 11:52:28.661440 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:28.661428    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-dbe0e7-t6pwk"
Sep 11 11:52:28.661713 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:28.661451    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b9b07fd2c63b5868cb03b03cd0aa6de5323d7fcc85c12799699989f02a206b1c"
Sep 11 11:52:29.773415 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:29.773381    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5745b581-jv87h"]
Sep 11 11:52:29.773826 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:29.773728    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfcd0f9d-1d02-4934-8713-6bbfc4cbe128" containerName="revoke-keys"
Sep 11 11:52:29.773826 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:29.773739    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfcd0f9d-1d02-4934-8713-6bbfc4cbe128" containerName="revoke-keys"
Sep 11 11:52:29.773826 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:29.773800    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfcd0f9d-1d02-4934-8713-6bbfc4cbe128" containerName="revoke-keys"
Sep 11 11:52:29.776834 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:29.776813    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5745b581-jv87h"
Sep 11 11:52:29.779105 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:29.779072    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 11:52:29.779225 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:29.779104    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f46tj\""
Sep 11 11:52:29.794305 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:29.794280    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5745b581-jv87h"]
Sep 11 11:52:29.865400 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:29.865370    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6fb9a031-e1c0-4c61-9cf6-d00e13cd1754-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-5745b581-jv87h\" (UID: \"6fb9a031-e1c0-4c61-9cf6-d00e13cd1754\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5745b581-jv87h"
Sep 11 11:52:29.965926 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:29.965895    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6fb9a031-e1c0-4c61-9cf6-d00e13cd1754-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-5745b581-jv87h\" (UID: \"6fb9a031-e1c0-4c61-9cf6-d00e13cd1754\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5745b581-jv87h"
Sep 11 11:52:29.966736 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:29.966715    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6fb9a031-e1c0-4c61-9cf6-d00e13cd1754-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-5745b581-jv87h\" (UID: \"6fb9a031-e1c0-4c61-9cf6-d00e13cd1754\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5745b581-jv87h"
Sep 11 11:52:30.088029 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:30.087947    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5745b581-jv87h"
Sep 11 11:52:30.360814 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:30.360788    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5745b581-jv87h"]
Sep 11 11:52:30.362911 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:52:30.362880    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fb9a031_e1c0_4c61_9cf6_d00e13cd1754.slice/crio-01153935804a7ed387b83c480680c14b42c8c4343c27ae8401db752e5570bdbf WatchSource:0}: Error finding container 01153935804a7ed387b83c480680c14b42c8c4343c27ae8401db752e5570bdbf: Status 404 returned error can't find the container with id 01153935804a7ed387b83c480680c14b42c8c4343c27ae8401db752e5570bdbf
Sep 11 11:52:30.671738 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:30.671708    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5745b581-jv87h" event={"ID":"6fb9a031-e1c0-4c61-9cf6-d00e13cd1754","Type":"ContainerStarted","Data":"aaa8674670f7c7c758b89541af5b1c13840751fab5cc85927ab831b7fd2e353f"}
Sep 11 11:52:30.671862 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:30.671771    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5745b581-jv87h" event={"ID":"6fb9a031-e1c0-4c61-9cf6-d00e13cd1754","Type":"ContainerStarted","Data":"01153935804a7ed387b83c480680c14b42c8c4343c27ae8401db752e5570bdbf"}
Sep 11 11:52:30.688105 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:30.688060    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5745b581-jv87h" podStartSLOduration=1.688045433 podStartE2EDuration="1.688045433s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:52:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:52:30.685987051 +0000 UTC m=+1101.508446946" watchObservedRunningTime="2026-09-11 11:52:30.688045433 +0000 UTC m=+1101.510505359"
Sep 11 11:52:31.678636 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:31.678598    2560 generic.go:356] "Generic (PLEG): container finished" podID="6fb9a031-e1c0-4c61-9cf6-d00e13cd1754" containerID="aaa8674670f7c7c758b89541af5b1c13840751fab5cc85927ab831b7fd2e353f" exitCode=0
Sep 11 11:52:31.679055 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:31.678689    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5745b581-jv87h" event={"ID":"6fb9a031-e1c0-4c61-9cf6-d00e13cd1754","Type":"ContainerDied","Data":"aaa8674670f7c7c758b89541af5b1c13840751fab5cc85927ab831b7fd2e353f"}
Sep 11 11:52:32.815344 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:32.815315    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5745b581-jv87h"
Sep 11 11:52:32.993843 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:32.993792    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6fb9a031-e1c0-4c61-9cf6-d00e13cd1754-maas-api-service-ca\") pod \"6fb9a031-e1c0-4c61-9cf6-d00e13cd1754\" (UID: \"6fb9a031-e1c0-4c61-9cf6-d00e13cd1754\") "
Sep 11 11:52:32.994208 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:32.994181    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fb9a031-e1c0-4c61-9cf6-d00e13cd1754-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6fb9a031-e1c0-4c61-9cf6-d00e13cd1754" (UID: "6fb9a031-e1c0-4c61-9cf6-d00e13cd1754"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 11:52:33.095132 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:33.095094    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6fb9a031-e1c0-4c61-9cf6-d00e13cd1754-maas-api-service-ca\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:52:33.689110 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:33.689079    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5745b581-jv87h"
Sep 11 11:52:33.689298 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:33.689082    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5745b581-jv87h" event={"ID":"6fb9a031-e1c0-4c61-9cf6-d00e13cd1754","Type":"ContainerDied","Data":"01153935804a7ed387b83c480680c14b42c8c4343c27ae8401db752e5570bdbf"}
Sep 11 11:52:33.689298 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:33.689209    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="01153935804a7ed387b83c480680c14b42c8c4343c27ae8401db752e5570bdbf"
Sep 11 11:52:35.301666 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:35.301611    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-dbe0e7-6fb4d6c78-pthvd"]
Sep 11 11:52:35.302071 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:35.301872    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-dbe0e7-6fb4d6c78-pthvd" podUID="070aa3b2-5f7c-43f2-bd0c-836f78060ca5" containerName="payload-pre-processing" containerID="cri-o://3be57d82bd2d2a9f104e4e882ecaf8db9fb1bf27c0c5ecb7b2befd2549df40d9" gracePeriod=30
Sep 11 11:52:35.481578 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:35.481547    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-dbe0e7-t6pwk"]
Sep 11 11:52:35.487178 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:35.487151    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-dbe0e7-t6pwk"]
Sep 11 11:52:35.566202 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:35.566131    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-dbe0e7-6fb4d6c78-pthvd"
Sep 11 11:52:35.701309 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:35.701273    2560 generic.go:356] "Generic (PLEG): container finished" podID="070aa3b2-5f7c-43f2-bd0c-836f78060ca5" containerID="3be57d82bd2d2a9f104e4e882ecaf8db9fb1bf27c0c5ecb7b2befd2549df40d9" exitCode=0
Sep 11 11:52:35.701456 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:35.701322    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-dbe0e7-6fb4d6c78-pthvd"
Sep 11 11:52:35.701456 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:35.701334    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-dbe0e7-6fb4d6c78-pthvd" event={"ID":"070aa3b2-5f7c-43f2-bd0c-836f78060ca5","Type":"ContainerDied","Data":"3be57d82bd2d2a9f104e4e882ecaf8db9fb1bf27c0c5ecb7b2befd2549df40d9"}
Sep 11 11:52:35.701456 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:35.701376    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-dbe0e7-6fb4d6c78-pthvd" event={"ID":"070aa3b2-5f7c-43f2-bd0c-836f78060ca5","Type":"ContainerDied","Data":"36c5b2f1e884c5dc32a945838e1052c3f5f9218dc975edbed05e26542858e954"}
Sep 11 11:52:35.701456 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:35.701399    2560 scope.go:117] "RemoveContainer" containerID="3be57d82bd2d2a9f104e4e882ecaf8db9fb1bf27c0c5ecb7b2befd2549df40d9"
Sep 11 11:52:35.709780 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:35.709761    2560 scope.go:117] "RemoveContainer" containerID="3be57d82bd2d2a9f104e4e882ecaf8db9fb1bf27c0c5ecb7b2befd2549df40d9"
Sep 11 11:52:35.710058 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:52:35.710040    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3be57d82bd2d2a9f104e4e882ecaf8db9fb1bf27c0c5ecb7b2befd2549df40d9\": container with ID starting with 3be57d82bd2d2a9f104e4e882ecaf8db9fb1bf27c0c5ecb7b2befd2549df40d9 not found: ID does not exist" containerID="3be57d82bd2d2a9f104e4e882ecaf8db9fb1bf27c0c5ecb7b2befd2549df40d9"
Sep 11 11:52:35.710119 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:35.710068    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3be57d82bd2d2a9f104e4e882ecaf8db9fb1bf27c0c5ecb7b2befd2549df40d9"} err="failed to get container status \"3be57d82bd2d2a9f104e4e882ecaf8db9fb1bf27c0c5ecb7b2befd2549df40d9\": rpc error: code = NotFound desc = could not find container \"3be57d82bd2d2a9f104e4e882ecaf8db9fb1bf27c0c5ecb7b2befd2549df40d9\": container with ID starting with 3be57d82bd2d2a9f104e4e882ecaf8db9fb1bf27c0c5ecb7b2befd2549df40d9 not found: ID does not exist"
Sep 11 11:52:35.718848 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:35.718830    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvfgc\" (UniqueName: \"kubernetes.io/projected/070aa3b2-5f7c-43f2-bd0c-836f78060ca5-kube-api-access-cvfgc\") pod \"070aa3b2-5f7c-43f2-bd0c-836f78060ca5\" (UID: \"070aa3b2-5f7c-43f2-bd0c-836f78060ca5\") "
Sep 11 11:52:35.718932 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:35.718919    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/070aa3b2-5f7c-43f2-bd0c-836f78060ca5-plugins-config-volume\") pod \"070aa3b2-5f7c-43f2-bd0c-836f78060ca5\" (UID: \"070aa3b2-5f7c-43f2-bd0c-836f78060ca5\") "
Sep 11 11:52:35.719260 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:35.719237    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/070aa3b2-5f7c-43f2-bd0c-836f78060ca5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "070aa3b2-5f7c-43f2-bd0c-836f78060ca5" (UID: "070aa3b2-5f7c-43f2-bd0c-836f78060ca5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 11:52:35.720604 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:35.720586    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/070aa3b2-5f7c-43f2-bd0c-836f78060ca5-kube-api-access-cvfgc" (OuterVolumeSpecName: "kube-api-access-cvfgc") pod "070aa3b2-5f7c-43f2-bd0c-836f78060ca5" (UID: "070aa3b2-5f7c-43f2-bd0c-836f78060ca5"). InnerVolumeSpecName "kube-api-access-cvfgc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:52:35.813561 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:35.813528    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfcd0f9d-1d02-4934-8713-6bbfc4cbe128" path="/var/lib/kubelet/pods/dfcd0f9d-1d02-4934-8713-6bbfc4cbe128/volumes"
Sep 11 11:52:35.819574 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:35.819527    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvfgc\" (UniqueName: \"kubernetes.io/projected/070aa3b2-5f7c-43f2-bd0c-836f78060ca5-kube-api-access-cvfgc\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:52:35.819574 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:35.819549    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/070aa3b2-5f7c-43f2-bd0c-836f78060ca5-plugins-config-volume\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:52:36.017052 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:36.017020    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-dbe0e7-6fb4d6c78-pthvd"]
Sep 11 11:52:36.021681 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:36.021659    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-dbe0e7-6fb4d6c78-pthvd"]
Sep 11 11:52:37.814046 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:37.814012    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="070aa3b2-5f7c-43f2-bd0c-836f78060ca5" path="/var/lib/kubelet/pods/070aa3b2-5f7c-43f2-bd0c-836f78060ca5/volumes"
Sep 11 11:52:40.738107 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:40.738078    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-5745b581-7bbfd7b95c-mvvl2"]
Sep 11 11:52:40.738508 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:40.738262    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-5745b581-7bbfd7b95c-mvvl2" podUID="dcb8922d-a417-44d7-a374-7e9056cd669b" containerName="payload-processing" containerID="cri-o://d51246b8a024de429c520e854bf73f0586bce26562daaaa1eb26a534777888f4" gracePeriod=30
Sep 11 11:52:40.744202 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:40.744175    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-5745b581-7c7d5cdf94-prfdw"]
Sep 11 11:52:40.744425 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:40.744375    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-5745b581-7c7d5cdf94-prfdw" podUID="3363afee-86ab-420d-86f4-fbc70e9c0941" containerName="payload-pre-processing" containerID="cri-o://c46de073ca33910da6b3d71a166e66be9a35da44869c77f6ac75a292dddcde63" gracePeriod=30
Sep 11 11:52:41.015064 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:41.015034    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5745b581-jv87h"]
Sep 11 11:52:41.020917 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:41.020895    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5745b581-jv87h"]
Sep 11 11:52:41.021564 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:41.021548    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-5745b581-7c7d5cdf94-prfdw"
Sep 11 11:52:41.024907 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:41.024889    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-5745b581-7bbfd7b95c-mvvl2"
Sep 11 11:52:41.067940 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:41.067908    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-plvlr\" (UniqueName: \"kubernetes.io/projected/dcb8922d-a417-44d7-a374-7e9056cd669b-kube-api-access-plvlr\") pod \"dcb8922d-a417-44d7-a374-7e9056cd669b\" (UID: \"dcb8922d-a417-44d7-a374-7e9056cd669b\") "
Sep 11 11:52:41.068121 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:41.067955    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3363afee-86ab-420d-86f4-fbc70e9c0941-plugins-config-volume\") pod \"3363afee-86ab-420d-86f4-fbc70e9c0941\" (UID: \"3363afee-86ab-420d-86f4-fbc70e9c0941\") "
Sep 11 11:52:41.068121 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:41.068081    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dcb8922d-a417-44d7-a374-7e9056cd669b-plugins-config-volume\") pod \"dcb8922d-a417-44d7-a374-7e9056cd669b\" (UID: \"dcb8922d-a417-44d7-a374-7e9056cd669b\") "
Sep 11 11:52:41.068121 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:41.068117    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kz9nk\" (UniqueName: \"kubernetes.io/projected/3363afee-86ab-420d-86f4-fbc70e9c0941-kube-api-access-kz9nk\") pod \"3363afee-86ab-420d-86f4-fbc70e9c0941\" (UID: \"3363afee-86ab-420d-86f4-fbc70e9c0941\") "
Sep 11 11:52:41.068381 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:41.068356    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3363afee-86ab-420d-86f4-fbc70e9c0941-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3363afee-86ab-420d-86f4-fbc70e9c0941" (UID: "3363afee-86ab-420d-86f4-fbc70e9c0941"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 11:52:41.068453 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:41.068433    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcb8922d-a417-44d7-a374-7e9056cd669b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "dcb8922d-a417-44d7-a374-7e9056cd669b" (UID: "dcb8922d-a417-44d7-a374-7e9056cd669b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 11:52:41.070249 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:41.070228    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcb8922d-a417-44d7-a374-7e9056cd669b-kube-api-access-plvlr" (OuterVolumeSpecName: "kube-api-access-plvlr") pod "dcb8922d-a417-44d7-a374-7e9056cd669b" (UID: "dcb8922d-a417-44d7-a374-7e9056cd669b"). InnerVolumeSpecName "kube-api-access-plvlr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:52:41.070366 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:41.070287    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3363afee-86ab-420d-86f4-fbc70e9c0941-kube-api-access-kz9nk" (OuterVolumeSpecName: "kube-api-access-kz9nk") pod "3363afee-86ab-420d-86f4-fbc70e9c0941" (UID: "3363afee-86ab-420d-86f4-fbc70e9c0941"). InnerVolumeSpecName "kube-api-access-kz9nk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:52:41.168779 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:41.168748    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-plvlr\" (UniqueName: \"kubernetes.io/projected/dcb8922d-a417-44d7-a374-7e9056cd669b-kube-api-access-plvlr\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:52:41.168779 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:41.168776    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3363afee-86ab-420d-86f4-fbc70e9c0941-plugins-config-volume\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:52:41.168779 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:41.168786    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dcb8922d-a417-44d7-a374-7e9056cd669b-plugins-config-volume\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:52:41.169021 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:41.168794    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kz9nk\" (UniqueName: \"kubernetes.io/projected/3363afee-86ab-420d-86f4-fbc70e9c0941-kube-api-access-kz9nk\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:52:41.745358 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:41.745320    2560 generic.go:356] "Generic (PLEG): container finished" podID="3363afee-86ab-420d-86f4-fbc70e9c0941" containerID="c46de073ca33910da6b3d71a166e66be9a35da44869c77f6ac75a292dddcde63" exitCode=0
Sep 11 11:52:41.745855 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:41.745372    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-5745b581-7c7d5cdf94-prfdw"
Sep 11 11:52:41.745855 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:41.745407    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-5745b581-7c7d5cdf94-prfdw" event={"ID":"3363afee-86ab-420d-86f4-fbc70e9c0941","Type":"ContainerDied","Data":"c46de073ca33910da6b3d71a166e66be9a35da44869c77f6ac75a292dddcde63"}
Sep 11 11:52:41.745855 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:41.745478    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-5745b581-7c7d5cdf94-prfdw" event={"ID":"3363afee-86ab-420d-86f4-fbc70e9c0941","Type":"ContainerDied","Data":"7098a8b6d139ea8d369f30d48d3a6db72c0a05099f14d77f9138525fce7ec5cf"}
Sep 11 11:52:41.745855 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:41.745514    2560 scope.go:117] "RemoveContainer" containerID="c46de073ca33910da6b3d71a166e66be9a35da44869c77f6ac75a292dddcde63"
Sep 11 11:52:41.746922 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:41.746900    2560 generic.go:356] "Generic (PLEG): container finished" podID="dcb8922d-a417-44d7-a374-7e9056cd669b" containerID="d51246b8a024de429c520e854bf73f0586bce26562daaaa1eb26a534777888f4" exitCode=0
Sep 11 11:52:41.747001 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:41.746948    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-5745b581-7bbfd7b95c-mvvl2"
Sep 11 11:52:41.747001 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:41.746974    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-5745b581-7bbfd7b95c-mvvl2" event={"ID":"dcb8922d-a417-44d7-a374-7e9056cd669b","Type":"ContainerDied","Data":"d51246b8a024de429c520e854bf73f0586bce26562daaaa1eb26a534777888f4"}
Sep 11 11:52:41.747096 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:41.747014    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-5745b581-7bbfd7b95c-mvvl2" event={"ID":"dcb8922d-a417-44d7-a374-7e9056cd669b","Type":"ContainerDied","Data":"3e3d46652830e7964ea14053e1127e84d298bf3dd6d8a0d0e981d2d456418b1c"}
Sep 11 11:52:41.756948 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:41.756932    2560 scope.go:117] "RemoveContainer" containerID="c46de073ca33910da6b3d71a166e66be9a35da44869c77f6ac75a292dddcde63"
Sep 11 11:52:41.757236 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:52:41.757211    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c46de073ca33910da6b3d71a166e66be9a35da44869c77f6ac75a292dddcde63\": container with ID starting with c46de073ca33910da6b3d71a166e66be9a35da44869c77f6ac75a292dddcde63 not found: ID does not exist" containerID="c46de073ca33910da6b3d71a166e66be9a35da44869c77f6ac75a292dddcde63"
Sep 11 11:52:41.757334 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:41.757242    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c46de073ca33910da6b3d71a166e66be9a35da44869c77f6ac75a292dddcde63"} err="failed to get container status \"c46de073ca33910da6b3d71a166e66be9a35da44869c77f6ac75a292dddcde63\": rpc error: code = NotFound desc = could not find container \"c46de073ca33910da6b3d71a166e66be9a35da44869c77f6ac75a292dddcde63\": container with ID starting with c46de073ca33910da6b3d71a166e66be9a35da44869c77f6ac75a292dddcde63 not found: ID does not exist"
Sep 11 11:52:41.757334 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:41.757259    2560 scope.go:117] "RemoveContainer" containerID="d51246b8a024de429c520e854bf73f0586bce26562daaaa1eb26a534777888f4"
Sep 11 11:52:41.764899 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:41.764884    2560 scope.go:117] "RemoveContainer" containerID="d51246b8a024de429c520e854bf73f0586bce26562daaaa1eb26a534777888f4"
Sep 11 11:52:41.765129 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:52:41.765113    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d51246b8a024de429c520e854bf73f0586bce26562daaaa1eb26a534777888f4\": container with ID starting with d51246b8a024de429c520e854bf73f0586bce26562daaaa1eb26a534777888f4 not found: ID does not exist" containerID="d51246b8a024de429c520e854bf73f0586bce26562daaaa1eb26a534777888f4"
Sep 11 11:52:41.765180 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:41.765135    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d51246b8a024de429c520e854bf73f0586bce26562daaaa1eb26a534777888f4"} err="failed to get container status \"d51246b8a024de429c520e854bf73f0586bce26562daaaa1eb26a534777888f4\": rpc error: code = NotFound desc = could not find container \"d51246b8a024de429c520e854bf73f0586bce26562daaaa1eb26a534777888f4\": container with ID starting with d51246b8a024de429c520e854bf73f0586bce26562daaaa1eb26a534777888f4 not found: ID does not exist"
Sep 11 11:52:41.772967 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:41.772916    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-5745b581-7c7d5cdf94-prfdw"]
Sep 11 11:52:41.775758 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:41.775739    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-5745b581-7c7d5cdf94-prfdw"]
Sep 11 11:52:41.788522 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:41.788500    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-5745b581-7bbfd7b95c-mvvl2"]
Sep 11 11:52:41.797012 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:41.796991    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-5745b581-7bbfd7b95c-mvvl2"]
Sep 11 11:52:41.817569 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:41.813910    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3363afee-86ab-420d-86f4-fbc70e9c0941" path="/var/lib/kubelet/pods/3363afee-86ab-420d-86f4-fbc70e9c0941/volumes"
Sep 11 11:52:41.817569 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:41.814408    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fb9a031-e1c0-4c61-9cf6-d00e13cd1754" path="/var/lib/kubelet/pods/6fb9a031-e1c0-4c61-9cf6-d00e13cd1754/volumes"
Sep 11 11:52:41.817569 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:41.814918    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcb8922d-a417-44d7-a374-7e9056cd669b" path="/var/lib/kubelet/pods/dcb8922d-a417-44d7-a374-7e9056cd669b/volumes"
Sep 11 11:52:44.016990 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:44.016958    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c6bcf5-h4l26"]
Sep 11 11:52:44.017353 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:44.017275    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="070aa3b2-5f7c-43f2-bd0c-836f78060ca5" containerName="payload-pre-processing"
Sep 11 11:52:44.017353 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:44.017286    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="070aa3b2-5f7c-43f2-bd0c-836f78060ca5" containerName="payload-pre-processing"
Sep 11 11:52:44.017353 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:44.017293    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcb8922d-a417-44d7-a374-7e9056cd669b" containerName="payload-processing"
Sep 11 11:52:44.017353 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:44.017299    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcb8922d-a417-44d7-a374-7e9056cd669b" containerName="payload-processing"
Sep 11 11:52:44.017353 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:44.017310    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3363afee-86ab-420d-86f4-fbc70e9c0941" containerName="payload-pre-processing"
Sep 11 11:52:44.017353 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:44.017316    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3363afee-86ab-420d-86f4-fbc70e9c0941" containerName="payload-pre-processing"
Sep 11 11:52:44.017353 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:44.017322    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fb9a031-e1c0-4c61-9cf6-d00e13cd1754" containerName="revoke-keys"
Sep 11 11:52:44.017353 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:44.017327    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fb9a031-e1c0-4c61-9cf6-d00e13cd1754" containerName="revoke-keys"
Sep 11 11:52:44.017608 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:44.017391    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="dcb8922d-a417-44d7-a374-7e9056cd669b" containerName="payload-processing"
Sep 11 11:52:44.017608 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:44.017402    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fb9a031-e1c0-4c61-9cf6-d00e13cd1754" containerName="revoke-keys"
Sep 11 11:52:44.017608 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:44.017409    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3363afee-86ab-420d-86f4-fbc70e9c0941" containerName="payload-pre-processing"
Sep 11 11:52:44.017608 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:44.017415    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="070aa3b2-5f7c-43f2-bd0c-836f78060ca5" containerName="payload-pre-processing"
Sep 11 11:52:44.021739 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:44.021720    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c6bcf5-h4l26"
Sep 11 11:52:44.024354 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:44.024332    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f46tj\""
Sep 11 11:52:44.024354 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:44.024349    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 11:52:44.030986 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:44.030963    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c6bcf5-h4l26"]
Sep 11 11:52:44.085972 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:44.085939    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/69c6a2ec-ac64-498d-80f4-099f6e1593aa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-c6bcf5-h4l26\" (UID: \"69c6a2ec-ac64-498d-80f4-099f6e1593aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c6bcf5-h4l26"
Sep 11 11:52:44.186908 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:44.186867    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/69c6a2ec-ac64-498d-80f4-099f6e1593aa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-c6bcf5-h4l26\" (UID: \"69c6a2ec-ac64-498d-80f4-099f6e1593aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c6bcf5-h4l26"
Sep 11 11:52:44.187504 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:44.187477    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/69c6a2ec-ac64-498d-80f4-099f6e1593aa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-c6bcf5-h4l26\" (UID: \"69c6a2ec-ac64-498d-80f4-099f6e1593aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c6bcf5-h4l26"
Sep 11 11:52:44.332099 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:44.332018    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c6bcf5-h4l26"
Sep 11 11:52:44.607005 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:44.606935    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c6bcf5-h4l26"]
Sep 11 11:52:44.609747 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:52:44.609711    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69c6a2ec_ac64_498d_80f4_099f6e1593aa.slice/crio-df80639d8e7ad53a339a57814f519f559d7e6e77d45a073d7a20fe024c197ac3 WatchSource:0}: Error finding container df80639d8e7ad53a339a57814f519f559d7e6e77d45a073d7a20fe024c197ac3: Status 404 returned error can't find the container with id df80639d8e7ad53a339a57814f519f559d7e6e77d45a073d7a20fe024c197ac3
Sep 11 11:52:44.768435 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:44.768399    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c6bcf5-h4l26" event={"ID":"69c6a2ec-ac64-498d-80f4-099f6e1593aa","Type":"ContainerStarted","Data":"df80639d8e7ad53a339a57814f519f559d7e6e77d45a073d7a20fe024c197ac3"}
Sep 11 11:52:45.775158 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:45.775122    2560 generic.go:356] "Generic (PLEG): container finished" podID="69c6a2ec-ac64-498d-80f4-099f6e1593aa" containerID="697c10b0bed79ae5350e83121b3907bb7688d283392fd1d436629b7b87068dba" exitCode=0
Sep 11 11:52:45.775521 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:45.775205    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c6bcf5-h4l26" event={"ID":"69c6a2ec-ac64-498d-80f4-099f6e1593aa","Type":"ContainerDied","Data":"697c10b0bed79ae5350e83121b3907bb7688d283392fd1d436629b7b87068dba"}
Sep 11 11:52:46.911747 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:46.911722    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c6bcf5-h4l26"
Sep 11 11:52:47.013275 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:47.013243    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/69c6a2ec-ac64-498d-80f4-099f6e1593aa-maas-api-service-ca\") pod \"69c6a2ec-ac64-498d-80f4-099f6e1593aa\" (UID: \"69c6a2ec-ac64-498d-80f4-099f6e1593aa\") "
Sep 11 11:52:47.013607 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:47.013584    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69c6a2ec-ac64-498d-80f4-099f6e1593aa-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "69c6a2ec-ac64-498d-80f4-099f6e1593aa" (UID: "69c6a2ec-ac64-498d-80f4-099f6e1593aa"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 11:52:47.113929 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:47.113852    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/69c6a2ec-ac64-498d-80f4-099f6e1593aa-maas-api-service-ca\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:52:47.612954 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:47.612921    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w"]
Sep 11 11:52:47.613212 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:47.613187    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w" podUID="8604a408-5e18-4650-9bfd-7e715d8e1819" containerName="istio-proxy" containerID="cri-o://7a77cc94f5b495018b94dc781fd9928f971ee43d7637e1553412d2f509e27fe5" gracePeriod=30
Sep 11 11:52:47.787200 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:47.787172    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c6bcf5-h4l26"
Sep 11 11:52:47.787356 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:47.787213    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c6bcf5-h4l26" event={"ID":"69c6a2ec-ac64-498d-80f4-099f6e1593aa","Type":"ContainerDied","Data":"df80639d8e7ad53a339a57814f519f559d7e6e77d45a073d7a20fe024c197ac3"}
Sep 11 11:52:47.787356 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:47.787259    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="df80639d8e7ad53a339a57814f519f559d7e6e77d45a073d7a20fe024c197ac3"
Sep 11 11:52:50.362237 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:50.362197    2560 patch_prober.go:28] interesting pod/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 11:52:50.362674 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:50.362253    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w" podUID="8604a408-5e18-4650-9bfd-7e715d8e1819" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 11:52:52.815241 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:52.815211    2560 generic.go:356] "Generic (PLEG): container finished" podID="8604a408-5e18-4650-9bfd-7e715d8e1819" containerID="7a77cc94f5b495018b94dc781fd9928f971ee43d7637e1553412d2f509e27fe5" exitCode=0
Sep 11 11:52:52.815582 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:52.815259    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w" event={"ID":"8604a408-5e18-4650-9bfd-7e715d8e1819","Type":"ContainerDied","Data":"7a77cc94f5b495018b94dc781fd9928f971ee43d7637e1553412d2f509e27fe5"}
Sep 11 11:52:52.815582 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:52.815310    2560 scope.go:117] "RemoveContainer" containerID="60fd29c50821d4f00458e8710bc76576af596232c5e25e93a05c8045b89f75ac"
Sep 11 11:52:52.855285 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:52.855262    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w"
Sep 11 11:52:52.965948 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:52.965917    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8604a408-5e18-4650-9bfd-7e715d8e1819-istio-token\") pod \"8604a408-5e18-4650-9bfd-7e715d8e1819\" (UID: \"8604a408-5e18-4650-9bfd-7e715d8e1819\") "
Sep 11 11:52:52.966115 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:52.965966    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8604a408-5e18-4650-9bfd-7e715d8e1819-workload-socket\") pod \"8604a408-5e18-4650-9bfd-7e715d8e1819\" (UID: \"8604a408-5e18-4650-9bfd-7e715d8e1819\") "
Sep 11 11:52:52.966115 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:52.965990    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8604a408-5e18-4650-9bfd-7e715d8e1819-istio-envoy\") pod \"8604a408-5e18-4650-9bfd-7e715d8e1819\" (UID: \"8604a408-5e18-4650-9bfd-7e715d8e1819\") "
Sep 11 11:52:52.966115 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:52.966036    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8604a408-5e18-4650-9bfd-7e715d8e1819-istio-data\") pod \"8604a408-5e18-4650-9bfd-7e715d8e1819\" (UID: \"8604a408-5e18-4650-9bfd-7e715d8e1819\") "
Sep 11 11:52:52.966115 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:52.966068    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8604a408-5e18-4650-9bfd-7e715d8e1819-workload-certs\") pod \"8604a408-5e18-4650-9bfd-7e715d8e1819\" (UID: \"8604a408-5e18-4650-9bfd-7e715d8e1819\") "
Sep 11 11:52:52.966115 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:52.966104    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8604a408-5e18-4650-9bfd-7e715d8e1819-istio-podinfo\") pod \"8604a408-5e18-4650-9bfd-7e715d8e1819\" (UID: \"8604a408-5e18-4650-9bfd-7e715d8e1819\") "
Sep 11 11:52:52.966386 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:52.966158    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8604a408-5e18-4650-9bfd-7e715d8e1819-istiod-ca-cert\") pod \"8604a408-5e18-4650-9bfd-7e715d8e1819\" (UID: \"8604a408-5e18-4650-9bfd-7e715d8e1819\") "
Sep 11 11:52:52.966386 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:52.966195    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8604a408-5e18-4650-9bfd-7e715d8e1819-credential-socket\") pod \"8604a408-5e18-4650-9bfd-7e715d8e1819\" (UID: \"8604a408-5e18-4650-9bfd-7e715d8e1819\") "
Sep 11 11:52:52.966386 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:52.966236    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrc5b\" (UniqueName: \"kubernetes.io/projected/8604a408-5e18-4650-9bfd-7e715d8e1819-kube-api-access-zrc5b\") pod \"8604a408-5e18-4650-9bfd-7e715d8e1819\" (UID: \"8604a408-5e18-4650-9bfd-7e715d8e1819\") "
Sep 11 11:52:52.966386 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:52.966264    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8604a408-5e18-4650-9bfd-7e715d8e1819-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8604a408-5e18-4650-9bfd-7e715d8e1819" (UID: "8604a408-5e18-4650-9bfd-7e715d8e1819"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:52:52.966386 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:52.966354    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8604a408-5e18-4650-9bfd-7e715d8e1819-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8604a408-5e18-4650-9bfd-7e715d8e1819" (UID: "8604a408-5e18-4650-9bfd-7e715d8e1819"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:52:52.966642 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:52.966485    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8604a408-5e18-4650-9bfd-7e715d8e1819-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8604a408-5e18-4650-9bfd-7e715d8e1819" (UID: "8604a408-5e18-4650-9bfd-7e715d8e1819"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:52:52.966642 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:52.966539    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8604a408-5e18-4650-9bfd-7e715d8e1819-istio-data" (OuterVolumeSpecName: "istio-data") pod "8604a408-5e18-4650-9bfd-7e715d8e1819" (UID: "8604a408-5e18-4650-9bfd-7e715d8e1819"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:52:52.966642 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:52.966558    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8604a408-5e18-4650-9bfd-7e715d8e1819-workload-socket\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:52:52.966642 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:52.966577    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8604a408-5e18-4650-9bfd-7e715d8e1819-workload-certs\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:52:52.966642 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:52.966575    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8604a408-5e18-4650-9bfd-7e715d8e1819-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8604a408-5e18-4650-9bfd-7e715d8e1819" (UID: "8604a408-5e18-4650-9bfd-7e715d8e1819"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 11:52:52.968277 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:52.968256    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8604a408-5e18-4650-9bfd-7e715d8e1819-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8604a408-5e18-4650-9bfd-7e715d8e1819" (UID: "8604a408-5e18-4650-9bfd-7e715d8e1819"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:52:52.968363 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:52.968315    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8604a408-5e18-4650-9bfd-7e715d8e1819-kube-api-access-zrc5b" (OuterVolumeSpecName: "kube-api-access-zrc5b") pod "8604a408-5e18-4650-9bfd-7e715d8e1819" (UID: "8604a408-5e18-4650-9bfd-7e715d8e1819"). InnerVolumeSpecName "kube-api-access-zrc5b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:52:52.968524 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:52.968502    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8604a408-5e18-4650-9bfd-7e715d8e1819-istio-token" (OuterVolumeSpecName: "istio-token") pod "8604a408-5e18-4650-9bfd-7e715d8e1819" (UID: "8604a408-5e18-4650-9bfd-7e715d8e1819"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:52:52.968621 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:52.968500    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8604a408-5e18-4650-9bfd-7e715d8e1819-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8604a408-5e18-4650-9bfd-7e715d8e1819" (UID: "8604a408-5e18-4650-9bfd-7e715d8e1819"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 11:52:53.067468 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:53.067440    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8604a408-5e18-4650-9bfd-7e715d8e1819-istio-data\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:52:53.067468 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:53.067464    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8604a408-5e18-4650-9bfd-7e715d8e1819-istio-podinfo\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:52:53.067468 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:53.067473    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8604a408-5e18-4650-9bfd-7e715d8e1819-istiod-ca-cert\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:52:53.067700 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:53.067483    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8604a408-5e18-4650-9bfd-7e715d8e1819-credential-socket\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:52:53.067700 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:53.067492    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrc5b\" (UniqueName: \"kubernetes.io/projected/8604a408-5e18-4650-9bfd-7e715d8e1819-kube-api-access-zrc5b\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:52:53.067700 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:53.067502    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8604a408-5e18-4650-9bfd-7e715d8e1819-istio-token\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:52:53.067700 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:53.067511    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8604a408-5e18-4650-9bfd-7e715d8e1819-istio-envoy\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:52:53.821314 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:53.821278    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w" event={"ID":"8604a408-5e18-4650-9bfd-7e715d8e1819","Type":"ContainerDied","Data":"2365557ee03acae7a60baffb70d7c92eec6058789a111e3da56821d6eac13cb4"}
Sep 11 11:52:53.821314 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:53.821304    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w"
Sep 11 11:52:53.821830 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:53.821348    2560 scope.go:117] "RemoveContainer" containerID="7a77cc94f5b495018b94dc781fd9928f971ee43d7637e1553412d2f509e27fe5"
Sep 11 11:52:53.853331 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:53.853300    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w"]
Sep 11 11:52:53.862708 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:53.862685    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-5745b581-openshift-default-76846c4d84-bcb9w"]
Sep 11 11:52:54.904632 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:54.904599    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-c6bcf5-54fcb8ccbb-v2nr8"]
Sep 11 11:52:54.905013 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:54.904833    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c6bcf5-54fcb8ccbb-v2nr8" podUID="5b4a6ccc-31af-4331-86c4-d5ac54626ae3" containerName="payload-pre-processing" containerID="cri-o://8fa39ec3488f81085888c314a9f9810fdb1f11a52cbb5ef94a4a01a0b88d5725" gracePeriod=30
Sep 11 11:52:55.164792 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:55.164736    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c6bcf5-54fcb8ccbb-v2nr8"
Sep 11 11:52:55.233799 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:55.233757    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c6bcf5-h4l26"]
Sep 11 11:52:55.240574 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:55.240544    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c6bcf5-h4l26"]
Sep 11 11:52:55.286445 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:55.286416    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b4a6ccc-31af-4331-86c4-d5ac54626ae3-plugins-config-volume\") pod \"5b4a6ccc-31af-4331-86c4-d5ac54626ae3\" (UID: \"5b4a6ccc-31af-4331-86c4-d5ac54626ae3\") "
Sep 11 11:52:55.286592 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:55.286508    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ltgdf\" (UniqueName: \"kubernetes.io/projected/5b4a6ccc-31af-4331-86c4-d5ac54626ae3-kube-api-access-ltgdf\") pod \"5b4a6ccc-31af-4331-86c4-d5ac54626ae3\" (UID: \"5b4a6ccc-31af-4331-86c4-d5ac54626ae3\") "
Sep 11 11:52:55.286851 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:55.286827    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b4a6ccc-31af-4331-86c4-d5ac54626ae3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5b4a6ccc-31af-4331-86c4-d5ac54626ae3" (UID: "5b4a6ccc-31af-4331-86c4-d5ac54626ae3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 11:52:55.288493 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:55.288475    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b4a6ccc-31af-4331-86c4-d5ac54626ae3-kube-api-access-ltgdf" (OuterVolumeSpecName: "kube-api-access-ltgdf") pod "5b4a6ccc-31af-4331-86c4-d5ac54626ae3" (UID: "5b4a6ccc-31af-4331-86c4-d5ac54626ae3"). InnerVolumeSpecName "kube-api-access-ltgdf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:52:55.387419 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:55.387387    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b4a6ccc-31af-4331-86c4-d5ac54626ae3-plugins-config-volume\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:52:55.387419 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:55.387413    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ltgdf\" (UniqueName: \"kubernetes.io/projected/5b4a6ccc-31af-4331-86c4-d5ac54626ae3-kube-api-access-ltgdf\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:52:55.814342 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:55.814308    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69c6a2ec-ac64-498d-80f4-099f6e1593aa" path="/var/lib/kubelet/pods/69c6a2ec-ac64-498d-80f4-099f6e1593aa/volumes"
Sep 11 11:52:55.814727 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:55.814713    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8604a408-5e18-4650-9bfd-7e715d8e1819" path="/var/lib/kubelet/pods/8604a408-5e18-4650-9bfd-7e715d8e1819/volumes"
Sep 11 11:52:55.834220 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:55.834197    2560 generic.go:356] "Generic (PLEG): container finished" podID="5b4a6ccc-31af-4331-86c4-d5ac54626ae3" containerID="8fa39ec3488f81085888c314a9f9810fdb1f11a52cbb5ef94a4a01a0b88d5725" exitCode=0
Sep 11 11:52:55.834355 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:55.834237    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c6bcf5-54fcb8ccbb-v2nr8"
Sep 11 11:52:55.834355 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:55.834278    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c6bcf5-54fcb8ccbb-v2nr8" event={"ID":"5b4a6ccc-31af-4331-86c4-d5ac54626ae3","Type":"ContainerDied","Data":"8fa39ec3488f81085888c314a9f9810fdb1f11a52cbb5ef94a4a01a0b88d5725"}
Sep 11 11:52:55.834355 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:55.834330    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c6bcf5-54fcb8ccbb-v2nr8" event={"ID":"5b4a6ccc-31af-4331-86c4-d5ac54626ae3","Type":"ContainerDied","Data":"42326851beb78b87bc0a0cf82ac8eaebafde5a98c1059baa442a109b11e13c59"}
Sep 11 11:52:55.834516 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:55.834359    2560 scope.go:117] "RemoveContainer" containerID="8fa39ec3488f81085888c314a9f9810fdb1f11a52cbb5ef94a4a01a0b88d5725"
Sep 11 11:52:55.843013 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:55.842993    2560 scope.go:117] "RemoveContainer" containerID="8fa39ec3488f81085888c314a9f9810fdb1f11a52cbb5ef94a4a01a0b88d5725"
Sep 11 11:52:55.843273 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:52:55.843256    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8fa39ec3488f81085888c314a9f9810fdb1f11a52cbb5ef94a4a01a0b88d5725\": container with ID starting with 8fa39ec3488f81085888c314a9f9810fdb1f11a52cbb5ef94a4a01a0b88d5725 not found: ID does not exist" containerID="8fa39ec3488f81085888c314a9f9810fdb1f11a52cbb5ef94a4a01a0b88d5725"
Sep 11 11:52:55.843325 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:55.843285    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fa39ec3488f81085888c314a9f9810fdb1f11a52cbb5ef94a4a01a0b88d5725"} err="failed to get container status \"8fa39ec3488f81085888c314a9f9810fdb1f11a52cbb5ef94a4a01a0b88d5725\": rpc error: code = NotFound desc = could not find container \"8fa39ec3488f81085888c314a9f9810fdb1f11a52cbb5ef94a4a01a0b88d5725\": container with ID starting with 8fa39ec3488f81085888c314a9f9810fdb1f11a52cbb5ef94a4a01a0b88d5725 not found: ID does not exist"
Sep 11 11:52:55.855685 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:55.855642    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-c6bcf5-54fcb8ccbb-v2nr8"]
Sep 11 11:52:55.859221 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:55.859200    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-c6bcf5-54fcb8ccbb-v2nr8"]
Sep 11 11:52:57.813879 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:52:57.813844    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b4a6ccc-31af-4331-86c4-d5ac54626ae3" path="/var/lib/kubelet/pods/5b4a6ccc-31af-4331-86c4-d5ac54626ae3/volumes"
Sep 11 11:53:03.914048 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:03.914015    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd"]
Sep 11 11:53:03.914459 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:03.914444    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69c6a2ec-ac64-498d-80f4-099f6e1593aa" containerName="revoke-keys"
Sep 11 11:53:03.914498 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:03.914461    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="69c6a2ec-ac64-498d-80f4-099f6e1593aa" containerName="revoke-keys"
Sep 11 11:53:03.914498 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:03.914479    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b4a6ccc-31af-4331-86c4-d5ac54626ae3" containerName="payload-pre-processing"
Sep 11 11:53:03.914498 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:03.914488    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b4a6ccc-31af-4331-86c4-d5ac54626ae3" containerName="payload-pre-processing"
Sep 11 11:53:03.914611 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:03.914499    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8604a408-5e18-4650-9bfd-7e715d8e1819" containerName="istio-proxy"
Sep 11 11:53:03.914611 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:03.914508    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8604a408-5e18-4650-9bfd-7e715d8e1819" containerName="istio-proxy"
Sep 11 11:53:03.914611 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:03.914534    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8604a408-5e18-4650-9bfd-7e715d8e1819" containerName="istio-proxy"
Sep 11 11:53:03.914611 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:03.914542    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8604a408-5e18-4650-9bfd-7e715d8e1819" containerName="istio-proxy"
Sep 11 11:53:03.914760 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:03.914611    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="69c6a2ec-ac64-498d-80f4-099f6e1593aa" containerName="revoke-keys"
Sep 11 11:53:03.914760 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:03.914624    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="8604a408-5e18-4650-9bfd-7e715d8e1819" containerName="istio-proxy"
Sep 11 11:53:03.914760 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:03.914634    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b4a6ccc-31af-4331-86c4-d5ac54626ae3" containerName="payload-pre-processing"
Sep 11 11:53:03.919225 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:03.919204    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd"
Sep 11 11:53:03.922091 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:03.922072    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-272c5e-openshift-default-dockercfg-z4mj4\""
Sep 11 11:53:03.942299 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:03.942265    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd"]
Sep 11 11:53:04.059790 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:04.059746    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc32b842-3e83-4ac7-97c2-bf82cf7377b4-credential-socket\") pod \"e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd\" (UID: \"bc32b842-3e83-4ac7-97c2-bf82cf7377b4\") " pod="openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd"
Sep 11 11:53:04.059967 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:04.059805    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc32b842-3e83-4ac7-97c2-bf82cf7377b4-istio-podinfo\") pod \"e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd\" (UID: \"bc32b842-3e83-4ac7-97c2-bf82cf7377b4\") " pod="openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd"
Sep 11 11:53:04.059967 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:04.059850    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc32b842-3e83-4ac7-97c2-bf82cf7377b4-istio-envoy\") pod \"e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd\" (UID: \"bc32b842-3e83-4ac7-97c2-bf82cf7377b4\") " pod="openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd"
Sep 11 11:53:04.059967 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:04.059869    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc32b842-3e83-4ac7-97c2-bf82cf7377b4-istio-token\") pod \"e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd\" (UID: \"bc32b842-3e83-4ac7-97c2-bf82cf7377b4\") " pod="openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd"
Sep 11 11:53:04.059967 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:04.059927    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc32b842-3e83-4ac7-97c2-bf82cf7377b4-workload-certs\") pod \"e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd\" (UID: \"bc32b842-3e83-4ac7-97c2-bf82cf7377b4\") " pod="openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd"
Sep 11 11:53:04.060233 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:04.059982    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9gnt\" (UniqueName: \"kubernetes.io/projected/bc32b842-3e83-4ac7-97c2-bf82cf7377b4-kube-api-access-g9gnt\") pod \"e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd\" (UID: \"bc32b842-3e83-4ac7-97c2-bf82cf7377b4\") " pod="openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd"
Sep 11 11:53:04.060233 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:04.060013    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc32b842-3e83-4ac7-97c2-bf82cf7377b4-workload-socket\") pod \"e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd\" (UID: \"bc32b842-3e83-4ac7-97c2-bf82cf7377b4\") " pod="openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd"
Sep 11 11:53:04.060233 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:04.060081    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc32b842-3e83-4ac7-97c2-bf82cf7377b4-istio-data\") pod \"e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd\" (UID: \"bc32b842-3e83-4ac7-97c2-bf82cf7377b4\") " pod="openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd"
Sep 11 11:53:04.060233 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:04.060115    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc32b842-3e83-4ac7-97c2-bf82cf7377b4-istiod-ca-cert\") pod \"e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd\" (UID: \"bc32b842-3e83-4ac7-97c2-bf82cf7377b4\") " pod="openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd"
Sep 11 11:53:04.161048 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:04.161012    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc32b842-3e83-4ac7-97c2-bf82cf7377b4-credential-socket\") pod \"e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd\" (UID: \"bc32b842-3e83-4ac7-97c2-bf82cf7377b4\") " pod="openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd"
Sep 11 11:53:04.161048 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:04.161052    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc32b842-3e83-4ac7-97c2-bf82cf7377b4-istio-podinfo\") pod \"e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd\" (UID: \"bc32b842-3e83-4ac7-97c2-bf82cf7377b4\") " pod="openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd"
Sep 11 11:53:04.161307 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:04.161083    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc32b842-3e83-4ac7-97c2-bf82cf7377b4-istio-envoy\") pod \"e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd\" (UID: \"bc32b842-3e83-4ac7-97c2-bf82cf7377b4\") " pod="openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd"
Sep 11 11:53:04.161307 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:04.161099    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc32b842-3e83-4ac7-97c2-bf82cf7377b4-istio-token\") pod \"e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd\" (UID: \"bc32b842-3e83-4ac7-97c2-bf82cf7377b4\") " pod="openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd"
Sep 11 11:53:04.161307 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:04.161115    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc32b842-3e83-4ac7-97c2-bf82cf7377b4-workload-certs\") pod \"e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd\" (UID: \"bc32b842-3e83-4ac7-97c2-bf82cf7377b4\") " pod="openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd"
Sep 11 11:53:04.161307 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:04.161140    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9gnt\" (UniqueName: \"kubernetes.io/projected/bc32b842-3e83-4ac7-97c2-bf82cf7377b4-kube-api-access-g9gnt\") pod \"e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd\" (UID: \"bc32b842-3e83-4ac7-97c2-bf82cf7377b4\") " pod="openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd"
Sep 11 11:53:04.161307 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:04.161170    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc32b842-3e83-4ac7-97c2-bf82cf7377b4-workload-socket\") pod \"e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd\" (UID: \"bc32b842-3e83-4ac7-97c2-bf82cf7377b4\") " pod="openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd"
Sep 11 11:53:04.161307 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:04.161210    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc32b842-3e83-4ac7-97c2-bf82cf7377b4-istio-data\") pod \"e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd\" (UID: \"bc32b842-3e83-4ac7-97c2-bf82cf7377b4\") " pod="openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd"
Sep 11 11:53:04.161307 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:04.161252    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc32b842-3e83-4ac7-97c2-bf82cf7377b4-istiod-ca-cert\") pod \"e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd\" (UID: \"bc32b842-3e83-4ac7-97c2-bf82cf7377b4\") " pod="openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd"
Sep 11 11:53:04.161714 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:04.161595    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc32b842-3e83-4ac7-97c2-bf82cf7377b4-workload-certs\") pod \"e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd\" (UID: \"bc32b842-3e83-4ac7-97c2-bf82cf7377b4\") " pod="openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd"
Sep 11 11:53:04.161714 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:04.161629    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc32b842-3e83-4ac7-97c2-bf82cf7377b4-workload-socket\") pod \"e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd\" (UID: \"bc32b842-3e83-4ac7-97c2-bf82cf7377b4\") " pod="openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd"
Sep 11 11:53:04.161714 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:04.161688    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc32b842-3e83-4ac7-97c2-bf82cf7377b4-istio-data\") pod \"e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd\" (UID: \"bc32b842-3e83-4ac7-97c2-bf82cf7377b4\") " pod="openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd"
Sep 11 11:53:04.161843 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:04.161749    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc32b842-3e83-4ac7-97c2-bf82cf7377b4-credential-socket\") pod \"e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd\" (UID: \"bc32b842-3e83-4ac7-97c2-bf82cf7377b4\") " pod="openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd"
Sep 11 11:53:04.162112 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:04.162086    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc32b842-3e83-4ac7-97c2-bf82cf7377b4-istiod-ca-cert\") pod \"e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd\" (UID: \"bc32b842-3e83-4ac7-97c2-bf82cf7377b4\") " pod="openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd"
Sep 11 11:53:04.163549 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:04.163531    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc32b842-3e83-4ac7-97c2-bf82cf7377b4-istio-envoy\") pod \"e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd\" (UID: \"bc32b842-3e83-4ac7-97c2-bf82cf7377b4\") " pod="openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd"
Sep 11 11:53:04.163800 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:04.163780    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc32b842-3e83-4ac7-97c2-bf82cf7377b4-istio-podinfo\") pod \"e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd\" (UID: \"bc32b842-3e83-4ac7-97c2-bf82cf7377b4\") " pod="openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd"
Sep 11 11:53:04.184204 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:04.184141    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc32b842-3e83-4ac7-97c2-bf82cf7377b4-istio-token\") pod \"e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd\" (UID: \"bc32b842-3e83-4ac7-97c2-bf82cf7377b4\") " pod="openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd"
Sep 11 11:53:04.184371 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:04.184346    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9gnt\" (UniqueName: \"kubernetes.io/projected/bc32b842-3e83-4ac7-97c2-bf82cf7377b4-kube-api-access-g9gnt\") pod \"e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd\" (UID: \"bc32b842-3e83-4ac7-97c2-bf82cf7377b4\") " pod="openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd"
Sep 11 11:53:04.231342 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:04.231309    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd"
Sep 11 11:53:04.529281 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:04.529258    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd"]
Sep 11 11:53:04.531338 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:53:04.531307    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc32b842_3e83_4ac7_97c2_bf82cf7377b4.slice/crio-b39979e0c08a6335f3244f9327d17429ed73be6014c8258e7861dd3e0bffa14b WatchSource:0}: Error finding container b39979e0c08a6335f3244f9327d17429ed73be6014c8258e7861dd3e0bffa14b: Status 404 returned error can't find the container with id b39979e0c08a6335f3244f9327d17429ed73be6014c8258e7861dd3e0bffa14b
Sep 11 11:53:04.533444 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:04.533413    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:53:04.533508 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:04.533480    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:53:04.533546 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:04.533509    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:53:04.884611 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:04.884523    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd" event={"ID":"bc32b842-3e83-4ac7-97c2-bf82cf7377b4","Type":"ContainerStarted","Data":"e6946c0707702e1017ea0378932fd4b92745d5a902c9a2a40a35b27d47131701"}
Sep 11 11:53:04.884611 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:04.884583    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd" event={"ID":"bc32b842-3e83-4ac7-97c2-bf82cf7377b4","Type":"ContainerStarted","Data":"b39979e0c08a6335f3244f9327d17429ed73be6014c8258e7861dd3e0bffa14b"}
Sep 11 11:53:05.231731 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:05.231696    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd"
Sep 11 11:53:05.236601 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:05.236574    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd"
Sep 11 11:53:05.261769 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:05.261710    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd" podStartSLOduration=2.261694167 podStartE2EDuration="2.261694167s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:53:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:53:04.944935214 +0000 UTC m=+1135.767395105" watchObservedRunningTime="2026-09-11 11:53:05.261694167 +0000 UTC m=+1136.084154039"
Sep 11 11:53:05.814222 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:05.814194    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p"]
Sep 11 11:53:05.814546 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:05.814533    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="8604a408-5e18-4650-9bfd-7e715d8e1819" containerName="istio-proxy"
Sep 11 11:53:05.817535 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:05.817518    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p"
Sep 11 11:53:05.822478 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:05.822450    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-8989e8-openshift-default-dockercfg-7pnnh\""
Sep 11 11:53:05.863685 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:05.863643    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p"]
Sep 11 11:53:05.875833 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:05.875803    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1-istio-envoy\") pod \"e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p\" (UID: \"8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1\") " pod="openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p"
Sep 11 11:53:05.876000 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:05.875865    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1-workload-socket\") pod \"e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p\" (UID: \"8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1\") " pod="openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p"
Sep 11 11:53:05.876000 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:05.875921    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7mmk\" (UniqueName: \"kubernetes.io/projected/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1-kube-api-access-n7mmk\") pod \"e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p\" (UID: \"8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1\") " pod="openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p"
Sep 11 11:53:05.876000 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:05.875952    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1-workload-certs\") pod \"e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p\" (UID: \"8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1\") " pod="openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p"
Sep 11 11:53:05.876000 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:05.875969    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1-istiod-ca-cert\") pod \"e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p\" (UID: \"8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1\") " pod="openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p"
Sep 11 11:53:05.876000 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:05.875996    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1-istio-podinfo\") pod \"e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p\" (UID: \"8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1\") " pod="openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p"
Sep 11 11:53:05.876227 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:05.876071    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1-istio-token\") pod \"e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p\" (UID: \"8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1\") " pod="openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p"
Sep 11 11:53:05.876227 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:05.876116    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1-istio-data\") pod \"e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p\" (UID: \"8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1\") " pod="openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p"
Sep 11 11:53:05.876227 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:05.876136    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1-credential-socket\") pod \"e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p\" (UID: \"8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1\") " pod="openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p"
Sep 11 11:53:05.890477 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:05.890445    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd"
Sep 11 11:53:05.892084 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:05.892058    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd"
Sep 11 11:53:05.977153 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:05.977119    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1-istio-envoy\") pod \"e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p\" (UID: \"8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1\") " pod="openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p"
Sep 11 11:53:05.977323 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:05.977286    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1-workload-socket\") pod \"e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p\" (UID: \"8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1\") " pod="openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p"
Sep 11 11:53:05.977387 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:05.977324    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7mmk\" (UniqueName: \"kubernetes.io/projected/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1-kube-api-access-n7mmk\") pod \"e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p\" (UID: \"8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1\") " pod="openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p"
Sep 11 11:53:05.977387 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:05.977373    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1-workload-certs\") pod \"e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p\" (UID: \"8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1\") " pod="openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p"
Sep 11 11:53:05.977490 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:05.977400    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1-istiod-ca-cert\") pod \"e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p\" (UID: \"8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1\") " pod="openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p"
Sep 11 11:53:05.977490 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:05.977444    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1-istio-podinfo\") pod \"e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p\" (UID: \"8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1\") " pod="openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p"
Sep 11 11:53:05.977490 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:05.977484    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1-istio-token\") pod \"e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p\" (UID: \"8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1\") " pod="openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p"
Sep 11 11:53:05.977676 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:05.977542    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1-istio-data\") pod \"e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p\" (UID: \"8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1\") " pod="openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p"
Sep 11 11:53:05.977676 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:05.977572    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1-credential-socket\") pod \"e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p\" (UID: \"8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1\") " pod="openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p"
Sep 11 11:53:05.977798 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:05.977675    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1-workload-socket\") pod \"e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p\" (UID: \"8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1\") " pod="openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p"
Sep 11 11:53:05.980414 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:05.977896    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1-credential-socket\") pod \"e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p\" (UID: \"8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1\") " pod="openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p"
Sep 11 11:53:05.980414 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:05.978213    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1-istiod-ca-cert\") pod \"e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p\" (UID: \"8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1\") " pod="openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p"
Sep 11 11:53:05.980414 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:05.978231    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1-istio-data\") pod \"e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p\" (UID: \"8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1\") " pod="openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p"
Sep 11 11:53:05.980414 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:05.978322    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1-workload-certs\") pod \"e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p\" (UID: \"8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1\") " pod="openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p"
Sep 11 11:53:05.980414 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:05.980110    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1-istio-envoy\") pod \"e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p\" (UID: \"8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1\") " pod="openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p"
Sep 11 11:53:05.980825 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:05.980810    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1-istio-podinfo\") pod \"e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p\" (UID: \"8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1\") " pod="openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p"
Sep 11 11:53:05.991262 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:05.991215    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1-istio-token\") pod \"e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p\" (UID: \"8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1\") " pod="openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p"
Sep 11 11:53:05.991625 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:05.991607    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7mmk\" (UniqueName: \"kubernetes.io/projected/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1-kube-api-access-n7mmk\") pod \"e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p\" (UID: \"8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1\") " pod="openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p"
Sep 11 11:53:06.127978 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:06.127885    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p"
Sep 11 11:53:06.418698 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:06.418570    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p"]
Sep 11 11:53:06.421766 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:53:06.421732    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a9ac5e7_b1e9_4067_88b8_b8b031dd53c1.slice/crio-ec0af5d4eb37301c9985a74638d7df38b6c9fdd450a0b2dabb65957579c02369 WatchSource:0}: Error finding container ec0af5d4eb37301c9985a74638d7df38b6c9fdd450a0b2dabb65957579c02369: Status 404 returned error can't find the container with id ec0af5d4eb37301c9985a74638d7df38b6c9fdd450a0b2dabb65957579c02369
Sep 11 11:53:06.424259 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:06.424231    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:53:06.424355 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:06.424304    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:53:06.424355 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:06.424332    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:53:06.897110 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:06.897076    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p" event={"ID":"8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1","Type":"ContainerStarted","Data":"b02316daea35894ddf30baf8c4d9fbd3e635fc4f9ce1980f0eb5f1730afdb29e"}
Sep 11 11:53:06.897317 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:06.897125    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p" event={"ID":"8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1","Type":"ContainerStarted","Data":"ec0af5d4eb37301c9985a74638d7df38b6c9fdd450a0b2dabb65957579c02369"}
Sep 11 11:53:06.947875 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:06.946000    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p" podStartSLOduration=1.945981132 podStartE2EDuration="1.945981132s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:53:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:53:06.944017269 +0000 UTC m=+1137.766477143" watchObservedRunningTime="2026-09-11 11:53:06.945981132 +0000 UTC m=+1137.768441006"
Sep 11 11:53:07.129050 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:07.129021    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p"
Sep 11 11:53:07.133899 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:07.133870    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p"
Sep 11 11:53:07.902098 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:07.902068    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p"
Sep 11 11:53:07.902961 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:07.902942    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p"
Sep 11 11:53:11.907692 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:11.907658    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8989e8-b78fbfbb6-5lmqh"]
Sep 11 11:53:11.912700 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:11.912679    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8989e8-b78fbfbb6-5lmqh"
Sep 11 11:53:11.915523 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:11.915494    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-8989e8-dockercfg-vmcgk\""
Sep 11 11:53:11.917757 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:11.917732    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-8989e8\""
Sep 11 11:53:12.016934 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:12.016899    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8989e8-b78fbfbb6-5lmqh"]
Sep 11 11:53:12.033710 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:12.033673    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd8dbbbb-c2fb-4f86-82c4-286bd0635afe-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-8989e8-b78fbfbb6-5lmqh\" (UID: \"dd8dbbbb-c2fb-4f86-82c4-286bd0635afe\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8989e8-b78fbfbb6-5lmqh"
Sep 11 11:53:12.033881 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:12.033769    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg4rn\" (UniqueName: \"kubernetes.io/projected/dd8dbbbb-c2fb-4f86-82c4-286bd0635afe-kube-api-access-pg4rn\") pod \"payload-pre-processing-e2e-shared-a-w2-8989e8-b78fbfbb6-5lmqh\" (UID: \"dd8dbbbb-c2fb-4f86-82c4-286bd0635afe\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8989e8-b78fbfbb6-5lmqh"
Sep 11 11:53:12.134607 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:12.134565    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd8dbbbb-c2fb-4f86-82c4-286bd0635afe-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-8989e8-b78fbfbb6-5lmqh\" (UID: \"dd8dbbbb-c2fb-4f86-82c4-286bd0635afe\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8989e8-b78fbfbb6-5lmqh"
Sep 11 11:53:12.134814 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:12.134631    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg4rn\" (UniqueName: \"kubernetes.io/projected/dd8dbbbb-c2fb-4f86-82c4-286bd0635afe-kube-api-access-pg4rn\") pod \"payload-pre-processing-e2e-shared-a-w2-8989e8-b78fbfbb6-5lmqh\" (UID: \"dd8dbbbb-c2fb-4f86-82c4-286bd0635afe\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8989e8-b78fbfbb6-5lmqh"
Sep 11 11:53:12.135298 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:12.135279    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd8dbbbb-c2fb-4f86-82c4-286bd0635afe-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-8989e8-b78fbfbb6-5lmqh\" (UID: \"dd8dbbbb-c2fb-4f86-82c4-286bd0635afe\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8989e8-b78fbfbb6-5lmqh"
Sep 11 11:53:12.147605 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:12.147576    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg4rn\" (UniqueName: \"kubernetes.io/projected/dd8dbbbb-c2fb-4f86-82c4-286bd0635afe-kube-api-access-pg4rn\") pod \"payload-pre-processing-e2e-shared-a-w2-8989e8-b78fbfbb6-5lmqh\" (UID: \"dd8dbbbb-c2fb-4f86-82c4-286bd0635afe\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8989e8-b78fbfbb6-5lmqh"
Sep 11 11:53:12.223496 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:12.223466    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8989e8-b78fbfbb6-5lmqh"
Sep 11 11:53:12.543093 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:12.542703    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8989e8-b78fbfbb6-5lmqh"]
Sep 11 11:53:12.545960 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:53:12.545934    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd8dbbbb_c2fb_4f86_82c4_286bd0635afe.slice/crio-d0a68e1e59af0a5260860a3072ae5a2d21b9e1d9fe0d30b6b0537d52a80a2239 WatchSource:0}: Error finding container d0a68e1e59af0a5260860a3072ae5a2d21b9e1d9fe0d30b6b0537d52a80a2239: Status 404 returned error can't find the container with id d0a68e1e59af0a5260860a3072ae5a2d21b9e1d9fe0d30b6b0537d52a80a2239
Sep 11 11:53:12.928209 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:12.928107    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8989e8-b78fbfbb6-5lmqh" event={"ID":"dd8dbbbb-c2fb-4f86-82c4-286bd0635afe","Type":"ContainerStarted","Data":"c383c7711cb00db270b72c49abe484c75dd270d0fec9644bf9bab8bafdd87df4"}
Sep 11 11:53:12.928209 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:12.928167    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8989e8-b78fbfbb6-5lmqh" event={"ID":"dd8dbbbb-c2fb-4f86-82c4-286bd0635afe","Type":"ContainerStarted","Data":"d0a68e1e59af0a5260860a3072ae5a2d21b9e1d9fe0d30b6b0537d52a80a2239"}
Sep 11 11:53:12.928209 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:12.928195    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8989e8-b78fbfbb6-5lmqh"
Sep 11 11:53:21.931864 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:21.931812    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 11:53:21.932305 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:21.931887    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd" podUID="bc32b842-3e83-4ac7-97c2-bf82cf7377b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 11:53:22.994116 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:22.994082    2560 generic.go:356] "Generic (PLEG): container finished" podID="bc32b842-3e83-4ac7-97c2-bf82cf7377b4" containerID="e6946c0707702e1017ea0378932fd4b92745d5a902c9a2a40a35b27d47131701" exitCode=0
Sep 11 11:53:22.994531 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:22.994154    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd" event={"ID":"bc32b842-3e83-4ac7-97c2-bf82cf7377b4","Type":"ContainerDied","Data":"e6946c0707702e1017ea0378932fd4b92745d5a902c9a2a40a35b27d47131701"}
Sep 11 11:53:22.994578 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:22.994559    2560 scope.go:117] "RemoveContainer" containerID="e6946c0707702e1017ea0378932fd4b92745d5a902c9a2a40a35b27d47131701"
Sep 11 11:53:22.995744 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:22.995718    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:53:22.995811 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:22.995799    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:53:22.995859 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:22.995845    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:53:23.020457 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:23.020411    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8989e8-b78fbfbb6-5lmqh" podStartSLOduration=12.02039647 podStartE2EDuration="12.02039647s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:53:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:53:12.972958205 +0000 UTC m=+1143.795418109" watchObservedRunningTime="2026-09-11 11:53:23.02039647 +0000 UTC m=+1153.842856355"
Sep 11 11:53:23.935475 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:23.935441    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8989e8-b78fbfbb6-5lmqh"
Sep 11 11:53:24.001709 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:24.001636    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd" event={"ID":"bc32b842-3e83-4ac7-97c2-bf82cf7377b4","Type":"ContainerStarted","Data":"00de6bd627f03793f25c41365ff5819dbaa5e642281a0f3e8571f0722a1cd943"}
Sep 11 11:53:24.231668 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:24.231620    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd"
Sep 11 11:53:24.231836 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:24.231810    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 11 11:53:24.231884 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:24.231860    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd" podUID="bc32b842-3e83-4ac7-97c2-bf82cf7377b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 11 11:53:25.232408 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:25.232374    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 11 11:53:25.232832 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:25.232434    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd" podUID="bc32b842-3e83-4ac7-97c2-bf82cf7377b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 11 11:53:26.232786 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:26.232743    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 11 11:53:26.233176 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:26.232809    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd" podUID="bc32b842-3e83-4ac7-97c2-bf82cf7377b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 11 11:53:27.232332 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:27.232299    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 11 11:53:27.232503 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:27.232352    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd" podUID="bc32b842-3e83-4ac7-97c2-bf82cf7377b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 11 11:53:28.232538 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:28.232503    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 11 11:53:28.232928 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:28.232571    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd" podUID="bc32b842-3e83-4ac7-97c2-bf82cf7377b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 11 11:53:29.028220 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:29.028187    2560 generic.go:356] "Generic (PLEG): container finished" podID="8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1" containerID="b02316daea35894ddf30baf8c4d9fbd3e635fc4f9ce1980f0eb5f1730afdb29e" exitCode=0
Sep 11 11:53:29.028428 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:29.028266    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p" event={"ID":"8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1","Type":"ContainerDied","Data":"b02316daea35894ddf30baf8c4d9fbd3e635fc4f9ce1980f0eb5f1730afdb29e"}
Sep 11 11:53:29.028731 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:29.028715    2560 scope.go:117] "RemoveContainer" containerID="b02316daea35894ddf30baf8c4d9fbd3e635fc4f9ce1980f0eb5f1730afdb29e"
Sep 11 11:53:29.029765 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:29.029739    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:53:29.029861 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:29.029819    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:53:29.029927 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:29.029865    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:53:29.232119 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:29.232076    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 11 11:53:29.232312 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:29.232159    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd" podUID="bc32b842-3e83-4ac7-97c2-bf82cf7377b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 11 11:53:30.034902 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:30.034866    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p" event={"ID":"8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1","Type":"ContainerStarted","Data":"7d834c95b48ddd88eeceba19d496c042bc7f79139d2f895aa7b4a1bb5a48dacb"}
Sep 11 11:53:30.128881 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:30.128841    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p"
Sep 11 11:53:30.129059 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:30.129024    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 11 11:53:30.129106 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:30.129075    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p" podUID="8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 11 11:53:30.235504 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:30.235471    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd"
Sep 11 11:53:30.235960 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:30.235935    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd"
Sep 11 11:53:30.240678 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:30.240632    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd"
Sep 11 11:53:31.128693 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:31.128632    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 11 11:53:31.129096 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:31.128709    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p" podUID="8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 11 11:53:32.129131 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:32.129040    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 11 11:53:32.129131 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:32.129110    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p" podUID="8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 11 11:53:33.129123 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:33.129089    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 11 11:53:33.129307 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:33.129148    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p" podUID="8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 11 11:53:34.129327 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:34.129288    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 11 11:53:34.129765 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:34.129341    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p" podUID="8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 11 11:53:35.128995 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:35.128955    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 11 11:53:35.129177 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:35.129048    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p" podUID="8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 11 11:53:36.132851 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:36.132818    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p"
Sep 11 11:53:36.133285 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:36.133103    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p"
Sep 11 11:53:36.133851 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:36.133830    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p"
Sep 11 11:53:38.673447 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:38.673414    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-117711-76895d6bb6-x8l8g"]
Sep 11 11:53:38.676615 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:38.676598    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-117711-76895d6bb6-x8l8g"
Sep 11 11:53:38.679421 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:38.679393    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-117711\""
Sep 11 11:53:38.694450 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:38.694422    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddzsb\" (UniqueName: \"kubernetes.io/projected/86547d81-aba7-43fe-be0a-42bbd471c9d1-kube-api-access-ddzsb\") pod \"payload-pre-processing-e2e-shared-b-w3-117711-76895d6bb6-x8l8g\" (UID: \"86547d81-aba7-43fe-be0a-42bbd471c9d1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-117711-76895d6bb6-x8l8g"
Sep 11 11:53:38.694589 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:38.694504    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86547d81-aba7-43fe-be0a-42bbd471c9d1-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-117711-76895d6bb6-x8l8g\" (UID: \"86547d81-aba7-43fe-be0a-42bbd471c9d1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-117711-76895d6bb6-x8l8g"
Sep 11 11:53:38.707124 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:38.707096    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-117711-76895d6bb6-x8l8g"]
Sep 11 11:53:38.743166 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:38.743133    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-117711-6f65b68bd5-bpv4n"]
Sep 11 11:53:38.746077 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:38.746056    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-117711-6f65b68bd5-bpv4n"
Sep 11 11:53:38.748911 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:38.748883    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-117711-dockercfg-6vt7c\""
Sep 11 11:53:38.773239 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:38.773214    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-117711-6f65b68bd5-bpv4n"]
Sep 11 11:53:38.795309 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:38.795277    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3ae70641-8c9b-4583-a640-e83e52395ae6-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-117711-6f65b68bd5-bpv4n\" (UID: \"3ae70641-8c9b-4583-a640-e83e52395ae6\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-117711-6f65b68bd5-bpv4n"
Sep 11 11:53:38.795430 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:38.795347    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86547d81-aba7-43fe-be0a-42bbd471c9d1-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-117711-76895d6bb6-x8l8g\" (UID: \"86547d81-aba7-43fe-be0a-42bbd471c9d1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-117711-76895d6bb6-x8l8g"
Sep 11 11:53:38.795430 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:38.795418    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddzsb\" (UniqueName: \"kubernetes.io/projected/86547d81-aba7-43fe-be0a-42bbd471c9d1-kube-api-access-ddzsb\") pod \"payload-pre-processing-e2e-shared-b-w3-117711-76895d6bb6-x8l8g\" (UID: \"86547d81-aba7-43fe-be0a-42bbd471c9d1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-117711-76895d6bb6-x8l8g"
Sep 11 11:53:38.795517 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:38.795445    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdr6q\" (UniqueName: \"kubernetes.io/projected/3ae70641-8c9b-4583-a640-e83e52395ae6-kube-api-access-hdr6q\") pod \"payload-processing-e2e-shared-b-w3-117711-6f65b68bd5-bpv4n\" (UID: \"3ae70641-8c9b-4583-a640-e83e52395ae6\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-117711-6f65b68bd5-bpv4n"
Sep 11 11:53:38.795983 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:38.795965    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86547d81-aba7-43fe-be0a-42bbd471c9d1-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-117711-76895d6bb6-x8l8g\" (UID: \"86547d81-aba7-43fe-be0a-42bbd471c9d1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-117711-76895d6bb6-x8l8g"
Sep 11 11:53:38.815661 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:38.815627    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddzsb\" (UniqueName: \"kubernetes.io/projected/86547d81-aba7-43fe-be0a-42bbd471c9d1-kube-api-access-ddzsb\") pod \"payload-pre-processing-e2e-shared-b-w3-117711-76895d6bb6-x8l8g\" (UID: \"86547d81-aba7-43fe-be0a-42bbd471c9d1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-117711-76895d6bb6-x8l8g"
Sep 11 11:53:38.896752 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:38.896714    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdr6q\" (UniqueName: \"kubernetes.io/projected/3ae70641-8c9b-4583-a640-e83e52395ae6-kube-api-access-hdr6q\") pod \"payload-processing-e2e-shared-b-w3-117711-6f65b68bd5-bpv4n\" (UID: \"3ae70641-8c9b-4583-a640-e83e52395ae6\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-117711-6f65b68bd5-bpv4n"
Sep 11 11:53:38.896931 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:38.896776    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3ae70641-8c9b-4583-a640-e83e52395ae6-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-117711-6f65b68bd5-bpv4n\" (UID: \"3ae70641-8c9b-4583-a640-e83e52395ae6\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-117711-6f65b68bd5-bpv4n"
Sep 11 11:53:38.897496 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:38.897472    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3ae70641-8c9b-4583-a640-e83e52395ae6-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-117711-6f65b68bd5-bpv4n\" (UID: \"3ae70641-8c9b-4583-a640-e83e52395ae6\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-117711-6f65b68bd5-bpv4n"
Sep 11 11:53:38.910777 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:38.910751    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdr6q\" (UniqueName: \"kubernetes.io/projected/3ae70641-8c9b-4583-a640-e83e52395ae6-kube-api-access-hdr6q\") pod \"payload-processing-e2e-shared-b-w3-117711-6f65b68bd5-bpv4n\" (UID: \"3ae70641-8c9b-4583-a640-e83e52395ae6\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-117711-6f65b68bd5-bpv4n"
Sep 11 11:53:38.987340 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:38.987306    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-117711-76895d6bb6-x8l8g"
Sep 11 11:53:39.055939 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:39.055908    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-117711-6f65b68bd5-bpv4n"
Sep 11 11:53:39.277537 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:39.277447    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-117711-76895d6bb6-x8l8g"]
Sep 11 11:53:39.281488 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:53:39.281463    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86547d81_aba7_43fe_be0a_42bbd471c9d1.slice/crio-bf53d285ab69eb1c5756657060452ba983595e38bfce07c5028dd6f15a862dc5 WatchSource:0}: Error finding container bf53d285ab69eb1c5756657060452ba983595e38bfce07c5028dd6f15a862dc5: Status 404 returned error can't find the container with id bf53d285ab69eb1c5756657060452ba983595e38bfce07c5028dd6f15a862dc5
Sep 11 11:53:39.354703 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:39.354678    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-117711-6f65b68bd5-bpv4n"]
Sep 11 11:53:39.355938 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:53:39.355912    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ae70641_8c9b_4583_a640_e83e52395ae6.slice/crio-0fdc9953db9cfac66d35e9c018f483d6375a840af4dffa67e8ab8b4cc1a460f3 WatchSource:0}: Error finding container 0fdc9953db9cfac66d35e9c018f483d6375a840af4dffa67e8ab8b4cc1a460f3: Status 404 returned error can't find the container with id 0fdc9953db9cfac66d35e9c018f483d6375a840af4dffa67e8ab8b4cc1a460f3
Sep 11 11:53:40.096766 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:40.096728    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-117711-6f65b68bd5-bpv4n" event={"ID":"3ae70641-8c9b-4583-a640-e83e52395ae6","Type":"ContainerStarted","Data":"90e67ef280535ddfcccce07268e4a82dc18cecf1cb79647e4db11d882b46806a"}
Sep 11 11:53:40.097247 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:40.096839    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-117711-6f65b68bd5-bpv4n"
Sep 11 11:53:40.097247 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:40.096868    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-117711-6f65b68bd5-bpv4n" event={"ID":"3ae70641-8c9b-4583-a640-e83e52395ae6","Type":"ContainerStarted","Data":"0fdc9953db9cfac66d35e9c018f483d6375a840af4dffa67e8ab8b4cc1a460f3"}
Sep 11 11:53:40.098780 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:40.098755    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-117711-76895d6bb6-x8l8g" event={"ID":"86547d81-aba7-43fe-be0a-42bbd471c9d1","Type":"ContainerStarted","Data":"12b27b089eed8ec79db6249c0f7c7d652790479b015a664bbd59d4aab4720844"}
Sep 11 11:53:40.098904 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:40.098800    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-117711-76895d6bb6-x8l8g" event={"ID":"86547d81-aba7-43fe-be0a-42bbd471c9d1","Type":"ContainerStarted","Data":"bf53d285ab69eb1c5756657060452ba983595e38bfce07c5028dd6f15a862dc5"}
Sep 11 11:53:40.098904 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:40.098891    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-117711-76895d6bb6-x8l8g"
Sep 11 11:53:40.119525 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:40.119482    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-117711-6f65b68bd5-bpv4n" podStartSLOduration=2.11946764 podStartE2EDuration="2.11946764s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:53:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:53:40.117371891 +0000 UTC m=+1170.939831765" watchObservedRunningTime="2026-09-11 11:53:40.11946764 +0000 UTC m=+1170.941927512"
Sep 11 11:53:40.152400 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:40.152346    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-117711-76895d6bb6-x8l8g" podStartSLOduration=2.152328519 podStartE2EDuration="2.152328519s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:53:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:53:40.150591276 +0000 UTC m=+1170.973051180" watchObservedRunningTime="2026-09-11 11:53:40.152328519 +0000 UTC m=+1170.974788393"
Sep 11 11:53:45.729379 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:45.729347    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6daa53-54647978cd-b6whd"]
Sep 11 11:53:45.733313 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:45.733288    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6daa53-54647978cd-b6whd"
Sep 11 11:53:45.735959 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:45.735937    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-6daa53-dockercfg-lhd4x\""
Sep 11 11:53:45.736184 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:45.736169    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-6daa53\""
Sep 11 11:53:45.747444 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:45.747420    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6daa53-54647978cd-b6whd"]
Sep 11 11:53:45.761998 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:45.756725    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f279c48-55be-428f-8131-c0ab788a9453-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-6daa53-54647978cd-b6whd\" (UID: \"1f279c48-55be-428f-8131-c0ab788a9453\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6daa53-54647978cd-b6whd"
Sep 11 11:53:45.761998 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:45.756868    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9zh4\" (UniqueName: \"kubernetes.io/projected/1f279c48-55be-428f-8131-c0ab788a9453-kube-api-access-m9zh4\") pod \"payload-pre-processing-e2e-shared-b-w2-6daa53-54647978cd-b6whd\" (UID: \"1f279c48-55be-428f-8131-c0ab788a9453\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6daa53-54647978cd-b6whd"
Sep 11 11:53:45.857823 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:45.857784    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f279c48-55be-428f-8131-c0ab788a9453-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-6daa53-54647978cd-b6whd\" (UID: \"1f279c48-55be-428f-8131-c0ab788a9453\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6daa53-54647978cd-b6whd"
Sep 11 11:53:45.858012 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:45.857960    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9zh4\" (UniqueName: \"kubernetes.io/projected/1f279c48-55be-428f-8131-c0ab788a9453-kube-api-access-m9zh4\") pod \"payload-pre-processing-e2e-shared-b-w2-6daa53-54647978cd-b6whd\" (UID: \"1f279c48-55be-428f-8131-c0ab788a9453\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6daa53-54647978cd-b6whd"
Sep 11 11:53:45.858611 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:45.858584    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f279c48-55be-428f-8131-c0ab788a9453-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-6daa53-54647978cd-b6whd\" (UID: \"1f279c48-55be-428f-8131-c0ab788a9453\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6daa53-54647978cd-b6whd"
Sep 11 11:53:45.869826 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:45.869802    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9zh4\" (UniqueName: \"kubernetes.io/projected/1f279c48-55be-428f-8131-c0ab788a9453-kube-api-access-m9zh4\") pod \"payload-pre-processing-e2e-shared-b-w2-6daa53-54647978cd-b6whd\" (UID: \"1f279c48-55be-428f-8131-c0ab788a9453\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6daa53-54647978cd-b6whd"
Sep 11 11:53:46.045014 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:46.044919    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6daa53-54647978cd-b6whd"
Sep 11 11:53:46.326430 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:46.326405    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6daa53-54647978cd-b6whd"]
Sep 11 11:53:46.328796 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:53:46.328763    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f279c48_55be_428f_8131_c0ab788a9453.slice/crio-c7bf21d808f0895107ce1259a97df51cc1b4777db47ee99665e6774156b2716f WatchSource:0}: Error finding container c7bf21d808f0895107ce1259a97df51cc1b4777db47ee99665e6774156b2716f: Status 404 returned error can't find the container with id c7bf21d808f0895107ce1259a97df51cc1b4777db47ee99665e6774156b2716f
Sep 11 11:53:47.136738 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:47.136695    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6daa53-54647978cd-b6whd" event={"ID":"1f279c48-55be-428f-8131-c0ab788a9453","Type":"ContainerStarted","Data":"7d2ca9ff60859a4313fb79d4317ce8f8188aa4db06763168160b26030f3c77e3"}
Sep 11 11:53:47.137128 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:47.136768    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6daa53-54647978cd-b6whd" event={"ID":"1f279c48-55be-428f-8131-c0ab788a9453","Type":"ContainerStarted","Data":"c7bf21d808f0895107ce1259a97df51cc1b4777db47ee99665e6774156b2716f"}
Sep 11 11:53:47.137128 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:47.136799    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6daa53-54647978cd-b6whd"
Sep 11 11:53:47.174833 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:47.174769    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6daa53-54647978cd-b6whd" podStartSLOduration=2.174747155 podStartE2EDuration="2.174747155s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:53:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:53:47.171832505 +0000 UTC m=+1177.994292401" watchObservedRunningTime="2026-09-11 11:53:47.174747155 +0000 UTC m=+1177.997207033"
Sep 11 11:53:51.107580 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:51.107547    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-117711-6f65b68bd5-bpv4n"
Sep 11 11:53:51.108020 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:51.107624    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-117711-76895d6bb6-x8l8g"
Sep 11 11:53:58.145130 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:53:58.145098    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6daa53-54647978cd-b6whd"
Sep 11 11:54:28.780211 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:54:28.780168    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-307b7f39-5b757dd494-cn2ss"]
Sep 11 11:54:28.785313 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:54:28.785289    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-307b7f39-5b757dd494-cn2ss"
Sep 11 11:54:28.787815 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:54:28.787793    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-307b7f39-dockercfg-4h92l\""
Sep 11 11:54:28.787944 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:54:28.787922    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-307b7f39\""
Sep 11 11:54:28.799852 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:54:28.799831    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-307b7f39-767f878777-bgv4n"]
Sep 11 11:54:28.803122 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:54:28.803103    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-307b7f39-767f878777-bgv4n"
Sep 11 11:54:28.803630 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:54:28.803603    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-307b7f39-5b757dd494-cn2ss"]
Sep 11 11:54:28.815889 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:54:28.815865    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-307b7f39-767f878777-bgv4n"]
Sep 11 11:54:28.849376 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:54:28.849345    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpstf\" (UniqueName: \"kubernetes.io/projected/0ec040ee-a090-402a-9b54-417fb778f8ae-kube-api-access-cpstf\") pod \"payload-processing-e2e-mt-307b7f39-767f878777-bgv4n\" (UID: \"0ec040ee-a090-402a-9b54-417fb778f8ae\") " pod="openshift-ingress/payload-processing-e2e-mt-307b7f39-767f878777-bgv4n"
Sep 11 11:54:28.849543 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:54:28.849388    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkpxx\" (UniqueName: \"kubernetes.io/projected/952f4a26-f6b4-43c4-810d-f16268f2fe4e-kube-api-access-dkpxx\") pod \"payload-pre-processing-e2e-mt-307b7f39-5b757dd494-cn2ss\" (UID: \"952f4a26-f6b4-43c4-810d-f16268f2fe4e\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-307b7f39-5b757dd494-cn2ss"
Sep 11 11:54:28.849543 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:54:28.849413    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/952f4a26-f6b4-43c4-810d-f16268f2fe4e-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-307b7f39-5b757dd494-cn2ss\" (UID: \"952f4a26-f6b4-43c4-810d-f16268f2fe4e\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-307b7f39-5b757dd494-cn2ss"
Sep 11 11:54:28.849543 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:54:28.849528    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ec040ee-a090-402a-9b54-417fb778f8ae-plugins-config-volume\") pod \"payload-processing-e2e-mt-307b7f39-767f878777-bgv4n\" (UID: \"0ec040ee-a090-402a-9b54-417fb778f8ae\") " pod="openshift-ingress/payload-processing-e2e-mt-307b7f39-767f878777-bgv4n"
Sep 11 11:54:28.950215 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:54:28.950179    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpstf\" (UniqueName: \"kubernetes.io/projected/0ec040ee-a090-402a-9b54-417fb778f8ae-kube-api-access-cpstf\") pod \"payload-processing-e2e-mt-307b7f39-767f878777-bgv4n\" (UID: \"0ec040ee-a090-402a-9b54-417fb778f8ae\") " pod="openshift-ingress/payload-processing-e2e-mt-307b7f39-767f878777-bgv4n"
Sep 11 11:54:28.950419 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:54:28.950240    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkpxx\" (UniqueName: \"kubernetes.io/projected/952f4a26-f6b4-43c4-810d-f16268f2fe4e-kube-api-access-dkpxx\") pod \"payload-pre-processing-e2e-mt-307b7f39-5b757dd494-cn2ss\" (UID: \"952f4a26-f6b4-43c4-810d-f16268f2fe4e\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-307b7f39-5b757dd494-cn2ss"
Sep 11 11:54:28.950419 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:54:28.950283    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/952f4a26-f6b4-43c4-810d-f16268f2fe4e-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-307b7f39-5b757dd494-cn2ss\" (UID: \"952f4a26-f6b4-43c4-810d-f16268f2fe4e\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-307b7f39-5b757dd494-cn2ss"
Sep 11 11:54:28.950419 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:54:28.950361    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ec040ee-a090-402a-9b54-417fb778f8ae-plugins-config-volume\") pod \"payload-processing-e2e-mt-307b7f39-767f878777-bgv4n\" (UID: \"0ec040ee-a090-402a-9b54-417fb778f8ae\") " pod="openshift-ingress/payload-processing-e2e-mt-307b7f39-767f878777-bgv4n"
Sep 11 11:54:28.951182 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:54:28.951157    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ec040ee-a090-402a-9b54-417fb778f8ae-plugins-config-volume\") pod \"payload-processing-e2e-mt-307b7f39-767f878777-bgv4n\" (UID: \"0ec040ee-a090-402a-9b54-417fb778f8ae\") " pod="openshift-ingress/payload-processing-e2e-mt-307b7f39-767f878777-bgv4n"
Sep 11 11:54:28.951284 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:54:28.951160    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/952f4a26-f6b4-43c4-810d-f16268f2fe4e-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-307b7f39-5b757dd494-cn2ss\" (UID: \"952f4a26-f6b4-43c4-810d-f16268f2fe4e\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-307b7f39-5b757dd494-cn2ss"
Sep 11 11:54:28.959213 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:54:28.959189    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpstf\" (UniqueName: \"kubernetes.io/projected/0ec040ee-a090-402a-9b54-417fb778f8ae-kube-api-access-cpstf\") pod \"payload-processing-e2e-mt-307b7f39-767f878777-bgv4n\" (UID: \"0ec040ee-a090-402a-9b54-417fb778f8ae\") " pod="openshift-ingress/payload-processing-e2e-mt-307b7f39-767f878777-bgv4n"
Sep 11 11:54:28.959331 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:54:28.959220    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkpxx\" (UniqueName: \"kubernetes.io/projected/952f4a26-f6b4-43c4-810d-f16268f2fe4e-kube-api-access-dkpxx\") pod \"payload-pre-processing-e2e-mt-307b7f39-5b757dd494-cn2ss\" (UID: \"952f4a26-f6b4-43c4-810d-f16268f2fe4e\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-307b7f39-5b757dd494-cn2ss"
Sep 11 11:54:29.095264 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:54:29.095169    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-307b7f39-5b757dd494-cn2ss"
Sep 11 11:54:29.113381 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:54:29.113349    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-307b7f39-767f878777-bgv4n"
Sep 11 11:54:29.375527 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:54:29.375498    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-307b7f39-5b757dd494-cn2ss"]
Sep 11 11:54:29.378159 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:54:29.378135    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod952f4a26_f6b4_43c4_810d_f16268f2fe4e.slice/crio-d1fc379a131cb7a0dc8dbc7a934574f8236f8bb6a79cd9774d8584d76de6cc81 WatchSource:0}: Error finding container d1fc379a131cb7a0dc8dbc7a934574f8236f8bb6a79cd9774d8584d76de6cc81: Status 404 returned error can't find the container with id d1fc379a131cb7a0dc8dbc7a934574f8236f8bb6a79cd9774d8584d76de6cc81
Sep 11 11:54:29.397898 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:54:29.397878    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-307b7f39-767f878777-bgv4n"]
Sep 11 11:54:29.399906 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:54:29.399878    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ec040ee_a090_402a_9b54_417fb778f8ae.slice/crio-f52c024f7c9317f28174210af1487a7bbe80f1904f6afa466be3efb84b93368d WatchSource:0}: Error finding container f52c024f7c9317f28174210af1487a7bbe80f1904f6afa466be3efb84b93368d: Status 404 returned error can't find the container with id f52c024f7c9317f28174210af1487a7bbe80f1904f6afa466be3efb84b93368d
Sep 11 11:54:30.380377 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:54:30.380333    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-307b7f39-767f878777-bgv4n" event={"ID":"0ec040ee-a090-402a-9b54-417fb778f8ae","Type":"ContainerStarted","Data":"6337626bd9b2b822aed238bedbc8bec20d5e3fbcedc931cb9fdd1be20cbb27ba"}
Sep 11 11:54:30.380871 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:54:30.380437    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-307b7f39-767f878777-bgv4n" event={"ID":"0ec040ee-a090-402a-9b54-417fb778f8ae","Type":"ContainerStarted","Data":"f52c024f7c9317f28174210af1487a7bbe80f1904f6afa466be3efb84b93368d"}
Sep 11 11:54:30.380871 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:54:30.380467    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-307b7f39-767f878777-bgv4n"
Sep 11 11:54:30.382683 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:54:30.382630    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-307b7f39-5b757dd494-cn2ss" event={"ID":"952f4a26-f6b4-43c4-810d-f16268f2fe4e","Type":"ContainerStarted","Data":"6fd8ce0cb2bc305ba3ab3e78921a9da0cab848b822f3e64c0c4dcbf5b74ed63a"}
Sep 11 11:54:30.382827 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:54:30.382705    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-307b7f39-5b757dd494-cn2ss" event={"ID":"952f4a26-f6b4-43c4-810d-f16268f2fe4e","Type":"ContainerStarted","Data":"d1fc379a131cb7a0dc8dbc7a934574f8236f8bb6a79cd9774d8584d76de6cc81"}
Sep 11 11:54:30.382827 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:54:30.382733    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-307b7f39-5b757dd494-cn2ss"
Sep 11 11:54:30.398319 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:54:30.398273    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-307b7f39-767f878777-bgv4n" podStartSLOduration=2.398255833 podStartE2EDuration="2.398255833s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:54:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:54:30.396179873 +0000 UTC m=+1221.218639765" watchObservedRunningTime="2026-09-11 11:54:30.398255833 +0000 UTC m=+1221.220715710"
Sep 11 11:54:30.413709 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:54:30.413643    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-307b7f39-5b757dd494-cn2ss" podStartSLOduration=2.413629239 podStartE2EDuration="2.413629239s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:54:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:54:30.411819392 +0000 UTC m=+1221.234279282" watchObservedRunningTime="2026-09-11 11:54:30.413629239 +0000 UTC m=+1221.236089112"
Sep 11 11:54:41.389824 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:54:41.389792    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-307b7f39-767f878777-bgv4n"
Sep 11 11:54:41.390296 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:54:41.389956    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-307b7f39-5b757dd494-cn2ss"
Sep 11 11:55:09.894070 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:55:09.893994    2560 scope.go:117] "RemoveContainer" containerID="8717bba15ab044e21d708c86252928dd846a6f21de345ef3150874ad41dc7cbb"
Sep 11 11:55:09.902316 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:55:09.902293    2560 scope.go:117] "RemoveContainer" containerID="d975a6184759659a72405a3db8b165abae4bc134ca5da45741414eb9e43df9a3"
Sep 11 11:55:46.232155 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:55:46.232119    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-307b7f39-j5swx"]
Sep 11 11:55:46.235667 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:55:46.235629    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-307b7f39-j5swx"
Sep 11 11:55:46.238036 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:55:46.238010    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 11:55:46.238158 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:55:46.238086    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f46tj\""
Sep 11 11:55:46.242953 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:55:46.242929    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-307b7f39-j5swx"]
Sep 11 11:55:46.345820 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:55:46.345775    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bcee5bb9-1b0c-4b17-bdd0-b04132cd3ea3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-307b7f39-j5swx\" (UID: \"bcee5bb9-1b0c-4b17-bdd0-b04132cd3ea3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-307b7f39-j5swx"
Sep 11 11:55:46.447059 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:55:46.447018    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bcee5bb9-1b0c-4b17-bdd0-b04132cd3ea3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-307b7f39-j5swx\" (UID: \"bcee5bb9-1b0c-4b17-bdd0-b04132cd3ea3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-307b7f39-j5swx"
Sep 11 11:55:46.447705 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:55:46.447683    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bcee5bb9-1b0c-4b17-bdd0-b04132cd3ea3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-307b7f39-j5swx\" (UID: \"bcee5bb9-1b0c-4b17-bdd0-b04132cd3ea3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-307b7f39-j5swx"
Sep 11 11:55:46.548961 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:55:46.548882    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-307b7f39-j5swx"
Sep 11 11:55:46.828157 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:55:46.828133    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-307b7f39-j5swx"]
Sep 11 11:55:46.830145 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:55:46.830118    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcee5bb9_1b0c_4b17_bdd0_b04132cd3ea3.slice/crio-965860e903eaf83a0a5780954fbd805e0f57c3e0c15e7acf8f7e20fde17404bf WatchSource:0}: Error finding container 965860e903eaf83a0a5780954fbd805e0f57c3e0c15e7acf8f7e20fde17404bf: Status 404 returned error can't find the container with id 965860e903eaf83a0a5780954fbd805e0f57c3e0c15e7acf8f7e20fde17404bf
Sep 11 11:55:47.794000 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:55:47.793969    2560 generic.go:356] "Generic (PLEG): container finished" podID="bcee5bb9-1b0c-4b17-bdd0-b04132cd3ea3" containerID="7bcb703ad8bc8559a9e7c9bfb8783d4dc4a61d2d0b5ca2470558cc236df2facf" exitCode=0
Sep 11 11:55:47.794360 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:55:47.794059    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-307b7f39-j5swx" event={"ID":"bcee5bb9-1b0c-4b17-bdd0-b04132cd3ea3","Type":"ContainerDied","Data":"7bcb703ad8bc8559a9e7c9bfb8783d4dc4a61d2d0b5ca2470558cc236df2facf"}
Sep 11 11:55:47.794360 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:55:47.794110    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-307b7f39-j5swx" event={"ID":"bcee5bb9-1b0c-4b17-bdd0-b04132cd3ea3","Type":"ContainerStarted","Data":"965860e903eaf83a0a5780954fbd805e0f57c3e0c15e7acf8f7e20fde17404bf"}
Sep 11 11:55:48.933006 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:55:48.932979    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-307b7f39-j5swx"
Sep 11 11:55:49.070937 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:55:49.070858    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bcee5bb9-1b0c-4b17-bdd0-b04132cd3ea3-maas-api-service-ca\") pod \"bcee5bb9-1b0c-4b17-bdd0-b04132cd3ea3\" (UID: \"bcee5bb9-1b0c-4b17-bdd0-b04132cd3ea3\") "
Sep 11 11:55:49.071191 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:55:49.071168    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcee5bb9-1b0c-4b17-bdd0-b04132cd3ea3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bcee5bb9-1b0c-4b17-bdd0-b04132cd3ea3" (UID: "bcee5bb9-1b0c-4b17-bdd0-b04132cd3ea3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 11:55:49.172389 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:55:49.172358    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bcee5bb9-1b0c-4b17-bdd0-b04132cd3ea3-maas-api-service-ca\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:55:49.804314 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:55:49.804285    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-307b7f39-j5swx"
Sep 11 11:55:49.804478 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:55:49.804278    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-307b7f39-j5swx" event={"ID":"bcee5bb9-1b0c-4b17-bdd0-b04132cd3ea3","Type":"ContainerDied","Data":"965860e903eaf83a0a5780954fbd805e0f57c3e0c15e7acf8f7e20fde17404bf"}
Sep 11 11:55:49.804478 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:55:49.804408    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="965860e903eaf83a0a5780954fbd805e0f57c3e0c15e7acf8f7e20fde17404bf"
Sep 11 11:56:01.994243 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:56:01.994207    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-307b7f39-767f878777-bgv4n"]
Sep 11 11:56:01.994717 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:56:01.994464    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-307b7f39-767f878777-bgv4n" podUID="0ec040ee-a090-402a-9b54-417fb778f8ae" containerName="payload-processing" containerID="cri-o://6337626bd9b2b822aed238bedbc8bec20d5e3fbcedc931cb9fdd1be20cbb27ba" gracePeriod=30
Sep 11 11:56:02.007772 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:56:02.007746    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-307b7f39-5b757dd494-cn2ss"]
Sep 11 11:56:02.007948 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:56:02.007927    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-307b7f39-5b757dd494-cn2ss" podUID="952f4a26-f6b4-43c4-810d-f16268f2fe4e" containerName="payload-pre-processing" containerID="cri-o://6fd8ce0cb2bc305ba3ab3e78921a9da0cab848b822f3e64c0c4dcbf5b74ed63a" gracePeriod=30
Sep 11 11:56:02.297517 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:56:02.297494    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-307b7f39-767f878777-bgv4n"
Sep 11 11:56:02.300354 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:56:02.300331    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-307b7f39-5b757dd494-cn2ss"
Sep 11 11:56:02.394100 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:56:02.394070    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/952f4a26-f6b4-43c4-810d-f16268f2fe4e-plugins-config-volume\") pod \"952f4a26-f6b4-43c4-810d-f16268f2fe4e\" (UID: \"952f4a26-f6b4-43c4-810d-f16268f2fe4e\") "
Sep 11 11:56:02.394277 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:56:02.394114    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ec040ee-a090-402a-9b54-417fb778f8ae-plugins-config-volume\") pod \"0ec040ee-a090-402a-9b54-417fb778f8ae\" (UID: \"0ec040ee-a090-402a-9b54-417fb778f8ae\") "
Sep 11 11:56:02.394277 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:56:02.394162    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkpxx\" (UniqueName: \"kubernetes.io/projected/952f4a26-f6b4-43c4-810d-f16268f2fe4e-kube-api-access-dkpxx\") pod \"952f4a26-f6b4-43c4-810d-f16268f2fe4e\" (UID: \"952f4a26-f6b4-43c4-810d-f16268f2fe4e\") "
Sep 11 11:56:02.394277 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:56:02.394215    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cpstf\" (UniqueName: \"kubernetes.io/projected/0ec040ee-a090-402a-9b54-417fb778f8ae-kube-api-access-cpstf\") pod \"0ec040ee-a090-402a-9b54-417fb778f8ae\" (UID: \"0ec040ee-a090-402a-9b54-417fb778f8ae\") "
Sep 11 11:56:02.394450 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:56:02.394426    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/952f4a26-f6b4-43c4-810d-f16268f2fe4e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "952f4a26-f6b4-43c4-810d-f16268f2fe4e" (UID: "952f4a26-f6b4-43c4-810d-f16268f2fe4e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 11:56:02.394598 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:56:02.394559    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ec040ee-a090-402a-9b54-417fb778f8ae-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0ec040ee-a090-402a-9b54-417fb778f8ae" (UID: "0ec040ee-a090-402a-9b54-417fb778f8ae"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 11:56:02.396210 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:56:02.396188    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/952f4a26-f6b4-43c4-810d-f16268f2fe4e-kube-api-access-dkpxx" (OuterVolumeSpecName: "kube-api-access-dkpxx") pod "952f4a26-f6b4-43c4-810d-f16268f2fe4e" (UID: "952f4a26-f6b4-43c4-810d-f16268f2fe4e"). InnerVolumeSpecName "kube-api-access-dkpxx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:56:02.396306 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:56:02.396283    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ec040ee-a090-402a-9b54-417fb778f8ae-kube-api-access-cpstf" (OuterVolumeSpecName: "kube-api-access-cpstf") pod "0ec040ee-a090-402a-9b54-417fb778f8ae" (UID: "0ec040ee-a090-402a-9b54-417fb778f8ae"). InnerVolumeSpecName "kube-api-access-cpstf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:56:02.495675 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:56:02.495608    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ec040ee-a090-402a-9b54-417fb778f8ae-plugins-config-volume\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:56:02.495675 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:56:02.495641    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dkpxx\" (UniqueName: \"kubernetes.io/projected/952f4a26-f6b4-43c4-810d-f16268f2fe4e-kube-api-access-dkpxx\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:56:02.495675 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:56:02.495678    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpstf\" (UniqueName: \"kubernetes.io/projected/0ec040ee-a090-402a-9b54-417fb778f8ae-kube-api-access-cpstf\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:56:02.495996 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:56:02.495688    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/952f4a26-f6b4-43c4-810d-f16268f2fe4e-plugins-config-volume\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:56:02.535572 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:56:02.535493    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-307b7f39-j5swx"]
Sep 11 11:56:02.540996 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:56:02.540971    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-307b7f39-j5swx"]
Sep 11 11:56:02.872014 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:56:02.871920    2560 generic.go:356] "Generic (PLEG): container finished" podID="0ec040ee-a090-402a-9b54-417fb778f8ae" containerID="6337626bd9b2b822aed238bedbc8bec20d5e3fbcedc931cb9fdd1be20cbb27ba" exitCode=0
Sep 11 11:56:02.872014 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:56:02.871967    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-307b7f39-767f878777-bgv4n"
Sep 11 11:56:02.872014 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:56:02.872002    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-307b7f39-767f878777-bgv4n" event={"ID":"0ec040ee-a090-402a-9b54-417fb778f8ae","Type":"ContainerDied","Data":"6337626bd9b2b822aed238bedbc8bec20d5e3fbcedc931cb9fdd1be20cbb27ba"}
Sep 11 11:56:02.872300 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:56:02.872046    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-307b7f39-767f878777-bgv4n" event={"ID":"0ec040ee-a090-402a-9b54-417fb778f8ae","Type":"ContainerDied","Data":"f52c024f7c9317f28174210af1487a7bbe80f1904f6afa466be3efb84b93368d"}
Sep 11 11:56:02.872300 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:56:02.872073    2560 scope.go:117] "RemoveContainer" containerID="6337626bd9b2b822aed238bedbc8bec20d5e3fbcedc931cb9fdd1be20cbb27ba"
Sep 11 11:56:02.873245 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:56:02.873223    2560 generic.go:356] "Generic (PLEG): container finished" podID="952f4a26-f6b4-43c4-810d-f16268f2fe4e" containerID="6fd8ce0cb2bc305ba3ab3e78921a9da0cab848b822f3e64c0c4dcbf5b74ed63a" exitCode=0
Sep 11 11:56:02.873337 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:56:02.873259    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-307b7f39-5b757dd494-cn2ss" event={"ID":"952f4a26-f6b4-43c4-810d-f16268f2fe4e","Type":"ContainerDied","Data":"6fd8ce0cb2bc305ba3ab3e78921a9da0cab848b822f3e64c0c4dcbf5b74ed63a"}
Sep 11 11:56:02.873337 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:56:02.873308    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-307b7f39-5b757dd494-cn2ss" event={"ID":"952f4a26-f6b4-43c4-810d-f16268f2fe4e","Type":"ContainerDied","Data":"d1fc379a131cb7a0dc8dbc7a934574f8236f8bb6a79cd9774d8584d76de6cc81"}
Sep 11 11:56:02.873337 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:56:02.873265    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-307b7f39-5b757dd494-cn2ss"
Sep 11 11:56:02.882235 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:56:02.882221    2560 scope.go:117] "RemoveContainer" containerID="6337626bd9b2b822aed238bedbc8bec20d5e3fbcedc931cb9fdd1be20cbb27ba"
Sep 11 11:56:02.882501 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:56:02.882477    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6337626bd9b2b822aed238bedbc8bec20d5e3fbcedc931cb9fdd1be20cbb27ba\": container with ID starting with 6337626bd9b2b822aed238bedbc8bec20d5e3fbcedc931cb9fdd1be20cbb27ba not found: ID does not exist" containerID="6337626bd9b2b822aed238bedbc8bec20d5e3fbcedc931cb9fdd1be20cbb27ba"
Sep 11 11:56:02.882594 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:56:02.882505    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6337626bd9b2b822aed238bedbc8bec20d5e3fbcedc931cb9fdd1be20cbb27ba"} err="failed to get container status \"6337626bd9b2b822aed238bedbc8bec20d5e3fbcedc931cb9fdd1be20cbb27ba\": rpc error: code = NotFound desc = could not find container \"6337626bd9b2b822aed238bedbc8bec20d5e3fbcedc931cb9fdd1be20cbb27ba\": container with ID starting with 6337626bd9b2b822aed238bedbc8bec20d5e3fbcedc931cb9fdd1be20cbb27ba not found: ID does not exist"
Sep 11 11:56:02.882594 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:56:02.882519    2560 scope.go:117] "RemoveContainer" containerID="6fd8ce0cb2bc305ba3ab3e78921a9da0cab848b822f3e64c0c4dcbf5b74ed63a"
Sep 11 11:56:02.891267 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:56:02.891251    2560 scope.go:117] "RemoveContainer" containerID="6fd8ce0cb2bc305ba3ab3e78921a9da0cab848b822f3e64c0c4dcbf5b74ed63a"
Sep 11 11:56:02.891526 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:56:02.891509    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6fd8ce0cb2bc305ba3ab3e78921a9da0cab848b822f3e64c0c4dcbf5b74ed63a\": container with ID starting with 6fd8ce0cb2bc305ba3ab3e78921a9da0cab848b822f3e64c0c4dcbf5b74ed63a not found: ID does not exist" containerID="6fd8ce0cb2bc305ba3ab3e78921a9da0cab848b822f3e64c0c4dcbf5b74ed63a"
Sep 11 11:56:02.891587 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:56:02.891536    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fd8ce0cb2bc305ba3ab3e78921a9da0cab848b822f3e64c0c4dcbf5b74ed63a"} err="failed to get container status \"6fd8ce0cb2bc305ba3ab3e78921a9da0cab848b822f3e64c0c4dcbf5b74ed63a\": rpc error: code = NotFound desc = could not find container \"6fd8ce0cb2bc305ba3ab3e78921a9da0cab848b822f3e64c0c4dcbf5b74ed63a\": container with ID starting with 6fd8ce0cb2bc305ba3ab3e78921a9da0cab848b822f3e64c0c4dcbf5b74ed63a not found: ID does not exist"
Sep 11 11:56:02.913255 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:56:02.913234    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-307b7f39-767f878777-bgv4n"]
Sep 11 11:56:02.918456 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:56:02.918436    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-307b7f39-767f878777-bgv4n"]
Sep 11 11:56:02.935322 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:56:02.935292    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-307b7f39-5b757dd494-cn2ss"]
Sep 11 11:56:02.939951 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:56:02.939930    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-307b7f39-5b757dd494-cn2ss"]
Sep 11 11:56:03.813870 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:56:03.813834    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ec040ee-a090-402a-9b54-417fb778f8ae" path="/var/lib/kubelet/pods/0ec040ee-a090-402a-9b54-417fb778f8ae/volumes"
Sep 11 11:56:03.814241 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:56:03.814199    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="952f4a26-f6b4-43c4-810d-f16268f2fe4e" path="/var/lib/kubelet/pods/952f4a26-f6b4-43c4-810d-f16268f2fe4e/volumes"
Sep 11 11:56:03.814483 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:56:03.814471    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bcee5bb9-1b0c-4b17-bdd0-b04132cd3ea3" path="/var/lib/kubelet/pods/bcee5bb9-1b0c-4b17-bdd0-b04132cd3ea3/volumes"
Sep 11 11:56:09.924535 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:56:09.924505    2560 scope.go:117] "RemoveContainer" containerID="8e2aba37b35e0b0f275bddfda144234c8fd4e470754dc9266616d2c129e9133a"
Sep 11 11:57:09.950844 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:09.950810    2560 scope.go:117] "RemoveContainer" containerID="4eb0b94a8fd25a76a4735ed2d955c626e2f98f01af6bb544266c2dd9966dd4ac"
Sep 11 11:57:47.815213 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:47.815183    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57"]
Sep 11 11:57:47.815703 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:47.815513    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="952f4a26-f6b4-43c4-810d-f16268f2fe4e" containerName="payload-pre-processing"
Sep 11 11:57:47.815703 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:47.815525    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="952f4a26-f6b4-43c4-810d-f16268f2fe4e" containerName="payload-pre-processing"
Sep 11 11:57:47.815703 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:47.815538    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcee5bb9-1b0c-4b17-bdd0-b04132cd3ea3" containerName="revoke-keys"
Sep 11 11:57:47.815703 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:47.815543    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcee5bb9-1b0c-4b17-bdd0-b04132cd3ea3" containerName="revoke-keys"
Sep 11 11:57:47.815703 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:47.815557    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ec040ee-a090-402a-9b54-417fb778f8ae" containerName="payload-processing"
Sep 11 11:57:47.815703 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:47.815562    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ec040ee-a090-402a-9b54-417fb778f8ae" containerName="payload-processing"
Sep 11 11:57:47.815703 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:47.815618    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="952f4a26-f6b4-43c4-810d-f16268f2fe4e" containerName="payload-pre-processing"
Sep 11 11:57:47.815703 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:47.815630    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcee5bb9-1b0c-4b17-bdd0-b04132cd3ea3" containerName="revoke-keys"
Sep 11 11:57:47.815703 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:47.815640    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ec040ee-a090-402a-9b54-417fb778f8ae" containerName="payload-processing"
Sep 11 11:57:47.818741 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:47.818722    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57"
Sep 11 11:57:47.821692 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:47.821671    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-f9def1-openshift-default-dockercfg-xvdrx\""
Sep 11 11:57:47.832142 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:47.832110    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57"]
Sep 11 11:57:47.914202 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:47.914164    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b916e548-09ed-43b5-a3e2-2c27ca564ad9-workload-socket\") pod \"e2e-api-a-f9def1-openshift-default-66768d9446-7tp57\" (UID: \"b916e548-09ed-43b5-a3e2-2c27ca564ad9\") " pod="openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57"
Sep 11 11:57:47.914443 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:47.914422    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b916e548-09ed-43b5-a3e2-2c27ca564ad9-istio-envoy\") pod \"e2e-api-a-f9def1-openshift-default-66768d9446-7tp57\" (UID: \"b916e548-09ed-43b5-a3e2-2c27ca564ad9\") " pod="openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57"
Sep 11 11:57:47.914606 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:47.914580    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b916e548-09ed-43b5-a3e2-2c27ca564ad9-credential-socket\") pod \"e2e-api-a-f9def1-openshift-default-66768d9446-7tp57\" (UID: \"b916e548-09ed-43b5-a3e2-2c27ca564ad9\") " pod="openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57"
Sep 11 11:57:47.914766 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:47.914680    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b916e548-09ed-43b5-a3e2-2c27ca564ad9-istio-token\") pod \"e2e-api-a-f9def1-openshift-default-66768d9446-7tp57\" (UID: \"b916e548-09ed-43b5-a3e2-2c27ca564ad9\") " pod="openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57"
Sep 11 11:57:47.914766 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:47.914730    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b916e548-09ed-43b5-a3e2-2c27ca564ad9-istio-podinfo\") pod \"e2e-api-a-f9def1-openshift-default-66768d9446-7tp57\" (UID: \"b916e548-09ed-43b5-a3e2-2c27ca564ad9\") " pod="openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57"
Sep 11 11:57:47.914897 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:47.914765    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b916e548-09ed-43b5-a3e2-2c27ca564ad9-istiod-ca-cert\") pod \"e2e-api-a-f9def1-openshift-default-66768d9446-7tp57\" (UID: \"b916e548-09ed-43b5-a3e2-2c27ca564ad9\") " pod="openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57"
Sep 11 11:57:47.914897 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:47.914800    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b916e548-09ed-43b5-a3e2-2c27ca564ad9-workload-certs\") pod \"e2e-api-a-f9def1-openshift-default-66768d9446-7tp57\" (UID: \"b916e548-09ed-43b5-a3e2-2c27ca564ad9\") " pod="openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57"
Sep 11 11:57:47.914897 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:47.914879    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b916e548-09ed-43b5-a3e2-2c27ca564ad9-istio-data\") pod \"e2e-api-a-f9def1-openshift-default-66768d9446-7tp57\" (UID: \"b916e548-09ed-43b5-a3e2-2c27ca564ad9\") " pod="openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57"
Sep 11 11:57:47.915061 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:47.914931    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljqxb\" (UniqueName: \"kubernetes.io/projected/b916e548-09ed-43b5-a3e2-2c27ca564ad9-kube-api-access-ljqxb\") pod \"e2e-api-a-f9def1-openshift-default-66768d9446-7tp57\" (UID: \"b916e548-09ed-43b5-a3e2-2c27ca564ad9\") " pod="openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57"
Sep 11 11:57:48.016061 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:48.016027    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b916e548-09ed-43b5-a3e2-2c27ca564ad9-workload-certs\") pod \"e2e-api-a-f9def1-openshift-default-66768d9446-7tp57\" (UID: \"b916e548-09ed-43b5-a3e2-2c27ca564ad9\") " pod="openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57"
Sep 11 11:57:48.016245 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:48.016089    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b916e548-09ed-43b5-a3e2-2c27ca564ad9-istio-data\") pod \"e2e-api-a-f9def1-openshift-default-66768d9446-7tp57\" (UID: \"b916e548-09ed-43b5-a3e2-2c27ca564ad9\") " pod="openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57"
Sep 11 11:57:48.016245 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:48.016114    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljqxb\" (UniqueName: \"kubernetes.io/projected/b916e548-09ed-43b5-a3e2-2c27ca564ad9-kube-api-access-ljqxb\") pod \"e2e-api-a-f9def1-openshift-default-66768d9446-7tp57\" (UID: \"b916e548-09ed-43b5-a3e2-2c27ca564ad9\") " pod="openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57"
Sep 11 11:57:48.016245 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:48.016159    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b916e548-09ed-43b5-a3e2-2c27ca564ad9-workload-socket\") pod \"e2e-api-a-f9def1-openshift-default-66768d9446-7tp57\" (UID: \"b916e548-09ed-43b5-a3e2-2c27ca564ad9\") " pod="openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57"
Sep 11 11:57:48.016245 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:48.016178    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b916e548-09ed-43b5-a3e2-2c27ca564ad9-istio-envoy\") pod \"e2e-api-a-f9def1-openshift-default-66768d9446-7tp57\" (UID: \"b916e548-09ed-43b5-a3e2-2c27ca564ad9\") " pod="openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57"
Sep 11 11:57:48.016245 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:48.016212    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b916e548-09ed-43b5-a3e2-2c27ca564ad9-credential-socket\") pod \"e2e-api-a-f9def1-openshift-default-66768d9446-7tp57\" (UID: \"b916e548-09ed-43b5-a3e2-2c27ca564ad9\") " pod="openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57"
Sep 11 11:57:48.016245 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:48.016241    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b916e548-09ed-43b5-a3e2-2c27ca564ad9-istio-token\") pod \"e2e-api-a-f9def1-openshift-default-66768d9446-7tp57\" (UID: \"b916e548-09ed-43b5-a3e2-2c27ca564ad9\") " pod="openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57"
Sep 11 11:57:48.016569 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:48.016347    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b916e548-09ed-43b5-a3e2-2c27ca564ad9-istio-podinfo\") pod \"e2e-api-a-f9def1-openshift-default-66768d9446-7tp57\" (UID: \"b916e548-09ed-43b5-a3e2-2c27ca564ad9\") " pod="openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57"
Sep 11 11:57:48.016569 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:48.016405    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b916e548-09ed-43b5-a3e2-2c27ca564ad9-istiod-ca-cert\") pod \"e2e-api-a-f9def1-openshift-default-66768d9446-7tp57\" (UID: \"b916e548-09ed-43b5-a3e2-2c27ca564ad9\") " pod="openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57"
Sep 11 11:57:48.016569 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:48.016478    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b916e548-09ed-43b5-a3e2-2c27ca564ad9-workload-certs\") pod \"e2e-api-a-f9def1-openshift-default-66768d9446-7tp57\" (UID: \"b916e548-09ed-43b5-a3e2-2c27ca564ad9\") " pod="openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57"
Sep 11 11:57:48.016768 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:48.016615    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b916e548-09ed-43b5-a3e2-2c27ca564ad9-credential-socket\") pod \"e2e-api-a-f9def1-openshift-default-66768d9446-7tp57\" (UID: \"b916e548-09ed-43b5-a3e2-2c27ca564ad9\") " pod="openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57"
Sep 11 11:57:48.016829 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:48.016780    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b916e548-09ed-43b5-a3e2-2c27ca564ad9-workload-socket\") pod \"e2e-api-a-f9def1-openshift-default-66768d9446-7tp57\" (UID: \"b916e548-09ed-43b5-a3e2-2c27ca564ad9\") " pod="openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57"
Sep 11 11:57:48.016829 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:48.016812    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b916e548-09ed-43b5-a3e2-2c27ca564ad9-istio-data\") pod \"e2e-api-a-f9def1-openshift-default-66768d9446-7tp57\" (UID: \"b916e548-09ed-43b5-a3e2-2c27ca564ad9\") " pod="openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57"
Sep 11 11:57:48.017247 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:48.017227    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b916e548-09ed-43b5-a3e2-2c27ca564ad9-istiod-ca-cert\") pod \"e2e-api-a-f9def1-openshift-default-66768d9446-7tp57\" (UID: \"b916e548-09ed-43b5-a3e2-2c27ca564ad9\") " pod="openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57"
Sep 11 11:57:48.019034 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:48.019010    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b916e548-09ed-43b5-a3e2-2c27ca564ad9-istio-envoy\") pod \"e2e-api-a-f9def1-openshift-default-66768d9446-7tp57\" (UID: \"b916e548-09ed-43b5-a3e2-2c27ca564ad9\") " pod="openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57"
Sep 11 11:57:48.019219 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:48.019200    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b916e548-09ed-43b5-a3e2-2c27ca564ad9-istio-podinfo\") pod \"e2e-api-a-f9def1-openshift-default-66768d9446-7tp57\" (UID: \"b916e548-09ed-43b5-a3e2-2c27ca564ad9\") " pod="openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57"
Sep 11 11:57:48.029591 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:48.029562    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b916e548-09ed-43b5-a3e2-2c27ca564ad9-istio-token\") pod \"e2e-api-a-f9def1-openshift-default-66768d9446-7tp57\" (UID: \"b916e548-09ed-43b5-a3e2-2c27ca564ad9\") " pod="openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57"
Sep 11 11:57:48.029824 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:48.029803    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljqxb\" (UniqueName: \"kubernetes.io/projected/b916e548-09ed-43b5-a3e2-2c27ca564ad9-kube-api-access-ljqxb\") pod \"e2e-api-a-f9def1-openshift-default-66768d9446-7tp57\" (UID: \"b916e548-09ed-43b5-a3e2-2c27ca564ad9\") " pod="openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57"
Sep 11 11:57:48.128952 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:48.128868    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57"
Sep 11 11:57:48.407410 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:48.407320    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57"]
Sep 11 11:57:48.410565 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:57:48.410532    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb916e548_09ed_43b5_a3e2_2c27ca564ad9.slice/crio-e771189c21c3c43521030db5c6626e86de2bbc965a1b064d72fc88fc7d929560 WatchSource:0}: Error finding container e771189c21c3c43521030db5c6626e86de2bbc965a1b064d72fc88fc7d929560: Status 404 returned error can't find the container with id e771189c21c3c43521030db5c6626e86de2bbc965a1b064d72fc88fc7d929560
Sep 11 11:57:48.412704 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:48.412674    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:57:48.412781 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:48.412736    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:57:48.412781 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:48.412771    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:57:49.394943 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:49.394678    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57" event={"ID":"b916e548-09ed-43b5-a3e2-2c27ca564ad9","Type":"ContainerStarted","Data":"8aed3cbd48f0af5d1818419b24b89f07e53a1dfbb09a6db309d6e6d7f819d47d"}
Sep 11 11:57:49.395388 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:49.395034    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57" event={"ID":"b916e548-09ed-43b5-a3e2-2c27ca564ad9","Type":"ContainerStarted","Data":"e771189c21c3c43521030db5c6626e86de2bbc965a1b064d72fc88fc7d929560"}
Sep 11 11:57:49.417717 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:49.417673    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57" podStartSLOduration=2.417642781 podStartE2EDuration="2.417642781s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:57:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:57:49.41612878 +0000 UTC m=+1420.238588674" watchObservedRunningTime="2026-09-11 11:57:49.417642781 +0000 UTC m=+1420.240102653"
Sep 11 11:57:50.129528 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:50.129495    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57"
Sep 11 11:57:50.134726 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:50.134701    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57"
Sep 11 11:57:50.399759 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:50.399681    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57"
Sep 11 11:57:50.400637 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:50.400618    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57"
Sep 11 11:57:53.282027 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:53.281993    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-f9def1-56f7cdf686-6jj9z"]
Sep 11 11:57:53.285238 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:53.285222    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f9def1-56f7cdf686-6jj9z"
Sep 11 11:57:53.287462 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:53.287413    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-f9def1\""
Sep 11 11:57:53.287601 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:53.287496    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-f9def1-dockercfg-g47cc\""
Sep 11 11:57:53.295186 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:53.295161    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-f9def1-56f7cdf686-6jj9z"]
Sep 11 11:57:53.367366 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:53.367328    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce92886d-619c-4208-8304-fe3e34f506cf-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-f9def1-56f7cdf686-6jj9z\" (UID: \"ce92886d-619c-4208-8304-fe3e34f506cf\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-f9def1-56f7cdf686-6jj9z"
Sep 11 11:57:53.367539 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:53.367454    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vclnz\" (UniqueName: \"kubernetes.io/projected/ce92886d-619c-4208-8304-fe3e34f506cf-kube-api-access-vclnz\") pod \"payload-pre-processing-e2e-api-a-f9def1-56f7cdf686-6jj9z\" (UID: \"ce92886d-619c-4208-8304-fe3e34f506cf\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-f9def1-56f7cdf686-6jj9z"
Sep 11 11:57:53.467919 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:53.467881    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vclnz\" (UniqueName: \"kubernetes.io/projected/ce92886d-619c-4208-8304-fe3e34f506cf-kube-api-access-vclnz\") pod \"payload-pre-processing-e2e-api-a-f9def1-56f7cdf686-6jj9z\" (UID: \"ce92886d-619c-4208-8304-fe3e34f506cf\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-f9def1-56f7cdf686-6jj9z"
Sep 11 11:57:53.468112 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:53.467942    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce92886d-619c-4208-8304-fe3e34f506cf-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-f9def1-56f7cdf686-6jj9z\" (UID: \"ce92886d-619c-4208-8304-fe3e34f506cf\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-f9def1-56f7cdf686-6jj9z"
Sep 11 11:57:53.468759 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:53.468729    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce92886d-619c-4208-8304-fe3e34f506cf-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-f9def1-56f7cdf686-6jj9z\" (UID: \"ce92886d-619c-4208-8304-fe3e34f506cf\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-f9def1-56f7cdf686-6jj9z"
Sep 11 11:57:53.475603 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:53.475578    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vclnz\" (UniqueName: \"kubernetes.io/projected/ce92886d-619c-4208-8304-fe3e34f506cf-kube-api-access-vclnz\") pod \"payload-pre-processing-e2e-api-a-f9def1-56f7cdf686-6jj9z\" (UID: \"ce92886d-619c-4208-8304-fe3e34f506cf\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-f9def1-56f7cdf686-6jj9z"
Sep 11 11:57:53.597038 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:53.596956    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f9def1-56f7cdf686-6jj9z"
Sep 11 11:57:53.866428 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:53.866325    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-f9def1-56f7cdf686-6jj9z"]
Sep 11 11:57:53.869062 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:57:53.869014    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce92886d_619c_4208_8304_fe3e34f506cf.slice/crio-2e90d3e2eabcf1f2d5a2ae47b7002ff27e627e078c90083941e4e4e3cdf3d19e WatchSource:0}: Error finding container 2e90d3e2eabcf1f2d5a2ae47b7002ff27e627e078c90083941e4e4e3cdf3d19e: Status 404 returned error can't find the container with id 2e90d3e2eabcf1f2d5a2ae47b7002ff27e627e078c90083941e4e4e3cdf3d19e
Sep 11 11:57:54.426722 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:54.426682    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f9def1-56f7cdf686-6jj9z" event={"ID":"ce92886d-619c-4208-8304-fe3e34f506cf","Type":"ContainerStarted","Data":"b249e302d14026ed040e0c41908e6506d839bf023cbd03468e01969b75eec433"}
Sep 11 11:57:54.427095 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:54.426748    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f9def1-56f7cdf686-6jj9z"
Sep 11 11:57:54.427095 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:54.426773    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f9def1-56f7cdf686-6jj9z" event={"ID":"ce92886d-619c-4208-8304-fe3e34f506cf","Type":"ContainerStarted","Data":"2e90d3e2eabcf1f2d5a2ae47b7002ff27e627e078c90083941e4e4e3cdf3d19e"}
Sep 11 11:57:54.446913 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:57:54.446860    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f9def1-56f7cdf686-6jj9z" podStartSLOduration=1.446844737 podStartE2EDuration="1.446844737s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:57:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:57:54.44533716 +0000 UTC m=+1425.267797057" watchObservedRunningTime="2026-09-11 11:57:54.446844737 +0000 UTC m=+1425.269304609"
Sep 11 11:58:05.434308 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:05.434231    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f9def1-56f7cdf686-6jj9z"
Sep 11 11:58:09.972040 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:09.972012    2560 scope.go:117] "RemoveContainer" containerID="acd10fb652b3662465f986f61a662f7a98f8f729a5c809ac5f0c38539c0a8cc3"
Sep 11 11:58:10.514413 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:10.514382    2560 generic.go:356] "Generic (PLEG): container finished" podID="b916e548-09ed-43b5-a3e2-2c27ca564ad9" containerID="8aed3cbd48f0af5d1818419b24b89f07e53a1dfbb09a6db309d6e6d7f819d47d" exitCode=0
Sep 11 11:58:10.514584 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:10.514456    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57" event={"ID":"b916e548-09ed-43b5-a3e2-2c27ca564ad9","Type":"ContainerDied","Data":"8aed3cbd48f0af5d1818419b24b89f07e53a1dfbb09a6db309d6e6d7f819d47d"}
Sep 11 11:58:10.514918 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:10.514901    2560 scope.go:117] "RemoveContainer" containerID="8aed3cbd48f0af5d1818419b24b89f07e53a1dfbb09a6db309d6e6d7f819d47d"
Sep 11 11:58:10.516013 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:10.515985    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:58:10.516099 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:10.516050    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:58:10.516146 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:10.516097    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:58:11.521830 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:11.521798    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57" event={"ID":"b916e548-09ed-43b5-a3e2-2c27ca564ad9","Type":"ContainerStarted","Data":"3e0855f9639dfccdafe65beb9f22f6b392344bfbbe1f7540e7ba82e349013426"}
Sep 11 11:58:12.129446 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:12.129412    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57"
Sep 11 11:58:12.129750 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:12.129727    2560 patch_prober.go:28] interesting pod/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 11 11:58:12.129818 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:12.129773    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57" podUID="b916e548-09ed-43b5-a3e2-2c27ca564ad9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 11 11:58:13.129613 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:13.129580    2560 patch_prober.go:28] interesting pod/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 11 11:58:13.130001 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:13.129635    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57" podUID="b916e548-09ed-43b5-a3e2-2c27ca564ad9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 11 11:58:14.129279 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:14.129236    2560 patch_prober.go:28] interesting pod/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 11 11:58:14.129466 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:14.129306    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57" podUID="b916e548-09ed-43b5-a3e2-2c27ca564ad9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 11 11:58:15.130005 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:15.129969    2560 patch_prober.go:28] interesting pod/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 11 11:58:15.130394 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:15.130023    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57" podUID="b916e548-09ed-43b5-a3e2-2c27ca564ad9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 11 11:58:16.129583 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:16.129541    2560 patch_prober.go:28] interesting pod/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 11 11:58:16.129788 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:16.129608    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57" podUID="b916e548-09ed-43b5-a3e2-2c27ca564ad9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 11 11:58:16.974783 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:16.974752    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m"]
Sep 11 11:58:16.978315 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:16.978290    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m"
Sep 11 11:58:16.980990 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:16.980966    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-641847-openshift-default-dockercfg-wr9nr\""
Sep 11 11:58:16.991008 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:16.990983    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m"]
Sep 11 11:58:17.094614 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:17.094579    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a4be15c-029f-48dd-8de7-e42c13320494-workload-certs\") pod \"e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m\" (UID: \"4a4be15c-029f-48dd-8de7-e42c13320494\") " pod="openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m"
Sep 11 11:58:17.094811 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:17.094632    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a4be15c-029f-48dd-8de7-e42c13320494-istio-podinfo\") pod \"e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m\" (UID: \"4a4be15c-029f-48dd-8de7-e42c13320494\") " pod="openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m"
Sep 11 11:58:17.094811 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:17.094686    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a4be15c-029f-48dd-8de7-e42c13320494-credential-socket\") pod \"e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m\" (UID: \"4a4be15c-029f-48dd-8de7-e42c13320494\") " pod="openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m"
Sep 11 11:58:17.094811 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:17.094736    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a4be15c-029f-48dd-8de7-e42c13320494-istio-data\") pod \"e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m\" (UID: \"4a4be15c-029f-48dd-8de7-e42c13320494\") " pod="openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m"
Sep 11 11:58:17.094811 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:17.094796    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a4be15c-029f-48dd-8de7-e42c13320494-istio-token\") pod \"e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m\" (UID: \"4a4be15c-029f-48dd-8de7-e42c13320494\") " pod="openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m"
Sep 11 11:58:17.095034 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:17.094839    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a4be15c-029f-48dd-8de7-e42c13320494-workload-socket\") pod \"e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m\" (UID: \"4a4be15c-029f-48dd-8de7-e42c13320494\") " pod="openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m"
Sep 11 11:58:17.095034 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:17.094868    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h96kc\" (UniqueName: \"kubernetes.io/projected/4a4be15c-029f-48dd-8de7-e42c13320494-kube-api-access-h96kc\") pod \"e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m\" (UID: \"4a4be15c-029f-48dd-8de7-e42c13320494\") " pod="openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m"
Sep 11 11:58:17.095034 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:17.094932    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a4be15c-029f-48dd-8de7-e42c13320494-istio-envoy\") pod \"e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m\" (UID: \"4a4be15c-029f-48dd-8de7-e42c13320494\") " pod="openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m"
Sep 11 11:58:17.095034 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:17.094949    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a4be15c-029f-48dd-8de7-e42c13320494-istiod-ca-cert\") pod \"e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m\" (UID: \"4a4be15c-029f-48dd-8de7-e42c13320494\") " pod="openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m"
Sep 11 11:58:17.133522 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:17.133492    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57"
Sep 11 11:58:17.133905 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:17.133883    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57"
Sep 11 11:58:17.134493 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:17.134473    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57"
Sep 11 11:58:17.196543 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:17.196509    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a4be15c-029f-48dd-8de7-e42c13320494-istio-envoy\") pod \"e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m\" (UID: \"4a4be15c-029f-48dd-8de7-e42c13320494\") " pod="openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m"
Sep 11 11:58:17.196543 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:17.196553    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a4be15c-029f-48dd-8de7-e42c13320494-istiod-ca-cert\") pod \"e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m\" (UID: \"4a4be15c-029f-48dd-8de7-e42c13320494\") " pod="openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m"
Sep 11 11:58:17.196818 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:17.196629    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a4be15c-029f-48dd-8de7-e42c13320494-workload-certs\") pod \"e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m\" (UID: \"4a4be15c-029f-48dd-8de7-e42c13320494\") " pod="openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m"
Sep 11 11:58:17.196818 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:17.196685    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a4be15c-029f-48dd-8de7-e42c13320494-istio-podinfo\") pod \"e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m\" (UID: \"4a4be15c-029f-48dd-8de7-e42c13320494\") " pod="openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m"
Sep 11 11:58:17.196818 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:17.196727    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a4be15c-029f-48dd-8de7-e42c13320494-credential-socket\") pod \"e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m\" (UID: \"4a4be15c-029f-48dd-8de7-e42c13320494\") " pod="openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m"
Sep 11 11:58:17.196818 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:17.196750    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a4be15c-029f-48dd-8de7-e42c13320494-istio-data\") pod \"e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m\" (UID: \"4a4be15c-029f-48dd-8de7-e42c13320494\") " pod="openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m"
Sep 11 11:58:17.196818 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:17.196791    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a4be15c-029f-48dd-8de7-e42c13320494-istio-token\") pod \"e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m\" (UID: \"4a4be15c-029f-48dd-8de7-e42c13320494\") " pod="openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m"
Sep 11 11:58:17.197113 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:17.196825    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a4be15c-029f-48dd-8de7-e42c13320494-workload-socket\") pod \"e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m\" (UID: \"4a4be15c-029f-48dd-8de7-e42c13320494\") " pod="openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m"
Sep 11 11:58:17.197113 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:17.196849    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h96kc\" (UniqueName: \"kubernetes.io/projected/4a4be15c-029f-48dd-8de7-e42c13320494-kube-api-access-h96kc\") pod \"e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m\" (UID: \"4a4be15c-029f-48dd-8de7-e42c13320494\") " pod="openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m"
Sep 11 11:58:17.198333 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:17.197622    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a4be15c-029f-48dd-8de7-e42c13320494-credential-socket\") pod \"e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m\" (UID: \"4a4be15c-029f-48dd-8de7-e42c13320494\") " pod="openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m"
Sep 11 11:58:17.198333 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:17.197686    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a4be15c-029f-48dd-8de7-e42c13320494-workload-certs\") pod \"e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m\" (UID: \"4a4be15c-029f-48dd-8de7-e42c13320494\") " pod="openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m"
Sep 11 11:58:17.198333 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:17.198020    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a4be15c-029f-48dd-8de7-e42c13320494-workload-socket\") pod \"e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m\" (UID: \"4a4be15c-029f-48dd-8de7-e42c13320494\") " pod="openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m"
Sep 11 11:58:17.198333 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:17.198234    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a4be15c-029f-48dd-8de7-e42c13320494-istio-data\") pod \"e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m\" (UID: \"4a4be15c-029f-48dd-8de7-e42c13320494\") " pod="openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m"
Sep 11 11:58:17.198333 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:17.198290    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a4be15c-029f-48dd-8de7-e42c13320494-istiod-ca-cert\") pod \"e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m\" (UID: \"4a4be15c-029f-48dd-8de7-e42c13320494\") " pod="openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m"
Sep 11 11:58:17.200359 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:17.200318    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a4be15c-029f-48dd-8de7-e42c13320494-istio-podinfo\") pod \"e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m\" (UID: \"4a4be15c-029f-48dd-8de7-e42c13320494\") " pod="openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m"
Sep 11 11:58:17.200573 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:17.200551    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a4be15c-029f-48dd-8de7-e42c13320494-istio-envoy\") pod \"e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m\" (UID: \"4a4be15c-029f-48dd-8de7-e42c13320494\") " pod="openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m"
Sep 11 11:58:17.209906 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:17.209872    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a4be15c-029f-48dd-8de7-e42c13320494-istio-token\") pod \"e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m\" (UID: \"4a4be15c-029f-48dd-8de7-e42c13320494\") " pod="openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m"
Sep 11 11:58:17.212255 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:17.212231    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h96kc\" (UniqueName: \"kubernetes.io/projected/4a4be15c-029f-48dd-8de7-e42c13320494-kube-api-access-h96kc\") pod \"e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m\" (UID: \"4a4be15c-029f-48dd-8de7-e42c13320494\") " pod="openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m"
Sep 11 11:58:17.290241 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:17.290126    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m"
Sep 11 11:58:17.569585 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:17.569562    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m"]
Sep 11 11:58:17.571330 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:58:17.571309    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a4be15c_029f_48dd_8de7_e42c13320494.slice/crio-3d46a3211c2feb203d73b889cc78c2f01729222bb8935ff5b62e97a5ae1c6870 WatchSource:0}: Error finding container 3d46a3211c2feb203d73b889cc78c2f01729222bb8935ff5b62e97a5ae1c6870: Status 404 returned error can't find the container with id 3d46a3211c2feb203d73b889cc78c2f01729222bb8935ff5b62e97a5ae1c6870
Sep 11 11:58:17.573492 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:17.573458    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:58:17.573548 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:17.573521    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:58:17.573590 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:17.573552    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:58:18.561914 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:18.561872    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m" event={"ID":"4a4be15c-029f-48dd-8de7-e42c13320494","Type":"ContainerStarted","Data":"6e2f97f75f8b15cc1fba441218af2207b7274d9b58e67aaa9c0f8b67bcd9a087"}
Sep 11 11:58:18.562334 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:18.561934    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m" event={"ID":"4a4be15c-029f-48dd-8de7-e42c13320494","Type":"ContainerStarted","Data":"3d46a3211c2feb203d73b889cc78c2f01729222bb8935ff5b62e97a5ae1c6870"}
Sep 11 11:58:18.582054 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:18.581999    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m" podStartSLOduration=2.581984605 podStartE2EDuration="2.581984605s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:58:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:58:18.580905341 +0000 UTC m=+1449.403365214" watchObservedRunningTime="2026-09-11 11:58:18.581984605 +0000 UTC m=+1449.404444523"
Sep 11 11:58:19.290638 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:19.290600    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m"
Sep 11 11:58:19.296131 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:19.296091    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m"
Sep 11 11:58:19.567308 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:19.567224    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m"
Sep 11 11:58:19.568232 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:19.568208    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m"
Sep 11 11:58:43.704018 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:43.703982    2560 generic.go:356] "Generic (PLEG): container finished" podID="4a4be15c-029f-48dd-8de7-e42c13320494" containerID="6e2f97f75f8b15cc1fba441218af2207b7274d9b58e67aaa9c0f8b67bcd9a087" exitCode=0
Sep 11 11:58:43.704481 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:43.704026    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m" event={"ID":"4a4be15c-029f-48dd-8de7-e42c13320494","Type":"ContainerDied","Data":"6e2f97f75f8b15cc1fba441218af2207b7274d9b58e67aaa9c0f8b67bcd9a087"}
Sep 11 11:58:43.704481 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:43.704416    2560 scope.go:117] "RemoveContainer" containerID="6e2f97f75f8b15cc1fba441218af2207b7274d9b58e67aaa9c0f8b67bcd9a087"
Sep 11 11:58:43.705610 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:43.705580    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:58:43.705744 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:43.705683    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:58:43.705744 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:43.705733    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 11:58:44.710927 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:44.710885    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m" event={"ID":"4a4be15c-029f-48dd-8de7-e42c13320494","Type":"ContainerStarted","Data":"770bad44ff506c34ac34d0f5eec46141a142ad13c3855e6d0c6a7361565b1773"}
Sep 11 11:58:45.291048 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:45.291008    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m"
Sep 11 11:58:45.292052 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:45.292026    2560 patch_prober.go:28] interesting pod/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 11 11:58:45.292164 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:45.292077    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m" podUID="4a4be15c-029f-48dd-8de7-e42c13320494" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 11 11:58:46.290892 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:46.290853    2560 patch_prober.go:28] interesting pod/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 11 11:58:46.291277 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:46.290942    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m" podUID="4a4be15c-029f-48dd-8de7-e42c13320494" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 11 11:58:47.291543 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:47.291504    2560 patch_prober.go:28] interesting pod/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 11 11:58:47.291960 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:47.291574    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m" podUID="4a4be15c-029f-48dd-8de7-e42c13320494" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 11 11:58:48.204214 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:48.204179    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f9def1-fptg9"]
Sep 11 11:58:48.207411 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:48.207393    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f9def1-fptg9"
Sep 11 11:58:48.209850 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:48.209828    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 11:58:48.209941 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:48.209829    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f46tj\""
Sep 11 11:58:48.215119 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:48.215098    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f9def1-fptg9"]
Sep 11 11:58:48.290982 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:48.290945    2560 patch_prober.go:28] interesting pod/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 11 11:58:48.291155 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:48.291019    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m" podUID="4a4be15c-029f-48dd-8de7-e42c13320494" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 11 11:58:48.296517 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:48.296490    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/91bc8ee2-cb07-46f4-97bc-54205087fcaf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-f9def1-fptg9\" (UID: \"91bc8ee2-cb07-46f4-97bc-54205087fcaf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f9def1-fptg9"
Sep 11 11:58:48.397390 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:48.397352    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/91bc8ee2-cb07-46f4-97bc-54205087fcaf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-f9def1-fptg9\" (UID: \"91bc8ee2-cb07-46f4-97bc-54205087fcaf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f9def1-fptg9"
Sep 11 11:58:48.398028 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:48.398009    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/91bc8ee2-cb07-46f4-97bc-54205087fcaf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-f9def1-fptg9\" (UID: \"91bc8ee2-cb07-46f4-97bc-54205087fcaf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f9def1-fptg9"
Sep 11 11:58:48.518633 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:48.518599    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f9def1-fptg9"
Sep 11 11:58:48.818841 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:48.818768    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f9def1-fptg9"]
Sep 11 11:58:48.822548 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:58:48.822521    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91bc8ee2_cb07_46f4_97bc_54205087fcaf.slice/crio-ffa8f96f8813e1f49eecdf9c46d6e7bd5fc60d3e6dcbf62f25155e0d2fcaaa2a WatchSource:0}: Error finding container ffa8f96f8813e1f49eecdf9c46d6e7bd5fc60d3e6dcbf62f25155e0d2fcaaa2a: Status 404 returned error can't find the container with id ffa8f96f8813e1f49eecdf9c46d6e7bd5fc60d3e6dcbf62f25155e0d2fcaaa2a
Sep 11 11:58:49.290568 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:49.290529    2560 patch_prober.go:28] interesting pod/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 11 11:58:49.290805 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:49.290587    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m" podUID="4a4be15c-029f-48dd-8de7-e42c13320494" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 11 11:58:49.567745 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:49.567708    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m"
Sep 11 11:58:49.740140 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:49.740091    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f9def1-fptg9" event={"ID":"91bc8ee2-cb07-46f4-97bc-54205087fcaf","Type":"ContainerStarted","Data":"6c04fed9489c1182b8ac111ad0f1302f9fec07bf6f36b44952e3610c4081c9e6"}
Sep 11 11:58:49.740323 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:49.740164    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f9def1-fptg9" event={"ID":"91bc8ee2-cb07-46f4-97bc-54205087fcaf","Type":"ContainerStarted","Data":"ffa8f96f8813e1f49eecdf9c46d6e7bd5fc60d3e6dcbf62f25155e0d2fcaaa2a"}
Sep 11 11:58:49.757572 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:49.757524    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f9def1-fptg9" podStartSLOduration=1.75750816 podStartE2EDuration="1.75750816s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:58:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:58:49.755454204 +0000 UTC m=+1480.577914117" watchObservedRunningTime="2026-09-11 11:58:49.75750816 +0000 UTC m=+1480.579968032"
Sep 11 11:58:50.295242 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:50.295207    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m"
Sep 11 11:58:50.296063 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:50.296043    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m"
Sep 11 11:58:50.747191 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:50.747149    2560 generic.go:356] "Generic (PLEG): container finished" podID="91bc8ee2-cb07-46f4-97bc-54205087fcaf" containerID="6c04fed9489c1182b8ac111ad0f1302f9fec07bf6f36b44952e3610c4081c9e6" exitCode=0
Sep 11 11:58:50.747691 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:50.747237    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f9def1-fptg9" event={"ID":"91bc8ee2-cb07-46f4-97bc-54205087fcaf","Type":"ContainerDied","Data":"6c04fed9489c1182b8ac111ad0f1302f9fec07bf6f36b44952e3610c4081c9e6"}
Sep 11 11:58:51.891123 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:51.891089    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f9def1-fptg9"
Sep 11 11:58:52.032155 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:52.032059    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/91bc8ee2-cb07-46f4-97bc-54205087fcaf-maas-api-service-ca\") pod \"91bc8ee2-cb07-46f4-97bc-54205087fcaf\" (UID: \"91bc8ee2-cb07-46f4-97bc-54205087fcaf\") "
Sep 11 11:58:52.032414 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:52.032387    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91bc8ee2-cb07-46f4-97bc-54205087fcaf-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "91bc8ee2-cb07-46f4-97bc-54205087fcaf" (UID: "91bc8ee2-cb07-46f4-97bc-54205087fcaf"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 11:58:52.132925 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:52.132894    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/91bc8ee2-cb07-46f4-97bc-54205087fcaf-maas-api-service-ca\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:58:52.759070 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:52.759044    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f9def1-fptg9"
Sep 11 11:58:52.759070 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:52.759061    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f9def1-fptg9" event={"ID":"91bc8ee2-cb07-46f4-97bc-54205087fcaf","Type":"ContainerDied","Data":"ffa8f96f8813e1f49eecdf9c46d6e7bd5fc60d3e6dcbf62f25155e0d2fcaaa2a"}
Sep 11 11:58:52.759285 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:58:52.759106    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ffa8f96f8813e1f49eecdf9c46d6e7bd5fc60d3e6dcbf62f25155e0d2fcaaa2a"
Sep 11 11:59:03.998404 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:03.998365    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-f9def1-56f7cdf686-6jj9z"]
Sep 11 11:59:03.998995 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:03.998820    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f9def1-56f7cdf686-6jj9z" podUID="ce92886d-619c-4208-8304-fe3e34f506cf" containerName="payload-pre-processing" containerID="cri-o://b249e302d14026ed040e0c41908e6506d839bf023cbd03468e01969b75eec433" gracePeriod=30
Sep 11 11:59:04.238636 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:04.238579    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f9def1-fptg9"]
Sep 11 11:59:04.244845 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:04.244808    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f9def1-fptg9"]
Sep 11 11:59:04.275872 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:04.275846    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f9def1-56f7cdf686-6jj9z"
Sep 11 11:59:04.450643 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:04.450601    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce92886d-619c-4208-8304-fe3e34f506cf-plugins-config-volume\") pod \"ce92886d-619c-4208-8304-fe3e34f506cf\" (UID: \"ce92886d-619c-4208-8304-fe3e34f506cf\") "
Sep 11 11:59:04.450843 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:04.450732    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vclnz\" (UniqueName: \"kubernetes.io/projected/ce92886d-619c-4208-8304-fe3e34f506cf-kube-api-access-vclnz\") pod \"ce92886d-619c-4208-8304-fe3e34f506cf\" (UID: \"ce92886d-619c-4208-8304-fe3e34f506cf\") "
Sep 11 11:59:04.451077 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:04.451055    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce92886d-619c-4208-8304-fe3e34f506cf-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ce92886d-619c-4208-8304-fe3e34f506cf" (UID: "ce92886d-619c-4208-8304-fe3e34f506cf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 11:59:04.452729 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:04.452711    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce92886d-619c-4208-8304-fe3e34f506cf-kube-api-access-vclnz" (OuterVolumeSpecName: "kube-api-access-vclnz") pod "ce92886d-619c-4208-8304-fe3e34f506cf" (UID: "ce92886d-619c-4208-8304-fe3e34f506cf"). InnerVolumeSpecName "kube-api-access-vclnz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:59:04.551672 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:04.551565    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vclnz\" (UniqueName: \"kubernetes.io/projected/ce92886d-619c-4208-8304-fe3e34f506cf-kube-api-access-vclnz\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:59:04.551672 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:04.551592    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce92886d-619c-4208-8304-fe3e34f506cf-plugins-config-volume\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:59:04.822872 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:04.822788    2560 generic.go:356] "Generic (PLEG): container finished" podID="ce92886d-619c-4208-8304-fe3e34f506cf" containerID="b249e302d14026ed040e0c41908e6506d839bf023cbd03468e01969b75eec433" exitCode=0
Sep 11 11:59:04.822872 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:04.822843    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f9def1-56f7cdf686-6jj9z"
Sep 11 11:59:04.823048 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:04.822872    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f9def1-56f7cdf686-6jj9z" event={"ID":"ce92886d-619c-4208-8304-fe3e34f506cf","Type":"ContainerDied","Data":"b249e302d14026ed040e0c41908e6506d839bf023cbd03468e01969b75eec433"}
Sep 11 11:59:04.823048 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:04.822929    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f9def1-56f7cdf686-6jj9z" event={"ID":"ce92886d-619c-4208-8304-fe3e34f506cf","Type":"ContainerDied","Data":"2e90d3e2eabcf1f2d5a2ae47b7002ff27e627e078c90083941e4e4e3cdf3d19e"}
Sep 11 11:59:04.823048 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:04.822954    2560 scope.go:117] "RemoveContainer" containerID="b249e302d14026ed040e0c41908e6506d839bf023cbd03468e01969b75eec433"
Sep 11 11:59:04.832311 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:04.832294    2560 scope.go:117] "RemoveContainer" containerID="b249e302d14026ed040e0c41908e6506d839bf023cbd03468e01969b75eec433"
Sep 11 11:59:04.832626 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:59:04.832601    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b249e302d14026ed040e0c41908e6506d839bf023cbd03468e01969b75eec433\": container with ID starting with b249e302d14026ed040e0c41908e6506d839bf023cbd03468e01969b75eec433 not found: ID does not exist" containerID="b249e302d14026ed040e0c41908e6506d839bf023cbd03468e01969b75eec433"
Sep 11 11:59:04.832737 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:04.832639    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b249e302d14026ed040e0c41908e6506d839bf023cbd03468e01969b75eec433"} err="failed to get container status \"b249e302d14026ed040e0c41908e6506d839bf023cbd03468e01969b75eec433\": rpc error: code = NotFound desc = could not find container \"b249e302d14026ed040e0c41908e6506d839bf023cbd03468e01969b75eec433\": container with ID starting with b249e302d14026ed040e0c41908e6506d839bf023cbd03468e01969b75eec433 not found: ID does not exist"
Sep 11 11:59:04.846273 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:04.846237    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-f9def1-56f7cdf686-6jj9z"]
Sep 11 11:59:04.849188 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:04.849143    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-f9def1-56f7cdf686-6jj9z"]
Sep 11 11:59:05.814085 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:05.814037    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91bc8ee2-cb07-46f4-97bc-54205087fcaf" path="/var/lib/kubelet/pods/91bc8ee2-cb07-46f4-97bc-54205087fcaf/volumes"
Sep 11 11:59:05.814590 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:05.814569    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce92886d-619c-4208-8304-fe3e34f506cf" path="/var/lib/kubelet/pods/ce92886d-619c-4208-8304-fe3e34f506cf/volumes"
Sep 11 11:59:09.992799 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:09.992768    2560 scope.go:117] "RemoveContainer" containerID="aaa8674670f7c7c758b89541af5b1c13840751fab5cc85927ab831b7fd2e353f"
Sep 11 11:59:10.001126 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:10.001102    2560 scope.go:117] "RemoveContainer" containerID="7cde8d621a6be61f0b1b4e69f11faad3c09c34543ce4a2891a8c35544c9510e3"
Sep 11 11:59:10.008456 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:10.008436    2560 scope.go:117] "RemoveContainer" containerID="697c10b0bed79ae5350e83121b3907bb7688d283392fd1d436629b7b87068dba"
Sep 11 11:59:11.379950 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:11.379918    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57"]
Sep 11 11:59:11.380428 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:11.380164    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57" podUID="b916e548-09ed-43b5-a3e2-2c27ca564ad9" containerName="istio-proxy" containerID="cri-o://3e0855f9639dfccdafe65beb9f22f6b392344bfbbe1f7540e7ba82e349013426" gracePeriod=30
Sep 11 11:59:11.735002 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:11.734969    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-641847-qbz6w"]
Sep 11 11:59:11.735359 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:11.735345    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91bc8ee2-cb07-46f4-97bc-54205087fcaf" containerName="revoke-keys"
Sep 11 11:59:11.735412 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:11.735361    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="91bc8ee2-cb07-46f4-97bc-54205087fcaf" containerName="revoke-keys"
Sep 11 11:59:11.735412 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:11.735370    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce92886d-619c-4208-8304-fe3e34f506cf" containerName="payload-pre-processing"
Sep 11 11:59:11.735412 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:11.735376    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce92886d-619c-4208-8304-fe3e34f506cf" containerName="payload-pre-processing"
Sep 11 11:59:11.735507 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:11.735433    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce92886d-619c-4208-8304-fe3e34f506cf" containerName="payload-pre-processing"
Sep 11 11:59:11.735507 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:11.735443    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="91bc8ee2-cb07-46f4-97bc-54205087fcaf" containerName="revoke-keys"
Sep 11 11:59:11.738436 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:11.738418    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-641847-qbz6w"
Sep 11 11:59:11.741056 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:11.741030    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f46tj\""
Sep 11 11:59:11.741172 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:11.741110    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 11:59:11.752890 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:11.752867    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-641847-qbz6w"]
Sep 11 11:59:11.919743 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:11.919673    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b568c7eb-7d79-49ff-831e-1aa80ffdf8ac-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-641847-qbz6w\" (UID: \"b568c7eb-7d79-49ff-831e-1aa80ffdf8ac\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-641847-qbz6w"
Sep 11 11:59:12.020796 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:12.020715    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b568c7eb-7d79-49ff-831e-1aa80ffdf8ac-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-641847-qbz6w\" (UID: \"b568c7eb-7d79-49ff-831e-1aa80ffdf8ac\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-641847-qbz6w"
Sep 11 11:59:12.021342 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:12.021322    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b568c7eb-7d79-49ff-831e-1aa80ffdf8ac-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-641847-qbz6w\" (UID: \"b568c7eb-7d79-49ff-831e-1aa80ffdf8ac\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-641847-qbz6w"
Sep 11 11:59:12.049115 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:12.049078    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-641847-qbz6w"
Sep 11 11:59:12.321801 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:12.321779    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-641847-qbz6w"]
Sep 11 11:59:12.323930 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:59:12.323903    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb568c7eb_7d79_49ff_831e_1aa80ffdf8ac.slice/crio-44b4b11c987b2dc407e884de95bf63fc9fceacd28988027d6e814aa6b2a4c478 WatchSource:0}: Error finding container 44b4b11c987b2dc407e884de95bf63fc9fceacd28988027d6e814aa6b2a4c478: Status 404 returned error can't find the container with id 44b4b11c987b2dc407e884de95bf63fc9fceacd28988027d6e814aa6b2a4c478
Sep 11 11:59:12.865141 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:12.865105    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-641847-qbz6w" event={"ID":"b568c7eb-7d79-49ff-831e-1aa80ffdf8ac","Type":"ContainerStarted","Data":"394912e251656c275ac320bf352e8463bdc0704d040895235922bb1646912341"}
Sep 11 11:59:12.865519 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:12.865167    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-641847-qbz6w" event={"ID":"b568c7eb-7d79-49ff-831e-1aa80ffdf8ac","Type":"ContainerStarted","Data":"44b4b11c987b2dc407e884de95bf63fc9fceacd28988027d6e814aa6b2a4c478"}
Sep 11 11:59:12.896306 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:12.896201    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-641847-qbz6w" podStartSLOduration=1.8961811530000001 podStartE2EDuration="1.896181153s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:59:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:59:12.895361544 +0000 UTC m=+1503.717821416" watchObservedRunningTime="2026-09-11 11:59:12.896181153 +0000 UTC m=+1503.718641027"
Sep 11 11:59:13.871603 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:13.871568    2560 generic.go:356] "Generic (PLEG): container finished" podID="b568c7eb-7d79-49ff-831e-1aa80ffdf8ac" containerID="394912e251656c275ac320bf352e8463bdc0704d040895235922bb1646912341" exitCode=0
Sep 11 11:59:13.871603 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:13.871609    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-641847-qbz6w" event={"ID":"b568c7eb-7d79-49ff-831e-1aa80ffdf8ac","Type":"ContainerDied","Data":"394912e251656c275ac320bf352e8463bdc0704d040895235922bb1646912341"}
Sep 11 11:59:15.004084 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:15.004059    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-641847-qbz6w"
Sep 11 11:59:15.049413 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:15.049382    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b568c7eb-7d79-49ff-831e-1aa80ffdf8ac-maas-api-service-ca\") pod \"b568c7eb-7d79-49ff-831e-1aa80ffdf8ac\" (UID: \"b568c7eb-7d79-49ff-831e-1aa80ffdf8ac\") "
Sep 11 11:59:15.049750 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:15.049726    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b568c7eb-7d79-49ff-831e-1aa80ffdf8ac-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b568c7eb-7d79-49ff-831e-1aa80ffdf8ac" (UID: "b568c7eb-7d79-49ff-831e-1aa80ffdf8ac"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 11:59:15.150590 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:15.150499    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b568c7eb-7d79-49ff-831e-1aa80ffdf8ac-maas-api-service-ca\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:59:15.882856 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:15.882826    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-641847-qbz6w"
Sep 11 11:59:15.883034 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:15.882860    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-641847-qbz6w" event={"ID":"b568c7eb-7d79-49ff-831e-1aa80ffdf8ac","Type":"ContainerDied","Data":"44b4b11c987b2dc407e884de95bf63fc9fceacd28988027d6e814aa6b2a4c478"}
Sep 11 11:59:15.883034 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:15.882908    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="44b4b11c987b2dc407e884de95bf63fc9fceacd28988027d6e814aa6b2a4c478"
Sep 11 11:59:16.634898 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:16.634873    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57"
Sep 11 11:59:16.663201 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:16.663126    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b916e548-09ed-43b5-a3e2-2c27ca564ad9-istio-podinfo\") pod \"b916e548-09ed-43b5-a3e2-2c27ca564ad9\" (UID: \"b916e548-09ed-43b5-a3e2-2c27ca564ad9\") "
Sep 11 11:59:16.663201 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:16.663170    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b916e548-09ed-43b5-a3e2-2c27ca564ad9-istiod-ca-cert\") pod \"b916e548-09ed-43b5-a3e2-2c27ca564ad9\" (UID: \"b916e548-09ed-43b5-a3e2-2c27ca564ad9\") "
Sep 11 11:59:16.663413 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:16.663208    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b916e548-09ed-43b5-a3e2-2c27ca564ad9-credential-socket\") pod \"b916e548-09ed-43b5-a3e2-2c27ca564ad9\" (UID: \"b916e548-09ed-43b5-a3e2-2c27ca564ad9\") "
Sep 11 11:59:16.663413 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:16.663253    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b916e548-09ed-43b5-a3e2-2c27ca564ad9-istio-token\") pod \"b916e548-09ed-43b5-a3e2-2c27ca564ad9\" (UID: \"b916e548-09ed-43b5-a3e2-2c27ca564ad9\") "
Sep 11 11:59:16.663413 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:16.663286    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b916e548-09ed-43b5-a3e2-2c27ca564ad9-workload-socket\") pod \"b916e548-09ed-43b5-a3e2-2c27ca564ad9\" (UID: \"b916e548-09ed-43b5-a3e2-2c27ca564ad9\") "
Sep 11 11:59:16.663589 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:16.663486    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b916e548-09ed-43b5-a3e2-2c27ca564ad9-workload-certs\") pod \"b916e548-09ed-43b5-a3e2-2c27ca564ad9\" (UID: \"b916e548-09ed-43b5-a3e2-2c27ca564ad9\") "
Sep 11 11:59:16.663740 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:16.663580    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b916e548-09ed-43b5-a3e2-2c27ca564ad9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b916e548-09ed-43b5-a3e2-2c27ca564ad9" (UID: "b916e548-09ed-43b5-a3e2-2c27ca564ad9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:59:16.663740 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:16.663633    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b916e548-09ed-43b5-a3e2-2c27ca564ad9-istio-data\") pod \"b916e548-09ed-43b5-a3e2-2c27ca564ad9\" (UID: \"b916e548-09ed-43b5-a3e2-2c27ca564ad9\") "
Sep 11 11:59:16.663870 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:16.663744    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ljqxb\" (UniqueName: \"kubernetes.io/projected/b916e548-09ed-43b5-a3e2-2c27ca564ad9-kube-api-access-ljqxb\") pod \"b916e548-09ed-43b5-a3e2-2c27ca564ad9\" (UID: \"b916e548-09ed-43b5-a3e2-2c27ca564ad9\") "
Sep 11 11:59:16.663870 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:16.663760    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b916e548-09ed-43b5-a3e2-2c27ca564ad9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b916e548-09ed-43b5-a3e2-2c27ca564ad9" (UID: "b916e548-09ed-43b5-a3e2-2c27ca564ad9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:59:16.663870 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:16.663692    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b916e548-09ed-43b5-a3e2-2c27ca564ad9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b916e548-09ed-43b5-a3e2-2c27ca564ad9" (UID: "b916e548-09ed-43b5-a3e2-2c27ca564ad9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 11:59:16.663870 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:16.663783    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b916e548-09ed-43b5-a3e2-2c27ca564ad9-istio-envoy\") pod \"b916e548-09ed-43b5-a3e2-2c27ca564ad9\" (UID: \"b916e548-09ed-43b5-a3e2-2c27ca564ad9\") "
Sep 11 11:59:16.664077 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:16.663949    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b916e548-09ed-43b5-a3e2-2c27ca564ad9-istio-data" (OuterVolumeSpecName: "istio-data") pod "b916e548-09ed-43b5-a3e2-2c27ca564ad9" (UID: "b916e548-09ed-43b5-a3e2-2c27ca564ad9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:59:16.664182 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:16.664122    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b916e548-09ed-43b5-a3e2-2c27ca564ad9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b916e548-09ed-43b5-a3e2-2c27ca564ad9" (UID: "b916e548-09ed-43b5-a3e2-2c27ca564ad9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:59:16.664296 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:16.664181    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b916e548-09ed-43b5-a3e2-2c27ca564ad9-istiod-ca-cert\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:59:16.664296 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:16.664200    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b916e548-09ed-43b5-a3e2-2c27ca564ad9-credential-socket\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:59:16.664296 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:16.664212    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b916e548-09ed-43b5-a3e2-2c27ca564ad9-workload-certs\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:59:16.664296 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:16.664224    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b916e548-09ed-43b5-a3e2-2c27ca564ad9-istio-data\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:59:16.665611 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:16.665561    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b916e548-09ed-43b5-a3e2-2c27ca564ad9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b916e548-09ed-43b5-a3e2-2c27ca564ad9" (UID: "b916e548-09ed-43b5-a3e2-2c27ca564ad9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 11:59:16.666272 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:16.666242    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b916e548-09ed-43b5-a3e2-2c27ca564ad9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b916e548-09ed-43b5-a3e2-2c27ca564ad9" (UID: "b916e548-09ed-43b5-a3e2-2c27ca564ad9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:59:16.666394 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:16.666370    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b916e548-09ed-43b5-a3e2-2c27ca564ad9-kube-api-access-ljqxb" (OuterVolumeSpecName: "kube-api-access-ljqxb") pod "b916e548-09ed-43b5-a3e2-2c27ca564ad9" (UID: "b916e548-09ed-43b5-a3e2-2c27ca564ad9"). InnerVolumeSpecName "kube-api-access-ljqxb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:59:16.666849 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:16.666824    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b916e548-09ed-43b5-a3e2-2c27ca564ad9-istio-token" (OuterVolumeSpecName: "istio-token") pod "b916e548-09ed-43b5-a3e2-2c27ca564ad9" (UID: "b916e548-09ed-43b5-a3e2-2c27ca564ad9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:59:16.765526 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:16.765485    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ljqxb\" (UniqueName: \"kubernetes.io/projected/b916e548-09ed-43b5-a3e2-2c27ca564ad9-kube-api-access-ljqxb\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:59:16.765526 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:16.765526    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b916e548-09ed-43b5-a3e2-2c27ca564ad9-istio-envoy\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:59:16.765769 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:16.765538    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b916e548-09ed-43b5-a3e2-2c27ca564ad9-istio-podinfo\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:59:16.765769 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:16.765546    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b916e548-09ed-43b5-a3e2-2c27ca564ad9-istio-token\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:59:16.765769 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:16.765555    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b916e548-09ed-43b5-a3e2-2c27ca564ad9-workload-socket\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:59:16.889437 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:16.889403    2560 generic.go:356] "Generic (PLEG): container finished" podID="b916e548-09ed-43b5-a3e2-2c27ca564ad9" containerID="3e0855f9639dfccdafe65beb9f22f6b392344bfbbe1f7540e7ba82e349013426" exitCode=0
Sep 11 11:59:16.889598 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:16.889454    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57"
Sep 11 11:59:16.889598 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:16.889486    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57" event={"ID":"b916e548-09ed-43b5-a3e2-2c27ca564ad9","Type":"ContainerDied","Data":"3e0855f9639dfccdafe65beb9f22f6b392344bfbbe1f7540e7ba82e349013426"}
Sep 11 11:59:16.889598 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:16.889541    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57" event={"ID":"b916e548-09ed-43b5-a3e2-2c27ca564ad9","Type":"ContainerDied","Data":"e771189c21c3c43521030db5c6626e86de2bbc965a1b064d72fc88fc7d929560"}
Sep 11 11:59:16.889598 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:16.889572    2560 scope.go:117] "RemoveContainer" containerID="3e0855f9639dfccdafe65beb9f22f6b392344bfbbe1f7540e7ba82e349013426"
Sep 11 11:59:16.898964 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:16.898946    2560 scope.go:117] "RemoveContainer" containerID="8aed3cbd48f0af5d1818419b24b89f07e53a1dfbb09a6db309d6e6d7f819d47d"
Sep 11 11:59:16.906732 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:16.906715    2560 scope.go:117] "RemoveContainer" containerID="3e0855f9639dfccdafe65beb9f22f6b392344bfbbe1f7540e7ba82e349013426"
Sep 11 11:59:16.906996 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:59:16.906977    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e0855f9639dfccdafe65beb9f22f6b392344bfbbe1f7540e7ba82e349013426\": container with ID starting with 3e0855f9639dfccdafe65beb9f22f6b392344bfbbe1f7540e7ba82e349013426 not found: ID does not exist" containerID="3e0855f9639dfccdafe65beb9f22f6b392344bfbbe1f7540e7ba82e349013426"
Sep 11 11:59:16.907061 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:16.907004    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e0855f9639dfccdafe65beb9f22f6b392344bfbbe1f7540e7ba82e349013426"} err="failed to get container status \"3e0855f9639dfccdafe65beb9f22f6b392344bfbbe1f7540e7ba82e349013426\": rpc error: code = NotFound desc = could not find container \"3e0855f9639dfccdafe65beb9f22f6b392344bfbbe1f7540e7ba82e349013426\": container with ID starting with 3e0855f9639dfccdafe65beb9f22f6b392344bfbbe1f7540e7ba82e349013426 not found: ID does not exist"
Sep 11 11:59:16.907061 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:16.907021    2560 scope.go:117] "RemoveContainer" containerID="8aed3cbd48f0af5d1818419b24b89f07e53a1dfbb09a6db309d6e6d7f819d47d"
Sep 11 11:59:16.907295 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:59:16.907280    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8aed3cbd48f0af5d1818419b24b89f07e53a1dfbb09a6db309d6e6d7f819d47d\": container with ID starting with 8aed3cbd48f0af5d1818419b24b89f07e53a1dfbb09a6db309d6e6d7f819d47d not found: ID does not exist" containerID="8aed3cbd48f0af5d1818419b24b89f07e53a1dfbb09a6db309d6e6d7f819d47d"
Sep 11 11:59:16.907346 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:16.907296    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8aed3cbd48f0af5d1818419b24b89f07e53a1dfbb09a6db309d6e6d7f819d47d"} err="failed to get container status \"8aed3cbd48f0af5d1818419b24b89f07e53a1dfbb09a6db309d6e6d7f819d47d\": rpc error: code = NotFound desc = could not find container \"8aed3cbd48f0af5d1818419b24b89f07e53a1dfbb09a6db309d6e6d7f819d47d\": container with ID starting with 8aed3cbd48f0af5d1818419b24b89f07e53a1dfbb09a6db309d6e6d7f819d47d not found: ID does not exist"
Sep 11 11:59:16.913586 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:16.913527    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57"]
Sep 11 11:59:16.918124 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:16.918104    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-f9def1-openshift-default-66768d9446-7tp57"]
Sep 11 11:59:17.814295 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:17.814253    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b916e548-09ed-43b5-a3e2-2c27ca564ad9" path="/var/lib/kubelet/pods/b916e548-09ed-43b5-a3e2-2c27ca564ad9/volumes"
Sep 11 11:59:27.662884 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:27.662850    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-641847-qbz6w"]
Sep 11 11:59:27.668113 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:27.668086    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-641847-qbz6w"]
Sep 11 11:59:27.814137 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:27.814099    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b568c7eb-7d79-49ff-831e-1aa80ffdf8ac" path="/var/lib/kubelet/pods/b568c7eb-7d79-49ff-831e-1aa80ffdf8ac/volumes"
Sep 11 11:59:34.221953 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:34.221872    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m"]
Sep 11 11:59:34.222328 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:34.222164    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m" podUID="4a4be15c-029f-48dd-8de7-e42c13320494" containerName="istio-proxy" containerID="cri-o://770bad44ff506c34ac34d0f5eec46141a142ad13c3855e6d0c6a7361565b1773" gracePeriod=30
Sep 11 11:59:34.535775 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:34.535693    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-8989e8-h2rkb"]
Sep 11 11:59:34.536231 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:34.536212    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b568c7eb-7d79-49ff-831e-1aa80ffdf8ac" containerName="revoke-keys"
Sep 11 11:59:34.536282 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:34.536235    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b568c7eb-7d79-49ff-831e-1aa80ffdf8ac" containerName="revoke-keys"
Sep 11 11:59:34.536282 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:34.536273    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b916e548-09ed-43b5-a3e2-2c27ca564ad9" containerName="istio-proxy"
Sep 11 11:59:34.536388 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:34.536281    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b916e548-09ed-43b5-a3e2-2c27ca564ad9" containerName="istio-proxy"
Sep 11 11:59:34.536388 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:34.536293    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b916e548-09ed-43b5-a3e2-2c27ca564ad9" containerName="istio-proxy"
Sep 11 11:59:34.536388 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:34.536301    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b916e548-09ed-43b5-a3e2-2c27ca564ad9" containerName="istio-proxy"
Sep 11 11:59:34.536480 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:34.536388    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b916e548-09ed-43b5-a3e2-2c27ca564ad9" containerName="istio-proxy"
Sep 11 11:59:34.536480 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:34.536398    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b568c7eb-7d79-49ff-831e-1aa80ffdf8ac" containerName="revoke-keys"
Sep 11 11:59:34.536480 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:34.536406    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b916e548-09ed-43b5-a3e2-2c27ca564ad9" containerName="istio-proxy"
Sep 11 11:59:34.541110 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:34.541090    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-8989e8-h2rkb"
Sep 11 11:59:34.543398 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:34.543376    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 11:59:34.543526 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:34.543456    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f46tj\""
Sep 11 11:59:34.547350 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:34.547322    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-8989e8-h2rkb"]
Sep 11 11:59:34.626049 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:34.626012    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb21c96e-b3e4-4425-9aca-37d882b0c157-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-8989e8-h2rkb\" (UID: \"cb21c96e-b3e4-4425-9aca-37d882b0c157\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-8989e8-h2rkb"
Sep 11 11:59:34.727500 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:34.727450    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb21c96e-b3e4-4425-9aca-37d882b0c157-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-8989e8-h2rkb\" (UID: \"cb21c96e-b3e4-4425-9aca-37d882b0c157\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-8989e8-h2rkb"
Sep 11 11:59:34.728319 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:34.728291    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb21c96e-b3e4-4425-9aca-37d882b0c157-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-8989e8-h2rkb\" (UID: \"cb21c96e-b3e4-4425-9aca-37d882b0c157\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-8989e8-h2rkb"
Sep 11 11:59:34.852803 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:34.852710    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-8989e8-h2rkb"
Sep 11 11:59:35.131682 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:35.131635    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-8989e8-h2rkb"]
Sep 11 11:59:35.133676 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:59:35.133630    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb21c96e_b3e4_4425_9aca_37d882b0c157.slice/crio-5b69a85c82a89c38f676efa4b152363891a83dbf3ad4d9d7a5711ba09f0deaad WatchSource:0}: Error finding container 5b69a85c82a89c38f676efa4b152363891a83dbf3ad4d9d7a5711ba09f0deaad: Status 404 returned error can't find the container with id 5b69a85c82a89c38f676efa4b152363891a83dbf3ad4d9d7a5711ba09f0deaad
Sep 11 11:59:35.298368 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:35.298328    2560 patch_prober.go:28] interesting pod/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 11:59:35.298738 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:35.298431    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m" podUID="4a4be15c-029f-48dd-8de7-e42c13320494" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 11:59:35.984012 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:35.983982    2560 generic.go:356] "Generic (PLEG): container finished" podID="cb21c96e-b3e4-4425-9aca-37d882b0c157" containerID="bd9cb177bab4dc995589e8a25a41b4e8243dbc9c586dff707120ee60ce3af48f" exitCode=0
Sep 11 11:59:35.984198 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:35.984080    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-8989e8-h2rkb" event={"ID":"cb21c96e-b3e4-4425-9aca-37d882b0c157","Type":"ContainerDied","Data":"bd9cb177bab4dc995589e8a25a41b4e8243dbc9c586dff707120ee60ce3af48f"}
Sep 11 11:59:35.984198 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:35.984134    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-8989e8-h2rkb" event={"ID":"cb21c96e-b3e4-4425-9aca-37d882b0c157","Type":"ContainerStarted","Data":"5b69a85c82a89c38f676efa4b152363891a83dbf3ad4d9d7a5711ba09f0deaad"}
Sep 11 11:59:37.121748 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:37.121725    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-8989e8-h2rkb"
Sep 11 11:59:37.253431 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:37.253336    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb21c96e-b3e4-4425-9aca-37d882b0c157-maas-api-service-ca\") pod \"cb21c96e-b3e4-4425-9aca-37d882b0c157\" (UID: \"cb21c96e-b3e4-4425-9aca-37d882b0c157\") "
Sep 11 11:59:37.253718 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:37.253698    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb21c96e-b3e4-4425-9aca-37d882b0c157-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cb21c96e-b3e4-4425-9aca-37d882b0c157" (UID: "cb21c96e-b3e4-4425-9aca-37d882b0c157"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 11:59:37.355075 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:37.355041    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb21c96e-b3e4-4425-9aca-37d882b0c157-maas-api-service-ca\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:59:37.994411 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:37.994386    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-8989e8-h2rkb"
Sep 11 11:59:37.994575 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:37.994425    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-8989e8-h2rkb" event={"ID":"cb21c96e-b3e4-4425-9aca-37d882b0c157","Type":"ContainerDied","Data":"5b69a85c82a89c38f676efa4b152363891a83dbf3ad4d9d7a5711ba09f0deaad"}
Sep 11 11:59:37.994575 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:37.994476    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5b69a85c82a89c38f676efa4b152363891a83dbf3ad4d9d7a5711ba09f0deaad"
Sep 11 11:59:39.480175 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:39.480149    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m"
Sep 11 11:59:39.575260 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:39.575178    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a4be15c-029f-48dd-8de7-e42c13320494-istio-data\") pod \"4a4be15c-029f-48dd-8de7-e42c13320494\" (UID: \"4a4be15c-029f-48dd-8de7-e42c13320494\") "
Sep 11 11:59:39.575260 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:39.575218    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a4be15c-029f-48dd-8de7-e42c13320494-istio-token\") pod \"4a4be15c-029f-48dd-8de7-e42c13320494\" (UID: \"4a4be15c-029f-48dd-8de7-e42c13320494\") "
Sep 11 11:59:39.575497 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:39.575264    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a4be15c-029f-48dd-8de7-e42c13320494-istio-envoy\") pod \"4a4be15c-029f-48dd-8de7-e42c13320494\" (UID: \"4a4be15c-029f-48dd-8de7-e42c13320494\") "
Sep 11 11:59:39.575497 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:39.575285    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a4be15c-029f-48dd-8de7-e42c13320494-istiod-ca-cert\") pod \"4a4be15c-029f-48dd-8de7-e42c13320494\" (UID: \"4a4be15c-029f-48dd-8de7-e42c13320494\") "
Sep 11 11:59:39.575497 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:39.575315    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h96kc\" (UniqueName: \"kubernetes.io/projected/4a4be15c-029f-48dd-8de7-e42c13320494-kube-api-access-h96kc\") pod \"4a4be15c-029f-48dd-8de7-e42c13320494\" (UID: \"4a4be15c-029f-48dd-8de7-e42c13320494\") "
Sep 11 11:59:39.575497 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:39.575343    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a4be15c-029f-48dd-8de7-e42c13320494-credential-socket\") pod \"4a4be15c-029f-48dd-8de7-e42c13320494\" (UID: \"4a4be15c-029f-48dd-8de7-e42c13320494\") "
Sep 11 11:59:39.575497 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:39.575393    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a4be15c-029f-48dd-8de7-e42c13320494-istio-podinfo\") pod \"4a4be15c-029f-48dd-8de7-e42c13320494\" (UID: \"4a4be15c-029f-48dd-8de7-e42c13320494\") "
Sep 11 11:59:39.575497 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:39.575424    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a4be15c-029f-48dd-8de7-e42c13320494-workload-certs\") pod \"4a4be15c-029f-48dd-8de7-e42c13320494\" (UID: \"4a4be15c-029f-48dd-8de7-e42c13320494\") "
Sep 11 11:59:39.575818 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:39.575504    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a4be15c-029f-48dd-8de7-e42c13320494-istio-data" (OuterVolumeSpecName: "istio-data") pod "4a4be15c-029f-48dd-8de7-e42c13320494" (UID: "4a4be15c-029f-48dd-8de7-e42c13320494"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:59:39.575818 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:39.575521    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a4be15c-029f-48dd-8de7-e42c13320494-workload-socket\") pod \"4a4be15c-029f-48dd-8de7-e42c13320494\" (UID: \"4a4be15c-029f-48dd-8de7-e42c13320494\") "
Sep 11 11:59:39.575818 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:39.575771    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a4be15c-029f-48dd-8de7-e42c13320494-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4a4be15c-029f-48dd-8de7-e42c13320494" (UID: "4a4be15c-029f-48dd-8de7-e42c13320494"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:59:39.575818 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:39.575799    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a4be15c-029f-48dd-8de7-e42c13320494-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4a4be15c-029f-48dd-8de7-e42c13320494" (UID: "4a4be15c-029f-48dd-8de7-e42c13320494"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 11:59:39.576034 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:39.575863    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a4be15c-029f-48dd-8de7-e42c13320494-istio-data\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:59:39.576034 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:39.575881    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a4be15c-029f-48dd-8de7-e42c13320494-workload-certs\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:59:39.576034 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:39.575946    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a4be15c-029f-48dd-8de7-e42c13320494-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4a4be15c-029f-48dd-8de7-e42c13320494" (UID: "4a4be15c-029f-48dd-8de7-e42c13320494"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:59:39.576034 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:39.575963    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a4be15c-029f-48dd-8de7-e42c13320494-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4a4be15c-029f-48dd-8de7-e42c13320494" (UID: "4a4be15c-029f-48dd-8de7-e42c13320494"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:59:39.577758 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:39.577722    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4a4be15c-029f-48dd-8de7-e42c13320494-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4a4be15c-029f-48dd-8de7-e42c13320494" (UID: "4a4be15c-029f-48dd-8de7-e42c13320494"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 11:59:39.577758 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:39.577736    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a4be15c-029f-48dd-8de7-e42c13320494-kube-api-access-h96kc" (OuterVolumeSpecName: "kube-api-access-h96kc") pod "4a4be15c-029f-48dd-8de7-e42c13320494" (UID: "4a4be15c-029f-48dd-8de7-e42c13320494"). InnerVolumeSpecName "kube-api-access-h96kc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:59:39.577973 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:39.577952    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a4be15c-029f-48dd-8de7-e42c13320494-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4a4be15c-029f-48dd-8de7-e42c13320494" (UID: "4a4be15c-029f-48dd-8de7-e42c13320494"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:59:39.578058 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:39.578037    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a4be15c-029f-48dd-8de7-e42c13320494-istio-token" (OuterVolumeSpecName: "istio-token") pod "4a4be15c-029f-48dd-8de7-e42c13320494" (UID: "4a4be15c-029f-48dd-8de7-e42c13320494"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:59:39.677037 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:39.677000    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a4be15c-029f-48dd-8de7-e42c13320494-istio-token\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:59:39.677037 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:39.677029    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a4be15c-029f-48dd-8de7-e42c13320494-istio-envoy\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:59:39.677037 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:39.677040    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a4be15c-029f-48dd-8de7-e42c13320494-istiod-ca-cert\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:59:39.677279 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:39.677055    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h96kc\" (UniqueName: \"kubernetes.io/projected/4a4be15c-029f-48dd-8de7-e42c13320494-kube-api-access-h96kc\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:59:39.677279 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:39.677069    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a4be15c-029f-48dd-8de7-e42c13320494-credential-socket\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:59:39.677279 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:39.677079    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a4be15c-029f-48dd-8de7-e42c13320494-istio-podinfo\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:59:39.677279 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:39.677091    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a4be15c-029f-48dd-8de7-e42c13320494-workload-socket\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:59:40.005792 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:40.005755    2560 generic.go:356] "Generic (PLEG): container finished" podID="4a4be15c-029f-48dd-8de7-e42c13320494" containerID="770bad44ff506c34ac34d0f5eec46141a142ad13c3855e6d0c6a7361565b1773" exitCode=0
Sep 11 11:59:40.005999 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:40.005800    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m"
Sep 11 11:59:40.005999 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:40.005878    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m" event={"ID":"4a4be15c-029f-48dd-8de7-e42c13320494","Type":"ContainerDied","Data":"770bad44ff506c34ac34d0f5eec46141a142ad13c3855e6d0c6a7361565b1773"}
Sep 11 11:59:40.005999 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:40.005941    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m" event={"ID":"4a4be15c-029f-48dd-8de7-e42c13320494","Type":"ContainerDied","Data":"3d46a3211c2feb203d73b889cc78c2f01729222bb8935ff5b62e97a5ae1c6870"}
Sep 11 11:59:40.005999 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:40.005970    2560 scope.go:117] "RemoveContainer" containerID="770bad44ff506c34ac34d0f5eec46141a142ad13c3855e6d0c6a7361565b1773"
Sep 11 11:59:40.014837 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:40.014792    2560 scope.go:117] "RemoveContainer" containerID="6e2f97f75f8b15cc1fba441218af2207b7274d9b58e67aaa9c0f8b67bcd9a087"
Sep 11 11:59:40.022736 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:40.022708    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m"]
Sep 11 11:59:40.023778 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:40.023756    2560 scope.go:117] "RemoveContainer" containerID="770bad44ff506c34ac34d0f5eec46141a142ad13c3855e6d0c6a7361565b1773"
Sep 11 11:59:40.024105 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:59:40.024084    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"770bad44ff506c34ac34d0f5eec46141a142ad13c3855e6d0c6a7361565b1773\": container with ID starting with 770bad44ff506c34ac34d0f5eec46141a142ad13c3855e6d0c6a7361565b1773 not found: ID does not exist" containerID="770bad44ff506c34ac34d0f5eec46141a142ad13c3855e6d0c6a7361565b1773"
Sep 11 11:59:40.024154 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:40.024120    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"770bad44ff506c34ac34d0f5eec46141a142ad13c3855e6d0c6a7361565b1773"} err="failed to get container status \"770bad44ff506c34ac34d0f5eec46141a142ad13c3855e6d0c6a7361565b1773\": rpc error: code = NotFound desc = could not find container \"770bad44ff506c34ac34d0f5eec46141a142ad13c3855e6d0c6a7361565b1773\": container with ID starting with 770bad44ff506c34ac34d0f5eec46141a142ad13c3855e6d0c6a7361565b1773 not found: ID does not exist"
Sep 11 11:59:40.024154 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:40.024146    2560 scope.go:117] "RemoveContainer" containerID="6e2f97f75f8b15cc1fba441218af2207b7274d9b58e67aaa9c0f8b67bcd9a087"
Sep 11 11:59:40.024948 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:59:40.024533    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e2f97f75f8b15cc1fba441218af2207b7274d9b58e67aaa9c0f8b67bcd9a087\": container with ID starting with 6e2f97f75f8b15cc1fba441218af2207b7274d9b58e67aaa9c0f8b67bcd9a087 not found: ID does not exist" containerID="6e2f97f75f8b15cc1fba441218af2207b7274d9b58e67aaa9c0f8b67bcd9a087"
Sep 11 11:59:40.024948 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:40.024592    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e2f97f75f8b15cc1fba441218af2207b7274d9b58e67aaa9c0f8b67bcd9a087"} err="failed to get container status \"6e2f97f75f8b15cc1fba441218af2207b7274d9b58e67aaa9c0f8b67bcd9a087\": rpc error: code = NotFound desc = could not find container \"6e2f97f75f8b15cc1fba441218af2207b7274d9b58e67aaa9c0f8b67bcd9a087\": container with ID starting with 6e2f97f75f8b15cc1fba441218af2207b7274d9b58e67aaa9c0f8b67bcd9a087 not found: ID does not exist"
Sep 11 11:59:40.026577 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:40.026558    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-641847-openshift-default-5598ccdfcd-gm52m"]
Sep 11 11:59:41.813572 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:41.813542    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a4be15c-029f-48dd-8de7-e42c13320494" path="/var/lib/kubelet/pods/4a4be15c-029f-48dd-8de7-e42c13320494/volumes"
Sep 11 11:59:45.346178 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:45.346142    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8989e8-b78fbfbb6-5lmqh"]
Sep 11 11:59:45.346731 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:45.346357    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8989e8-b78fbfbb6-5lmqh" podUID="dd8dbbbb-c2fb-4f86-82c4-286bd0635afe" containerName="payload-pre-processing" containerID="cri-o://c383c7711cb00db270b72c49abe484c75dd270d0fec9644bf9bab8bafdd87df4" gracePeriod=30
Sep 11 11:59:45.602215 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:45.602154    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8989e8-b78fbfbb6-5lmqh"
Sep 11 11:59:45.645304 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:45.645268    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-8989e8-h2rkb"]
Sep 11 11:59:45.648159 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:45.648136    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-8989e8-h2rkb"]
Sep 11 11:59:45.733520 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:45.733487    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pg4rn\" (UniqueName: \"kubernetes.io/projected/dd8dbbbb-c2fb-4f86-82c4-286bd0635afe-kube-api-access-pg4rn\") pod \"dd8dbbbb-c2fb-4f86-82c4-286bd0635afe\" (UID: \"dd8dbbbb-c2fb-4f86-82c4-286bd0635afe\") "
Sep 11 11:59:45.733731 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:45.733534    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd8dbbbb-c2fb-4f86-82c4-286bd0635afe-plugins-config-volume\") pod \"dd8dbbbb-c2fb-4f86-82c4-286bd0635afe\" (UID: \"dd8dbbbb-c2fb-4f86-82c4-286bd0635afe\") "
Sep 11 11:59:45.733914 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:45.733883    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd8dbbbb-c2fb-4f86-82c4-286bd0635afe-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "dd8dbbbb-c2fb-4f86-82c4-286bd0635afe" (UID: "dd8dbbbb-c2fb-4f86-82c4-286bd0635afe"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 11:59:45.735540 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:45.735511    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd8dbbbb-c2fb-4f86-82c4-286bd0635afe-kube-api-access-pg4rn" (OuterVolumeSpecName: "kube-api-access-pg4rn") pod "dd8dbbbb-c2fb-4f86-82c4-286bd0635afe" (UID: "dd8dbbbb-c2fb-4f86-82c4-286bd0635afe"). InnerVolumeSpecName "kube-api-access-pg4rn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:59:45.813870 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:45.813837    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb21c96e-b3e4-4425-9aca-37d882b0c157" path="/var/lib/kubelet/pods/cb21c96e-b3e4-4425-9aca-37d882b0c157/volumes"
Sep 11 11:59:45.834324 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:45.834282    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pg4rn\" (UniqueName: \"kubernetes.io/projected/dd8dbbbb-c2fb-4f86-82c4-286bd0635afe-kube-api-access-pg4rn\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:59:45.834324 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:45.834318    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd8dbbbb-c2fb-4f86-82c4-286bd0635afe-plugins-config-volume\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:59:46.045527 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:46.045497    2560 generic.go:356] "Generic (PLEG): container finished" podID="dd8dbbbb-c2fb-4f86-82c4-286bd0635afe" containerID="c383c7711cb00db270b72c49abe484c75dd270d0fec9644bf9bab8bafdd87df4" exitCode=0
Sep 11 11:59:46.045727 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:46.045535    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8989e8-b78fbfbb6-5lmqh" event={"ID":"dd8dbbbb-c2fb-4f86-82c4-286bd0635afe","Type":"ContainerDied","Data":"c383c7711cb00db270b72c49abe484c75dd270d0fec9644bf9bab8bafdd87df4"}
Sep 11 11:59:46.045727 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:46.045549    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8989e8-b78fbfbb6-5lmqh"
Sep 11 11:59:46.045727 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:46.045581    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8989e8-b78fbfbb6-5lmqh" event={"ID":"dd8dbbbb-c2fb-4f86-82c4-286bd0635afe","Type":"ContainerDied","Data":"d0a68e1e59af0a5260860a3072ae5a2d21b9e1d9fe0d30b6b0537d52a80a2239"}
Sep 11 11:59:46.045727 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:46.045604    2560 scope.go:117] "RemoveContainer" containerID="c383c7711cb00db270b72c49abe484c75dd270d0fec9644bf9bab8bafdd87df4"
Sep 11 11:59:46.054013 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:46.053995    2560 scope.go:117] "RemoveContainer" containerID="c383c7711cb00db270b72c49abe484c75dd270d0fec9644bf9bab8bafdd87df4"
Sep 11 11:59:46.054275 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:59:46.054257    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c383c7711cb00db270b72c49abe484c75dd270d0fec9644bf9bab8bafdd87df4\": container with ID starting with c383c7711cb00db270b72c49abe484c75dd270d0fec9644bf9bab8bafdd87df4 not found: ID does not exist" containerID="c383c7711cb00db270b72c49abe484c75dd270d0fec9644bf9bab8bafdd87df4"
Sep 11 11:59:46.054326 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:46.054285    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c383c7711cb00db270b72c49abe484c75dd270d0fec9644bf9bab8bafdd87df4"} err="failed to get container status \"c383c7711cb00db270b72c49abe484c75dd270d0fec9644bf9bab8bafdd87df4\": rpc error: code = NotFound desc = could not find container \"c383c7711cb00db270b72c49abe484c75dd270d0fec9644bf9bab8bafdd87df4\": container with ID starting with c383c7711cb00db270b72c49abe484c75dd270d0fec9644bf9bab8bafdd87df4 not found: ID does not exist"
Sep 11 11:59:46.072854 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:46.072822    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8989e8-b78fbfbb6-5lmqh"]
Sep 11 11:59:46.076868 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:46.076842    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8989e8-b78fbfbb6-5lmqh"]
Sep 11 11:59:47.814261 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:47.814220    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd8dbbbb-c2fb-4f86-82c4-286bd0635afe" path="/var/lib/kubelet/pods/dd8dbbbb-c2fb-4f86-82c4-286bd0635afe/volumes"
Sep 11 11:59:52.605113 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:52.605080    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p"]
Sep 11 11:59:52.605602 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:52.605301    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p" podUID="8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1" containerName="istio-proxy" containerID="cri-o://7d834c95b48ddd88eeceba19d496c042bc7f79139d2f895aa7b4a1bb5a48dacb" gracePeriod=30
Sep 11 11:59:52.963694 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:52.963667    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-6daa53-2tzw5"]
Sep 11 11:59:52.964012 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:52.964001    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a4be15c-029f-48dd-8de7-e42c13320494" containerName="istio-proxy"
Sep 11 11:59:52.964056 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:52.964014    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a4be15c-029f-48dd-8de7-e42c13320494" containerName="istio-proxy"
Sep 11 11:59:52.964056 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:52.964024    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb21c96e-b3e4-4425-9aca-37d882b0c157" containerName="revoke-keys"
Sep 11 11:59:52.964056 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:52.964029    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb21c96e-b3e4-4425-9aca-37d882b0c157" containerName="revoke-keys"
Sep 11 11:59:52.964056 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:52.964039    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd8dbbbb-c2fb-4f86-82c4-286bd0635afe" containerName="payload-pre-processing"
Sep 11 11:59:52.964056 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:52.964044    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd8dbbbb-c2fb-4f86-82c4-286bd0635afe" containerName="payload-pre-processing"
Sep 11 11:59:52.964222 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:52.964107    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a4be15c-029f-48dd-8de7-e42c13320494" containerName="istio-proxy"
Sep 11 11:59:52.964222 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:52.964114    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb21c96e-b3e4-4425-9aca-37d882b0c157" containerName="revoke-keys"
Sep 11 11:59:52.964222 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:52.964123    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a4be15c-029f-48dd-8de7-e42c13320494" containerName="istio-proxy"
Sep 11 11:59:52.964222 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:52.964130    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd8dbbbb-c2fb-4f86-82c4-286bd0635afe" containerName="payload-pre-processing"
Sep 11 11:59:52.968271 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:52.968252    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-6daa53-2tzw5"
Sep 11 11:59:52.970912 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:52.970888    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 11:59:52.971014 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:52.970888    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f46tj\""
Sep 11 11:59:52.979731 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:52.979702    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-6daa53-2tzw5"]
Sep 11 11:59:52.998748 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:52.998720    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/57979dcf-cad4-40db-9009-f2c4c4cb15ad-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-6daa53-2tzw5\" (UID: \"57979dcf-cad4-40db-9009-f2c4c4cb15ad\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-6daa53-2tzw5"
Sep 11 11:59:53.099996 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:53.099960    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/57979dcf-cad4-40db-9009-f2c4c4cb15ad-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-6daa53-2tzw5\" (UID: \"57979dcf-cad4-40db-9009-f2c4c4cb15ad\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-6daa53-2tzw5"
Sep 11 11:59:53.100774 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:53.100754    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/57979dcf-cad4-40db-9009-f2c4c4cb15ad-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-6daa53-2tzw5\" (UID: \"57979dcf-cad4-40db-9009-f2c4c4cb15ad\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-6daa53-2tzw5"
Sep 11 11:59:53.278701 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:53.278597    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-6daa53-2tzw5"
Sep 11 11:59:53.555634 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:53.555610    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-6daa53-2tzw5"]
Sep 11 11:59:53.557593 ip-10-0-142-230 kubenswrapper[2560]: W0911 11:59:53.557563    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57979dcf_cad4_40db_9009_f2c4c4cb15ad.slice/crio-aa59dee28185e80a49c5391281f0c271c1731cb7833c5ff91a5516fa04e4aee5 WatchSource:0}: Error finding container aa59dee28185e80a49c5391281f0c271c1731cb7833c5ff91a5516fa04e4aee5: Status 404 returned error can't find the container with id aa59dee28185e80a49c5391281f0c271c1731cb7833c5ff91a5516fa04e4aee5
Sep 11 11:59:54.086171 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:54.086131    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-6daa53-2tzw5" event={"ID":"57979dcf-cad4-40db-9009-f2c4c4cb15ad","Type":"ContainerStarted","Data":"8d9f0036e5d61160051d4e3db36ddb6e88d711f7914367fb9e0a617732d8f176"}
Sep 11 11:59:54.086560 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:54.086232    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-6daa53-2tzw5" event={"ID":"57979dcf-cad4-40db-9009-f2c4c4cb15ad","Type":"ContainerStarted","Data":"aa59dee28185e80a49c5391281f0c271c1731cb7833c5ff91a5516fa04e4aee5"}
Sep 11 11:59:54.105149 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:54.105097    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-6daa53-2tzw5" podStartSLOduration=2.105080253 podStartE2EDuration="2.105080253s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:59:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:59:54.103771147 +0000 UTC m=+1544.926231024" watchObservedRunningTime="2026-09-11 11:59:54.105080253 +0000 UTC m=+1544.927540125"
Sep 11 11:59:55.092970 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:55.092931    2560 generic.go:356] "Generic (PLEG): container finished" podID="57979dcf-cad4-40db-9009-f2c4c4cb15ad" containerID="8d9f0036e5d61160051d4e3db36ddb6e88d711f7914367fb9e0a617732d8f176" exitCode=0
Sep 11 11:59:55.093363 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:55.093026    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-6daa53-2tzw5" event={"ID":"57979dcf-cad4-40db-9009-f2c4c4cb15ad","Type":"ContainerDied","Data":"8d9f0036e5d61160051d4e3db36ddb6e88d711f7914367fb9e0a617732d8f176"}
Sep 11 11:59:56.228371 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:56.228341    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-6daa53-2tzw5"
Sep 11 11:59:56.319760 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:56.319725    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/57979dcf-cad4-40db-9009-f2c4c4cb15ad-maas-api-service-ca\") pod \"57979dcf-cad4-40db-9009-f2c4c4cb15ad\" (UID: \"57979dcf-cad4-40db-9009-f2c4c4cb15ad\") "
Sep 11 11:59:56.320079 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:56.320055    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57979dcf-cad4-40db-9009-f2c4c4cb15ad-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "57979dcf-cad4-40db-9009-f2c4c4cb15ad" (UID: "57979dcf-cad4-40db-9009-f2c4c4cb15ad"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 11:59:56.420370 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:56.420288    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/57979dcf-cad4-40db-9009-f2c4c4cb15ad-maas-api-service-ca\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:59:57.104673 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:57.104625    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-6daa53-2tzw5"
Sep 11 11:59:57.104673 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:57.104631    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-6daa53-2tzw5" event={"ID":"57979dcf-cad4-40db-9009-f2c4c4cb15ad","Type":"ContainerDied","Data":"aa59dee28185e80a49c5391281f0c271c1731cb7833c5ff91a5516fa04e4aee5"}
Sep 11 11:59:57.104941 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:57.104695    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aa59dee28185e80a49c5391281f0c271c1731cb7833c5ff91a5516fa04e4aee5"
Sep 11 11:59:57.867948 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:57.867887    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p"
Sep 11 11:59:57.930712 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:57.930681    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n7mmk\" (UniqueName: \"kubernetes.io/projected/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1-kube-api-access-n7mmk\") pod \"8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1\" (UID: \"8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1\") "
Sep 11 11:59:57.930873 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:57.930722    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1-istio-podinfo\") pod \"8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1\" (UID: \"8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1\") "
Sep 11 11:59:57.930873 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:57.930740    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1-istiod-ca-cert\") pod \"8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1\" (UID: \"8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1\") "
Sep 11 11:59:57.930873 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:57.930761    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1-istio-data\") pod \"8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1\" (UID: \"8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1\") "
Sep 11 11:59:57.930873 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:57.930780    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1-istio-envoy\") pod \"8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1\" (UID: \"8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1\") "
Sep 11 11:59:57.930873 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:57.930811    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1-workload-socket\") pod \"8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1\" (UID: \"8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1\") "
Sep 11 11:59:57.930873 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:57.930837    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1-credential-socket\") pod \"8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1\" (UID: \"8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1\") "
Sep 11 11:59:57.931173 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:57.930898    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1-workload-certs\") pod \"8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1\" (UID: \"8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1\") "
Sep 11 11:59:57.931173 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:57.930919    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1-istio-token\") pod \"8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1\" (UID: \"8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1\") "
Sep 11 11:59:57.931173 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:57.931102    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1-istio-data" (OuterVolumeSpecName: "istio-data") pod "8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1" (UID: "8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:59:57.931335 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:57.931174    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1" (UID: "8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:59:57.931335 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:57.931189    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1" (UID: "8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 11:59:57.931448 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:57.931336    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1" (UID: "8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:59:57.931448 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:57.931393    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1" (UID: "8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:59:57.932976 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:57.932940    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1" (UID: "8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 11:59:57.933085 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:57.932998    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1-kube-api-access-n7mmk" (OuterVolumeSpecName: "kube-api-access-n7mmk") pod "8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1" (UID: "8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1"). InnerVolumeSpecName "kube-api-access-n7mmk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:59:57.933307 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:57.933281    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1-istio-token" (OuterVolumeSpecName: "istio-token") pod "8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1" (UID: "8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:59:57.933307 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:57.933296    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1" (UID: "8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:59:58.031513 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:58.031477    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1-credential-socket\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:59:58.031513 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:58.031508    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1-workload-certs\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:59:58.031513 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:58.031518    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1-istio-token\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:59:58.031784 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:58.031526    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n7mmk\" (UniqueName: \"kubernetes.io/projected/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1-kube-api-access-n7mmk\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:59:58.031784 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:58.031536    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1-istio-podinfo\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:59:58.031784 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:58.031544    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1-istiod-ca-cert\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:59:58.031784 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:58.031552    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1-istio-data\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:59:58.031784 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:58.031558    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1-istio-envoy\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:59:58.031784 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:58.031565    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1-workload-socket\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 11:59:58.111578 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:58.111546    2560 generic.go:356] "Generic (PLEG): container finished" podID="8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1" containerID="7d834c95b48ddd88eeceba19d496c042bc7f79139d2f895aa7b4a1bb5a48dacb" exitCode=0
Sep 11 11:59:58.111799 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:58.111597    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p" event={"ID":"8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1","Type":"ContainerDied","Data":"7d834c95b48ddd88eeceba19d496c042bc7f79139d2f895aa7b4a1bb5a48dacb"}
Sep 11 11:59:58.111799 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:58.111604    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p"
Sep 11 11:59:58.111799 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:58.111642    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p" event={"ID":"8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1","Type":"ContainerDied","Data":"ec0af5d4eb37301c9985a74638d7df38b6c9fdd450a0b2dabb65957579c02369"}
Sep 11 11:59:58.111799 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:58.111676    2560 scope.go:117] "RemoveContainer" containerID="7d834c95b48ddd88eeceba19d496c042bc7f79139d2f895aa7b4a1bb5a48dacb"
Sep 11 11:59:58.121418 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:58.121402    2560 scope.go:117] "RemoveContainer" containerID="b02316daea35894ddf30baf8c4d9fbd3e635fc4f9ce1980f0eb5f1730afdb29e"
Sep 11 11:59:58.129133 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:58.129115    2560 scope.go:117] "RemoveContainer" containerID="7d834c95b48ddd88eeceba19d496c042bc7f79139d2f895aa7b4a1bb5a48dacb"
Sep 11 11:59:58.129390 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:59:58.129373    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d834c95b48ddd88eeceba19d496c042bc7f79139d2f895aa7b4a1bb5a48dacb\": container with ID starting with 7d834c95b48ddd88eeceba19d496c042bc7f79139d2f895aa7b4a1bb5a48dacb not found: ID does not exist" containerID="7d834c95b48ddd88eeceba19d496c042bc7f79139d2f895aa7b4a1bb5a48dacb"
Sep 11 11:59:58.129430 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:58.129399    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d834c95b48ddd88eeceba19d496c042bc7f79139d2f895aa7b4a1bb5a48dacb"} err="failed to get container status \"7d834c95b48ddd88eeceba19d496c042bc7f79139d2f895aa7b4a1bb5a48dacb\": rpc error: code = NotFound desc = could not find container \"7d834c95b48ddd88eeceba19d496c042bc7f79139d2f895aa7b4a1bb5a48dacb\": container with ID starting with 7d834c95b48ddd88eeceba19d496c042bc7f79139d2f895aa7b4a1bb5a48dacb not found: ID does not exist"
Sep 11 11:59:58.129430 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:58.129417    2560 scope.go:117] "RemoveContainer" containerID="b02316daea35894ddf30baf8c4d9fbd3e635fc4f9ce1980f0eb5f1730afdb29e"
Sep 11 11:59:58.129639 ip-10-0-142-230 kubenswrapper[2560]: E0911 11:59:58.129621    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b02316daea35894ddf30baf8c4d9fbd3e635fc4f9ce1980f0eb5f1730afdb29e\": container with ID starting with b02316daea35894ddf30baf8c4d9fbd3e635fc4f9ce1980f0eb5f1730afdb29e not found: ID does not exist" containerID="b02316daea35894ddf30baf8c4d9fbd3e635fc4f9ce1980f0eb5f1730afdb29e"
Sep 11 11:59:58.129695 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:58.129661    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b02316daea35894ddf30baf8c4d9fbd3e635fc4f9ce1980f0eb5f1730afdb29e"} err="failed to get container status \"b02316daea35894ddf30baf8c4d9fbd3e635fc4f9ce1980f0eb5f1730afdb29e\": rpc error: code = NotFound desc = could not find container \"b02316daea35894ddf30baf8c4d9fbd3e635fc4f9ce1980f0eb5f1730afdb29e\": container with ID starting with b02316daea35894ddf30baf8c4d9fbd3e635fc4f9ce1980f0eb5f1730afdb29e not found: ID does not exist"
Sep 11 11:59:58.135139 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:58.135112    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p"]
Sep 11 11:59:58.140314 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:58.140293    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-8989e8-openshift-default-75fd9c5c96-wtz8p"]
Sep 11 11:59:59.816851 ip-10-0-142-230 kubenswrapper[2560]: I0911 11:59:59.814425    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1" path="/var/lib/kubelet/pods/8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1/volumes"
Sep 11 12:00:00.133578 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:00.133493    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-272c5e-29818800-vzvwf"]
Sep 11 12:00:00.133895 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:00.133880    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1" containerName="istio-proxy"
Sep 11 12:00:00.133895 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:00.133896    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1" containerName="istio-proxy"
Sep 11 12:00:00.134024 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:00.133918    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a4be15c-029f-48dd-8de7-e42c13320494" containerName="istio-proxy"
Sep 11 12:00:00.134024 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:00.133925    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a4be15c-029f-48dd-8de7-e42c13320494" containerName="istio-proxy"
Sep 11 12:00:00.134024 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:00.133933    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57979dcf-cad4-40db-9009-f2c4c4cb15ad" containerName="revoke-keys"
Sep 11 12:00:00.134024 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:00.133939    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="57979dcf-cad4-40db-9009-f2c4c4cb15ad" containerName="revoke-keys"
Sep 11 12:00:00.134024 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:00.134006    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1" containerName="istio-proxy"
Sep 11 12:00:00.134024 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:00.134014    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1" containerName="istio-proxy"
Sep 11 12:00:00.134024 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:00.134020    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="57979dcf-cad4-40db-9009-f2c4c4cb15ad" containerName="revoke-keys"
Sep 11 12:00:00.137267 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:00.137246    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-6daa53-29818800-t2qq6"]
Sep 11 12:00:00.137390 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:00.137373    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-272c5e-29818800-vzvwf"
Sep 11 12:00:00.137711 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:00.137689    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1" containerName="istio-proxy"
Sep 11 12:00:00.137711 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:00.137710    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a9ac5e7-b1e9-4067-88b8-b8b031dd53c1" containerName="istio-proxy"
Sep 11 12:00:00.139882 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:00.139858    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f46tj\""
Sep 11 12:00:00.140623 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:00.140607    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-117711-29818800-x6md6"]
Sep 11 12:00:00.140754 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:00.140732    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-6daa53-29818800-t2qq6"
Sep 11 12:00:00.143956 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:00.143937    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-117711-29818800-x6md6"
Sep 11 12:00:00.144715 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:00.144689    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-6daa53-29818800-t2qq6"]
Sep 11 12:00:00.151779 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:00.150692    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-272c5e-29818800-vzvwf"]
Sep 11 12:00:00.153378 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:00.152931    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-117711-29818800-x6md6"]
Sep 11 12:00:00.153576 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:00.153133    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-272c5e-29818800-vzvwf"
Sep 11 12:00:00.164496 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:00.164474    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-6daa53-29818800-t2qq6"
Sep 11 12:00:00.205250 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:00.205052    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-117711-29818800-x6md6"
Sep 11 12:00:00.441922 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:00.441897    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-272c5e-29818800-vzvwf"]
Sep 11 12:00:00.443690 ip-10-0-142-230 kubenswrapper[2560]: W0911 12:00:00.443663    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb26e4f52_bd1a_4e8a_a41d_85819dd476f0.slice/crio-e29e233e78b69234b62b2567360e7506b9ffbc7f631170f1401016acfe8c9ec5 WatchSource:0}: Error finding container e29e233e78b69234b62b2567360e7506b9ffbc7f631170f1401016acfe8c9ec5: Status 404 returned error can't find the container with id e29e233e78b69234b62b2567360e7506b9ffbc7f631170f1401016acfe8c9ec5
Sep 11 12:00:00.471976 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:00.471954    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-6daa53-29818800-t2qq6"]
Sep 11 12:00:00.473239 ip-10-0-142-230 kubenswrapper[2560]: W0911 12:00:00.473219    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc74c4a9e_1655_4d6c_bb2a_22040c38e884.slice/crio-faa197c426138a53fc2118d66fbd8b3f6d7c0018dcb51738f73a03ba70535b82 WatchSource:0}: Error finding container faa197c426138a53fc2118d66fbd8b3f6d7c0018dcb51738f73a03ba70535b82: Status 404 returned error can't find the container with id faa197c426138a53fc2118d66fbd8b3f6d7c0018dcb51738f73a03ba70535b82
Sep 11 12:00:00.497050 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:00.497025    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-117711-29818800-x6md6"]
Sep 11 12:00:00.505727 ip-10-0-142-230 kubenswrapper[2560]: W0911 12:00:00.505699    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67263530_834c_4e6f_8e5d_b559957198ef.slice/crio-d4cec1e9453479488f6e304e69a8ce08efed89a4e75d4a334ea5cff6cb93f2be WatchSource:0}: Error finding container d4cec1e9453479488f6e304e69a8ce08efed89a4e75d4a334ea5cff6cb93f2be: Status 404 returned error can't find the container with id d4cec1e9453479488f6e304e69a8ce08efed89a4e75d4a334ea5cff6cb93f2be
Sep 11 12:00:01.129398 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:01.129305    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-117711-29818800-x6md6" event={"ID":"67263530-834c-4e6f-8e5d-b559957198ef","Type":"ContainerStarted","Data":"dcada8fb8c38a1e5b44a9342b40e34a35406cb84e0aeff545629f6e0cba89b19"}
Sep 11 12:00:01.129398 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:01.129367    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-117711-29818800-x6md6" event={"ID":"67263530-834c-4e6f-8e5d-b559957198ef","Type":"ContainerStarted","Data":"d4cec1e9453479488f6e304e69a8ce08efed89a4e75d4a334ea5cff6cb93f2be"}
Sep 11 12:00:01.130884 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:01.130858    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-6daa53-29818800-t2qq6" event={"ID":"c74c4a9e-1655-4d6c-bb2a-22040c38e884","Type":"ContainerStarted","Data":"16db9ade4db0b4f897ada34ad4fd8f955be6c588a645480bbfa72f2f109a9aa4"}
Sep 11 12:00:01.131008 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:01.130901    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-6daa53-29818800-t2qq6" event={"ID":"c74c4a9e-1655-4d6c-bb2a-22040c38e884","Type":"ContainerStarted","Data":"faa197c426138a53fc2118d66fbd8b3f6d7c0018dcb51738f73a03ba70535b82"}
Sep 11 12:00:01.132521 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:01.132497    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-272c5e-29818800-vzvwf" event={"ID":"b26e4f52-bd1a-4e8a-a41d-85819dd476f0","Type":"ContainerStarted","Data":"2ae6be30c95a8843df7bfc6b056b6ad9101fbf7f269401bf64a0535d9be374b6"}
Sep 11 12:00:01.132611 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:01.132542    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-272c5e-29818800-vzvwf" event={"ID":"b26e4f52-bd1a-4e8a-a41d-85819dd476f0","Type":"ContainerStarted","Data":"e29e233e78b69234b62b2567360e7506b9ffbc7f631170f1401016acfe8c9ec5"}
Sep 11 12:00:01.145716 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:01.145667    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-117711-29818800-x6md6" podStartSLOduration=1.14563931 podStartE2EDuration="1.14563931s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:00:01.144580829 +0000 UTC m=+1551.967040720" watchObservedRunningTime="2026-09-11 12:00:01.14563931 +0000 UTC m=+1551.968099174"
Sep 11 12:00:01.160670 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:01.160606    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-272c5e-29818800-vzvwf" podStartSLOduration=1.160590093 podStartE2EDuration="1.160590093s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:00:01.159470957 +0000 UTC m=+1551.981930829" watchObservedRunningTime="2026-09-11 12:00:01.160590093 +0000 UTC m=+1551.983049965"
Sep 11 12:00:01.177399 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:01.177345    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-6daa53-29818800-t2qq6" podStartSLOduration=1.177330202 podStartE2EDuration="1.177330202s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:00:01.175971105 +0000 UTC m=+1551.998430977" watchObservedRunningTime="2026-09-11 12:00:01.177330202 +0000 UTC m=+1551.999790075"
Sep 11 12:00:02.139905 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:02.139864    2560 generic.go:356] "Generic (PLEG): container finished" podID="67263530-834c-4e6f-8e5d-b559957198ef" containerID="dcada8fb8c38a1e5b44a9342b40e34a35406cb84e0aeff545629f6e0cba89b19" exitCode=0
Sep 11 12:00:02.140349 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:02.139945    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-117711-29818800-x6md6" event={"ID":"67263530-834c-4e6f-8e5d-b559957198ef","Type":"ContainerDied","Data":"dcada8fb8c38a1e5b44a9342b40e34a35406cb84e0aeff545629f6e0cba89b19"}
Sep 11 12:00:02.141753 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:02.141726    2560 generic.go:356] "Generic (PLEG): container finished" podID="c74c4a9e-1655-4d6c-bb2a-22040c38e884" containerID="16db9ade4db0b4f897ada34ad4fd8f955be6c588a645480bbfa72f2f109a9aa4" exitCode=0
Sep 11 12:00:02.141892 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:02.141816    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-6daa53-29818800-t2qq6" event={"ID":"c74c4a9e-1655-4d6c-bb2a-22040c38e884","Type":"ContainerDied","Data":"16db9ade4db0b4f897ada34ad4fd8f955be6c588a645480bbfa72f2f109a9aa4"}
Sep 11 12:00:02.143445 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:02.143420    2560 generic.go:356] "Generic (PLEG): container finished" podID="b26e4f52-bd1a-4e8a-a41d-85819dd476f0" containerID="2ae6be30c95a8843df7bfc6b056b6ad9101fbf7f269401bf64a0535d9be374b6" exitCode=0
Sep 11 12:00:02.143553 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:02.143453    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-272c5e-29818800-vzvwf" event={"ID":"b26e4f52-bd1a-4e8a-a41d-85819dd476f0","Type":"ContainerDied","Data":"2ae6be30c95a8843df7bfc6b056b6ad9101fbf7f269401bf64a0535d9be374b6"}
Sep 11 12:00:03.295175 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:03.295143    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-6daa53-29818800-t2qq6"
Sep 11 12:00:03.351097 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:03.351068    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-117711-29818800-x6md6"
Sep 11 12:00:03.353929 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:03.353907    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-272c5e-29818800-vzvwf"
Sep 11 12:00:03.535431 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:03.535396    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-6daa53-29818800-t2qq6"]
Sep 11 12:00:03.544987 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:03.544955    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-6daa53-29818800-t2qq6"]
Sep 11 12:00:03.574758 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:03.574729    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6daa53-54647978cd-b6whd"]
Sep 11 12:00:03.574938 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:03.574918    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6daa53-54647978cd-b6whd" podUID="1f279c48-55be-428f-8131-c0ab788a9453" containerName="payload-pre-processing" containerID="cri-o://7d2ca9ff60859a4313fb79d4317ce8f8188aa4db06763168160b26030f3c77e3" gracePeriod=30
Sep 11 12:00:03.744239 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:03.744187    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-6daa53-2tzw5"]
Sep 11 12:00:03.749004 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:03.748977    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-6daa53-2tzw5"]
Sep 11 12:00:03.817507 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:03.817483    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57979dcf-cad4-40db-9009-f2c4c4cb15ad" path="/var/lib/kubelet/pods/57979dcf-cad4-40db-9009-f2c4c4cb15ad/volumes"
Sep 11 12:00:03.817836 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:03.817819    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c74c4a9e-1655-4d6c-bb2a-22040c38e884" path="/var/lib/kubelet/pods/c74c4a9e-1655-4d6c-bb2a-22040c38e884/volumes"
Sep 11 12:00:03.828611 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:03.828531    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6daa53-54647978cd-b6whd"
Sep 11 12:00:03.873996 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:03.873961    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9zh4\" (UniqueName: \"kubernetes.io/projected/1f279c48-55be-428f-8131-c0ab788a9453-kube-api-access-m9zh4\") pod \"1f279c48-55be-428f-8131-c0ab788a9453\" (UID: \"1f279c48-55be-428f-8131-c0ab788a9453\") "
Sep 11 12:00:03.874183 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:03.874100    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f279c48-55be-428f-8131-c0ab788a9453-plugins-config-volume\") pod \"1f279c48-55be-428f-8131-c0ab788a9453\" (UID: \"1f279c48-55be-428f-8131-c0ab788a9453\") "
Sep 11 12:00:03.874468 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:03.874446    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f279c48-55be-428f-8131-c0ab788a9453-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1f279c48-55be-428f-8131-c0ab788a9453" (UID: "1f279c48-55be-428f-8131-c0ab788a9453"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:00:03.876068 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:03.876044    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f279c48-55be-428f-8131-c0ab788a9453-kube-api-access-m9zh4" (OuterVolumeSpecName: "kube-api-access-m9zh4") pod "1f279c48-55be-428f-8131-c0ab788a9453" (UID: "1f279c48-55be-428f-8131-c0ab788a9453"). InnerVolumeSpecName "kube-api-access-m9zh4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:00:03.975263 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:03.975230    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f279c48-55be-428f-8131-c0ab788a9453-plugins-config-volume\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 12:00:03.975263 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:03.975257    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9zh4\" (UniqueName: \"kubernetes.io/projected/1f279c48-55be-428f-8131-c0ab788a9453-kube-api-access-m9zh4\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 12:00:04.156138 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:04.156053    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-272c5e-29818800-vzvwf"
Sep 11 12:00:04.156138 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:04.156095    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-272c5e-29818800-vzvwf" event={"ID":"b26e4f52-bd1a-4e8a-a41d-85819dd476f0","Type":"ContainerDied","Data":"e29e233e78b69234b62b2567360e7506b9ffbc7f631170f1401016acfe8c9ec5"}
Sep 11 12:00:04.156341 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:04.156145    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e29e233e78b69234b62b2567360e7506b9ffbc7f631170f1401016acfe8c9ec5"
Sep 11 12:00:04.157498 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:04.157478    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-117711-29818800-x6md6"
Sep 11 12:00:04.157641 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:04.157514    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-117711-29818800-x6md6" event={"ID":"67263530-834c-4e6f-8e5d-b559957198ef","Type":"ContainerDied","Data":"d4cec1e9453479488f6e304e69a8ce08efed89a4e75d4a334ea5cff6cb93f2be"}
Sep 11 12:00:04.157641 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:04.157550    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d4cec1e9453479488f6e304e69a8ce08efed89a4e75d4a334ea5cff6cb93f2be"
Sep 11 12:00:04.158992 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:04.158966    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-6daa53-29818800-t2qq6"
Sep 11 12:00:04.159095 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:04.158993    2560 scope.go:117] "RemoveContainer" containerID="16db9ade4db0b4f897ada34ad4fd8f955be6c588a645480bbfa72f2f109a9aa4"
Sep 11 12:00:04.160546 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:04.160525    2560 generic.go:356] "Generic (PLEG): container finished" podID="1f279c48-55be-428f-8131-c0ab788a9453" containerID="7d2ca9ff60859a4313fb79d4317ce8f8188aa4db06763168160b26030f3c77e3" exitCode=0
Sep 11 12:00:04.160621 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:04.160560    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6daa53-54647978cd-b6whd"
Sep 11 12:00:04.160621 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:04.160576    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6daa53-54647978cd-b6whd" event={"ID":"1f279c48-55be-428f-8131-c0ab788a9453","Type":"ContainerDied","Data":"7d2ca9ff60859a4313fb79d4317ce8f8188aa4db06763168160b26030f3c77e3"}
Sep 11 12:00:04.160621 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:04.160609    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6daa53-54647978cd-b6whd" event={"ID":"1f279c48-55be-428f-8131-c0ab788a9453","Type":"ContainerDied","Data":"c7bf21d808f0895107ce1259a97df51cc1b4777db47ee99665e6774156b2716f"}
Sep 11 12:00:04.169506 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:04.169485    2560 scope.go:117] "RemoveContainer" containerID="7d2ca9ff60859a4313fb79d4317ce8f8188aa4db06763168160b26030f3c77e3"
Sep 11 12:00:04.178502 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:04.178481    2560 scope.go:117] "RemoveContainer" containerID="7d2ca9ff60859a4313fb79d4317ce8f8188aa4db06763168160b26030f3c77e3"
Sep 11 12:00:04.178874 ip-10-0-142-230 kubenswrapper[2560]: E0911 12:00:04.178838    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d2ca9ff60859a4313fb79d4317ce8f8188aa4db06763168160b26030f3c77e3\": container with ID starting with 7d2ca9ff60859a4313fb79d4317ce8f8188aa4db06763168160b26030f3c77e3 not found: ID does not exist" containerID="7d2ca9ff60859a4313fb79d4317ce8f8188aa4db06763168160b26030f3c77e3"
Sep 11 12:00:04.178998 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:04.178878    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d2ca9ff60859a4313fb79d4317ce8f8188aa4db06763168160b26030f3c77e3"} err="failed to get container status \"7d2ca9ff60859a4313fb79d4317ce8f8188aa4db06763168160b26030f3c77e3\": rpc error: code = NotFound desc = could not find container \"7d2ca9ff60859a4313fb79d4317ce8f8188aa4db06763168160b26030f3c77e3\": container with ID starting with 7d2ca9ff60859a4313fb79d4317ce8f8188aa4db06763168160b26030f3c77e3 not found: ID does not exist"
Sep 11 12:00:04.209371 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:04.209335    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6daa53-54647978cd-b6whd"]
Sep 11 12:00:04.213860 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:04.213834    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6daa53-54647978cd-b6whd"]
Sep 11 12:00:05.813572 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:05.813540    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f279c48-55be-428f-8131-c0ab788a9453" path="/var/lib/kubelet/pods/1f279c48-55be-428f-8131-c0ab788a9453/volumes"
Sep 11 12:00:27.222049 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:27.222012    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff"]
Sep 11 12:00:27.222517 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:27.222364    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c74c4a9e-1655-4d6c-bb2a-22040c38e884" containerName="cleanup"
Sep 11 12:00:27.222517 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:27.222377    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c74c4a9e-1655-4d6c-bb2a-22040c38e884" containerName="cleanup"
Sep 11 12:00:27.222517 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:27.222394    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f279c48-55be-428f-8131-c0ab788a9453" containerName="payload-pre-processing"
Sep 11 12:00:27.222517 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:27.222400    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f279c48-55be-428f-8131-c0ab788a9453" containerName="payload-pre-processing"
Sep 11 12:00:27.222517 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:27.222407    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b26e4f52-bd1a-4e8a-a41d-85819dd476f0" containerName="cleanup"
Sep 11 12:00:27.222517 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:27.222413    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b26e4f52-bd1a-4e8a-a41d-85819dd476f0" containerName="cleanup"
Sep 11 12:00:27.222517 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:27.222427    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67263530-834c-4e6f-8e5d-b559957198ef" containerName="cleanup"
Sep 11 12:00:27.222517 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:27.222435    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="67263530-834c-4e6f-8e5d-b559957198ef" containerName="cleanup"
Sep 11 12:00:27.222517 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:27.222483    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c74c4a9e-1655-4d6c-bb2a-22040c38e884" containerName="cleanup"
Sep 11 12:00:27.222517 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:27.222492    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f279c48-55be-428f-8131-c0ab788a9453" containerName="payload-pre-processing"
Sep 11 12:00:27.222517 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:27.222499    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b26e4f52-bd1a-4e8a-a41d-85819dd476f0" containerName="cleanup"
Sep 11 12:00:27.222517 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:27.222508    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="67263530-834c-4e6f-8e5d-b559957198ef" containerName="cleanup"
Sep 11 12:00:27.225455 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:27.225439    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff"
Sep 11 12:00:27.228691 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:27.228669    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-b19164-openshift-default-dockercfg-mzpnf\""
Sep 11 12:00:27.259373 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:27.259337    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff"]
Sep 11 12:00:27.286280 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:27.286242    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eefebbbe-68f8-477c-a226-3659f60e50c3-istio-podinfo\") pod \"e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff\" (UID: \"eefebbbe-68f8-477c-a226-3659f60e50c3\") " pod="openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff"
Sep 11 12:00:27.286480 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:27.286362    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eefebbbe-68f8-477c-a226-3659f60e50c3-workload-socket\") pod \"e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff\" (UID: \"eefebbbe-68f8-477c-a226-3659f60e50c3\") " pod="openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff"
Sep 11 12:00:27.286480 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:27.286398    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fvz7\" (UniqueName: \"kubernetes.io/projected/eefebbbe-68f8-477c-a226-3659f60e50c3-kube-api-access-9fvz7\") pod \"e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff\" (UID: \"eefebbbe-68f8-477c-a226-3659f60e50c3\") " pod="openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff"
Sep 11 12:00:27.286480 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:27.286444    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eefebbbe-68f8-477c-a226-3659f60e50c3-workload-certs\") pod \"e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff\" (UID: \"eefebbbe-68f8-477c-a226-3659f60e50c3\") " pod="openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff"
Sep 11 12:00:27.286480 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:27.286478    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eefebbbe-68f8-477c-a226-3659f60e50c3-istio-data\") pod \"e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff\" (UID: \"eefebbbe-68f8-477c-a226-3659f60e50c3\") " pod="openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff"
Sep 11 12:00:27.286734 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:27.286504    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eefebbbe-68f8-477c-a226-3659f60e50c3-istio-token\") pod \"e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff\" (UID: \"eefebbbe-68f8-477c-a226-3659f60e50c3\") " pod="openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff"
Sep 11 12:00:27.286734 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:27.286528    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eefebbbe-68f8-477c-a226-3659f60e50c3-istiod-ca-cert\") pod \"e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff\" (UID: \"eefebbbe-68f8-477c-a226-3659f60e50c3\") " pod="openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff"
Sep 11 12:00:27.286734 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:27.286578    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eefebbbe-68f8-477c-a226-3659f60e50c3-istio-envoy\") pod \"e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff\" (UID: \"eefebbbe-68f8-477c-a226-3659f60e50c3\") " pod="openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff"
Sep 11 12:00:27.286734 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:27.286618    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eefebbbe-68f8-477c-a226-3659f60e50c3-credential-socket\") pod \"e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff\" (UID: \"eefebbbe-68f8-477c-a226-3659f60e50c3\") " pod="openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff"
Sep 11 12:00:27.387384 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:27.387346    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eefebbbe-68f8-477c-a226-3659f60e50c3-istio-envoy\") pod \"e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff\" (UID: \"eefebbbe-68f8-477c-a226-3659f60e50c3\") " pod="openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff"
Sep 11 12:00:27.387384 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:27.387386    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eefebbbe-68f8-477c-a226-3659f60e50c3-credential-socket\") pod \"e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff\" (UID: \"eefebbbe-68f8-477c-a226-3659f60e50c3\") " pod="openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff"
Sep 11 12:00:27.387600 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:27.387417    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eefebbbe-68f8-477c-a226-3659f60e50c3-istio-podinfo\") pod \"e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff\" (UID: \"eefebbbe-68f8-477c-a226-3659f60e50c3\") " pod="openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff"
Sep 11 12:00:27.387600 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:27.387445    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eefebbbe-68f8-477c-a226-3659f60e50c3-workload-socket\") pod \"e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff\" (UID: \"eefebbbe-68f8-477c-a226-3659f60e50c3\") " pod="openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff"
Sep 11 12:00:27.387600 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:27.387468    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fvz7\" (UniqueName: \"kubernetes.io/projected/eefebbbe-68f8-477c-a226-3659f60e50c3-kube-api-access-9fvz7\") pod \"e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff\" (UID: \"eefebbbe-68f8-477c-a226-3659f60e50c3\") " pod="openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff"
Sep 11 12:00:27.387600 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:27.387502    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eefebbbe-68f8-477c-a226-3659f60e50c3-workload-certs\") pod \"e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff\" (UID: \"eefebbbe-68f8-477c-a226-3659f60e50c3\") " pod="openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff"
Sep 11 12:00:27.387600 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:27.387528    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eefebbbe-68f8-477c-a226-3659f60e50c3-istio-data\") pod \"e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff\" (UID: \"eefebbbe-68f8-477c-a226-3659f60e50c3\") " pod="openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff"
Sep 11 12:00:27.387600 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:27.387551    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eefebbbe-68f8-477c-a226-3659f60e50c3-istio-token\") pod \"e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff\" (UID: \"eefebbbe-68f8-477c-a226-3659f60e50c3\") " pod="openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff"
Sep 11 12:00:27.387600 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:27.387572    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eefebbbe-68f8-477c-a226-3659f60e50c3-istiod-ca-cert\") pod \"e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff\" (UID: \"eefebbbe-68f8-477c-a226-3659f60e50c3\") " pod="openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff"
Sep 11 12:00:27.387991 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:27.387940    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eefebbbe-68f8-477c-a226-3659f60e50c3-workload-socket\") pod \"e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff\" (UID: \"eefebbbe-68f8-477c-a226-3659f60e50c3\") " pod="openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff"
Sep 11 12:00:27.388048 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:27.388011    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eefebbbe-68f8-477c-a226-3659f60e50c3-workload-certs\") pod \"e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff\" (UID: \"eefebbbe-68f8-477c-a226-3659f60e50c3\") " pod="openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff"
Sep 11 12:00:27.388134 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:27.388110    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eefebbbe-68f8-477c-a226-3659f60e50c3-credential-socket\") pod \"e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff\" (UID: \"eefebbbe-68f8-477c-a226-3659f60e50c3\") " pod="openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff"
Sep 11 12:00:27.388265 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:27.388246    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eefebbbe-68f8-477c-a226-3659f60e50c3-istio-data\") pod \"e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff\" (UID: \"eefebbbe-68f8-477c-a226-3659f60e50c3\") " pod="openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff"
Sep 11 12:00:27.388353 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:27.388338    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eefebbbe-68f8-477c-a226-3659f60e50c3-istiod-ca-cert\") pod \"e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff\" (UID: \"eefebbbe-68f8-477c-a226-3659f60e50c3\") " pod="openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff"
Sep 11 12:00:27.390240 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:27.390213    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eefebbbe-68f8-477c-a226-3659f60e50c3-istio-envoy\") pod \"e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff\" (UID: \"eefebbbe-68f8-477c-a226-3659f60e50c3\") " pod="openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff"
Sep 11 12:00:27.390445 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:27.390430    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eefebbbe-68f8-477c-a226-3659f60e50c3-istio-podinfo\") pod \"e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff\" (UID: \"eefebbbe-68f8-477c-a226-3659f60e50c3\") " pod="openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff"
Sep 11 12:00:27.401212 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:27.401183    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fvz7\" (UniqueName: \"kubernetes.io/projected/eefebbbe-68f8-477c-a226-3659f60e50c3-kube-api-access-9fvz7\") pod \"e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff\" (UID: \"eefebbbe-68f8-477c-a226-3659f60e50c3\") " pod="openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff"
Sep 11 12:00:27.401434 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:27.401416    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eefebbbe-68f8-477c-a226-3659f60e50c3-istio-token\") pod \"e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff\" (UID: \"eefebbbe-68f8-477c-a226-3659f60e50c3\") " pod="openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff"
Sep 11 12:00:27.535729 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:27.535612    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff"
Sep 11 12:00:27.855339 ip-10-0-142-230 kubenswrapper[2560]: W0911 12:00:27.855311    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeefebbbe_68f8_477c_a226_3659f60e50c3.slice/crio-70205c5e75ecbd7f986a95956e5c04c359d8ca9c3f6079615ff41ec21189c05b WatchSource:0}: Error finding container 70205c5e75ecbd7f986a95956e5c04c359d8ca9c3f6079615ff41ec21189c05b: Status 404 returned error can't find the container with id 70205c5e75ecbd7f986a95956e5c04c359d8ca9c3f6079615ff41ec21189c05b
Sep 11 12:00:27.857402 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:27.857373    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 12:00:27.857481 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:27.857434    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 12:00:27.857481 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:27.857462    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 12:00:27.873758 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:27.873732    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff"]
Sep 11 12:00:28.286084 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:28.286040    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff" event={"ID":"eefebbbe-68f8-477c-a226-3659f60e50c3","Type":"ContainerStarted","Data":"751d2e5d9772d097da3701ad8a0afe215b828765858315e5b729ab543c338ea5"}
Sep 11 12:00:28.286491 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:28.286137    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff" event={"ID":"eefebbbe-68f8-477c-a226-3659f60e50c3","Type":"ContainerStarted","Data":"70205c5e75ecbd7f986a95956e5c04c359d8ca9c3f6079615ff41ec21189c05b"}
Sep 11 12:00:28.536152 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:28.536058    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff"
Sep 11 12:00:28.541519 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:28.541487    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff"
Sep 11 12:00:28.589406 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:28.589354    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff" podStartSLOduration=1.5893397409999999 podStartE2EDuration="1.589339741s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:00:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:00:28.339611679 +0000 UTC m=+1579.162071552" watchObservedRunningTime="2026-09-11 12:00:28.589339741 +0000 UTC m=+1579.411799613"
Sep 11 12:00:29.291609 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:29.291574    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff"
Sep 11 12:00:29.292459 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:29.292440    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff"
Sep 11 12:00:32.907779 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:32.907744    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-b19164-7dbcf76459-zhpt8"]
Sep 11 12:00:32.911399 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:32.911372    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-b19164-7dbcf76459-zhpt8"
Sep 11 12:00:32.916009 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:32.915986    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-b19164-dockercfg-8mldx\""
Sep 11 12:00:32.916258 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:32.916243    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-b19164\""
Sep 11 12:00:32.928499 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:32.928470    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-b19164-7dbcf76459-zhpt8"]
Sep 11 12:00:33.043377 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:33.043330    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hj7r5\" (UniqueName: \"kubernetes.io/projected/5393c9b2-39a6-4122-838b-14039bc116d5-kube-api-access-hj7r5\") pod \"payload-processing-e2e-ipp-a-b19164-7dbcf76459-zhpt8\" (UID: \"5393c9b2-39a6-4122-838b-14039bc116d5\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-b19164-7dbcf76459-zhpt8"
Sep 11 12:00:33.043377 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:33.043370    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5393c9b2-39a6-4122-838b-14039bc116d5-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-b19164-7dbcf76459-zhpt8\" (UID: \"5393c9b2-39a6-4122-838b-14039bc116d5\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-b19164-7dbcf76459-zhpt8"
Sep 11 12:00:33.144850 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:33.144807    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hj7r5\" (UniqueName: \"kubernetes.io/projected/5393c9b2-39a6-4122-838b-14039bc116d5-kube-api-access-hj7r5\") pod \"payload-processing-e2e-ipp-a-b19164-7dbcf76459-zhpt8\" (UID: \"5393c9b2-39a6-4122-838b-14039bc116d5\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-b19164-7dbcf76459-zhpt8"
Sep 11 12:00:33.144850 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:33.144848    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5393c9b2-39a6-4122-838b-14039bc116d5-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-b19164-7dbcf76459-zhpt8\" (UID: \"5393c9b2-39a6-4122-838b-14039bc116d5\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-b19164-7dbcf76459-zhpt8"
Sep 11 12:00:33.145527 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:33.145505    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5393c9b2-39a6-4122-838b-14039bc116d5-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-b19164-7dbcf76459-zhpt8\" (UID: \"5393c9b2-39a6-4122-838b-14039bc116d5\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-b19164-7dbcf76459-zhpt8"
Sep 11 12:00:33.156803 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:33.156774    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hj7r5\" (UniqueName: \"kubernetes.io/projected/5393c9b2-39a6-4122-838b-14039bc116d5-kube-api-access-hj7r5\") pod \"payload-processing-e2e-ipp-a-b19164-7dbcf76459-zhpt8\" (UID: \"5393c9b2-39a6-4122-838b-14039bc116d5\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-b19164-7dbcf76459-zhpt8"
Sep 11 12:00:33.223790 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:33.223751    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-b19164-7dbcf76459-zhpt8"
Sep 11 12:00:33.496570 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:33.496543    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-b19164-7dbcf76459-zhpt8"]
Sep 11 12:00:33.499213 ip-10-0-142-230 kubenswrapper[2560]: W0911 12:00:33.499184    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5393c9b2_39a6_4122_838b_14039bc116d5.slice/crio-a03a695196a76043f98952e75178c96cdbc2bc7d253dca23f3aaa18170a4bb99 WatchSource:0}: Error finding container a03a695196a76043f98952e75178c96cdbc2bc7d253dca23f3aaa18170a4bb99: Status 404 returned error can't find the container with id a03a695196a76043f98952e75178c96cdbc2bc7d253dca23f3aaa18170a4bb99
Sep 11 12:00:34.324224 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:34.324179    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-b19164-7dbcf76459-zhpt8" event={"ID":"5393c9b2-39a6-4122-838b-14039bc116d5","Type":"ContainerStarted","Data":"31f669d00493d4c2d276fda2006ac2c7125f36dc728c47956bd6ee2e21ab90b5"}
Sep 11 12:00:34.324611 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:34.324248    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-b19164-7dbcf76459-zhpt8" event={"ID":"5393c9b2-39a6-4122-838b-14039bc116d5","Type":"ContainerStarted","Data":"a03a695196a76043f98952e75178c96cdbc2bc7d253dca23f3aaa18170a4bb99"}
Sep 11 12:00:34.324611 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:34.324372    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-b19164-7dbcf76459-zhpt8"
Sep 11 12:00:45.331944 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:45.331910    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-b19164-7dbcf76459-zhpt8"
Sep 11 12:00:45.333772 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:45.333744    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 12:00:45.333889 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:45.333805    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff" podUID="eefebbbe-68f8-477c-a226-3659f60e50c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 12:00:45.371567 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:45.371521    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-b19164-7dbcf76459-zhpt8" podStartSLOduration=13.371507461 podStartE2EDuration="13.371507461s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:00:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:00:34.345532495 +0000 UTC m=+1585.167992381" watchObservedRunningTime="2026-09-11 12:00:45.371507461 +0000 UTC m=+1596.193967333"
Sep 11 12:00:47.402911 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:47.402876    2560 generic.go:356] "Generic (PLEG): container finished" podID="eefebbbe-68f8-477c-a226-3659f60e50c3" containerID="751d2e5d9772d097da3701ad8a0afe215b828765858315e5b729ab543c338ea5" exitCode=0
Sep 11 12:00:47.403330 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:47.402948    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff" event={"ID":"eefebbbe-68f8-477c-a226-3659f60e50c3","Type":"ContainerDied","Data":"751d2e5d9772d097da3701ad8a0afe215b828765858315e5b729ab543c338ea5"}
Sep 11 12:00:47.403379 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:47.403331    2560 scope.go:117] "RemoveContainer" containerID="751d2e5d9772d097da3701ad8a0afe215b828765858315e5b729ab543c338ea5"
Sep 11 12:00:47.404342 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:47.404310    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 12:00:47.404433 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:47.404378    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 12:00:47.404433 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:47.404410    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 12:00:48.410459 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:48.410426    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff" event={"ID":"eefebbbe-68f8-477c-a226-3659f60e50c3","Type":"ContainerStarted","Data":"e367ba0800ef5b16949eb96fb55f26451ca28abfb83c354daa9d888d2931ec05"}
Sep 11 12:00:48.536828 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:48.536775    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff"
Sep 11 12:00:48.537415 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:48.537319    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 11 12:00:48.537663 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:48.537607    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff" podUID="eefebbbe-68f8-477c-a226-3659f60e50c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 11 12:00:49.536835 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:49.536792    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 11 12:00:49.537333 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:49.536861    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff" podUID="eefebbbe-68f8-477c-a226-3659f60e50c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 11 12:00:50.536669 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:50.536601    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 11 12:00:50.536880 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:50.536714    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff" podUID="eefebbbe-68f8-477c-a226-3659f60e50c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 11 12:00:51.536960 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:51.536921    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 11 12:00:51.537522 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:51.537490    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff" podUID="eefebbbe-68f8-477c-a226-3659f60e50c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 11 12:00:52.537018 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:52.536981    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 11 12:00:52.537605 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:52.537570    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff" podUID="eefebbbe-68f8-477c-a226-3659f60e50c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 11 12:00:53.542764 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:53.542736    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff"
Sep 11 12:00:53.543219 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:53.543031    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff"
Sep 11 12:00:53.543830 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:00:53.543809    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff"
Sep 11 12:01:59.513545 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:01:59.513515    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-b19164-7dbcf76459-zhpt8_5393c9b2-39a6-4122-838b-14039bc116d5/payload-processing/0.log"
Sep 11 12:02:00.287125 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:00.287077    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz"]
Sep 11 12:02:00.290969 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:00.290946    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz"
Sep 11 12:02:00.294425 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:00.294397    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-b8e0f0-openshift-default-dockercfg-j4xb6\""
Sep 11 12:02:00.300827 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:00.300800    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz"]
Sep 11 12:02:00.449680 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:00.449613    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba-workload-certs\") pod \"e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz\" (UID: \"2c3a1d36-4e5a-4bb6-859e-05dcb1141cba\") " pod="openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz"
Sep 11 12:02:00.449680 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:00.449677    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba-istio-token\") pod \"e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz\" (UID: \"2c3a1d36-4e5a-4bb6-859e-05dcb1141cba\") " pod="openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz"
Sep 11 12:02:00.449900 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:00.449783    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba-workload-socket\") pod \"e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz\" (UID: \"2c3a1d36-4e5a-4bb6-859e-05dcb1141cba\") " pod="openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz"
Sep 11 12:02:00.449900 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:00.449836    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n66fg\" (UniqueName: \"kubernetes.io/projected/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba-kube-api-access-n66fg\") pod \"e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz\" (UID: \"2c3a1d36-4e5a-4bb6-859e-05dcb1141cba\") " pod="openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz"
Sep 11 12:02:00.449900 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:00.449879    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba-credential-socket\") pod \"e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz\" (UID: \"2c3a1d36-4e5a-4bb6-859e-05dcb1141cba\") " pod="openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz"
Sep 11 12:02:00.450007 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:00.449911    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba-istio-envoy\") pod \"e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz\" (UID: \"2c3a1d36-4e5a-4bb6-859e-05dcb1141cba\") " pod="openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz"
Sep 11 12:02:00.450007 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:00.449933    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba-istio-data\") pod \"e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz\" (UID: \"2c3a1d36-4e5a-4bb6-859e-05dcb1141cba\") " pod="openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz"
Sep 11 12:02:00.450007 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:00.449948    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba-istio-podinfo\") pod \"e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz\" (UID: \"2c3a1d36-4e5a-4bb6-859e-05dcb1141cba\") " pod="openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz"
Sep 11 12:02:00.450007 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:00.449970    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba-istiod-ca-cert\") pod \"e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz\" (UID: \"2c3a1d36-4e5a-4bb6-859e-05dcb1141cba\") " pod="openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz"
Sep 11 12:02:00.551174 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:00.551091    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba-credential-socket\") pod \"e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz\" (UID: \"2c3a1d36-4e5a-4bb6-859e-05dcb1141cba\") " pod="openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz"
Sep 11 12:02:00.551174 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:00.551130    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba-istio-envoy\") pod \"e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz\" (UID: \"2c3a1d36-4e5a-4bb6-859e-05dcb1141cba\") " pod="openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz"
Sep 11 12:02:00.551174 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:00.551157    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba-istio-data\") pod \"e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz\" (UID: \"2c3a1d36-4e5a-4bb6-859e-05dcb1141cba\") " pod="openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz"
Sep 11 12:02:00.551740 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:00.551257    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba-istio-podinfo\") pod \"e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz\" (UID: \"2c3a1d36-4e5a-4bb6-859e-05dcb1141cba\") " pod="openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz"
Sep 11 12:02:00.551740 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:00.551290    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba-istiod-ca-cert\") pod \"e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz\" (UID: \"2c3a1d36-4e5a-4bb6-859e-05dcb1141cba\") " pod="openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz"
Sep 11 12:02:00.551740 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:00.551337    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba-workload-certs\") pod \"e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz\" (UID: \"2c3a1d36-4e5a-4bb6-859e-05dcb1141cba\") " pod="openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz"
Sep 11 12:02:00.551740 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:00.551371    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba-istio-token\") pod \"e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz\" (UID: \"2c3a1d36-4e5a-4bb6-859e-05dcb1141cba\") " pod="openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz"
Sep 11 12:02:00.551740 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:00.551448    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba-workload-socket\") pod \"e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz\" (UID: \"2c3a1d36-4e5a-4bb6-859e-05dcb1141cba\") " pod="openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz"
Sep 11 12:02:00.551740 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:00.551500    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n66fg\" (UniqueName: \"kubernetes.io/projected/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba-kube-api-access-n66fg\") pod \"e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz\" (UID: \"2c3a1d36-4e5a-4bb6-859e-05dcb1141cba\") " pod="openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz"
Sep 11 12:02:00.551740 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:00.551641    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba-credential-socket\") pod \"e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz\" (UID: \"2c3a1d36-4e5a-4bb6-859e-05dcb1141cba\") " pod="openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz"
Sep 11 12:02:00.552112 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:00.551760    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba-workload-certs\") pod \"e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz\" (UID: \"2c3a1d36-4e5a-4bb6-859e-05dcb1141cba\") " pod="openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz"
Sep 11 12:02:00.552171 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:00.552113    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba-istio-data\") pod \"e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz\" (UID: \"2c3a1d36-4e5a-4bb6-859e-05dcb1141cba\") " pod="openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz"
Sep 11 12:02:00.552171 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:00.552152    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba-workload-socket\") pod \"e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz\" (UID: \"2c3a1d36-4e5a-4bb6-859e-05dcb1141cba\") " pod="openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz"
Sep 11 12:02:00.552468 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:00.552447    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba-istiod-ca-cert\") pod \"e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz\" (UID: \"2c3a1d36-4e5a-4bb6-859e-05dcb1141cba\") " pod="openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz"
Sep 11 12:02:00.553563 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:00.553535    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba-istio-envoy\") pod \"e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz\" (UID: \"2c3a1d36-4e5a-4bb6-859e-05dcb1141cba\") " pod="openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz"
Sep 11 12:02:00.553804 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:00.553786    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba-istio-podinfo\") pod \"e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz\" (UID: \"2c3a1d36-4e5a-4bb6-859e-05dcb1141cba\") " pod="openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz"
Sep 11 12:02:00.559165 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:00.559139    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba-istio-token\") pod \"e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz\" (UID: \"2c3a1d36-4e5a-4bb6-859e-05dcb1141cba\") " pod="openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz"
Sep 11 12:02:00.559261 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:00.559236    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n66fg\" (UniqueName: \"kubernetes.io/projected/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba-kube-api-access-n66fg\") pod \"e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz\" (UID: \"2c3a1d36-4e5a-4bb6-859e-05dcb1141cba\") " pod="openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz"
Sep 11 12:02:00.603372 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:00.603330    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz"
Sep 11 12:02:00.884713 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:00.884689    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz"]
Sep 11 12:02:00.886924 ip-10-0-142-230 kubenswrapper[2560]: W0911 12:02:00.886886    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c3a1d36_4e5a_4bb6_859e_05dcb1141cba.slice/crio-062b06266805f2aa3274322444beebb1d4fb1ab7e4287238aa81281d6c345bf0 WatchSource:0}: Error finding container 062b06266805f2aa3274322444beebb1d4fb1ab7e4287238aa81281d6c345bf0: Status 404 returned error can't find the container with id 062b06266805f2aa3274322444beebb1d4fb1ab7e4287238aa81281d6c345bf0
Sep 11 12:02:00.889079 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:00.889052    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 12:02:00.889147 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:00.889113    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 12:02:00.889147 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:00.889143    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 12:02:01.784405 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:01.784365    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz" event={"ID":"2c3a1d36-4e5a-4bb6-859e-05dcb1141cba","Type":"ContainerStarted","Data":"e4574d1c83c530b1a3d4d3e9c37f0f3bad91ecbfeba41a8a38abfb51823276bc"}
Sep 11 12:02:01.784883 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:01.784449    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz" event={"ID":"2c3a1d36-4e5a-4bb6-859e-05dcb1141cba","Type":"ContainerStarted","Data":"062b06266805f2aa3274322444beebb1d4fb1ab7e4287238aa81281d6c345bf0"}
Sep 11 12:02:01.810091 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:01.810041    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz" podStartSLOduration=1.810024779 podStartE2EDuration="1.810024779s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:02:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:02:01.807398199 +0000 UTC m=+1672.629858072" watchObservedRunningTime="2026-09-11 12:02:01.810024779 +0000 UTC m=+1672.632484652"
Sep 11 12:02:02.604676 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:02.604607    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz"
Sep 11 12:02:02.610430 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:02.610400    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz"
Sep 11 12:02:02.789626 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:02.789593    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz"
Sep 11 12:02:02.790678 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:02.790663    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz"
Sep 11 12:02:06.218406 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:06.218371    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-b8e0f0-5db6f77c57-9f9gs"]
Sep 11 12:02:06.222023 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:06.222002    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b8e0f0-5db6f77c57-9f9gs"
Sep 11 12:02:06.225026 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:06.225004    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-b8e0f0-dockercfg-4d9hd\""
Sep 11 12:02:06.225287 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:06.225273    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-b8e0f0\""
Sep 11 12:02:06.242483 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:06.242454    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-b8e0f0-5db6f77c57-9f9gs"]
Sep 11 12:02:06.405065 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:06.405026    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ztn2\" (UniqueName: \"kubernetes.io/projected/90da8e53-b512-439e-8d1b-bd711b1293e8-kube-api-access-2ztn2\") pod \"payload-processing-e2e-ipp-cleanup-b8e0f0-5db6f77c57-9f9gs\" (UID: \"90da8e53-b512-439e-8d1b-bd711b1293e8\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b8e0f0-5db6f77c57-9f9gs"
Sep 11 12:02:06.405250 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:06.405095    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90da8e53-b512-439e-8d1b-bd711b1293e8-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-b8e0f0-5db6f77c57-9f9gs\" (UID: \"90da8e53-b512-439e-8d1b-bd711b1293e8\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b8e0f0-5db6f77c57-9f9gs"
Sep 11 12:02:06.506475 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:06.506382    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ztn2\" (UniqueName: \"kubernetes.io/projected/90da8e53-b512-439e-8d1b-bd711b1293e8-kube-api-access-2ztn2\") pod \"payload-processing-e2e-ipp-cleanup-b8e0f0-5db6f77c57-9f9gs\" (UID: \"90da8e53-b512-439e-8d1b-bd711b1293e8\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b8e0f0-5db6f77c57-9f9gs"
Sep 11 12:02:06.506475 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:06.506461    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90da8e53-b512-439e-8d1b-bd711b1293e8-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-b8e0f0-5db6f77c57-9f9gs\" (UID: \"90da8e53-b512-439e-8d1b-bd711b1293e8\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b8e0f0-5db6f77c57-9f9gs"
Sep 11 12:02:06.507194 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:06.507175    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90da8e53-b512-439e-8d1b-bd711b1293e8-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-b8e0f0-5db6f77c57-9f9gs\" (UID: \"90da8e53-b512-439e-8d1b-bd711b1293e8\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b8e0f0-5db6f77c57-9f9gs"
Sep 11 12:02:06.517272 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:06.517244    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ztn2\" (UniqueName: \"kubernetes.io/projected/90da8e53-b512-439e-8d1b-bd711b1293e8-kube-api-access-2ztn2\") pod \"payload-processing-e2e-ipp-cleanup-b8e0f0-5db6f77c57-9f9gs\" (UID: \"90da8e53-b512-439e-8d1b-bd711b1293e8\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b8e0f0-5db6f77c57-9f9gs"
Sep 11 12:02:06.533104 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:06.533076    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b8e0f0-5db6f77c57-9f9gs"
Sep 11 12:02:06.820143 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:06.820030    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-b8e0f0-5db6f77c57-9f9gs"]
Sep 11 12:02:06.822968 ip-10-0-142-230 kubenswrapper[2560]: W0911 12:02:06.822944    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90da8e53_b512_439e_8d1b_bd711b1293e8.slice/crio-f0d7b0ba82e35ae8040d848003d222a7e41733a93f11036cbc2afee0e4a33735 WatchSource:0}: Error finding container f0d7b0ba82e35ae8040d848003d222a7e41733a93f11036cbc2afee0e4a33735: Status 404 returned error can't find the container with id f0d7b0ba82e35ae8040d848003d222a7e41733a93f11036cbc2afee0e4a33735
Sep 11 12:02:07.816833 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:07.816793    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b8e0f0-5db6f77c57-9f9gs" event={"ID":"90da8e53-b512-439e-8d1b-bd711b1293e8","Type":"ContainerStarted","Data":"b644985aeb1937226accae152f0bfcc15459f313f0334f8f4d8236e156ab93f7"}
Sep 11 12:02:07.817235 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:07.816850    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b8e0f0-5db6f77c57-9f9gs" event={"ID":"90da8e53-b512-439e-8d1b-bd711b1293e8","Type":"ContainerStarted","Data":"f0d7b0ba82e35ae8040d848003d222a7e41733a93f11036cbc2afee0e4a33735"}
Sep 11 12:02:07.817235 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:07.816891    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b8e0f0-5db6f77c57-9f9gs"
Sep 11 12:02:07.842433 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:07.842377    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b8e0f0-5db6f77c57-9f9gs" podStartSLOduration=1.842360529 podStartE2EDuration="1.842360529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:02:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:02:07.838874769 +0000 UTC m=+1678.661334663" watchObservedRunningTime="2026-09-11 12:02:07.842360529 +0000 UTC m=+1678.664820426"
Sep 11 12:02:10.076963 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:10.076930    2560 scope.go:117] "RemoveContainer" containerID="7bcb703ad8bc8559a9e7c9bfb8783d4dc4a61d2d0b5ca2470558cc236df2facf"
Sep 11 12:02:18.825181 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:18.825147    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b8e0f0-5db6f77c57-9f9gs"
Sep 11 12:02:21.902952 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:21.902916    2560 generic.go:356] "Generic (PLEG): container finished" podID="2c3a1d36-4e5a-4bb6-859e-05dcb1141cba" containerID="e4574d1c83c530b1a3d4d3e9c37f0f3bad91ecbfeba41a8a38abfb51823276bc" exitCode=0
Sep 11 12:02:21.903355 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:21.902960    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz" event={"ID":"2c3a1d36-4e5a-4bb6-859e-05dcb1141cba","Type":"ContainerDied","Data":"e4574d1c83c530b1a3d4d3e9c37f0f3bad91ecbfeba41a8a38abfb51823276bc"}
Sep 11 12:02:21.903405 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:21.903358    2560 scope.go:117] "RemoveContainer" containerID="e4574d1c83c530b1a3d4d3e9c37f0f3bad91ecbfeba41a8a38abfb51823276bc"
Sep 11 12:02:21.904469 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:21.904438    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 12:02:21.904522 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:21.904506    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 12:02:21.904561 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:21.904539    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 12:02:22.910527 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:22.910493    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz" event={"ID":"2c3a1d36-4e5a-4bb6-859e-05dcb1141cba","Type":"ContainerStarted","Data":"7be458e1a18e593d2cdffe90f571c8e0d66ec297539510e24cdeafbbcc2999fc"}
Sep 11 12:02:23.604614 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:23.604580    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz"
Sep 11 12:02:23.604817 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:23.604790    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 11 12:02:23.604873 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:23.604843    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz" podUID="2c3a1d36-4e5a-4bb6-859e-05dcb1141cba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 11 12:02:24.604499 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:24.604455    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 11 12:02:24.604943 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:24.604519    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz" podUID="2c3a1d36-4e5a-4bb6-859e-05dcb1141cba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 11 12:02:25.604416 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:25.604374    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 11 12:02:25.604604 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:25.604446    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz" podUID="2c3a1d36-4e5a-4bb6-859e-05dcb1141cba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 11 12:02:26.604617 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:26.604568    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 11 12:02:26.605053 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:26.604682    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz" podUID="2c3a1d36-4e5a-4bb6-859e-05dcb1141cba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 11 12:02:27.604159 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:27.604123    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 11 12:02:27.604345 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:27.604205    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz" podUID="2c3a1d36-4e5a-4bb6-859e-05dcb1141cba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 11 12:02:28.604463 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:28.604429    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 11 12:02:28.604881 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:28.604479    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz" podUID="2c3a1d36-4e5a-4bb6-859e-05dcb1141cba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 11 12:02:29.392024 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:29.391990    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-b8e0f0-vsqqw"]
Sep 11 12:02:29.395496 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:29.395473    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-b8e0f0-vsqqw"
Sep 11 12:02:29.398314 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:29.398292    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 12:02:29.398438 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:29.398414    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f46tj\""
Sep 11 12:02:29.414190 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:29.414157    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-b8e0f0-vsqqw"]
Sep 11 12:02:29.516099 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:29.516058    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/68ff6324-f470-49f8-b636-2c9881771d24-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-b8e0f0-vsqqw\" (UID: \"68ff6324-f470-49f8-b636-2c9881771d24\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-b8e0f0-vsqqw"
Sep 11 12:02:29.608387 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:29.608355    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz"
Sep 11 12:02:29.608867 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:29.608762    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz"
Sep 11 12:02:29.609361 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:29.609342    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz"
Sep 11 12:02:29.616960 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:29.616928    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/68ff6324-f470-49f8-b636-2c9881771d24-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-b8e0f0-vsqqw\" (UID: \"68ff6324-f470-49f8-b636-2c9881771d24\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-b8e0f0-vsqqw"
Sep 11 12:02:29.617520 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:29.617503    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/68ff6324-f470-49f8-b636-2c9881771d24-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-b8e0f0-vsqqw\" (UID: \"68ff6324-f470-49f8-b636-2c9881771d24\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-b8e0f0-vsqqw"
Sep 11 12:02:29.705096 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:29.705011    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-b8e0f0-vsqqw"
Sep 11 12:02:29.997481 ip-10-0-142-230 kubenswrapper[2560]: W0911 12:02:29.997451    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68ff6324_f470_49f8_b636_2c9881771d24.slice/crio-4836a4337cfeae4f7c3b944081afdd0650ac59d9ad64d9f8dc757f71cc2c7db9 WatchSource:0}: Error finding container 4836a4337cfeae4f7c3b944081afdd0650ac59d9ad64d9f8dc757f71cc2c7db9: Status 404 returned error can't find the container with id 4836a4337cfeae4f7c3b944081afdd0650ac59d9ad64d9f8dc757f71cc2c7db9
Sep 11 12:02:29.999570 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:29.999548    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-b8e0f0-vsqqw"]
Sep 11 12:02:30.957438 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:30.957339    2560 generic.go:356] "Generic (PLEG): container finished" podID="68ff6324-f470-49f8-b636-2c9881771d24" containerID="9f30cd40e4887cadca647413d91ea999844a7f4e7f38beb38f2b3a3853e81800" exitCode=0
Sep 11 12:02:30.957916 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:30.957565    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-b8e0f0-vsqqw" event={"ID":"68ff6324-f470-49f8-b636-2c9881771d24","Type":"ContainerDied","Data":"9f30cd40e4887cadca647413d91ea999844a7f4e7f38beb38f2b3a3853e81800"}
Sep 11 12:02:30.957916 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:30.957642    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-b8e0f0-vsqqw" event={"ID":"68ff6324-f470-49f8-b636-2c9881771d24","Type":"ContainerStarted","Data":"4836a4337cfeae4f7c3b944081afdd0650ac59d9ad64d9f8dc757f71cc2c7db9"}
Sep 11 12:02:32.095691 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:32.095643    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-b8e0f0-vsqqw"
Sep 11 12:02:32.138460 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:32.138430    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/68ff6324-f470-49f8-b636-2c9881771d24-maas-api-service-ca\") pod \"68ff6324-f470-49f8-b636-2c9881771d24\" (UID: \"68ff6324-f470-49f8-b636-2c9881771d24\") "
Sep 11 12:02:32.138788 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:32.138764    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68ff6324-f470-49f8-b636-2c9881771d24-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "68ff6324-f470-49f8-b636-2c9881771d24" (UID: "68ff6324-f470-49f8-b636-2c9881771d24"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:02:32.239190 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:32.239106    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/68ff6324-f470-49f8-b636-2c9881771d24-maas-api-service-ca\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 12:02:32.968679 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:32.968631    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-b8e0f0-vsqqw"
Sep 11 12:02:32.968679 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:32.968631    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-b8e0f0-vsqqw" event={"ID":"68ff6324-f470-49f8-b636-2c9881771d24","Type":"ContainerDied","Data":"4836a4337cfeae4f7c3b944081afdd0650ac59d9ad64d9f8dc757f71cc2c7db9"}
Sep 11 12:02:32.968893 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:32.968704    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4836a4337cfeae4f7c3b944081afdd0650ac59d9ad64d9f8dc757f71cc2c7db9"
Sep 11 12:02:35.670549 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:35.670513    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-b8e0f0-5db6f77c57-9f9gs"]
Sep 11 12:02:35.671048 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:35.670764    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b8e0f0-5db6f77c57-9f9gs" podUID="90da8e53-b512-439e-8d1b-bd711b1293e8" containerName="payload-processing" containerID="cri-o://b644985aeb1937226accae152f0bfcc15459f313f0334f8f4d8236e156ab93f7" gracePeriod=30
Sep 11 12:02:35.937523 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:35.937493    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b8e0f0-5db6f77c57-9f9gs"
Sep 11 12:02:35.971265 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:35.971233    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-b8e0f0-vsqqw"]
Sep 11 12:02:35.977935 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:35.977907    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-b8e0f0-vsqqw"]
Sep 11 12:02:35.985478 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:35.985445    2560 generic.go:356] "Generic (PLEG): container finished" podID="90da8e53-b512-439e-8d1b-bd711b1293e8" containerID="b644985aeb1937226accae152f0bfcc15459f313f0334f8f4d8236e156ab93f7" exitCode=0
Sep 11 12:02:35.985623 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:35.985488    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b8e0f0-5db6f77c57-9f9gs" event={"ID":"90da8e53-b512-439e-8d1b-bd711b1293e8","Type":"ContainerDied","Data":"b644985aeb1937226accae152f0bfcc15459f313f0334f8f4d8236e156ab93f7"}
Sep 11 12:02:35.985623 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:35.985504    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b8e0f0-5db6f77c57-9f9gs"
Sep 11 12:02:35.985623 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:35.985530    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b8e0f0-5db6f77c57-9f9gs" event={"ID":"90da8e53-b512-439e-8d1b-bd711b1293e8","Type":"ContainerDied","Data":"f0d7b0ba82e35ae8040d848003d222a7e41733a93f11036cbc2afee0e4a33735"}
Sep 11 12:02:35.985623 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:35.985555    2560 scope.go:117] "RemoveContainer" containerID="b644985aeb1937226accae152f0bfcc15459f313f0334f8f4d8236e156ab93f7"
Sep 11 12:02:35.994392 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:35.994373    2560 scope.go:117] "RemoveContainer" containerID="b644985aeb1937226accae152f0bfcc15459f313f0334f8f4d8236e156ab93f7"
Sep 11 12:02:35.994696 ip-10-0-142-230 kubenswrapper[2560]: E0911 12:02:35.994672    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b644985aeb1937226accae152f0bfcc15459f313f0334f8f4d8236e156ab93f7\": container with ID starting with b644985aeb1937226accae152f0bfcc15459f313f0334f8f4d8236e156ab93f7 not found: ID does not exist" containerID="b644985aeb1937226accae152f0bfcc15459f313f0334f8f4d8236e156ab93f7"
Sep 11 12:02:35.994773 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:35.994703    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b644985aeb1937226accae152f0bfcc15459f313f0334f8f4d8236e156ab93f7"} err="failed to get container status \"b644985aeb1937226accae152f0bfcc15459f313f0334f8f4d8236e156ab93f7\": rpc error: code = NotFound desc = could not find container \"b644985aeb1937226accae152f0bfcc15459f313f0334f8f4d8236e156ab93f7\": container with ID starting with b644985aeb1937226accae152f0bfcc15459f313f0334f8f4d8236e156ab93f7 not found: ID does not exist"
Sep 11 12:02:36.077063 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:36.077028    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2ztn2\" (UniqueName: \"kubernetes.io/projected/90da8e53-b512-439e-8d1b-bd711b1293e8-kube-api-access-2ztn2\") pod \"90da8e53-b512-439e-8d1b-bd711b1293e8\" (UID: \"90da8e53-b512-439e-8d1b-bd711b1293e8\") "
Sep 11 12:02:36.077214 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:36.077099    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90da8e53-b512-439e-8d1b-bd711b1293e8-plugins-config-volume\") pod \"90da8e53-b512-439e-8d1b-bd711b1293e8\" (UID: \"90da8e53-b512-439e-8d1b-bd711b1293e8\") "
Sep 11 12:02:36.077480 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:36.077457    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90da8e53-b512-439e-8d1b-bd711b1293e8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "90da8e53-b512-439e-8d1b-bd711b1293e8" (UID: "90da8e53-b512-439e-8d1b-bd711b1293e8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:02:36.079119 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:36.079091    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90da8e53-b512-439e-8d1b-bd711b1293e8-kube-api-access-2ztn2" (OuterVolumeSpecName: "kube-api-access-2ztn2") pod "90da8e53-b512-439e-8d1b-bd711b1293e8" (UID: "90da8e53-b512-439e-8d1b-bd711b1293e8"). InnerVolumeSpecName "kube-api-access-2ztn2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:02:36.177976 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:36.177870    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90da8e53-b512-439e-8d1b-bd711b1293e8-plugins-config-volume\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 12:02:36.177976 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:36.177917    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2ztn2\" (UniqueName: \"kubernetes.io/projected/90da8e53-b512-439e-8d1b-bd711b1293e8-kube-api-access-2ztn2\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 12:02:36.316188 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:36.316150    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-b8e0f0-5db6f77c57-9f9gs"]
Sep 11 12:02:36.319681 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:36.319657    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-b8e0f0-5db6f77c57-9f9gs"]
Sep 11 12:02:37.815771 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:37.815733    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68ff6324-f470-49f8-b636-2c9881771d24" path="/var/lib/kubelet/pods/68ff6324-f470-49f8-b636-2c9881771d24/volumes"
Sep 11 12:02:37.816204 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:37.816156    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90da8e53-b512-439e-8d1b-bd711b1293e8" path="/var/lib/kubelet/pods/90da8e53-b512-439e-8d1b-bd711b1293e8/volumes"
Sep 11 12:02:42.882004 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:42.881973    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz"]
Sep 11 12:02:42.882423 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:42.882221    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz" podUID="2c3a1d36-4e5a-4bb6-859e-05dcb1141cba" containerName="istio-proxy" containerID="cri-o://7be458e1a18e593d2cdffe90f571c8e0d66ec297539510e24cdeafbbcc2999fc" gracePeriod=30
Sep 11 12:02:44.611348 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:44.611309    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Sep 11 12:02:44.611769 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:44.611376    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz" podUID="2c3a1d36-4e5a-4bb6-859e-05dcb1141cba" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 12:02:46.407623 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:46.407587    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b19164-wft7m"]
Sep 11 12:02:46.408014 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:46.407945    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68ff6324-f470-49f8-b636-2c9881771d24" containerName="revoke-keys"
Sep 11 12:02:46.408014 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:46.407957    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="68ff6324-f470-49f8-b636-2c9881771d24" containerName="revoke-keys"
Sep 11 12:02:46.408014 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:46.407973    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90da8e53-b512-439e-8d1b-bd711b1293e8" containerName="payload-processing"
Sep 11 12:02:46.408014 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:46.407979    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="90da8e53-b512-439e-8d1b-bd711b1293e8" containerName="payload-processing"
Sep 11 12:02:46.408148 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:46.408059    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="90da8e53-b512-439e-8d1b-bd711b1293e8" containerName="payload-processing"
Sep 11 12:02:46.408148 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:46.408066    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="68ff6324-f470-49f8-b636-2c9881771d24" containerName="revoke-keys"
Sep 11 12:02:46.410872 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:46.410857    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b19164-wft7m"
Sep 11 12:02:46.413847 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:46.413827    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 12:02:46.413947 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:46.413880    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f46tj\""
Sep 11 12:02:46.421797 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:46.421773    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b19164-wft7m"]
Sep 11 12:02:46.580636 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:46.580597    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0149138b-4e3e-41d6-beb9-3f286f25a300-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-b19164-wft7m\" (UID: \"0149138b-4e3e-41d6-beb9-3f286f25a300\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b19164-wft7m"
Sep 11 12:02:46.681222 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:46.681129    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0149138b-4e3e-41d6-beb9-3f286f25a300-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-b19164-wft7m\" (UID: \"0149138b-4e3e-41d6-beb9-3f286f25a300\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b19164-wft7m"
Sep 11 12:02:46.681778 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:46.681760    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0149138b-4e3e-41d6-beb9-3f286f25a300-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-b19164-wft7m\" (UID: \"0149138b-4e3e-41d6-beb9-3f286f25a300\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b19164-wft7m"
Sep 11 12:02:46.722279 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:46.722245    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b19164-wft7m"
Sep 11 12:02:46.994213 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:46.994187    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b19164-wft7m"]
Sep 11 12:02:46.995785 ip-10-0-142-230 kubenswrapper[2560]: W0911 12:02:46.995756    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0149138b_4e3e_41d6_beb9_3f286f25a300.slice/crio-7e43ec0a94260fdd3a3dd383cc8d83ef0659f581cc2bd4028cb48390c59932cf WatchSource:0}: Error finding container 7e43ec0a94260fdd3a3dd383cc8d83ef0659f581cc2bd4028cb48390c59932cf: Status 404 returned error can't find the container with id 7e43ec0a94260fdd3a3dd383cc8d83ef0659f581cc2bd4028cb48390c59932cf
Sep 11 12:02:47.042246 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:47.042219    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b19164-wft7m" event={"ID":"0149138b-4e3e-41d6-beb9-3f286f25a300","Type":"ContainerStarted","Data":"7e43ec0a94260fdd3a3dd383cc8d83ef0659f581cc2bd4028cb48390c59932cf"}
Sep 11 12:02:48.049960 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:48.049926    2560 generic.go:356] "Generic (PLEG): container finished" podID="2c3a1d36-4e5a-4bb6-859e-05dcb1141cba" containerID="7be458e1a18e593d2cdffe90f571c8e0d66ec297539510e24cdeafbbcc2999fc" exitCode=0
Sep 11 12:02:48.050390 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:48.049975    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz" event={"ID":"2c3a1d36-4e5a-4bb6-859e-05dcb1141cba","Type":"ContainerDied","Data":"7be458e1a18e593d2cdffe90f571c8e0d66ec297539510e24cdeafbbcc2999fc"}
Sep 11 12:02:48.050390 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:48.050049    2560 scope.go:117] "RemoveContainer" containerID="e4574d1c83c530b1a3d4d3e9c37f0f3bad91ecbfeba41a8a38abfb51823276bc"
Sep 11 12:02:48.052892 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:48.052719    2560 generic.go:356] "Generic (PLEG): container finished" podID="0149138b-4e3e-41d6-beb9-3f286f25a300" containerID="6a32f02729da66157033456edc47a5c49565b58bd3ad26bd11d2111eb57bda64" exitCode=0
Sep 11 12:02:48.052892 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:48.052804    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b19164-wft7m" event={"ID":"0149138b-4e3e-41d6-beb9-3f286f25a300","Type":"ContainerDied","Data":"6a32f02729da66157033456edc47a5c49565b58bd3ad26bd11d2111eb57bda64"}
Sep 11 12:02:48.140448 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:48.140422    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz"
Sep 11 12:02:48.295012 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:48.294980    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba-istio-podinfo\") pod \"2c3a1d36-4e5a-4bb6-859e-05dcb1141cba\" (UID: \"2c3a1d36-4e5a-4bb6-859e-05dcb1141cba\") "
Sep 11 12:02:48.295012 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:48.295012    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba-istiod-ca-cert\") pod \"2c3a1d36-4e5a-4bb6-859e-05dcb1141cba\" (UID: \"2c3a1d36-4e5a-4bb6-859e-05dcb1141cba\") "
Sep 11 12:02:48.295237 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:48.295051    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba-istio-data\") pod \"2c3a1d36-4e5a-4bb6-859e-05dcb1141cba\" (UID: \"2c3a1d36-4e5a-4bb6-859e-05dcb1141cba\") "
Sep 11 12:02:48.295237 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:48.295090    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba-credential-socket\") pod \"2c3a1d36-4e5a-4bb6-859e-05dcb1141cba\" (UID: \"2c3a1d36-4e5a-4bb6-859e-05dcb1141cba\") "
Sep 11 12:02:48.295237 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:48.295114    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba-istio-envoy\") pod \"2c3a1d36-4e5a-4bb6-859e-05dcb1141cba\" (UID: \"2c3a1d36-4e5a-4bb6-859e-05dcb1141cba\") "
Sep 11 12:02:48.295237 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:48.295134    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba-workload-socket\") pod \"2c3a1d36-4e5a-4bb6-859e-05dcb1141cba\" (UID: \"2c3a1d36-4e5a-4bb6-859e-05dcb1141cba\") "
Sep 11 12:02:48.295237 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:48.295181    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba-workload-certs\") pod \"2c3a1d36-4e5a-4bb6-859e-05dcb1141cba\" (UID: \"2c3a1d36-4e5a-4bb6-859e-05dcb1141cba\") "
Sep 11 12:02:48.295237 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:48.295206    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n66fg\" (UniqueName: \"kubernetes.io/projected/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba-kube-api-access-n66fg\") pod \"2c3a1d36-4e5a-4bb6-859e-05dcb1141cba\" (UID: \"2c3a1d36-4e5a-4bb6-859e-05dcb1141cba\") "
Sep 11 12:02:48.295566 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:48.295262    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba-istio-token\") pod \"2c3a1d36-4e5a-4bb6-859e-05dcb1141cba\" (UID: \"2c3a1d36-4e5a-4bb6-859e-05dcb1141cba\") "
Sep 11 12:02:48.295566 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:48.295432    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2c3a1d36-4e5a-4bb6-859e-05dcb1141cba" (UID: "2c3a1d36-4e5a-4bb6-859e-05dcb1141cba"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:02:48.295760 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:48.295588    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2c3a1d36-4e5a-4bb6-859e-05dcb1141cba" (UID: "2c3a1d36-4e5a-4bb6-859e-05dcb1141cba"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:02:48.295760 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:48.295621    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba-istio-data" (OuterVolumeSpecName: "istio-data") pod "2c3a1d36-4e5a-4bb6-859e-05dcb1141cba" (UID: "2c3a1d36-4e5a-4bb6-859e-05dcb1141cba"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:02:48.295760 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:48.295714    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2c3a1d36-4e5a-4bb6-859e-05dcb1141cba" (UID: "2c3a1d36-4e5a-4bb6-859e-05dcb1141cba"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:02:48.295994 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:48.295973    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba-istiod-ca-cert\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 12:02:48.296060 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:48.295998    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba-istio-data\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 12:02:48.296060 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:48.296013    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba-workload-socket\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 12:02:48.296060 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:48.296026    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba-workload-certs\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 12:02:48.296235 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:48.296061    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2c3a1d36-4e5a-4bb6-859e-05dcb1141cba" (UID: "2c3a1d36-4e5a-4bb6-859e-05dcb1141cba"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:02:48.297448 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:48.297421    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2c3a1d36-4e5a-4bb6-859e-05dcb1141cba" (UID: "2c3a1d36-4e5a-4bb6-859e-05dcb1141cba"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 12:02:48.297554 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:48.297471    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba-kube-api-access-n66fg" (OuterVolumeSpecName: "kube-api-access-n66fg") pod "2c3a1d36-4e5a-4bb6-859e-05dcb1141cba" (UID: "2c3a1d36-4e5a-4bb6-859e-05dcb1141cba"). InnerVolumeSpecName "kube-api-access-n66fg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:02:48.297747 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:48.297729    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba-istio-token" (OuterVolumeSpecName: "istio-token") pod "2c3a1d36-4e5a-4bb6-859e-05dcb1141cba" (UID: "2c3a1d36-4e5a-4bb6-859e-05dcb1141cba"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:02:48.297747 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:48.297731    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2c3a1d36-4e5a-4bb6-859e-05dcb1141cba" (UID: "2c3a1d36-4e5a-4bb6-859e-05dcb1141cba"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:02:48.397374 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:48.397286    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba-credential-socket\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 12:02:48.397374 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:48.397317    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba-istio-envoy\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 12:02:48.397374 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:48.397326    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n66fg\" (UniqueName: \"kubernetes.io/projected/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba-kube-api-access-n66fg\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 12:02:48.397374 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:48.397335    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba-istio-token\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 12:02:48.397374 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:48.397345    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba-istio-podinfo\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 12:02:49.059369 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:49.059337    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz"
Sep 11 12:02:49.059837 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:49.059371    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz" event={"ID":"2c3a1d36-4e5a-4bb6-859e-05dcb1141cba","Type":"ContainerDied","Data":"062b06266805f2aa3274322444beebb1d4fb1ab7e4287238aa81281d6c345bf0"}
Sep 11 12:02:49.059837 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:49.059424    2560 scope.go:117] "RemoveContainer" containerID="7be458e1a18e593d2cdffe90f571c8e0d66ec297539510e24cdeafbbcc2999fc"
Sep 11 12:02:49.085453 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:49.085420    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz"]
Sep 11 12:02:49.094209 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:49.094181    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-b8e0f0-openshift-default-746b774f4b-sbfrz"]
Sep 11 12:02:49.190588 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:49.190563    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b19164-wft7m"
Sep 11 12:02:49.306946 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:49.306893    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0149138b-4e3e-41d6-beb9-3f286f25a300-maas-api-service-ca\") pod \"0149138b-4e3e-41d6-beb9-3f286f25a300\" (UID: \"0149138b-4e3e-41d6-beb9-3f286f25a300\") "
Sep 11 12:02:49.307322 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:49.307295    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0149138b-4e3e-41d6-beb9-3f286f25a300-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0149138b-4e3e-41d6-beb9-3f286f25a300" (UID: "0149138b-4e3e-41d6-beb9-3f286f25a300"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:02:49.408609 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:49.408523    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0149138b-4e3e-41d6-beb9-3f286f25a300-maas-api-service-ca\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 12:02:49.814112 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:49.814079    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c3a1d36-4e5a-4bb6-859e-05dcb1141cba" path="/var/lib/kubelet/pods/2c3a1d36-4e5a-4bb6-859e-05dcb1141cba/volumes"
Sep 11 12:02:50.067159 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:50.067071    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b19164-wft7m"
Sep 11 12:02:50.067159 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:50.067103    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b19164-wft7m" event={"ID":"0149138b-4e3e-41d6-beb9-3f286f25a300","Type":"ContainerDied","Data":"7e43ec0a94260fdd3a3dd383cc8d83ef0659f581cc2bd4028cb48390c59932cf"}
Sep 11 12:02:50.067159 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:02:50.067147    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7e43ec0a94260fdd3a3dd383cc8d83ef0659f581cc2bd4028cb48390c59932cf"
Sep 11 12:03:02.226219 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:02.226181    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-b19164-7dbcf76459-zhpt8"]
Sep 11 12:03:02.226914 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:02.226455    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-b19164-7dbcf76459-zhpt8" podUID="5393c9b2-39a6-4122-838b-14039bc116d5" containerName="payload-processing" containerID="cri-o://31f669d00493d4c2d276fda2006ac2c7125f36dc728c47956bd6ee2e21ab90b5" gracePeriod=30
Sep 11 12:03:02.457199 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:02.457169    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b19164-wft7m"]
Sep 11 12:03:02.459227 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:02.459197    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b19164-wft7m"]
Sep 11 12:03:02.475022 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:02.475000    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-b19164-7dbcf76459-zhpt8"
Sep 11 12:03:02.528693 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:02.528590    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hj7r5\" (UniqueName: \"kubernetes.io/projected/5393c9b2-39a6-4122-838b-14039bc116d5-kube-api-access-hj7r5\") pod \"5393c9b2-39a6-4122-838b-14039bc116d5\" (UID: \"5393c9b2-39a6-4122-838b-14039bc116d5\") "
Sep 11 12:03:02.528693 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:02.528627    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5393c9b2-39a6-4122-838b-14039bc116d5-plugins-config-volume\") pod \"5393c9b2-39a6-4122-838b-14039bc116d5\" (UID: \"5393c9b2-39a6-4122-838b-14039bc116d5\") "
Sep 11 12:03:02.529074 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:02.529050    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5393c9b2-39a6-4122-838b-14039bc116d5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5393c9b2-39a6-4122-838b-14039bc116d5" (UID: "5393c9b2-39a6-4122-838b-14039bc116d5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:03:02.530624 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:02.530596    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5393c9b2-39a6-4122-838b-14039bc116d5-kube-api-access-hj7r5" (OuterVolumeSpecName: "kube-api-access-hj7r5") pod "5393c9b2-39a6-4122-838b-14039bc116d5" (UID: "5393c9b2-39a6-4122-838b-14039bc116d5"). InnerVolumeSpecName "kube-api-access-hj7r5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:03:02.629911 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:02.629872    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hj7r5\" (UniqueName: \"kubernetes.io/projected/5393c9b2-39a6-4122-838b-14039bc116d5-kube-api-access-hj7r5\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 12:03:02.629911 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:02.629902    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5393c9b2-39a6-4122-838b-14039bc116d5-plugins-config-volume\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 12:03:03.135406 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:03.135373    2560 generic.go:356] "Generic (PLEG): container finished" podID="5393c9b2-39a6-4122-838b-14039bc116d5" containerID="31f669d00493d4c2d276fda2006ac2c7125f36dc728c47956bd6ee2e21ab90b5" exitCode=0
Sep 11 12:03:03.135595 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:03.135410    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-b19164-7dbcf76459-zhpt8" event={"ID":"5393c9b2-39a6-4122-838b-14039bc116d5","Type":"ContainerDied","Data":"31f669d00493d4c2d276fda2006ac2c7125f36dc728c47956bd6ee2e21ab90b5"}
Sep 11 12:03:03.135595 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:03.135463    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-b19164-7dbcf76459-zhpt8" event={"ID":"5393c9b2-39a6-4122-838b-14039bc116d5","Type":"ContainerDied","Data":"a03a695196a76043f98952e75178c96cdbc2bc7d253dca23f3aaa18170a4bb99"}
Sep 11 12:03:03.135595 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:03.135486    2560 scope.go:117] "RemoveContainer" containerID="31f669d00493d4c2d276fda2006ac2c7125f36dc728c47956bd6ee2e21ab90b5"
Sep 11 12:03:03.135595 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:03.135418    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-b19164-7dbcf76459-zhpt8"
Sep 11 12:03:03.144772 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:03.144749    2560 scope.go:117] "RemoveContainer" containerID="31f669d00493d4c2d276fda2006ac2c7125f36dc728c47956bd6ee2e21ab90b5"
Sep 11 12:03:03.145068 ip-10-0-142-230 kubenswrapper[2560]: E0911 12:03:03.145049    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31f669d00493d4c2d276fda2006ac2c7125f36dc728c47956bd6ee2e21ab90b5\": container with ID starting with 31f669d00493d4c2d276fda2006ac2c7125f36dc728c47956bd6ee2e21ab90b5 not found: ID does not exist" containerID="31f669d00493d4c2d276fda2006ac2c7125f36dc728c47956bd6ee2e21ab90b5"
Sep 11 12:03:03.145131 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:03.145076    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31f669d00493d4c2d276fda2006ac2c7125f36dc728c47956bd6ee2e21ab90b5"} err="failed to get container status \"31f669d00493d4c2d276fda2006ac2c7125f36dc728c47956bd6ee2e21ab90b5\": rpc error: code = NotFound desc = could not find container \"31f669d00493d4c2d276fda2006ac2c7125f36dc728c47956bd6ee2e21ab90b5\": container with ID starting with 31f669d00493d4c2d276fda2006ac2c7125f36dc728c47956bd6ee2e21ab90b5 not found: ID does not exist"
Sep 11 12:03:03.162451 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:03.162423    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-b19164-7dbcf76459-zhpt8"]
Sep 11 12:03:03.165423 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:03.165398    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-b19164-7dbcf76459-zhpt8"]
Sep 11 12:03:03.813724 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:03.813691    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0149138b-4e3e-41d6-beb9-3f286f25a300" path="/var/lib/kubelet/pods/0149138b-4e3e-41d6-beb9-3f286f25a300/volumes"
Sep 11 12:03:03.814096 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:03.814051    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5393c9b2-39a6-4122-838b-14039bc116d5" path="/var/lib/kubelet/pods/5393c9b2-39a6-4122-838b-14039bc116d5/volumes"
Sep 11 12:03:51.538879 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:51.538839    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff"]
Sep 11 12:03:51.539343 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:51.539058    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff" podUID="eefebbbe-68f8-477c-a226-3659f60e50c3" containerName="istio-proxy" containerID="cri-o://e367ba0800ef5b16949eb96fb55f26451ca28abfb83c354daa9d888d2931ec05" gracePeriod=30
Sep 11 12:03:51.885598 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:51.885499    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-720006-5mp9b"]
Sep 11 12:03:51.885955 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:51.885937    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0149138b-4e3e-41d6-beb9-3f286f25a300" containerName="revoke-keys"
Sep 11 12:03:51.886062 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:51.885957    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0149138b-4e3e-41d6-beb9-3f286f25a300" containerName="revoke-keys"
Sep 11 12:03:51.886062 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:51.885974    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5393c9b2-39a6-4122-838b-14039bc116d5" containerName="payload-processing"
Sep 11 12:03:51.886062 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:51.885983    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5393c9b2-39a6-4122-838b-14039bc116d5" containerName="payload-processing"
Sep 11 12:03:51.886062 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:51.886001    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c3a1d36-4e5a-4bb6-859e-05dcb1141cba" containerName="istio-proxy"
Sep 11 12:03:51.886062 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:51.886008    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c3a1d36-4e5a-4bb6-859e-05dcb1141cba" containerName="istio-proxy"
Sep 11 12:03:51.886062 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:51.886021    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c3a1d36-4e5a-4bb6-859e-05dcb1141cba" containerName="istio-proxy"
Sep 11 12:03:51.886062 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:51.886029    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c3a1d36-4e5a-4bb6-859e-05dcb1141cba" containerName="istio-proxy"
Sep 11 12:03:51.886419 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:51.886127    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0149138b-4e3e-41d6-beb9-3f286f25a300" containerName="revoke-keys"
Sep 11 12:03:51.886419 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:51.886138    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c3a1d36-4e5a-4bb6-859e-05dcb1141cba" containerName="istio-proxy"
Sep 11 12:03:51.886419 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:51.886149    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5393c9b2-39a6-4122-838b-14039bc116d5" containerName="payload-processing"
Sep 11 12:03:51.886419 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:51.886157    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c3a1d36-4e5a-4bb6-859e-05dcb1141cba" containerName="istio-proxy"
Sep 11 12:03:51.889321 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:51.889301    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-720006-5mp9b"
Sep 11 12:03:51.892225 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:51.892200    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 12:03:51.892314 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:51.892298    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f46tj\""
Sep 11 12:03:51.913541 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:51.913510    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-720006-5mp9b"]
Sep 11 12:03:51.945849 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:51.945817    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e000f7bf-8090-42c2-8252-d2770ec00550-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-720006-5mp9b\" (UID: \"e000f7bf-8090-42c2-8252-d2770ec00550\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-720006-5mp9b"
Sep 11 12:03:52.046513 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:52.046482    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e000f7bf-8090-42c2-8252-d2770ec00550-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-720006-5mp9b\" (UID: \"e000f7bf-8090-42c2-8252-d2770ec00550\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-720006-5mp9b"
Sep 11 12:03:52.047172 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:52.047146    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e000f7bf-8090-42c2-8252-d2770ec00550-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-720006-5mp9b\" (UID: \"e000f7bf-8090-42c2-8252-d2770ec00550\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-720006-5mp9b"
Sep 11 12:03:52.199379 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:52.199294    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-720006-5mp9b"
Sep 11 12:03:52.489167 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:52.489132    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-720006-5mp9b"]
Sep 11 12:03:52.492134 ip-10-0-142-230 kubenswrapper[2560]: W0911 12:03:52.492109    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode000f7bf_8090_42c2_8252_d2770ec00550.slice/crio-0f01f9782a8a17e592715aa9ac37b4598e7440b7cf1af5bffe5c9f5c6ecb3be5 WatchSource:0}: Error finding container 0f01f9782a8a17e592715aa9ac37b4598e7440b7cf1af5bffe5c9f5c6ecb3be5: Status 404 returned error can't find the container with id 0f01f9782a8a17e592715aa9ac37b4598e7440b7cf1af5bffe5c9f5c6ecb3be5
Sep 11 12:03:53.388706 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:53.388594    2560 generic.go:356] "Generic (PLEG): container finished" podID="e000f7bf-8090-42c2-8252-d2770ec00550" containerID="9dbee59bb9b1e55c087d75d2d779d7c3865e8bc10a7efd300f5d376cf4e3b9ae" exitCode=0
Sep 11 12:03:53.388706 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:53.388681    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-720006-5mp9b" event={"ID":"e000f7bf-8090-42c2-8252-d2770ec00550","Type":"ContainerDied","Data":"9dbee59bb9b1e55c087d75d2d779d7c3865e8bc10a7efd300f5d376cf4e3b9ae"}
Sep 11 12:03:53.389102 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:53.388731    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-720006-5mp9b" event={"ID":"e000f7bf-8090-42c2-8252-d2770ec00550","Type":"ContainerStarted","Data":"0f01f9782a8a17e592715aa9ac37b4598e7440b7cf1af5bffe5c9f5c6ecb3be5"}
Sep 11 12:03:53.545380 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:53.545332    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 12:03:53.545530 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:53.545400    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff" podUID="eefebbbe-68f8-477c-a226-3659f60e50c3" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 12:03:54.526820 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:54.526795    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-720006-5mp9b"
Sep 11 12:03:54.569400 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:54.569372    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e000f7bf-8090-42c2-8252-d2770ec00550-maas-api-service-ca\") pod \"e000f7bf-8090-42c2-8252-d2770ec00550\" (UID: \"e000f7bf-8090-42c2-8252-d2770ec00550\") "
Sep 11 12:03:54.569785 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:54.569763    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e000f7bf-8090-42c2-8252-d2770ec00550-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e000f7bf-8090-42c2-8252-d2770ec00550" (UID: "e000f7bf-8090-42c2-8252-d2770ec00550"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:03:54.670088 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:54.670007    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e000f7bf-8090-42c2-8252-d2770ec00550-maas-api-service-ca\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 12:03:55.400440 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:55.400413    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-720006-5mp9b"
Sep 11 12:03:55.400618 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:55.400412    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-720006-5mp9b" event={"ID":"e000f7bf-8090-42c2-8252-d2770ec00550","Type":"ContainerDied","Data":"0f01f9782a8a17e592715aa9ac37b4598e7440b7cf1af5bffe5c9f5c6ecb3be5"}
Sep 11 12:03:55.400618 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:55.400532    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0f01f9782a8a17e592715aa9ac37b4598e7440b7cf1af5bffe5c9f5c6ecb3be5"
Sep 11 12:03:56.788071 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:56.788048    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff"
Sep 11 12:03:56.889118 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:56.889032    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eefebbbe-68f8-477c-a226-3659f60e50c3-workload-certs\") pod \"eefebbbe-68f8-477c-a226-3659f60e50c3\" (UID: \"eefebbbe-68f8-477c-a226-3659f60e50c3\") "
Sep 11 12:03:56.889118 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:56.889072    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eefebbbe-68f8-477c-a226-3659f60e50c3-credential-socket\") pod \"eefebbbe-68f8-477c-a226-3659f60e50c3\" (UID: \"eefebbbe-68f8-477c-a226-3659f60e50c3\") "
Sep 11 12:03:56.889118 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:56.889116    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eefebbbe-68f8-477c-a226-3659f60e50c3-istio-podinfo\") pod \"eefebbbe-68f8-477c-a226-3659f60e50c3\" (UID: \"eefebbbe-68f8-477c-a226-3659f60e50c3\") "
Sep 11 12:03:56.889394 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:56.889138    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eefebbbe-68f8-477c-a226-3659f60e50c3-istio-envoy\") pod \"eefebbbe-68f8-477c-a226-3659f60e50c3\" (UID: \"eefebbbe-68f8-477c-a226-3659f60e50c3\") "
Sep 11 12:03:56.889394 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:56.889156    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eefebbbe-68f8-477c-a226-3659f60e50c3-workload-socket\") pod \"eefebbbe-68f8-477c-a226-3659f60e50c3\" (UID: \"eefebbbe-68f8-477c-a226-3659f60e50c3\") "
Sep 11 12:03:56.889394 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:56.889185    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eefebbbe-68f8-477c-a226-3659f60e50c3-istiod-ca-cert\") pod \"eefebbbe-68f8-477c-a226-3659f60e50c3\" (UID: \"eefebbbe-68f8-477c-a226-3659f60e50c3\") "
Sep 11 12:03:56.889394 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:56.889203    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eefebbbe-68f8-477c-a226-3659f60e50c3-istio-data\") pod \"eefebbbe-68f8-477c-a226-3659f60e50c3\" (UID: \"eefebbbe-68f8-477c-a226-3659f60e50c3\") "
Sep 11 12:03:56.889394 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:56.889224    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eefebbbe-68f8-477c-a226-3659f60e50c3-istio-token\") pod \"eefebbbe-68f8-477c-a226-3659f60e50c3\" (UID: \"eefebbbe-68f8-477c-a226-3659f60e50c3\") "
Sep 11 12:03:56.889394 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:56.889282    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9fvz7\" (UniqueName: \"kubernetes.io/projected/eefebbbe-68f8-477c-a226-3659f60e50c3-kube-api-access-9fvz7\") pod \"eefebbbe-68f8-477c-a226-3659f60e50c3\" (UID: \"eefebbbe-68f8-477c-a226-3659f60e50c3\") "
Sep 11 12:03:56.889394 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:56.889345    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eefebbbe-68f8-477c-a226-3659f60e50c3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "eefebbbe-68f8-477c-a226-3659f60e50c3" (UID: "eefebbbe-68f8-477c-a226-3659f60e50c3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:03:56.889790 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:56.889425    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eefebbbe-68f8-477c-a226-3659f60e50c3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "eefebbbe-68f8-477c-a226-3659f60e50c3" (UID: "eefebbbe-68f8-477c-a226-3659f60e50c3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:03:56.889790 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:56.889446    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eefebbbe-68f8-477c-a226-3659f60e50c3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "eefebbbe-68f8-477c-a226-3659f60e50c3" (UID: "eefebbbe-68f8-477c-a226-3659f60e50c3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:03:56.889790 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:56.889619    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eefebbbe-68f8-477c-a226-3659f60e50c3-istio-data" (OuterVolumeSpecName: "istio-data") pod "eefebbbe-68f8-477c-a226-3659f60e50c3" (UID: "eefebbbe-68f8-477c-a226-3659f60e50c3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:03:56.889790 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:56.889637    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eefebbbe-68f8-477c-a226-3659f60e50c3-workload-certs\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 12:03:56.889790 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:56.889687    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eefebbbe-68f8-477c-a226-3659f60e50c3-credential-socket\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 12:03:56.889790 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:56.889704    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eefebbbe-68f8-477c-a226-3659f60e50c3-workload-socket\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 12:03:56.889790 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:56.889713    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eefebbbe-68f8-477c-a226-3659f60e50c3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "eefebbbe-68f8-477c-a226-3659f60e50c3" (UID: "eefebbbe-68f8-477c-a226-3659f60e50c3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:03:56.891349 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:56.891326    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eefebbbe-68f8-477c-a226-3659f60e50c3-kube-api-access-9fvz7" (OuterVolumeSpecName: "kube-api-access-9fvz7") pod "eefebbbe-68f8-477c-a226-3659f60e50c3" (UID: "eefebbbe-68f8-477c-a226-3659f60e50c3"). InnerVolumeSpecName "kube-api-access-9fvz7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:03:56.891349 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:56.891328    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/eefebbbe-68f8-477c-a226-3659f60e50c3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "eefebbbe-68f8-477c-a226-3659f60e50c3" (UID: "eefebbbe-68f8-477c-a226-3659f60e50c3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 12:03:56.891810 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:56.891782    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eefebbbe-68f8-477c-a226-3659f60e50c3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "eefebbbe-68f8-477c-a226-3659f60e50c3" (UID: "eefebbbe-68f8-477c-a226-3659f60e50c3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:03:56.891810 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:56.891785    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eefebbbe-68f8-477c-a226-3659f60e50c3-istio-token" (OuterVolumeSpecName: "istio-token") pod "eefebbbe-68f8-477c-a226-3659f60e50c3" (UID: "eefebbbe-68f8-477c-a226-3659f60e50c3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:03:56.990466 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:56.990431    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eefebbbe-68f8-477c-a226-3659f60e50c3-istio-podinfo\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 12:03:56.990466 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:56.990459    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eefebbbe-68f8-477c-a226-3659f60e50c3-istio-envoy\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 12:03:56.990697 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:56.990473    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eefebbbe-68f8-477c-a226-3659f60e50c3-istiod-ca-cert\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 12:03:56.990697 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:56.990485    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eefebbbe-68f8-477c-a226-3659f60e50c3-istio-data\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 12:03:56.990697 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:56.990493    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eefebbbe-68f8-477c-a226-3659f60e50c3-istio-token\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 12:03:56.990697 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:56.990501    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9fvz7\" (UniqueName: \"kubernetes.io/projected/eefebbbe-68f8-477c-a226-3659f60e50c3-kube-api-access-9fvz7\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 12:03:57.411583 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:57.411547    2560 generic.go:356] "Generic (PLEG): container finished" podID="eefebbbe-68f8-477c-a226-3659f60e50c3" containerID="e367ba0800ef5b16949eb96fb55f26451ca28abfb83c354daa9d888d2931ec05" exitCode=0
Sep 11 12:03:57.411776 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:57.411592    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff"
Sep 11 12:03:57.411776 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:57.411613    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff" event={"ID":"eefebbbe-68f8-477c-a226-3659f60e50c3","Type":"ContainerDied","Data":"e367ba0800ef5b16949eb96fb55f26451ca28abfb83c354daa9d888d2931ec05"}
Sep 11 12:03:57.411776 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:57.411677    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff" event={"ID":"eefebbbe-68f8-477c-a226-3659f60e50c3","Type":"ContainerDied","Data":"70205c5e75ecbd7f986a95956e5c04c359d8ca9c3f6079615ff41ec21189c05b"}
Sep 11 12:03:57.411776 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:57.411705    2560 scope.go:117] "RemoveContainer" containerID="e367ba0800ef5b16949eb96fb55f26451ca28abfb83c354daa9d888d2931ec05"
Sep 11 12:03:57.420917 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:57.420901    2560 scope.go:117] "RemoveContainer" containerID="751d2e5d9772d097da3701ad8a0afe215b828765858315e5b729ab543c338ea5"
Sep 11 12:03:57.428302 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:57.428283    2560 scope.go:117] "RemoveContainer" containerID="e367ba0800ef5b16949eb96fb55f26451ca28abfb83c354daa9d888d2931ec05"
Sep 11 12:03:57.428559 ip-10-0-142-230 kubenswrapper[2560]: E0911 12:03:57.428541    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e367ba0800ef5b16949eb96fb55f26451ca28abfb83c354daa9d888d2931ec05\": container with ID starting with e367ba0800ef5b16949eb96fb55f26451ca28abfb83c354daa9d888d2931ec05 not found: ID does not exist" containerID="e367ba0800ef5b16949eb96fb55f26451ca28abfb83c354daa9d888d2931ec05"
Sep 11 12:03:57.428600 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:57.428567    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e367ba0800ef5b16949eb96fb55f26451ca28abfb83c354daa9d888d2931ec05"} err="failed to get container status \"e367ba0800ef5b16949eb96fb55f26451ca28abfb83c354daa9d888d2931ec05\": rpc error: code = NotFound desc = could not find container \"e367ba0800ef5b16949eb96fb55f26451ca28abfb83c354daa9d888d2931ec05\": container with ID starting with e367ba0800ef5b16949eb96fb55f26451ca28abfb83c354daa9d888d2931ec05 not found: ID does not exist"
Sep 11 12:03:57.428600 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:57.428583    2560 scope.go:117] "RemoveContainer" containerID="751d2e5d9772d097da3701ad8a0afe215b828765858315e5b729ab543c338ea5"
Sep 11 12:03:57.428860 ip-10-0-142-230 kubenswrapper[2560]: E0911 12:03:57.428842    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"751d2e5d9772d097da3701ad8a0afe215b828765858315e5b729ab543c338ea5\": container with ID starting with 751d2e5d9772d097da3701ad8a0afe215b828765858315e5b729ab543c338ea5 not found: ID does not exist" containerID="751d2e5d9772d097da3701ad8a0afe215b828765858315e5b729ab543c338ea5"
Sep 11 12:03:57.428902 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:57.428866    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"751d2e5d9772d097da3701ad8a0afe215b828765858315e5b729ab543c338ea5"} err="failed to get container status \"751d2e5d9772d097da3701ad8a0afe215b828765858315e5b729ab543c338ea5\": rpc error: code = NotFound desc = could not find container \"751d2e5d9772d097da3701ad8a0afe215b828765858315e5b729ab543c338ea5\": container with ID starting with 751d2e5d9772d097da3701ad8a0afe215b828765858315e5b729ab543c338ea5 not found: ID does not exist"
Sep 11 12:03:57.447224 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:57.447198    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff"]
Sep 11 12:03:57.452201 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:57.452180    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-b19164-openshift-default-5666d77bb4-wdjff"]
Sep 11 12:03:57.814214 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:03:57.814181    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eefebbbe-68f8-477c-a226-3659f60e50c3" path="/var/lib/kubelet/pods/eefebbbe-68f8-477c-a226-3659f60e50c3/volumes"
Sep 11 12:04:04.065036 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:04.064952    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-720006-5mp9b"]
Sep 11 12:04:04.071037 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:04.071009    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-720006-5mp9b"]
Sep 11 12:04:05.812963 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:05.812928    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e000f7bf-8090-42c2-8252-d2770ec00550" path="/var/lib/kubelet/pods/e000f7bf-8090-42c2-8252-d2770ec00550/volumes"
Sep 11 12:04:11.829461 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:11.829429    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-272c5e-5n8n7"]
Sep 11 12:04:11.829884 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:11.829760    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eefebbbe-68f8-477c-a226-3659f60e50c3" containerName="istio-proxy"
Sep 11 12:04:11.829884 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:11.829773    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="eefebbbe-68f8-477c-a226-3659f60e50c3" containerName="istio-proxy"
Sep 11 12:04:11.829884 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:11.829782    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e000f7bf-8090-42c2-8252-d2770ec00550" containerName="revoke-keys"
Sep 11 12:04:11.829884 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:11.829789    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e000f7bf-8090-42c2-8252-d2770ec00550" containerName="revoke-keys"
Sep 11 12:04:11.829884 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:11.829800    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eefebbbe-68f8-477c-a226-3659f60e50c3" containerName="istio-proxy"
Sep 11 12:04:11.829884 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:11.829805    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="eefebbbe-68f8-477c-a226-3659f60e50c3" containerName="istio-proxy"
Sep 11 12:04:11.829884 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:11.829871    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="eefebbbe-68f8-477c-a226-3659f60e50c3" containerName="istio-proxy"
Sep 11 12:04:11.829884 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:11.829881    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e000f7bf-8090-42c2-8252-d2770ec00550" containerName="revoke-keys"
Sep 11 12:04:11.834007 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:11.833989    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-272c5e-5n8n7"
Sep 11 12:04:11.836866 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:11.836843    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f46tj\""
Sep 11 12:04:11.838202 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:11.837403    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 12:04:11.846412 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:11.845946    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-272c5e-5n8n7"]
Sep 11 12:04:11.916353 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:11.916308    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d317194-84de-466c-97ab-468a346dc8fc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-272c5e-5n8n7\" (UID: \"0d317194-84de-466c-97ab-468a346dc8fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-272c5e-5n8n7"
Sep 11 12:04:12.017826 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:12.017788    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d317194-84de-466c-97ab-468a346dc8fc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-272c5e-5n8n7\" (UID: \"0d317194-84de-466c-97ab-468a346dc8fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-272c5e-5n8n7"
Sep 11 12:04:12.018497 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:12.018475    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d317194-84de-466c-97ab-468a346dc8fc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-272c5e-5n8n7\" (UID: \"0d317194-84de-466c-97ab-468a346dc8fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-272c5e-5n8n7"
Sep 11 12:04:12.150026 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:12.149941    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-272c5e-5n8n7"
Sep 11 12:04:12.432871 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:12.432845    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-272c5e-5n8n7"]
Sep 11 12:04:12.434896 ip-10-0-142-230 kubenswrapper[2560]: W0911 12:04:12.434865    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d317194_84de_466c_97ab_468a346dc8fc.slice/crio-ba65d36f173fe5ed04d88c06645c9ad573310b8a10002477711ab44dc9c5c3ac WatchSource:0}: Error finding container ba65d36f173fe5ed04d88c06645c9ad573310b8a10002477711ab44dc9c5c3ac: Status 404 returned error can't find the container with id ba65d36f173fe5ed04d88c06645c9ad573310b8a10002477711ab44dc9c5c3ac
Sep 11 12:04:12.492247 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:12.492210    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-272c5e-5n8n7" event={"ID":"0d317194-84de-466c-97ab-468a346dc8fc","Type":"ContainerStarted","Data":"ba65d36f173fe5ed04d88c06645c9ad573310b8a10002477711ab44dc9c5c3ac"}
Sep 11 12:04:13.498996 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:13.498957    2560 generic.go:356] "Generic (PLEG): container finished" podID="0d317194-84de-466c-97ab-468a346dc8fc" containerID="46b9d1a16a40b673b04ad9ad81a87d6b8310e3132756acdf8b1bde106c07c236" exitCode=0
Sep 11 12:04:13.499367 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:13.499048    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-272c5e-5n8n7" event={"ID":"0d317194-84de-466c-97ab-468a346dc8fc","Type":"ContainerDied","Data":"46b9d1a16a40b673b04ad9ad81a87d6b8310e3132756acdf8b1bde106c07c236"}
Sep 11 12:04:14.640980 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:14.640956    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-272c5e-5n8n7"
Sep 11 12:04:14.740887 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:14.740848    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d317194-84de-466c-97ab-468a346dc8fc-maas-api-service-ca\") pod \"0d317194-84de-466c-97ab-468a346dc8fc\" (UID: \"0d317194-84de-466c-97ab-468a346dc8fc\") "
Sep 11 12:04:14.741257 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:14.741232    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d317194-84de-466c-97ab-468a346dc8fc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0d317194-84de-466c-97ab-468a346dc8fc" (UID: "0d317194-84de-466c-97ab-468a346dc8fc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:04:14.841640 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:14.841554    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d317194-84de-466c-97ab-468a346dc8fc-maas-api-service-ca\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 12:04:15.510933 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:15.510904    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-272c5e-5n8n7"
Sep 11 12:04:15.511108 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:15.510939    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-272c5e-5n8n7" event={"ID":"0d317194-84de-466c-97ab-468a346dc8fc","Type":"ContainerDied","Data":"ba65d36f173fe5ed04d88c06645c9ad573310b8a10002477711ab44dc9c5c3ac"}
Sep 11 12:04:15.511108 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:15.510988    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ba65d36f173fe5ed04d88c06645c9ad573310b8a10002477711ab44dc9c5c3ac"
Sep 11 12:04:22.815025 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:22.814993    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-272c5e-29818800-vzvwf"]
Sep 11 12:04:22.826064 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:22.826036    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-272c5e-29818800-vzvwf"]
Sep 11 12:04:23.149342 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:23.149262    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-272c5e-5n8n7"]
Sep 11 12:04:23.162215 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:23.162187    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-272c5e-5n8n7"]
Sep 11 12:04:23.813082 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:23.813046    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d317194-84de-466c-97ab-468a346dc8fc" path="/var/lib/kubelet/pods/0d317194-84de-466c-97ab-468a346dc8fc/volumes"
Sep 11 12:04:23.813340 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:23.813327    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b26e4f52-bd1a-4e8a-a41d-85819dd476f0" path="/var/lib/kubelet/pods/b26e4f52-bd1a-4e8a-a41d-85819dd476f0/volumes"
Sep 11 12:04:30.930612 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:30.930581    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd"]
Sep 11 12:04:30.931029 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:30.930876    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd" podUID="bc32b842-3e83-4ac7-97c2-bf82cf7377b4" containerName="istio-proxy" containerID="cri-o://00de6bd627f03793f25c41365ff5819dbaa5e642281a0f3e8571f0722a1cd943" gracePeriod=30
Sep 11 12:04:31.281287 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:31.281250    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-117711-6j6p4"]
Sep 11 12:04:31.281636 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:31.281620    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d317194-84de-466c-97ab-468a346dc8fc" containerName="revoke-keys"
Sep 11 12:04:31.281712 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:31.281640    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d317194-84de-466c-97ab-468a346dc8fc" containerName="revoke-keys"
Sep 11 12:04:31.281752 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:31.281719    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d317194-84de-466c-97ab-468a346dc8fc" containerName="revoke-keys"
Sep 11 12:04:31.281752 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:31.281729    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="eefebbbe-68f8-477c-a226-3659f60e50c3" containerName="istio-proxy"
Sep 11 12:04:31.285727 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:31.285711    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-117711-6j6p4"
Sep 11 12:04:31.289369 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:31.289352    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f46tj\""
Sep 11 12:04:31.289476 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:31.289388    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 12:04:31.297627 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:31.297603    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-117711-6j6p4"]
Sep 11 12:04:31.377811 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:31.377781    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ecd5190-e85f-4102-96be-6990bfc62831-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-117711-6j6p4\" (UID: \"4ecd5190-e85f-4102-96be-6990bfc62831\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-117711-6j6p4"
Sep 11 12:04:31.478780 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:31.478740    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ecd5190-e85f-4102-96be-6990bfc62831-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-117711-6j6p4\" (UID: \"4ecd5190-e85f-4102-96be-6990bfc62831\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-117711-6j6p4"
Sep 11 12:04:31.479376 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:31.479355    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ecd5190-e85f-4102-96be-6990bfc62831-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-117711-6j6p4\" (UID: \"4ecd5190-e85f-4102-96be-6990bfc62831\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-117711-6j6p4"
Sep 11 12:04:31.595822 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:31.595742    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-117711-6j6p4"
Sep 11 12:04:31.872623 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:31.872598    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-117711-6j6p4"]
Sep 11 12:04:31.874839 ip-10-0-142-230 kubenswrapper[2560]: W0911 12:04:31.874810    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ecd5190_e85f_4102_96be_6990bfc62831.slice/crio-a4823abf6a86753584df33092d4d26ab492c671db17898dec231c972d8ffb8dd WatchSource:0}: Error finding container a4823abf6a86753584df33092d4d26ab492c671db17898dec231c972d8ffb8dd: Status 404 returned error can't find the container with id a4823abf6a86753584df33092d4d26ab492c671db17898dec231c972d8ffb8dd
Sep 11 12:04:32.595434 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:32.595402    2560 generic.go:356] "Generic (PLEG): container finished" podID="4ecd5190-e85f-4102-96be-6990bfc62831" containerID="d1727336226848c371324368aaed12c7ac91f7e54264ddbe6ebe2a5953a2a76c" exitCode=0
Sep 11 12:04:32.595823 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:32.595484    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-117711-6j6p4" event={"ID":"4ecd5190-e85f-4102-96be-6990bfc62831","Type":"ContainerDied","Data":"d1727336226848c371324368aaed12c7ac91f7e54264ddbe6ebe2a5953a2a76c"}
Sep 11 12:04:32.595823 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:32.595537    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-117711-6j6p4" event={"ID":"4ecd5190-e85f-4102-96be-6990bfc62831","Type":"ContainerStarted","Data":"a4823abf6a86753584df33092d4d26ab492c671db17898dec231c972d8ffb8dd"}
Sep 11 12:04:33.733300 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:33.733278    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-117711-6j6p4"
Sep 11 12:04:33.797753 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:33.797670    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ecd5190-e85f-4102-96be-6990bfc62831-maas-api-service-ca\") pod \"4ecd5190-e85f-4102-96be-6990bfc62831\" (UID: \"4ecd5190-e85f-4102-96be-6990bfc62831\") "
Sep 11 12:04:33.797963 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:33.797942    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ecd5190-e85f-4102-96be-6990bfc62831-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4ecd5190-e85f-4102-96be-6990bfc62831" (UID: "4ecd5190-e85f-4102-96be-6990bfc62831"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:04:33.899498 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:33.899408    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ecd5190-e85f-4102-96be-6990bfc62831-maas-api-service-ca\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 12:04:34.605727 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:34.605697    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-117711-6j6p4"
Sep 11 12:04:34.605906 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:34.605744    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-117711-6j6p4" event={"ID":"4ecd5190-e85f-4102-96be-6990bfc62831","Type":"ContainerDied","Data":"a4823abf6a86753584df33092d4d26ab492c671db17898dec231c972d8ffb8dd"}
Sep 11 12:04:34.605906 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:34.605790    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a4823abf6a86753584df33092d4d26ab492c671db17898dec231c972d8ffb8dd"
Sep 11 12:04:36.202466 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:36.202411    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd"
Sep 11 12:04:36.320537 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:36.320495    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc32b842-3e83-4ac7-97c2-bf82cf7377b4-istio-token\") pod \"bc32b842-3e83-4ac7-97c2-bf82cf7377b4\" (UID: \"bc32b842-3e83-4ac7-97c2-bf82cf7377b4\") "
Sep 11 12:04:36.320537 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:36.320554    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc32b842-3e83-4ac7-97c2-bf82cf7377b4-istio-envoy\") pod \"bc32b842-3e83-4ac7-97c2-bf82cf7377b4\" (UID: \"bc32b842-3e83-4ac7-97c2-bf82cf7377b4\") "
Sep 11 12:04:36.320839 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:36.320575    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc32b842-3e83-4ac7-97c2-bf82cf7377b4-workload-certs\") pod \"bc32b842-3e83-4ac7-97c2-bf82cf7377b4\" (UID: \"bc32b842-3e83-4ac7-97c2-bf82cf7377b4\") "
Sep 11 12:04:36.320839 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:36.320630    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc32b842-3e83-4ac7-97c2-bf82cf7377b4-credential-socket\") pod \"bc32b842-3e83-4ac7-97c2-bf82cf7377b4\" (UID: \"bc32b842-3e83-4ac7-97c2-bf82cf7377b4\") "
Sep 11 12:04:36.320839 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:36.320699    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc32b842-3e83-4ac7-97c2-bf82cf7377b4-istio-data\") pod \"bc32b842-3e83-4ac7-97c2-bf82cf7377b4\" (UID: \"bc32b842-3e83-4ac7-97c2-bf82cf7377b4\") "
Sep 11 12:04:36.320839 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:36.320744    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc32b842-3e83-4ac7-97c2-bf82cf7377b4-istio-podinfo\") pod \"bc32b842-3e83-4ac7-97c2-bf82cf7377b4\" (UID: \"bc32b842-3e83-4ac7-97c2-bf82cf7377b4\") "
Sep 11 12:04:36.320839 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:36.320770    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc32b842-3e83-4ac7-97c2-bf82cf7377b4-workload-socket\") pod \"bc32b842-3e83-4ac7-97c2-bf82cf7377b4\" (UID: \"bc32b842-3e83-4ac7-97c2-bf82cf7377b4\") "
Sep 11 12:04:36.320839 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:36.320796    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g9gnt\" (UniqueName: \"kubernetes.io/projected/bc32b842-3e83-4ac7-97c2-bf82cf7377b4-kube-api-access-g9gnt\") pod \"bc32b842-3e83-4ac7-97c2-bf82cf7377b4\" (UID: \"bc32b842-3e83-4ac7-97c2-bf82cf7377b4\") "
Sep 11 12:04:36.320839 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:36.320821    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc32b842-3e83-4ac7-97c2-bf82cf7377b4-istiod-ca-cert\") pod \"bc32b842-3e83-4ac7-97c2-bf82cf7377b4\" (UID: \"bc32b842-3e83-4ac7-97c2-bf82cf7377b4\") "
Sep 11 12:04:36.321299 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:36.320924    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc32b842-3e83-4ac7-97c2-bf82cf7377b4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bc32b842-3e83-4ac7-97c2-bf82cf7377b4" (UID: "bc32b842-3e83-4ac7-97c2-bf82cf7377b4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:04:36.321299 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:36.320976    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc32b842-3e83-4ac7-97c2-bf82cf7377b4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bc32b842-3e83-4ac7-97c2-bf82cf7377b4" (UID: "bc32b842-3e83-4ac7-97c2-bf82cf7377b4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:04:36.321299 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:36.321111    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc32b842-3e83-4ac7-97c2-bf82cf7377b4-workload-certs\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 12:04:36.321299 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:36.321129    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc32b842-3e83-4ac7-97c2-bf82cf7377b4-credential-socket\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 12:04:36.321299 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:36.321185    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc32b842-3e83-4ac7-97c2-bf82cf7377b4-istio-data" (OuterVolumeSpecName: "istio-data") pod "bc32b842-3e83-4ac7-97c2-bf82cf7377b4" (UID: "bc32b842-3e83-4ac7-97c2-bf82cf7377b4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:04:36.321299 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:36.321123    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc32b842-3e83-4ac7-97c2-bf82cf7377b4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bc32b842-3e83-4ac7-97c2-bf82cf7377b4" (UID: "bc32b842-3e83-4ac7-97c2-bf82cf7377b4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:04:36.321299 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:36.321264    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc32b842-3e83-4ac7-97c2-bf82cf7377b4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bc32b842-3e83-4ac7-97c2-bf82cf7377b4" (UID: "bc32b842-3e83-4ac7-97c2-bf82cf7377b4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:04:36.322708 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:36.322688    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc32b842-3e83-4ac7-97c2-bf82cf7377b4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bc32b842-3e83-4ac7-97c2-bf82cf7377b4" (UID: "bc32b842-3e83-4ac7-97c2-bf82cf7377b4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:04:36.323003 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:36.322989    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc32b842-3e83-4ac7-97c2-bf82cf7377b4-kube-api-access-g9gnt" (OuterVolumeSpecName: "kube-api-access-g9gnt") pod "bc32b842-3e83-4ac7-97c2-bf82cf7377b4" (UID: "bc32b842-3e83-4ac7-97c2-bf82cf7377b4"). InnerVolumeSpecName "kube-api-access-g9gnt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:04:36.323092 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:36.323079    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc32b842-3e83-4ac7-97c2-bf82cf7377b4-istio-token" (OuterVolumeSpecName: "istio-token") pod "bc32b842-3e83-4ac7-97c2-bf82cf7377b4" (UID: "bc32b842-3e83-4ac7-97c2-bf82cf7377b4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:04:36.323147 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:36.323106    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bc32b842-3e83-4ac7-97c2-bf82cf7377b4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bc32b842-3e83-4ac7-97c2-bf82cf7377b4" (UID: "bc32b842-3e83-4ac7-97c2-bf82cf7377b4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 12:04:36.422317 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:36.422284    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc32b842-3e83-4ac7-97c2-bf82cf7377b4-istio-token\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 12:04:36.422317 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:36.422311    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc32b842-3e83-4ac7-97c2-bf82cf7377b4-istio-envoy\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 12:04:36.422317 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:36.422320    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc32b842-3e83-4ac7-97c2-bf82cf7377b4-istio-data\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 12:04:36.422317 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:36.422328    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc32b842-3e83-4ac7-97c2-bf82cf7377b4-istio-podinfo\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 12:04:36.422577 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:36.422337    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc32b842-3e83-4ac7-97c2-bf82cf7377b4-workload-socket\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 12:04:36.422577 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:36.422348    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g9gnt\" (UniqueName: \"kubernetes.io/projected/bc32b842-3e83-4ac7-97c2-bf82cf7377b4-kube-api-access-g9gnt\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 12:04:36.422577 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:36.422357    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc32b842-3e83-4ac7-97c2-bf82cf7377b4-istiod-ca-cert\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 12:04:36.617362 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:36.617328    2560 generic.go:356] "Generic (PLEG): container finished" podID="bc32b842-3e83-4ac7-97c2-bf82cf7377b4" containerID="00de6bd627f03793f25c41365ff5819dbaa5e642281a0f3e8571f0722a1cd943" exitCode=0
Sep 11 12:04:36.617533 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:36.617368    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd" event={"ID":"bc32b842-3e83-4ac7-97c2-bf82cf7377b4","Type":"ContainerDied","Data":"00de6bd627f03793f25c41365ff5819dbaa5e642281a0f3e8571f0722a1cd943"}
Sep 11 12:04:36.617533 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:36.617392    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd"
Sep 11 12:04:36.617533 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:36.617435    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd" event={"ID":"bc32b842-3e83-4ac7-97c2-bf82cf7377b4","Type":"ContainerDied","Data":"b39979e0c08a6335f3244f9327d17429ed73be6014c8258e7861dd3e0bffa14b"}
Sep 11 12:04:36.617533 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:36.617456    2560 scope.go:117] "RemoveContainer" containerID="00de6bd627f03793f25c41365ff5819dbaa5e642281a0f3e8571f0722a1cd943"
Sep 11 12:04:36.626780 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:36.626761    2560 scope.go:117] "RemoveContainer" containerID="e6946c0707702e1017ea0378932fd4b92745d5a902c9a2a40a35b27d47131701"
Sep 11 12:04:36.634806 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:36.634790    2560 scope.go:117] "RemoveContainer" containerID="00de6bd627f03793f25c41365ff5819dbaa5e642281a0f3e8571f0722a1cd943"
Sep 11 12:04:36.635085 ip-10-0-142-230 kubenswrapper[2560]: E0911 12:04:36.635061    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00de6bd627f03793f25c41365ff5819dbaa5e642281a0f3e8571f0722a1cd943\": container with ID starting with 00de6bd627f03793f25c41365ff5819dbaa5e642281a0f3e8571f0722a1cd943 not found: ID does not exist" containerID="00de6bd627f03793f25c41365ff5819dbaa5e642281a0f3e8571f0722a1cd943"
Sep 11 12:04:36.635131 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:36.635093    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00de6bd627f03793f25c41365ff5819dbaa5e642281a0f3e8571f0722a1cd943"} err="failed to get container status \"00de6bd627f03793f25c41365ff5819dbaa5e642281a0f3e8571f0722a1cd943\": rpc error: code = NotFound desc = could not find container \"00de6bd627f03793f25c41365ff5819dbaa5e642281a0f3e8571f0722a1cd943\": container with ID starting with 00de6bd627f03793f25c41365ff5819dbaa5e642281a0f3e8571f0722a1cd943 not found: ID does not exist"
Sep 11 12:04:36.635131 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:36.635110    2560 scope.go:117] "RemoveContainer" containerID="e6946c0707702e1017ea0378932fd4b92745d5a902c9a2a40a35b27d47131701"
Sep 11 12:04:36.635343 ip-10-0-142-230 kubenswrapper[2560]: E0911 12:04:36.635324    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6946c0707702e1017ea0378932fd4b92745d5a902c9a2a40a35b27d47131701\": container with ID starting with e6946c0707702e1017ea0378932fd4b92745d5a902c9a2a40a35b27d47131701 not found: ID does not exist" containerID="e6946c0707702e1017ea0378932fd4b92745d5a902c9a2a40a35b27d47131701"
Sep 11 12:04:36.635399 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:36.635352    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6946c0707702e1017ea0378932fd4b92745d5a902c9a2a40a35b27d47131701"} err="failed to get container status \"e6946c0707702e1017ea0378932fd4b92745d5a902c9a2a40a35b27d47131701\": rpc error: code = NotFound desc = could not find container \"e6946c0707702e1017ea0378932fd4b92745d5a902c9a2a40a35b27d47131701\": container with ID starting with e6946c0707702e1017ea0378932fd4b92745d5a902c9a2a40a35b27d47131701 not found: ID does not exist"
Sep 11 12:04:36.640976 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:36.640951    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd"]
Sep 11 12:04:36.643976 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:36.643954    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-272c5e-openshift-default-554ffbb8d8-xlznd"]
Sep 11 12:04:37.813162 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:37.813133    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc32b842-3e83-4ac7-97c2-bf82cf7377b4" path="/var/lib/kubelet/pods/bc32b842-3e83-4ac7-97c2-bf82cf7377b4/volumes"
Sep 11 12:04:42.002421 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:42.002389    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-117711-29818800-x6md6"]
Sep 11 12:04:42.006746 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:42.006720    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-117711-29818800-x6md6"]
Sep 11 12:04:42.040156 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:42.040120    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-117711-6f65b68bd5-bpv4n"]
Sep 11 12:04:42.040485 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:42.040452    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-117711-6f65b68bd5-bpv4n" podUID="3ae70641-8c9b-4583-a640-e83e52395ae6" containerName="payload-processing" containerID="cri-o://90e67ef280535ddfcccce07268e4a82dc18cecf1cb79647e4db11d882b46806a" gracePeriod=30
Sep 11 12:04:42.047026 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:42.046995    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-117711-76895d6bb6-x8l8g"]
Sep 11 12:04:42.047274 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:42.047242    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-117711-76895d6bb6-x8l8g" podUID="86547d81-aba7-43fe-be0a-42bbd471c9d1" containerName="payload-pre-processing" containerID="cri-o://12b27b089eed8ec79db6249c0f7c7d652790479b015a664bbd59d4aab4720844" gracePeriod=30
Sep 11 12:04:42.274003 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:42.273973    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-117711-6j6p4"]
Sep 11 12:04:42.278512 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:42.278479    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-117711-6j6p4"]
Sep 11 12:04:42.303620 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:42.303597    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-117711-6f65b68bd5-bpv4n"
Sep 11 12:04:42.327955 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:42.327903    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-117711-76895d6bb6-x8l8g"
Sep 11 12:04:42.472153 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:42.472110    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86547d81-aba7-43fe-be0a-42bbd471c9d1-plugins-config-volume\") pod \"86547d81-aba7-43fe-be0a-42bbd471c9d1\" (UID: \"86547d81-aba7-43fe-be0a-42bbd471c9d1\") "
Sep 11 12:04:42.472342 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:42.472171    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3ae70641-8c9b-4583-a640-e83e52395ae6-plugins-config-volume\") pod \"3ae70641-8c9b-4583-a640-e83e52395ae6\" (UID: \"3ae70641-8c9b-4583-a640-e83e52395ae6\") "
Sep 11 12:04:42.472342 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:42.472215    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hdr6q\" (UniqueName: \"kubernetes.io/projected/3ae70641-8c9b-4583-a640-e83e52395ae6-kube-api-access-hdr6q\") pod \"3ae70641-8c9b-4583-a640-e83e52395ae6\" (UID: \"3ae70641-8c9b-4583-a640-e83e52395ae6\") "
Sep 11 12:04:42.472342 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:42.472311    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ddzsb\" (UniqueName: \"kubernetes.io/projected/86547d81-aba7-43fe-be0a-42bbd471c9d1-kube-api-access-ddzsb\") pod \"86547d81-aba7-43fe-be0a-42bbd471c9d1\" (UID: \"86547d81-aba7-43fe-be0a-42bbd471c9d1\") "
Sep 11 12:04:42.472569 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:42.472544    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86547d81-aba7-43fe-be0a-42bbd471c9d1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "86547d81-aba7-43fe-be0a-42bbd471c9d1" (UID: "86547d81-aba7-43fe-be0a-42bbd471c9d1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:04:42.472634 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:42.472609    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ae70641-8c9b-4583-a640-e83e52395ae6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3ae70641-8c9b-4583-a640-e83e52395ae6" (UID: "3ae70641-8c9b-4583-a640-e83e52395ae6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:04:42.474331 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:42.474308    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ae70641-8c9b-4583-a640-e83e52395ae6-kube-api-access-hdr6q" (OuterVolumeSpecName: "kube-api-access-hdr6q") pod "3ae70641-8c9b-4583-a640-e83e52395ae6" (UID: "3ae70641-8c9b-4583-a640-e83e52395ae6"). InnerVolumeSpecName "kube-api-access-hdr6q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:04:42.474423 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:42.474352    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86547d81-aba7-43fe-be0a-42bbd471c9d1-kube-api-access-ddzsb" (OuterVolumeSpecName: "kube-api-access-ddzsb") pod "86547d81-aba7-43fe-be0a-42bbd471c9d1" (UID: "86547d81-aba7-43fe-be0a-42bbd471c9d1"). InnerVolumeSpecName "kube-api-access-ddzsb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:04:42.574051 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:42.573968    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86547d81-aba7-43fe-be0a-42bbd471c9d1-plugins-config-volume\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 12:04:42.574051 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:42.573996    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3ae70641-8c9b-4583-a640-e83e52395ae6-plugins-config-volume\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 12:04:42.574051 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:42.574005    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hdr6q\" (UniqueName: \"kubernetes.io/projected/3ae70641-8c9b-4583-a640-e83e52395ae6-kube-api-access-hdr6q\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 12:04:42.574051 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:42.574015    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddzsb\" (UniqueName: \"kubernetes.io/projected/86547d81-aba7-43fe-be0a-42bbd471c9d1-kube-api-access-ddzsb\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 12:04:42.648847 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:42.648809    2560 generic.go:356] "Generic (PLEG): container finished" podID="86547d81-aba7-43fe-be0a-42bbd471c9d1" containerID="12b27b089eed8ec79db6249c0f7c7d652790479b015a664bbd59d4aab4720844" exitCode=0
Sep 11 12:04:42.649031 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:42.648877    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-117711-76895d6bb6-x8l8g"
Sep 11 12:04:42.649031 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:42.648902    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-117711-76895d6bb6-x8l8g" event={"ID":"86547d81-aba7-43fe-be0a-42bbd471c9d1","Type":"ContainerDied","Data":"12b27b089eed8ec79db6249c0f7c7d652790479b015a664bbd59d4aab4720844"}
Sep 11 12:04:42.649031 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:42.648990    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-117711-76895d6bb6-x8l8g" event={"ID":"86547d81-aba7-43fe-be0a-42bbd471c9d1","Type":"ContainerDied","Data":"bf53d285ab69eb1c5756657060452ba983595e38bfce07c5028dd6f15a862dc5"}
Sep 11 12:04:42.649031 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:42.649015    2560 scope.go:117] "RemoveContainer" containerID="12b27b089eed8ec79db6249c0f7c7d652790479b015a664bbd59d4aab4720844"
Sep 11 12:04:42.650521 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:42.650494    2560 generic.go:356] "Generic (PLEG): container finished" podID="3ae70641-8c9b-4583-a640-e83e52395ae6" containerID="90e67ef280535ddfcccce07268e4a82dc18cecf1cb79647e4db11d882b46806a" exitCode=0
Sep 11 12:04:42.650630 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:42.650552    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-117711-6f65b68bd5-bpv4n"
Sep 11 12:04:42.650772 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:42.650550    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-117711-6f65b68bd5-bpv4n" event={"ID":"3ae70641-8c9b-4583-a640-e83e52395ae6","Type":"ContainerDied","Data":"90e67ef280535ddfcccce07268e4a82dc18cecf1cb79647e4db11d882b46806a"}
Sep 11 12:04:42.650772 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:42.650689    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-117711-6f65b68bd5-bpv4n" event={"ID":"3ae70641-8c9b-4583-a640-e83e52395ae6","Type":"ContainerDied","Data":"0fdc9953db9cfac66d35e9c018f483d6375a840af4dffa67e8ab8b4cc1a460f3"}
Sep 11 12:04:42.658303 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:42.658287    2560 scope.go:117] "RemoveContainer" containerID="12b27b089eed8ec79db6249c0f7c7d652790479b015a664bbd59d4aab4720844"
Sep 11 12:04:42.658623 ip-10-0-142-230 kubenswrapper[2560]: E0911 12:04:42.658595    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12b27b089eed8ec79db6249c0f7c7d652790479b015a664bbd59d4aab4720844\": container with ID starting with 12b27b089eed8ec79db6249c0f7c7d652790479b015a664bbd59d4aab4720844 not found: ID does not exist" containerID="12b27b089eed8ec79db6249c0f7c7d652790479b015a664bbd59d4aab4720844"
Sep 11 12:04:42.658825 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:42.658794    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12b27b089eed8ec79db6249c0f7c7d652790479b015a664bbd59d4aab4720844"} err="failed to get container status \"12b27b089eed8ec79db6249c0f7c7d652790479b015a664bbd59d4aab4720844\": rpc error: code = NotFound desc = could not find container \"12b27b089eed8ec79db6249c0f7c7d652790479b015a664bbd59d4aab4720844\": container with ID starting with 12b27b089eed8ec79db6249c0f7c7d652790479b015a664bbd59d4aab4720844 not found: ID does not exist"
Sep 11 12:04:42.658923 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:42.658827    2560 scope.go:117] "RemoveContainer" containerID="90e67ef280535ddfcccce07268e4a82dc18cecf1cb79647e4db11d882b46806a"
Sep 11 12:04:42.666890 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:42.666875    2560 scope.go:117] "RemoveContainer" containerID="90e67ef280535ddfcccce07268e4a82dc18cecf1cb79647e4db11d882b46806a"
Sep 11 12:04:42.667139 ip-10-0-142-230 kubenswrapper[2560]: E0911 12:04:42.667120    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90e67ef280535ddfcccce07268e4a82dc18cecf1cb79647e4db11d882b46806a\": container with ID starting with 90e67ef280535ddfcccce07268e4a82dc18cecf1cb79647e4db11d882b46806a not found: ID does not exist" containerID="90e67ef280535ddfcccce07268e4a82dc18cecf1cb79647e4db11d882b46806a"
Sep 11 12:04:42.667198 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:42.667145    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90e67ef280535ddfcccce07268e4a82dc18cecf1cb79647e4db11d882b46806a"} err="failed to get container status \"90e67ef280535ddfcccce07268e4a82dc18cecf1cb79647e4db11d882b46806a\": rpc error: code = NotFound desc = could not find container \"90e67ef280535ddfcccce07268e4a82dc18cecf1cb79647e4db11d882b46806a\": container with ID starting with 90e67ef280535ddfcccce07268e4a82dc18cecf1cb79647e4db11d882b46806a not found: ID does not exist"
Sep 11 12:04:42.676141 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:42.676116    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-117711-6f65b68bd5-bpv4n"]
Sep 11 12:04:42.680415 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:42.680392    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-117711-6f65b68bd5-bpv4n"]
Sep 11 12:04:42.693792 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:42.693770    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-117711-76895d6bb6-x8l8g"]
Sep 11 12:04:42.698972 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:42.698953    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-117711-76895d6bb6-x8l8g"]
Sep 11 12:04:43.812801 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:43.812767    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ae70641-8c9b-4583-a640-e83e52395ae6" path="/var/lib/kubelet/pods/3ae70641-8c9b-4583-a640-e83e52395ae6/volumes"
Sep 11 12:04:43.813174 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:43.813124    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ecd5190-e85f-4102-96be-6990bfc62831" path="/var/lib/kubelet/pods/4ecd5190-e85f-4102-96be-6990bfc62831/volumes"
Sep 11 12:04:43.813353 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:43.813340    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67263530-834c-4e6f-8e5d-b559957198ef" path="/var/lib/kubelet/pods/67263530-834c-4e6f-8e5d-b559957198ef/volumes"
Sep 11 12:04:43.813604 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:04:43.813594    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86547d81-aba7-43fe-be0a-42bbd471c9d1" path="/var/lib/kubelet/pods/86547d81-aba7-43fe-be0a-42bbd471c9d1/volumes"
Sep 11 12:05:10.127466 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:05:10.127432    2560 scope.go:117] "RemoveContainer" containerID="6c04fed9489c1182b8ac111ad0f1302f9fec07bf6f36b44952e3610c4081c9e6"
Sep 11 12:06:10.157385 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:06:10.157352    2560 scope.go:117] "RemoveContainer" containerID="2ae6be30c95a8843df7bfc6b056b6ad9101fbf7f269401bf64a0535d9be374b6"
Sep 11 12:06:10.165493 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:06:10.165473    2560 scope.go:117] "RemoveContainer" containerID="dcada8fb8c38a1e5b44a9342b40e34a35406cb84e0aeff545629f6e0cba89b19"
Sep 11 12:06:10.174739 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:06:10.174721    2560 scope.go:117] "RemoveContainer" containerID="bd9cb177bab4dc995589e8a25a41b4e8243dbc9c586dff707120ee60ce3af48f"
Sep 11 12:06:10.182066 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:06:10.182040    2560 scope.go:117] "RemoveContainer" containerID="8d9f0036e5d61160051d4e3db36ddb6e88d711f7914367fb9e0a617732d8f176"
Sep 11 12:06:10.189351 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:06:10.189332    2560 scope.go:117] "RemoveContainer" containerID="394912e251656c275ac320bf352e8463bdc0704d040895235922bb1646912341"
Sep 11 12:07:20.626243 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:07:20.626205    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-95mx5"]
Sep 11 12:07:20.626823 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:07:20.626422    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-95mx5" podUID="26de7b73-7449-4702-ac08-80954d7ce5de" containerName="manager" containerID="cri-o://ca1f9ed43f866eb3b6121a5fc79564eebf22fe3c517a7cbbe3fabd3702dd743c" gracePeriod=10
Sep 11 12:07:22.674864 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:07:22.674835    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-95mx5"
Sep 11 12:07:22.812244 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:07:22.812214    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/26de7b73-7449-4702-ac08-80954d7ce5de-extensions-socket-volume\") pod \"26de7b73-7449-4702-ac08-80954d7ce5de\" (UID: \"26de7b73-7449-4702-ac08-80954d7ce5de\") "
Sep 11 12:07:22.812403 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:07:22.812305    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qf2jz\" (UniqueName: \"kubernetes.io/projected/26de7b73-7449-4702-ac08-80954d7ce5de-kube-api-access-qf2jz\") pod \"26de7b73-7449-4702-ac08-80954d7ce5de\" (UID: \"26de7b73-7449-4702-ac08-80954d7ce5de\") "
Sep 11 12:07:22.812635 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:07:22.812612    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26de7b73-7449-4702-ac08-80954d7ce5de-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "26de7b73-7449-4702-ac08-80954d7ce5de" (UID: "26de7b73-7449-4702-ac08-80954d7ce5de"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:07:22.814284 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:07:22.814260    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26de7b73-7449-4702-ac08-80954d7ce5de-kube-api-access-qf2jz" (OuterVolumeSpecName: "kube-api-access-qf2jz") pod "26de7b73-7449-4702-ac08-80954d7ce5de" (UID: "26de7b73-7449-4702-ac08-80954d7ce5de"). InnerVolumeSpecName "kube-api-access-qf2jz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:07:22.913863 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:07:22.913825    2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/26de7b73-7449-4702-ac08-80954d7ce5de-extensions-socket-volume\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 12:07:22.914031 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:07:22.913860    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qf2jz\" (UniqueName: \"kubernetes.io/projected/26de7b73-7449-4702-ac08-80954d7ce5de-kube-api-access-qf2jz\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Sep 11 12:07:23.400463 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:07:23.400427    2560 generic.go:356] "Generic (PLEG): container finished" podID="26de7b73-7449-4702-ac08-80954d7ce5de" containerID="ca1f9ed43f866eb3b6121a5fc79564eebf22fe3c517a7cbbe3fabd3702dd743c" exitCode=0
Sep 11 12:07:23.400669 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:07:23.400479    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-95mx5"
Sep 11 12:07:23.400669 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:07:23.400518    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-95mx5" event={"ID":"26de7b73-7449-4702-ac08-80954d7ce5de","Type":"ContainerDied","Data":"ca1f9ed43f866eb3b6121a5fc79564eebf22fe3c517a7cbbe3fabd3702dd743c"}
Sep 11 12:07:23.400669 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:07:23.400578    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-95mx5" event={"ID":"26de7b73-7449-4702-ac08-80954d7ce5de","Type":"ContainerDied","Data":"8b0f1d9ebbc7d3fb79fc325cf60a79a91b3dc92665587a5e8b6f21b51e3aad7a"}
Sep 11 12:07:23.400669 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:07:23.400605    2560 scope.go:117] "RemoveContainer" containerID="ca1f9ed43f866eb3b6121a5fc79564eebf22fe3c517a7cbbe3fabd3702dd743c"
Sep 11 12:07:23.409780 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:07:23.409760    2560 scope.go:117] "RemoveContainer" containerID="ca1f9ed43f866eb3b6121a5fc79564eebf22fe3c517a7cbbe3fabd3702dd743c"
Sep 11 12:07:23.410035 ip-10-0-142-230 kubenswrapper[2560]: E0911 12:07:23.410015    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca1f9ed43f866eb3b6121a5fc79564eebf22fe3c517a7cbbe3fabd3702dd743c\": container with ID starting with ca1f9ed43f866eb3b6121a5fc79564eebf22fe3c517a7cbbe3fabd3702dd743c not found: ID does not exist" containerID="ca1f9ed43f866eb3b6121a5fc79564eebf22fe3c517a7cbbe3fabd3702dd743c"
Sep 11 12:07:23.410081 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:07:23.410044    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca1f9ed43f866eb3b6121a5fc79564eebf22fe3c517a7cbbe3fabd3702dd743c"} err="failed to get container status \"ca1f9ed43f866eb3b6121a5fc79564eebf22fe3c517a7cbbe3fabd3702dd743c\": rpc error: code = NotFound desc = could not find container \"ca1f9ed43f866eb3b6121a5fc79564eebf22fe3c517a7cbbe3fabd3702dd743c\": container with ID starting with ca1f9ed43f866eb3b6121a5fc79564eebf22fe3c517a7cbbe3fabd3702dd743c not found: ID does not exist"
Sep 11 12:07:23.435421 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:07:23.435401    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-95mx5"]
Sep 11 12:07:23.440592 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:07:23.440571    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-95mx5"]
Sep 11 12:07:23.813432 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:07:23.813397    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26de7b73-7449-4702-ac08-80954d7ce5de" path="/var/lib/kubelet/pods/26de7b73-7449-4702-ac08-80954d7ce5de/volumes"
Sep 11 12:08:21.338309 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:08:21.338277    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l4lz6"]
Sep 11 12:08:21.338792 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:08:21.338572    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86547d81-aba7-43fe-be0a-42bbd471c9d1" containerName="payload-pre-processing"
Sep 11 12:08:21.338792 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:08:21.338583    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="86547d81-aba7-43fe-be0a-42bbd471c9d1" containerName="payload-pre-processing"
Sep 11 12:08:21.338792 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:08:21.338590    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ae70641-8c9b-4583-a640-e83e52395ae6" containerName="payload-processing"
Sep 11 12:08:21.338792 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:08:21.338596    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ae70641-8c9b-4583-a640-e83e52395ae6" containerName="payload-processing"
Sep 11 12:08:21.338792 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:08:21.338605    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc32b842-3e83-4ac7-97c2-bf82cf7377b4" containerName="istio-proxy"
Sep 11 12:08:21.338792 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:08:21.338611    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc32b842-3e83-4ac7-97c2-bf82cf7377b4" containerName="istio-proxy"
Sep 11 12:08:21.338792 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:08:21.338618    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26de7b73-7449-4702-ac08-80954d7ce5de" containerName="manager"
Sep 11 12:08:21.338792 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:08:21.338622    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="26de7b73-7449-4702-ac08-80954d7ce5de" containerName="manager"
Sep 11 12:08:21.338792 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:08:21.338629    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc32b842-3e83-4ac7-97c2-bf82cf7377b4" containerName="istio-proxy"
Sep 11 12:08:21.338792 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:08:21.338634    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc32b842-3e83-4ac7-97c2-bf82cf7377b4" containerName="istio-proxy"
Sep 11 12:08:21.338792 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:08:21.338640    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ecd5190-e85f-4102-96be-6990bfc62831" containerName="revoke-keys"
Sep 11 12:08:21.338792 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:08:21.338661    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ecd5190-e85f-4102-96be-6990bfc62831" containerName="revoke-keys"
Sep 11 12:08:21.338792 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:08:21.338726    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc32b842-3e83-4ac7-97c2-bf82cf7377b4" containerName="istio-proxy"
Sep 11 12:08:21.338792 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:08:21.338732    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc32b842-3e83-4ac7-97c2-bf82cf7377b4" containerName="istio-proxy"
Sep 11 12:08:21.338792 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:08:21.338740    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="86547d81-aba7-43fe-be0a-42bbd471c9d1" containerName="payload-pre-processing"
Sep 11 12:08:21.338792 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:08:21.338747    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="26de7b73-7449-4702-ac08-80954d7ce5de" containerName="manager"
Sep 11 12:08:21.338792 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:08:21.338752    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ae70641-8c9b-4583-a640-e83e52395ae6" containerName="payload-processing"
Sep 11 12:08:21.338792 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:08:21.338757    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ecd5190-e85f-4102-96be-6990bfc62831" containerName="revoke-keys"
Sep 11 12:08:21.341564 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:08:21.341549    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l4lz6"
Sep 11 12:08:21.345835 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:08:21.345805    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-8dpsl\""
Sep 11 12:08:21.357899 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:08:21.357876    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l4lz6"]
Sep 11 12:08:21.484553 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:08:21.484510    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2f46c99-0bfc-415a-a494-c7513a2c995f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-l4lz6\" (UID: \"c2f46c99-0bfc-415a-a494-c7513a2c995f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l4lz6"
Sep 11 12:08:21.484771 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:08:21.484615    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45qfn\" (UniqueName: \"kubernetes.io/projected/c2f46c99-0bfc-415a-a494-c7513a2c995f-kube-api-access-45qfn\") pod \"kuadrant-operator-controller-manager-5769f99d9f-l4lz6\" (UID: \"c2f46c99-0bfc-415a-a494-c7513a2c995f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l4lz6"
Sep 11 12:08:21.585074 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:08:21.585021    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2f46c99-0bfc-415a-a494-c7513a2c995f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-l4lz6\" (UID: \"c2f46c99-0bfc-415a-a494-c7513a2c995f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l4lz6"
Sep 11 12:08:21.585255 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:08:21.585109    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45qfn\" (UniqueName: \"kubernetes.io/projected/c2f46c99-0bfc-415a-a494-c7513a2c995f-kube-api-access-45qfn\") pod \"kuadrant-operator-controller-manager-5769f99d9f-l4lz6\" (UID: \"c2f46c99-0bfc-415a-a494-c7513a2c995f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l4lz6"
Sep 11 12:08:21.585449 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:08:21.585427    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2f46c99-0bfc-415a-a494-c7513a2c995f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-l4lz6\" (UID: \"c2f46c99-0bfc-415a-a494-c7513a2c995f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l4lz6"
Sep 11 12:08:21.600520 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:08:21.600452    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45qfn\" (UniqueName: \"kubernetes.io/projected/c2f46c99-0bfc-415a-a494-c7513a2c995f-kube-api-access-45qfn\") pod \"kuadrant-operator-controller-manager-5769f99d9f-l4lz6\" (UID: \"c2f46c99-0bfc-415a-a494-c7513a2c995f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l4lz6"
Sep 11 12:08:21.651202 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:08:21.651168    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l4lz6"
Sep 11 12:08:21.969279 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:08:21.969246    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l4lz6"]
Sep 11 12:08:21.972877 ip-10-0-142-230 kubenswrapper[2560]: W0911 12:08:21.972847    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2f46c99_0bfc_415a_a494_c7513a2c995f.slice/crio-bd5dfea1adb82a91ed2882e59a472d7932c5d256d3d7587ac9808d697342ddd3 WatchSource:0}: Error finding container bd5dfea1adb82a91ed2882e59a472d7932c5d256d3d7587ac9808d697342ddd3: Status 404 returned error can't find the container with id bd5dfea1adb82a91ed2882e59a472d7932c5d256d3d7587ac9808d697342ddd3
Sep 11 12:08:22.668212 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:08:22.668177    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l4lz6" event={"ID":"c2f46c99-0bfc-415a-a494-c7513a2c995f","Type":"ContainerStarted","Data":"306798bf37310a45ce45dd1b1462815f6b8c35c5d82042ad2fc34c0dcf53945f"}
Sep 11 12:08:22.668580 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:08:22.668251    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l4lz6" event={"ID":"c2f46c99-0bfc-415a-a494-c7513a2c995f","Type":"ContainerStarted","Data":"bd5dfea1adb82a91ed2882e59a472d7932c5d256d3d7587ac9808d697342ddd3"}
Sep 11 12:08:22.668580 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:08:22.668398    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l4lz6"
Sep 11 12:08:22.701905 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:08:22.701850    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l4lz6" podStartSLOduration=1.701836458 podStartE2EDuration="1.701836458s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:08:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:08:22.699040075 +0000 UTC m=+2053.521499978" watchObservedRunningTime="2026-09-11 12:08:22.701836458 +0000 UTC m=+2053.524296330"
Sep 11 12:08:33.675765 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:08:33.675690    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l4lz6"
Sep 11 12:09:10.237074 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:09:10.237033    2560 scope.go:117] "RemoveContainer" containerID="9f30cd40e4887cadca647413d91ea999844a7f4e7f38beb38f2b3a3853e81800"
Sep 11 12:09:10.245719 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:09:10.245689    2560 scope.go:117] "RemoveContainer" containerID="6a32f02729da66157033456edc47a5c49565b58bd3ad26bd11d2111eb57bda64"
Sep 11 12:10:10.266982 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:10.266899    2560 scope.go:117] "RemoveContainer" containerID="9dbee59bb9b1e55c087d75d2d779d7c3865e8bc10a7efd300f5d376cf4e3b9ae"
Sep 11 12:10:30.259443 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:30.259409    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86f769d976-pkrjx_587f6a18-b839-4755-be10-c7526e719b7d/copy-manifests/0.log"
Sep 11 12:10:30.275006 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:30.274981    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86f769d976-pkrjx_587f6a18-b839-4755-be10-c7526e719b7d/manager/0.log"
Sep 11 12:10:30.941252 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:30.941223    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29818785-j67d9_243cce38-2368-414d-a88b-69096577c4a2/cleanup/0.log"
Sep 11 12:10:32.023900 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:32.023874    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-hdm99_51f4220d-8e53-4eab-a7a8-6fd6b4c3bbba/manager/0.log"
Sep 11 12:10:32.142508 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:32.142482    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-z6mdx_ba64a1a4-a385-4ba7-b33a-0003451e30c2/manager/0.log"
Sep 11 12:10:32.367546 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:32.367467    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-l4lz6_c2f46c99-0bfc-415a-a494-c7513a2c995f/manager/0.log"
Sep 11 12:10:32.604114 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:32.604080    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-kr692_065deae5-3e15-4793-9532-b51476aa85c8/manager/0.log"
Sep 11 12:10:33.065265 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:33.065237    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-88gpc_6e9071bd-3735-4e97-8e97-7e76ea0f5b8f/discovery/0.log"
Sep 11 12:10:33.177374 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:33.177347    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-797c7d88fd-gm7jh_988113db-47a5-464d-8092-03ca36bff4df/kube-auth-proxy/0.log"
Sep 11 12:10:33.535111 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:33.535083    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-4pv2g_176eb299-aee1-47f4-9140-a3907c7cbf95/payload-pre-processing/0.log"
Sep 11 12:10:34.327024 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:34.326992    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-rx466_8043b841-3487-4648-9b20-4bb82c6d069d/main/0.log"
Sep 11 12:10:34.542916 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:34.542885    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9nc6_279659ab-2bae-4cd5-b20d-9278c514d965/main/0.log"
Sep 11 12:10:34.659040 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:34.658950    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-qkbk2_685a0ca3-71d1-4330-b840-56817a0a2a65/main/0.log"
Sep 11 12:10:43.793223 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:43.793189    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mtjkj_81901073-d576-4c23-bb13-e150254f32b7/global-pull-secret-syncer/0.log"
Sep 11 12:10:43.974152 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:43.974118    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-fv2ft_3b040dc1-8688-4630-8a3d-3b8d7bc7fdd5/konnectivity-agent/0.log"
Sep 11 12:10:44.059842 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:44.059763    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-230.ec2.internal_a41d8d936191e7605296179362bc8cf0/haproxy/0.log"
Sep 11 12:10:48.582804 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:48.582731    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-hdm99_51f4220d-8e53-4eab-a7a8-6fd6b4c3bbba/manager/0.log"
Sep 11 12:10:48.624894 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:48.624863    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-z6mdx_ba64a1a4-a385-4ba7-b33a-0003451e30c2/manager/0.log"
Sep 11 12:10:48.714574 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:48.714547    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-l4lz6_c2f46c99-0bfc-415a-a494-c7513a2c995f/manager/0.log"
Sep 11 12:10:48.828434 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:48.828399    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-kr692_065deae5-3e15-4793-9532-b51476aa85c8/manager/0.log"
Sep 11 12:10:51.057613 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:51.057585    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g2xm9_6d20a32e-98a1-415f-9e47-901630a17e9c/node-exporter/0.log"
Sep 11 12:10:51.100706 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:51.100675    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g2xm9_6d20a32e-98a1-415f-9e47-901630a17e9c/kube-rbac-proxy/0.log"
Sep 11 12:10:51.134979 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:51.134948    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g2xm9_6d20a32e-98a1-415f-9e47-901630a17e9c/init-textfile/0.log"
Sep 11 12:10:54.506913 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:54.506878    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ntf2c/perf-node-gather-daemonset-n8kpx"]
Sep 11 12:10:54.510116 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:54.510100    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ntf2c/perf-node-gather-daemonset-n8kpx"
Sep 11 12:10:54.513387 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:54.513362    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ntf2c\"/\"default-dockercfg-djvfd\""
Sep 11 12:10:54.513512 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:54.513432    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ntf2c\"/\"openshift-service-ca.crt\""
Sep 11 12:10:54.514099 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:54.514082    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ntf2c\"/\"kube-root-ca.crt\""
Sep 11 12:10:54.545212 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:54.545168    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b1e3c3a2-b928-48cb-95ac-f773ccab875c-lib-modules\") pod \"perf-node-gather-daemonset-n8kpx\" (UID: \"b1e3c3a2-b928-48cb-95ac-f773ccab875c\") " pod="openshift-must-gather-ntf2c/perf-node-gather-daemonset-n8kpx"
Sep 11 12:10:54.545425 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:54.545266    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b1e3c3a2-b928-48cb-95ac-f773ccab875c-proc\") pod \"perf-node-gather-daemonset-n8kpx\" (UID: \"b1e3c3a2-b928-48cb-95ac-f773ccab875c\") " pod="openshift-must-gather-ntf2c/perf-node-gather-daemonset-n8kpx"
Sep 11 12:10:54.545425 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:54.545298    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b1e3c3a2-b928-48cb-95ac-f773ccab875c-podres\") pod \"perf-node-gather-daemonset-n8kpx\" (UID: \"b1e3c3a2-b928-48cb-95ac-f773ccab875c\") " pod="openshift-must-gather-ntf2c/perf-node-gather-daemonset-n8kpx"
Sep 11 12:10:54.545425 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:54.545332    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hv96\" (UniqueName: \"kubernetes.io/projected/b1e3c3a2-b928-48cb-95ac-f773ccab875c-kube-api-access-2hv96\") pod \"perf-node-gather-daemonset-n8kpx\" (UID: \"b1e3c3a2-b928-48cb-95ac-f773ccab875c\") " pod="openshift-must-gather-ntf2c/perf-node-gather-daemonset-n8kpx"
Sep 11 12:10:54.545425 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:54.545391    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b1e3c3a2-b928-48cb-95ac-f773ccab875c-sys\") pod \"perf-node-gather-daemonset-n8kpx\" (UID: \"b1e3c3a2-b928-48cb-95ac-f773ccab875c\") " pod="openshift-must-gather-ntf2c/perf-node-gather-daemonset-n8kpx"
Sep 11 12:10:54.545425 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:54.545415    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ntf2c/perf-node-gather-daemonset-n8kpx"]
Sep 11 12:10:54.645951 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:54.645917    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b1e3c3a2-b928-48cb-95ac-f773ccab875c-podres\") pod \"perf-node-gather-daemonset-n8kpx\" (UID: \"b1e3c3a2-b928-48cb-95ac-f773ccab875c\") " pod="openshift-must-gather-ntf2c/perf-node-gather-daemonset-n8kpx"
Sep 11 12:10:54.646147 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:54.645959    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hv96\" (UniqueName: \"kubernetes.io/projected/b1e3c3a2-b928-48cb-95ac-f773ccab875c-kube-api-access-2hv96\") pod \"perf-node-gather-daemonset-n8kpx\" (UID: \"b1e3c3a2-b928-48cb-95ac-f773ccab875c\") " pod="openshift-must-gather-ntf2c/perf-node-gather-daemonset-n8kpx"
Sep 11 12:10:54.646147 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:54.645979    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b1e3c3a2-b928-48cb-95ac-f773ccab875c-sys\") pod \"perf-node-gather-daemonset-n8kpx\" (UID: \"b1e3c3a2-b928-48cb-95ac-f773ccab875c\") " pod="openshift-must-gather-ntf2c/perf-node-gather-daemonset-n8kpx"
Sep 11 12:10:54.646147 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:54.646013    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b1e3c3a2-b928-48cb-95ac-f773ccab875c-lib-modules\") pod \"perf-node-gather-daemonset-n8kpx\" (UID: \"b1e3c3a2-b928-48cb-95ac-f773ccab875c\") " pod="openshift-must-gather-ntf2c/perf-node-gather-daemonset-n8kpx"
Sep 11 12:10:54.646147 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:54.646066    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b1e3c3a2-b928-48cb-95ac-f773ccab875c-proc\") pod \"perf-node-gather-daemonset-n8kpx\" (UID: \"b1e3c3a2-b928-48cb-95ac-f773ccab875c\") " pod="openshift-must-gather-ntf2c/perf-node-gather-daemonset-n8kpx"
Sep 11 12:10:54.646147 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:54.646102    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b1e3c3a2-b928-48cb-95ac-f773ccab875c-podres\") pod \"perf-node-gather-daemonset-n8kpx\" (UID: \"b1e3c3a2-b928-48cb-95ac-f773ccab875c\") " pod="openshift-must-gather-ntf2c/perf-node-gather-daemonset-n8kpx"
Sep 11 12:10:54.646147 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:54.646133    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b1e3c3a2-b928-48cb-95ac-f773ccab875c-proc\") pod \"perf-node-gather-daemonset-n8kpx\" (UID: \"b1e3c3a2-b928-48cb-95ac-f773ccab875c\") " pod="openshift-must-gather-ntf2c/perf-node-gather-daemonset-n8kpx"
Sep 11 12:10:54.646147 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:54.646113    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b1e3c3a2-b928-48cb-95ac-f773ccab875c-sys\") pod \"perf-node-gather-daemonset-n8kpx\" (UID: \"b1e3c3a2-b928-48cb-95ac-f773ccab875c\") " pod="openshift-must-gather-ntf2c/perf-node-gather-daemonset-n8kpx"
Sep 11 12:10:54.646444 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:54.646181    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b1e3c3a2-b928-48cb-95ac-f773ccab875c-lib-modules\") pod \"perf-node-gather-daemonset-n8kpx\" (UID: \"b1e3c3a2-b928-48cb-95ac-f773ccab875c\") " pod="openshift-must-gather-ntf2c/perf-node-gather-daemonset-n8kpx"
Sep 11 12:10:54.654270 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:54.654242    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hv96\" (UniqueName: \"kubernetes.io/projected/b1e3c3a2-b928-48cb-95ac-f773ccab875c-kube-api-access-2hv96\") pod \"perf-node-gather-daemonset-n8kpx\" (UID: \"b1e3c3a2-b928-48cb-95ac-f773ccab875c\") " pod="openshift-must-gather-ntf2c/perf-node-gather-daemonset-n8kpx"
Sep 11 12:10:54.820284 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:54.820183    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ntf2c/perf-node-gather-daemonset-n8kpx"
Sep 11 12:10:55.092446 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:55.092367    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ntf2c/perf-node-gather-daemonset-n8kpx"]
Sep 11 12:10:55.095858 ip-10-0-142-230 kubenswrapper[2560]: W0911 12:10:55.095831    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb1e3c3a2_b928_48cb_95ac_f773ccab875c.slice/crio-a133641061478e8e32df1bbaa3397e2733a9c82f8728c68f523273c3a48cd15f WatchSource:0}: Error finding container a133641061478e8e32df1bbaa3397e2733a9c82f8728c68f523273c3a48cd15f: Status 404 returned error can't find the container with id a133641061478e8e32df1bbaa3397e2733a9c82f8728c68f523273c3a48cd15f
Sep 11 12:10:55.362856 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:55.362765    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ntf2c/perf-node-gather-daemonset-n8kpx" event={"ID":"b1e3c3a2-b928-48cb-95ac-f773ccab875c","Type":"ContainerStarted","Data":"53dd390691fbc46517a30827f3ac8f1c1db95076c3e2efb22cef498ac840e919"}
Sep 11 12:10:55.362856 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:55.362821    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ntf2c/perf-node-gather-daemonset-n8kpx" event={"ID":"b1e3c3a2-b928-48cb-95ac-f773ccab875c","Type":"ContainerStarted","Data":"a133641061478e8e32df1bbaa3397e2733a9c82f8728c68f523273c3a48cd15f"}
Sep 11 12:10:55.362856 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:55.362847    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ntf2c/perf-node-gather-daemonset-n8kpx"
Sep 11 12:10:55.385682 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:55.385625    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ntf2c/perf-node-gather-daemonset-n8kpx" podStartSLOduration=1.385611694 podStartE2EDuration="1.385611694s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:10:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:10:55.384804001 +0000 UTC m=+2206.207263882" watchObservedRunningTime="2026-09-11 12:10:55.385611694 +0000 UTC m=+2206.208071567"
Sep 11 12:10:57.059446 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:57.059416    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mlqk5_ccea5f58-9718-4139-8a7f-21f15d7c95b4/dns/0.log"
Sep 11 12:10:57.094843 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:57.094814    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mlqk5_ccea5f58-9718-4139-8a7f-21f15d7c95b4/kube-rbac-proxy/0.log"
Sep 11 12:10:57.192606 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:57.192574    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xc7zl_129a8b0d-dd99-476a-bc21-8fcf5b3335d0/dns-node-resolver/0.log"
Sep 11 12:10:57.784664 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:57.784625    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-bbd5d68d4-ht82m_06144b87-a467-47fe-b379-8f6998bf26cb/registry/0.log"
Sep 11 12:10:57.810079 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:57.810053    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fjlr9_da5daa69-1f21-42d2-b6d5-388f49a097d2/node-ca/0.log"
Sep 11 12:10:59.105045 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:59.105011    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-88gpc_6e9071bd-3735-4e97-8e97-7e76ea0f5b8f/discovery/0.log"
Sep 11 12:10:59.129189 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:59.129158    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-797c7d88fd-gm7jh_988113db-47a5-464d-8092-03ca36bff4df/kube-auth-proxy/0.log"
Sep 11 12:10:59.239842 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:10:59.239791    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-4pv2g_176eb299-aee1-47f4-9140-a3907c7cbf95/payload-pre-processing/0.log"
Sep 11 12:11:00.320269 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:11:00.320240    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qx5fk_1d5ddcf1-e41b-4400-bb50-8747546410f5/serve-healthcheck-canary/0.log"
Sep 11 12:11:01.011604 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:11:01.011574    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7h8hv_a144c788-3457-4841-8e4e-877e722a32f1/kube-rbac-proxy/0.log"
Sep 11 12:11:01.035321 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:11:01.035299    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7h8hv_a144c788-3457-4841-8e4e-877e722a32f1/exporter/0.log"
Sep 11 12:11:01.064119 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:11:01.064091    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7h8hv_a144c788-3457-4841-8e4e-877e722a32f1/extractor/0.log"
Sep 11 12:11:01.377564 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:11:01.377494    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ntf2c/perf-node-gather-daemonset-n8kpx"
Sep 11 12:11:04.099442 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:11:04.099405    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86f769d976-pkrjx_587f6a18-b839-4755-be10-c7526e719b7d/manager/0.log"
Sep 11 12:11:04.134159 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:11:04.134130    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86f769d976-pkrjx_587f6a18-b839-4755-be10-c7526e719b7d/copy-manifests/0.log"
Sep 11 12:11:05.406923 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:11:05.406892    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-88gpc_6e9071bd-3735-4e97-8e97-7e76ea0f5b8f/discovery/0.log"
Sep 11 12:11:05.423244 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:11:05.423219    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-797c7d88fd-gm7jh_988113db-47a5-464d-8092-03ca36bff4df/kube-auth-proxy/0.log"
Sep 11 12:11:05.535892 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:11:05.535862    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-4pv2g_176eb299-aee1-47f4-9140-a3907c7cbf95/payload-pre-processing/0.log"
Sep 11 12:11:07.358909 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:11:07.358881    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-88gpc_6e9071bd-3735-4e97-8e97-7e76ea0f5b8f/discovery/0.log"
Sep 11 12:11:07.374330 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:11:07.374302    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-797c7d88fd-gm7jh_988113db-47a5-464d-8092-03ca36bff4df/kube-auth-proxy/0.log"
Sep 11 12:11:07.454950 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:11:07.454921    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-4pv2g_176eb299-aee1-47f4-9140-a3907c7cbf95/payload-pre-processing/0.log"
Sep 11 12:11:10.283321 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:11:10.283291    2560 scope.go:117] "RemoveContainer" containerID="d1727336226848c371324368aaed12c7ac91f7e54264ddbe6ebe2a5953a2a76c"
Sep 11 12:11:10.290752 ip-10-0-142-230 kubenswrapper[2560]: I0911 12:11:10.290733    2560 scope.go:117] "RemoveContainer" containerID="46b9d1a16a40b673b04ad9ad81a87d6b8310e3132756acdf8b1bde106c07c236"