Sep 11 21:03:58.198073 ip-10-0-137-163 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 11 21:03:58.198086 ip-10-0-137-163 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 11 21:03:58.198094 ip-10-0-137-163 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 11 21:03:58.198390 ip-10-0-137-163 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 11 21:04:07.991455 ip-10-0-137-163 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found.
Sep 11 21:04:07.991468 ip-10-0-137-163 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot aab063c352f54d2fba62e2cf7f90f15b --
Sep 11 21:05:52.480051 ip-10-0-137-163 systemd[1]: Starting Kubernetes Kubelet...
Sep 11 21:05:52.912232 ip-10-0-137-163 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 21:05:52.912232 ip-10-0-137-163 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 11 21:05:52.912232 ip-10-0-137-163 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 21:05:52.912232 ip-10-0-137-163 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 11 21:05:52.912232 ip-10-0-137-163 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 21:05:52.912996 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.912307    2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 11 21:05:52.918238 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918210    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 21:05:52.918238 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918235    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 21:05:52.918238 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918239    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 21:05:52.918238 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918242    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 21:05:52.918376 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918246    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 21:05:52.918376 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918249    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 21:05:52.918376 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918252    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 21:05:52.918376 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918255    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 21:05:52.918376 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918258    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 21:05:52.918376 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918261    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 21:05:52.918376 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918265    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 21:05:52.918376 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918268    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 21:05:52.918376 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918273    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 21:05:52.918376 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918277    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 21:05:52.918376 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918281    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 21:05:52.918376 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918284    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 21:05:52.918376 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918287    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 21:05:52.918376 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918290    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 21:05:52.918376 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918293    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 21:05:52.918376 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918295    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 21:05:52.918376 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918298    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 21:05:52.918376 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918301    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 21:05:52.918376 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918304    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 21:05:52.918376 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918307    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 21:05:52.918870 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918310    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 21:05:52.918870 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918312    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 21:05:52.918870 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918315    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 21:05:52.918870 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918318    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 21:05:52.918870 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918321    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 21:05:52.918870 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918323    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 21:05:52.918870 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918326    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 21:05:52.918870 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918328    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 21:05:52.918870 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918331    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 21:05:52.918870 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918334    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 21:05:52.918870 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918336    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 21:05:52.918870 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918339    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 21:05:52.918870 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918341    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 21:05:52.918870 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918345    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 21:05:52.918870 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918348    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 21:05:52.918870 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918350    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 21:05:52.918870 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918353    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 21:05:52.918870 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918356    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 21:05:52.918870 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918358    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 21:05:52.918870 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918361    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 21:05:52.919555 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918364    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 21:05:52.919555 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918367    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 21:05:52.919555 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918370    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 21:05:52.919555 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918372    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 21:05:52.919555 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918375    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 21:05:52.919555 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918380    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 21:05:52.919555 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918384    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 21:05:52.919555 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918387    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 21:05:52.919555 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918391    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 21:05:52.919555 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918394    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 21:05:52.919555 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918396    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 21:05:52.919555 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918399    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 21:05:52.919555 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918402    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 21:05:52.919555 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918404    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 21:05:52.919555 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918409    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 21:05:52.919555 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918412    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 21:05:52.919555 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918415    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 21:05:52.919555 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918418    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 21:05:52.919555 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918420    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 21:05:52.920182 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918423    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 21:05:52.920182 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918426    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 21:05:52.920182 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918428    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 21:05:52.920182 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918431    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 21:05:52.920182 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918434    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 21:05:52.920182 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918437    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 21:05:52.920182 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918440    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 21:05:52.920182 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918443    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 21:05:52.920182 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918446    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 21:05:52.920182 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918448    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 21:05:52.920182 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918452    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 21:05:52.920182 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918455    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 21:05:52.920182 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918458    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 21:05:52.920182 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918461    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 21:05:52.920182 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918464    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 21:05:52.920182 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918467    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 21:05:52.920182 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918469    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 21:05:52.920182 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918472    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 21:05:52.920182 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918474    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 21:05:52.920719 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918477    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 21:05:52.920719 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918479    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 21:05:52.920719 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918482    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 21:05:52.920719 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918485    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 21:05:52.920719 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918487    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 21:05:52.920719 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918490    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 21:05:52.920719 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918492    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 21:05:52.920719 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918495    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 21:05:52.920719 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918497    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 21:05:52.920719 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918500    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 21:05:52.920719 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918503    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 21:05:52.920719 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918505    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 21:05:52.920719 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918508    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 21:05:52.920719 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918510    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 21:05:52.920719 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918513    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 21:05:52.920719 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918515    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 21:05:52.920719 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.918518    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 21:05:52.921535 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921513    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 21:05:52.921535 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921535    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 21:05:52.921592 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921539    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 21:05:52.921592 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921542    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 21:05:52.921592 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921547    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 21:05:52.921592 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921551    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 21:05:52.921592 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921557    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 21:05:52.921592 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921561    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 21:05:52.921592 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921565    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 21:05:52.921592 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921568    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 21:05:52.921592 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921571    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 21:05:52.921592 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921574    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 21:05:52.921592 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921577    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 21:05:52.921592 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921580    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 21:05:52.921592 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921583    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 21:05:52.921592 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921585    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 21:05:52.921592 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921588    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 21:05:52.921592 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921591    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 21:05:52.921592 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921594    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 21:05:52.921592 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921596    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 21:05:52.921592 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921599    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 21:05:52.922098 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921603    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 21:05:52.922098 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921606    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 21:05:52.922098 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921608    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 21:05:52.922098 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921612    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 21:05:52.922098 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921614    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 21:05:52.922098 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921617    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 21:05:52.922098 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921620    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 21:05:52.922098 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921622    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 21:05:52.922098 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921625    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 21:05:52.922098 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921627    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 21:05:52.922098 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921631    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 21:05:52.922098 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921634    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 21:05:52.922098 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921636    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 21:05:52.922098 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921639    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 21:05:52.922098 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921643    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 21:05:52.922098 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921647    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 21:05:52.922098 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921650    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 21:05:52.922098 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921653    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 21:05:52.922098 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921655    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 21:05:52.922561 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921676    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 21:05:52.922561 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921679    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 21:05:52.922561 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921682    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 21:05:52.922561 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921685    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 21:05:52.922561 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921687    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 21:05:52.922561 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921690    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 21:05:52.922561 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921692    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 21:05:52.922561 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921695    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 21:05:52.922561 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921697    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 21:05:52.922561 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921700    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 21:05:52.922561 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921704    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 21:05:52.922561 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921707    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 21:05:52.922561 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921710    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 21:05:52.922561 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921714    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 21:05:52.922561 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921717    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 21:05:52.922561 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921720    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 21:05:52.922561 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921722    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 21:05:52.922561 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921725    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 21:05:52.922561 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921727    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 21:05:52.922561 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921730    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 21:05:52.923084 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921733    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 21:05:52.923084 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921736    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 21:05:52.923084 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921738    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 21:05:52.923084 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921741    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 21:05:52.923084 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921743    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 21:05:52.923084 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921746    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 21:05:52.923084 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921749    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 21:05:52.923084 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921754    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 21:05:52.923084 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921757    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 21:05:52.923084 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921759    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 21:05:52.923084 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921762    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 21:05:52.923084 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921764    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 21:05:52.923084 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921767    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 21:05:52.923084 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921769    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 21:05:52.923084 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921772    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 21:05:52.923084 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921774    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 21:05:52.923084 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921777    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 21:05:52.923084 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921779    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 21:05:52.923084 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921782    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 21:05:52.923084 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921784    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 21:05:52.923580 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921787    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 21:05:52.923580 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921789    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 21:05:52.923580 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921792    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 21:05:52.923580 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921804    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 21:05:52.923580 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921806    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 21:05:52.923580 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921810    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 21:05:52.923580 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921813    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 21:05:52.923580 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921816    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 21:05:52.923580 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921818    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 21:05:52.923580 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921821    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 21:05:52.923580 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921824    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 21:05:52.923580 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921826    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 21:05:52.923580 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921829    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 21:05:52.923580 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921831    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 21:05:52.923580 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921834    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 21:05:52.923580 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921837    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 21:05:52.923580 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921839    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 21:05:52.923580 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921842    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 21:05:52.923580 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.921844    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 21:05:52.923580 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922273    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 21:05:52.924104 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922278    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 21:05:52.924104 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922281    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 21:05:52.924104 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922284    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 21:05:52.924104 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922287    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 21:05:52.924104 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922290    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 21:05:52.924104 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922292    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 21:05:52.924104 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922295    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 21:05:52.924104 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922298    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 21:05:52.924104 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922301    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 21:05:52.924104 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922303    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 21:05:52.924104 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922306    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 21:05:52.924104 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922309    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 21:05:52.924104 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922311    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 21:05:52.924104 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922314    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 21:05:52.924104 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922316    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 21:05:52.924104 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922320    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 21:05:52.924104 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922322    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 21:05:52.924104 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922325    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 21:05:52.924104 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922329    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 21:05:52.924104 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922332    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 21:05:52.924617 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922334    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 21:05:52.924617 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922337    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 21:05:52.924617 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922340    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 21:05:52.924617 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922342    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 21:05:52.924617 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922345    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 21:05:52.924617 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922347    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 21:05:52.924617 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922350    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 21:05:52.924617 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922352    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 21:05:52.924617 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922355    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 21:05:52.924617 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922358    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 21:05:52.924617 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922360    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 21:05:52.924617 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922363    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 21:05:52.924617 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922365    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 21:05:52.924617 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922368    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 21:05:52.924617 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922370    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 21:05:52.924617 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922372    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 21:05:52.924617 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922375    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 21:05:52.924617 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922377    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 21:05:52.924617 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922380    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 21:05:52.925114 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922383    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 21:05:52.925114 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922385    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 21:05:52.925114 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922388    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 21:05:52.925114 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922391    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 21:05:52.925114 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922394    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 21:05:52.925114 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922396    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 21:05:52.925114 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922398    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 21:05:52.925114 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922401    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 21:05:52.925114 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922403    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 21:05:52.925114 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922407    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 21:05:52.925114 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922409    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 21:05:52.925114 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922413    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 21:05:52.925114 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922416    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 21:05:52.925114 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922418    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 21:05:52.925114 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922423    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 21:05:52.925114 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922427    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 21:05:52.925114 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922430    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 21:05:52.925114 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922433    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 21:05:52.925114 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922436    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 21:05:52.925626 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922438    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 21:05:52.925626 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922441    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 21:05:52.925626 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922443    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 21:05:52.925626 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922446    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 21:05:52.925626 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922448    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 21:05:52.925626 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922451    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 21:05:52.925626 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922453    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 21:05:52.925626 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922456    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 21:05:52.925626 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922458    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 21:05:52.925626 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922461    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 21:05:52.925626 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922464    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 21:05:52.925626 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922466    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 21:05:52.925626 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922468    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 21:05:52.925626 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922471    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 21:05:52.925626 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922474    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 21:05:52.925626 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922477    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 21:05:52.925626 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922479    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 21:05:52.925626 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922482    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 21:05:52.925626 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922485    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 21:05:52.925626 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922487    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 21:05:52.926154 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922490    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 21:05:52.926154 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922492    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 21:05:52.926154 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922495    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 21:05:52.926154 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922498    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 21:05:52.926154 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922501    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 21:05:52.926154 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922504    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 21:05:52.926154 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922507    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 21:05:52.926154 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922510    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 21:05:52.926154 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922512    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 21:05:52.926154 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922515    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 21:05:52.926154 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922518    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 21:05:52.926154 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922521    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 21:05:52.926154 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922525    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 21:05:52.926154 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922529    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 21:05:52.926154 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922532    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 21:05:52.926154 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922535    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 21:05:52.926154 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922538    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 21:05:52.926154 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922540    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 21:05:52.926154 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922544    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 21:05:52.926616 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.922547    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 21:05:52.926616 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922630    2560 flags.go:64] FLAG: --address="0.0.0.0"
Sep 11 21:05:52.926616 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922689    2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 11 21:05:52.926616 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922697    2560 flags.go:64] FLAG: --anonymous-auth="true"
Sep 11 21:05:52.926616 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922702    2560 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 11 21:05:52.926616 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922706    2560 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 11 21:05:52.926616 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922710    2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 11 21:05:52.926616 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922716    2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 11 21:05:52.926616 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922726    2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 11 21:05:52.926616 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922730    2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 11 21:05:52.926616 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922733    2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 11 21:05:52.926616 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922737    2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 11 21:05:52.926616 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922740    2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 11 21:05:52.926616 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922744    2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 11 21:05:52.926616 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922747    2560 flags.go:64] FLAG: --cgroup-root=""
Sep 11 21:05:52.926616 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922750    2560 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 11 21:05:52.926616 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922753    2560 flags.go:64] FLAG: --client-ca-file=""
Sep 11 21:05:52.926616 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922758    2560 flags.go:64] FLAG: --cloud-provider="external"
Sep 11 21:05:52.926616 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922761    2560 flags.go:64] FLAG: --cluster-dns="[]"
Sep 11 21:05:52.926616 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922766    2560 flags.go:64] FLAG: --cluster-domain=""
Sep 11 21:05:52.926616 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922769    2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 11 21:05:52.926616 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922773    2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 11 21:05:52.926616 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922776    2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 11 21:05:52.927197 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922787    2560 flags.go:64] FLAG: --container-log-max-files="5"
Sep 11 21:05:52.927197 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922791    2560 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 11 21:05:52.927197 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922794    2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 11 21:05:52.927197 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922798    2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 11 21:05:52.927197 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922801    2560 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 11 21:05:52.927197 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922805    2560 flags.go:64] FLAG: --contention-profiling="false"
Sep 11 21:05:52.927197 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922808    2560 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 11 21:05:52.927197 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922811    2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 11 21:05:52.927197 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922814    2560 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 11 21:05:52.927197 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922817    2560 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 11 21:05:52.927197 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922822    2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 11 21:05:52.927197 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922825    2560 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 11 21:05:52.927197 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922828    2560 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 11 21:05:52.927197 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922831    2560 flags.go:64] FLAG: --enable-load-reader="false"
Sep 11 21:05:52.927197 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922834    2560 flags.go:64] FLAG: --enable-server="true"
Sep 11 21:05:52.927197 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922837    2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 11 21:05:52.927197 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922842    2560 flags.go:64] FLAG: --event-burst="100"
Sep 11 21:05:52.927197 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922846    2560 flags.go:64] FLAG: --event-qps="50"
Sep 11 21:05:52.927197 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922849    2560 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 11 21:05:52.927197 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922852    2560 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 11 21:05:52.927197 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922855    2560 flags.go:64] FLAG: --eviction-hard=""
Sep 11 21:05:52.927197 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922859    2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 11 21:05:52.927197 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922863    2560 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 11 21:05:52.927197 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922866    2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 11 21:05:52.927197 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922869    2560 flags.go:64] FLAG: --eviction-soft=""
Sep 11 21:05:52.927813 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922872    2560 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 11 21:05:52.927813 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922875    2560 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 11 21:05:52.927813 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922879    2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 11 21:05:52.927813 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922882    2560 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 11 21:05:52.927813 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922885    2560 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 11 21:05:52.927813 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922888    2560 flags.go:64] FLAG: --fail-swap-on="true"
Sep 11 21:05:52.927813 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922891    2560 flags.go:64] FLAG: --feature-gates=""
Sep 11 21:05:52.927813 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922896    2560 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 11 21:05:52.927813 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922900    2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 11 21:05:52.927813 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922904    2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 11 21:05:52.927813 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922907    2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 11 21:05:52.927813 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922910    2560 flags.go:64] FLAG: --healthz-port="10248"
Sep 11 21:05:52.927813 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922914    2560 flags.go:64] FLAG: --help="false"
Sep 11 21:05:52.927813 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922917    2560 flags.go:64] FLAG: --hostname-override="ip-10-0-137-163.ec2.internal"
Sep 11 21:05:52.927813 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922920    2560 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 11 21:05:52.927813 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922923    2560 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 11 21:05:52.927813 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922926    2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 11 21:05:52.927813 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922930    2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 11 21:05:52.927813 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922934    2560 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 11 21:05:52.927813 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922937    2560 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 11 21:05:52.927813 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922939    2560 flags.go:64] FLAG: --image-service-endpoint=""
Sep 11 21:05:52.927813 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922942    2560 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 11 21:05:52.927813 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922945    2560 flags.go:64] FLAG: --kube-api-burst="100"
Sep 11 21:05:52.928448 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922949    2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 11 21:05:52.928448 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922952    2560 flags.go:64] FLAG: --kube-api-qps="50"
Sep 11 21:05:52.928448 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922955    2560 flags.go:64] FLAG: --kube-reserved=""
Sep 11 21:05:52.928448 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922958    2560 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 11 21:05:52.928448 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922964    2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 11 21:05:52.928448 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922968    2560 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 11 21:05:52.928448 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922971    2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 11 21:05:52.928448 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922974    2560 flags.go:64] FLAG: --lock-file=""
Sep 11 21:05:52.928448 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922977    2560 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 11 21:05:52.928448 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922980    2560 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 11 21:05:52.928448 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922983    2560 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 11 21:05:52.928448 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922989    2560 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 11 21:05:52.928448 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922992    2560 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 11 21:05:52.928448 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922995    2560 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 11 21:05:52.928448 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.922998    2560 flags.go:64] FLAG: --logging-format="text"
Sep 11 21:05:52.928448 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923001    2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 11 21:05:52.928448 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923006    2560 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 11 21:05:52.928448 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923009    2560 flags.go:64] FLAG: --manifest-url=""
Sep 11 21:05:52.928448 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923012    2560 flags.go:64] FLAG: --manifest-url-header=""
Sep 11 21:05:52.928448 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923017    2560 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 11 21:05:52.928448 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923020    2560 flags.go:64] FLAG: --max-open-files="1000000"
Sep 11 21:05:52.928448 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923025    2560 flags.go:64] FLAG: --max-pods="110"
Sep 11 21:05:52.928448 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923028    2560 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 11 21:05:52.928448 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923031    2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 11 21:05:52.928448 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923034    2560 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 11 21:05:52.929149 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923037    2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 11 21:05:52.929149 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923040    2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 11 21:05:52.929149 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923043    2560 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 11 21:05:52.929149 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923046    2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 11 21:05:52.929149 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923054    2560 flags.go:64] FLAG: --node-status-max-images="50"
Sep 11 21:05:52.929149 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923057    2560 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 11 21:05:52.929149 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923060    2560 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 11 21:05:52.929149 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923063    2560 flags.go:64] FLAG: --pod-cidr=""
Sep 11 21:05:52.929149 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923066    2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 11 21:05:52.929149 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923072    2560 flags.go:64] FLAG: --pod-manifest-path=""
Sep 11 21:05:52.929149 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923075    2560 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 11 21:05:52.929149 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923078    2560 flags.go:64] FLAG: --pods-per-core="0"
Sep 11 21:05:52.929149 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923083    2560 flags.go:64] FLAG: --port="10250"
Sep 11 21:05:52.929149 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923086    2560 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 11 21:05:52.929149 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923089    2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08eaae7190c7bfda3"
Sep 11 21:05:52.929149 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923093    2560 flags.go:64] FLAG: --qos-reserved=""
Sep 11 21:05:52.929149 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923096    2560 flags.go:64] FLAG: --read-only-port="10255"
Sep 11 21:05:52.929149 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923099    2560 flags.go:64] FLAG: --register-node="true"
Sep 11 21:05:52.929149 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923102    2560 flags.go:64] FLAG: --register-with-taints=""
Sep 11 21:05:52.929149 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923106    2560 flags.go:64] FLAG: --registry-burst="10"
Sep 11 21:05:52.929149 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923110    2560 flags.go:64] FLAG: --registry-qps="5"
Sep 11 21:05:52.929149 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923113    2560 flags.go:64] FLAG: --reserved-cpus=""
Sep 11 21:05:52.929149 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923116    2560 flags.go:64] FLAG: --reserved-memory=""
Sep 11 21:05:52.929149 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923122    2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 11 21:05:52.929149 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923125    2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 11 21:05:52.929800 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923128    2560 flags.go:64] FLAG: --rotate-certificates="false"
Sep 11 21:05:52.929800 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923131    2560 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 11 21:05:52.929800 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923133    2560 flags.go:64] FLAG: --runonce="false"
Sep 11 21:05:52.929800 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923136    2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 11 21:05:52.929800 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923140    2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 11 21:05:52.929800 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923143    2560 flags.go:64] FLAG: --seccomp-default="false"
Sep 11 21:05:52.929800 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923145    2560 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 11 21:05:52.929800 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923148    2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 11 21:05:52.929800 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923151    2560 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 11 21:05:52.929800 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923155    2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 11 21:05:52.929800 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923158    2560 flags.go:64] FLAG: --storage-driver-password="root"
Sep 11 21:05:52.929800 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923161    2560 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 11 21:05:52.929800 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923164    2560 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 11 21:05:52.929800 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923167    2560 flags.go:64] FLAG: --storage-driver-user="root"
Sep 11 21:05:52.929800 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923169    2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 11 21:05:52.929800 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923172    2560 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 11 21:05:52.929800 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923175    2560 flags.go:64] FLAG: --system-cgroups=""
Sep 11 21:05:52.929800 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923178    2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 11 21:05:52.929800 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923183    2560 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 11 21:05:52.929800 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923188    2560 flags.go:64] FLAG: --tls-cert-file=""
Sep 11 21:05:52.929800 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923191    2560 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 11 21:05:52.929800 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923196    2560 flags.go:64] FLAG: --tls-min-version=""
Sep 11 21:05:52.929800 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923198    2560 flags.go:64] FLAG: --tls-private-key-file=""
Sep 11 21:05:52.929800 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923201    2560 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 11 21:05:52.929800 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923204    2560 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 11 21:05:52.930422 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923207    2560 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 11 21:05:52.930422 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923211    2560 flags.go:64] FLAG: --v="2"
Sep 11 21:05:52.930422 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923215    2560 flags.go:64] FLAG: --version="false"
Sep 11 21:05:52.930422 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923220    2560 flags.go:64] FLAG: --vmodule=""
Sep 11 21:05:52.930422 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923225    2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 11 21:05:52.930422 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.923229    2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 11 21:05:52.930422 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923372    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 21:05:52.930422 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923377    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 21:05:52.930422 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923380    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 21:05:52.930422 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923383    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 21:05:52.930422 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923386    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 21:05:52.930422 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923389    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 21:05:52.930422 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923392    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 21:05:52.930422 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923395    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 21:05:52.930422 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923398    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 21:05:52.930422 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923400    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 21:05:52.930422 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923403    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 21:05:52.930422 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923406    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 21:05:52.930422 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923408    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 21:05:52.930422 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923411    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 21:05:52.930938 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923414    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 21:05:52.930938 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923416    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 21:05:52.930938 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923419    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 21:05:52.930938 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923422    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 21:05:52.930938 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923424    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 21:05:52.930938 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923427    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 21:05:52.930938 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923436    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 21:05:52.930938 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923439    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 21:05:52.930938 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923441    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 21:05:52.930938 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923444    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 21:05:52.930938 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923447    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 21:05:52.930938 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923450    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 21:05:52.930938 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923452    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 21:05:52.930938 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923455    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 21:05:52.930938 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923458    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 21:05:52.930938 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923460    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 21:05:52.930938 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923464    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 21:05:52.930938 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923468    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 21:05:52.930938 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923470    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 21:05:52.930938 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923473    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 21:05:52.931507 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923476    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 21:05:52.931507 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923478    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 21:05:52.931507 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923481    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 21:05:52.931507 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923484    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 21:05:52.931507 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923486    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 21:05:52.931507 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923489    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 21:05:52.931507 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923492    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 21:05:52.931507 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923494    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 21:05:52.931507 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923497    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 21:05:52.931507 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923500    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 21:05:52.931507 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923503    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 21:05:52.931507 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923506    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 21:05:52.931507 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923509    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 21:05:52.931507 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923511    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 21:05:52.931507 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923514    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 21:05:52.931507 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923516    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 21:05:52.931507 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923519    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 21:05:52.931507 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923522    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 21:05:52.931507 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923526    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 21:05:52.931507 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923529    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 21:05:52.932042 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923533    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 21:05:52.932042 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923537    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 21:05:52.932042 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923540    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 21:05:52.932042 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923543    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 21:05:52.932042 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923545    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 21:05:52.932042 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923548    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 21:05:52.932042 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923551    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 21:05:52.932042 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923554    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 21:05:52.932042 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923557    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 21:05:52.932042 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923561    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 21:05:52.932042 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923564    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 21:05:52.932042 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923567    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 21:05:52.932042 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923570    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 21:05:52.932042 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923572    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 21:05:52.932042 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923575    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 21:05:52.932042 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923577    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 21:05:52.932042 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923580    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 21:05:52.932042 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923583    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 21:05:52.932042 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923587    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 21:05:52.932545 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923591    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 21:05:52.932545 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923594    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 21:05:52.932545 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923597    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 21:05:52.932545 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923600    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 21:05:52.932545 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923602    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 21:05:52.932545 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923605    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 21:05:52.932545 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923608    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 21:05:52.932545 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923610    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 21:05:52.932545 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923613    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 21:05:52.932545 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923616    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 21:05:52.932545 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923618    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 21:05:52.932545 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923622    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 21:05:52.932545 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923625    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 21:05:52.932545 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923628    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 21:05:52.932545 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923631    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 21:05:52.932545 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923633    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 21:05:52.932545 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923636    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 21:05:52.932545 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923638    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 21:05:52.932545 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923641    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 21:05:52.932545 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923643    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 21:05:52.933113 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923648    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 21:05:52.933113 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923651    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 21:05:52.933113 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923655    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 21:05:52.933113 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923675    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 21:05:52.933113 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923680    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 21:05:52.933113 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.923683    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 21:05:52.933113 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.924258    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 21:05:52.933440 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.933411    2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 11 21:05:52.933476 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.933441    2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 11 21:05:52.934278 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.934266    2560 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 11 21:05:52.934313 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.934278    2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 11 21:05:52.934355 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934346    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 21:05:52.934355 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934355    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 21:05:52.934413 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934359    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 21:05:52.934413 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934363    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 21:05:52.934413 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934366    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 21:05:52.934413 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934369    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 21:05:52.934413 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934372    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 21:05:52.934413 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934376    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 21:05:52.934413 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934379    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 21:05:52.934413 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934382    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 21:05:52.934413 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934385    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 21:05:52.934413 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934388    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 21:05:52.934413 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934390    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 21:05:52.934413 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934393    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 21:05:52.934413 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934396    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 21:05:52.934413 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934398    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 21:05:52.934413 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934402    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 21:05:52.934413 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934405    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 21:05:52.934413 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934407    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 21:05:52.934413 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934410    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 21:05:52.934413 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934414    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 21:05:52.934413 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934417    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 21:05:52.934922 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934420    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 21:05:52.934922 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934423    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 21:05:52.934922 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934427    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 21:05:52.934922 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934430    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 21:05:52.934922 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934433    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 21:05:52.934922 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934435    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 21:05:52.934922 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934438    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 21:05:52.934922 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934441    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 21:05:52.934922 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934443    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 21:05:52.934922 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934446    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 21:05:52.934922 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934448    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 21:05:52.934922 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934451    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 21:05:52.934922 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934455    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 21:05:52.934922 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934460    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 21:05:52.934922 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934463    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 21:05:52.934922 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934465    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 21:05:52.934922 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934468    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 21:05:52.934922 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934471    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 21:05:52.934922 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934475    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 21:05:52.934922 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934477    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 21:05:52.935425 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934480    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 21:05:52.935425 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934483    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 21:05:52.935425 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934485    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 21:05:52.935425 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934488    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 21:05:52.935425 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934491    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 21:05:52.935425 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934494    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 21:05:52.935425 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934498    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 21:05:52.935425 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934501    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 21:05:52.935425 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934504    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 21:05:52.935425 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934507    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 21:05:52.935425 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934509    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 21:05:52.935425 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934513    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 21:05:52.935425 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934515    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 21:05:52.935425 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934519    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 21:05:52.935425 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934524    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 21:05:52.935425 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934528    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 21:05:52.935425 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934533    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 21:05:52.935425 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934536    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 21:05:52.935425 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934539    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 21:05:52.935425 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934541    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 21:05:52.935936 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934544    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 21:05:52.935936 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934547    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 21:05:52.935936 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934550    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 21:05:52.935936 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934553    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 21:05:52.935936 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934555    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 21:05:52.935936 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934558    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 21:05:52.935936 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934560    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 21:05:52.935936 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934563    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 21:05:52.935936 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934565    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 21:05:52.935936 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934568    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 21:05:52.935936 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934570    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 21:05:52.935936 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934573    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 21:05:52.935936 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934576    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 21:05:52.935936 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934579    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 21:05:52.935936 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934581    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 21:05:52.935936 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934584    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 21:05:52.935936 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934587    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 21:05:52.935936 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934590    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 21:05:52.935936 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934593    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 21:05:52.936410 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934595    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 21:05:52.936410 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934598    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 21:05:52.936410 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934601    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 21:05:52.936410 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934603    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 21:05:52.936410 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934607    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 21:05:52.936410 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934610    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 21:05:52.936410 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934613    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 21:05:52.936410 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934615    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 21:05:52.936410 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934618    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 21:05:52.936410 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934622    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 21:05:52.936410 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934624    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 21:05:52.936410 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934627    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 21:05:52.936410 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934630    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 21:05:52.936410 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934633    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 21:05:52.936410 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934636    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 21:05:52.936410 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934638    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 21:05:52.936410 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934641    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 21:05:52.936410 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934643    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 21:05:52.936965 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.934648    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 21:05:52.936965 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934791    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 21:05:52.936965 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934796    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 21:05:52.936965 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934799    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 21:05:52.936965 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934802    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 21:05:52.936965 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934804    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 21:05:52.936965 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934807    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 21:05:52.936965 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934810    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 21:05:52.936965 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934813    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 21:05:52.936965 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934816    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 21:05:52.936965 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934818    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 21:05:52.936965 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934821    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 21:05:52.936965 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934823    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 21:05:52.936965 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934827    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 21:05:52.936965 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934830    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 21:05:52.937350 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934832    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 21:05:52.937350 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934835    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 21:05:52.937350 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934838    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 21:05:52.937350 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934842    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 21:05:52.937350 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934845    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 21:05:52.937350 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934848    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 21:05:52.937350 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934851    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 21:05:52.937350 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934854    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 21:05:52.937350 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934857    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 21:05:52.937350 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934860    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 21:05:52.937350 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934862    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 21:05:52.937350 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934865    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 21:05:52.937350 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934867    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 21:05:52.937350 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934870    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 21:05:52.937350 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934872    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 21:05:52.937350 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934875    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 21:05:52.937350 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934877    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 21:05:52.937350 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934880    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 21:05:52.937350 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934882    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 21:05:52.937350 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934885    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 21:05:52.937863 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934887    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 21:05:52.937863 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934890    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 21:05:52.937863 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934892    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 21:05:52.937863 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934895    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 21:05:52.937863 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934898    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 21:05:52.937863 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934902    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 21:05:52.937863 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934905    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 21:05:52.937863 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934909    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 21:05:52.937863 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934912    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 21:05:52.937863 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934915    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 21:05:52.937863 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934918    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 21:05:52.937863 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934921    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 21:05:52.937863 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934924    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 21:05:52.937863 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934926    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 21:05:52.937863 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934930    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 21:05:52.937863 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934932    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 21:05:52.937863 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934937    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 21:05:52.937863 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934940    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 21:05:52.937863 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934943    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 21:05:52.938339 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934946    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 21:05:52.938339 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934949    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 21:05:52.938339 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934952    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 21:05:52.938339 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934956    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 21:05:52.938339 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934959    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 21:05:52.938339 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934962    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 21:05:52.938339 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934965    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 21:05:52.938339 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934967    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 21:05:52.938339 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934970    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 21:05:52.938339 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934973    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 21:05:52.938339 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934975    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 21:05:52.938339 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934978    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 21:05:52.938339 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934981    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 21:05:52.938339 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934983    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 21:05:52.938339 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934986    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 21:05:52.938339 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934989    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 21:05:52.938339 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934991    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 21:05:52.938339 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934994    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 21:05:52.938339 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.934996    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 21:05:52.938816 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.935000    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 21:05:52.938816 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.935002    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 21:05:52.938816 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.935005    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 21:05:52.938816 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.935008    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 21:05:52.938816 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.935011    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 21:05:52.938816 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.935015    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 21:05:52.938816 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.935017    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 21:05:52.938816 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.935020    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 21:05:52.938816 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.935022    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 21:05:52.938816 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.935025    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 21:05:52.938816 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.935027    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 21:05:52.938816 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.935030    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 21:05:52.938816 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.935033    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 21:05:52.938816 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.935035    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 21:05:52.938816 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.935038    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 21:05:52.938816 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.935040    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 21:05:52.938816 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.935043    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 21:05:52.938816 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.935046    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 21:05:52.938816 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.935048    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 21:05:52.938816 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.935051    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 21:05:52.939341 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.935054    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 21:05:52.939341 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.935056    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 21:05:52.939341 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.935059    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 21:05:52.939341 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.935062    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 21:05:52.939341 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.935064    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 21:05:52.939341 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.935067    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 21:05:52.939341 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:52.935069    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 21:05:52.939341 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.935075    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 21:05:52.939341 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.935215    2560 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 11 21:05:52.977647 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.977619    2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 11 21:05:52.978656 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.978640    2560 server.go:1019] "Starting client certificate rotation"
Sep 11 21:05:52.978798 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.978775    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 21:05:52.978871 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.978829    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 21:05:52.981146 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.981123    2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 21:05:52.982396 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.982370    2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 21:05:52.995152 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.995126    2560 log.go:25] "Validated CRI v1 runtime API"
Sep 11 21:05:52.998813 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.998783    2560 log.go:25] "Validated CRI v1 image API"
Sep 11 21:05:52.999713 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:52.999692    2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 11 21:05:53.004383 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.004355    2560 fs.go:135] Filesystem UUIDs: map[6d618a66-c8fa-41ed-9092-1aae431256d6:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 abe3a3b1-b0f9-4915-9445-7ae30566964c:/dev/nvme0n1p3]
Sep 11 21:05:53.004383 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.004378    2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 11 21:05:53.008903 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.008774    2560 manager.go:216] Machine: {Timestamp:2026-09-11 21:05:53.008174247 +0000 UTC m=+0.402209131 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:2965284 MemoryCapacity:33164472320 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e4b5622620cb84368eebd566b0d89 SystemUUID:ec2e4b56-2262-0cb8-4368-eebd566b0d89 BootID:aab063c3-52f5-4d2f-ba62-e2cf7f90f15b Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582234112 Type:vfs Inodes:4048397 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:38:27:94:f3:eb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:38:27:94:f3:eb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:16:d1:7d:83:9a:4d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164472320 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 11 21:05:53.008903 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.008892    2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 11 21:05:53.009038 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.008993    2560 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 11 21:05:53.009272 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.009252    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 21:05:53.011680 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.011632    2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 11 21:05:53.011846 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.011684    2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-163.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 11 21:05:53.013040 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.013023    2560 topology_manager.go:138] "Creating topology manager with none policy"
Sep 11 21:05:53.013079 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.013041    2560 container_manager_linux.go:309] "Creating device plugin manager"
Sep 11 21:05:53.013079 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.013050    2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 21:05:53.014188 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.014172    2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 21:05:53.014974 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.014960    2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 11 21:05:53.018476 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.018458    2560 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 21:05:53.018625 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.018614    2560 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 11 21:05:53.018672 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.018647    2560 kubelet.go:486] "Attempting to sync node with API server"
Sep 11 21:05:53.018710 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.018672    2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 11 21:05:53.018710 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.018693    2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 11 21:05:53.018710 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.018706    2560 kubelet.go:398] "Adding apiserver pod source"
Sep 11 21:05:53.018802 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.018717    2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 11 21:05:53.019163 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.019145    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 21:05:53.019205 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.019176    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 21:05:53.021874 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.021850    2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 11 21:05:53.024384 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.024368    2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 11 21:05:53.024464 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.024401    2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 11 21:05:53.025869 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.025856    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 11 21:05:53.025921 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.025874    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 11 21:05:53.025921 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.025880    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 11 21:05:53.025921 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.025886    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 11 21:05:53.025921 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.025895    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 11 21:05:53.025921 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.025901    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 11 21:05:53.025921 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.025916    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 11 21:05:53.025921 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.025922    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 11 21:05:53.026106 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.025929    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 11 21:05:53.026106 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.025935    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 11 21:05:53.026106 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.025944    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 11 21:05:53.026106 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.025950    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 11 21:05:53.027749 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.027736    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 11 21:05:53.027749 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.027752    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 11 21:05:53.029120 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:53.029076    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 11 21:05:53.029120 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:53.029076    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-163.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 11 21:05:53.031734 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.031704    2560 server.go:1268] "Started kubelet"
Sep 11 21:05:53.031837 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.031788    2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 11 21:05:53.031895 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.031827    2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 11 21:05:53.031962 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.031933    2560 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 11 21:05:53.032716 ip-10-0-137-163 systemd[1]: Started Kubernetes Kubelet.
Sep 11 21:05:53.034205 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.034180    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-163.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 11 21:05:53.034549 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.034521    2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 11 21:05:53.035475 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.035460    2560 server.go:310] "Adding debug handlers to kubelet server"
Sep 11 21:05:53.036397 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.036375    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rm66h"
Sep 11 21:05:53.037623 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:53.037604    2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 11 21:05:53.040913 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.040878    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 11 21:05:53.042032 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.041959    2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 11 21:05:53.042383 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:53.042344    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-163.ec2.internal\" not found"
Sep 11 21:05:53.043067 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.043042    2560 factory.go:55] Registering systemd factory
Sep 11 21:05:53.043067 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.043063    2560 factory.go:223] Registration of the systemd container factory successfully
Sep 11 21:05:53.043197 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.043069    2560 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 11 21:05:53.043197 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.043087    2560 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 11 21:05:53.043197 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.043071    2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 11 21:05:53.043330 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.043210    2560 reconstruct.go:97] "Volume reconstruction finished"
Sep 11 21:05:53.043330 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.043218    2560 reconciler.go:29] "Reconciler: start to sync state"
Sep 11 21:05:53.043330 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.043312    2560 factory.go:153] Registering CRI-O factory
Sep 11 21:05:53.043330 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.043328    2560 factory.go:223] Registration of the crio container factory successfully
Sep 11 21:05:53.043509 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.043390    2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 11 21:05:53.043509 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.043410    2560 factory.go:103] Registering Raw factory
Sep 11 21:05:53.043509 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.043427    2560 manager.go:1196] Started watching for new ooms in manager
Sep 11 21:05:53.043881 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.043864    2560 manager.go:349] Starting recovery of all containers
Sep 11 21:05:53.045199 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:53.042195    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-163.ec2.internal.18d46039ba85b302  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-163.ec2.internal,UID:ip-10-0-137-163.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-163.ec2.internal,},FirstTimestamp:2026-09-11 21:05:53.031656194 +0000 UTC m=+0.425691078,LastTimestamp:2026-09-11 21:05:53.031656194 +0000 UTC m=+0.425691078,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-163.ec2.internal,}"
Sep 11 21:05:53.045755 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.045726    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rm66h"
Sep 11 21:05:53.053260 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:53.053225    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-163.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 11 21:05:53.053260 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:53.053241    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 11 21:05:53.056266 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.056240    2560 manager.go:354] Recovery completed
Sep 11 21:05:53.061395 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.061375    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 21:05:53.063413 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.063391    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-163.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 21:05:53.063510 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.063427    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-163.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 21:05:53.063510 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.063442    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-163.ec2.internal" event="NodeHasSufficientPID"
Sep 11 21:05:53.064126 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.064111    2560 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 11 21:05:53.064126 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.064125    2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 11 21:05:53.064268 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.064117    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 21:05:53.064268 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.064145    2560 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 21:05:53.065084 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.065070    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-163.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 21:05:53.065145 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.065101    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-163.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 21:05:53.065145 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.065115    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-163.ec2.internal" event="NodeHasSufficientPID"
Sep 11 21:05:53.065912 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.065898    2560 policy_none.go:49] "None policy: Start"
Sep 11 21:05:53.065951 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.065917    2560 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 11 21:05:53.065951 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.065928    2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 11 21:05:53.067604 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.067590    2560 policy_none.go:47] "Start"
Sep 11 21:05:53.102435 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.102416    2560 manager.go:337] "Starting Device Plugin manager"
Sep 11 21:05:53.125274 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:53.102487    2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 11 21:05:53.125274 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.102501    2560 server.go:87] "Starting device plugin registration server"
Sep 11 21:05:53.125274 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.102951    2560 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 11 21:05:53.125274 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.102966    2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 11 21:05:53.125274 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.103070    2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 11 21:05:53.125274 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.103163    2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 11 21:05:53.125274 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.103172    2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 11 21:05:53.125274 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:53.103806    2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 11 21:05:53.125274 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:53.103866    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-163.ec2.internal\" not found"
Sep 11 21:05:53.125274 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.113508    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 11 21:05:53.125274 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.114916    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 11 21:05:53.125274 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.114966    2560 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 11 21:05:53.125274 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.114993    2560 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 11 21:05:53.125274 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:53.115031    2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 11 21:05:53.125274 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.117279    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 21:05:53.203609 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.203501    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 21:05:53.204623 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.204603    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-163.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 21:05:53.204719 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.204640    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-163.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 21:05:53.204719 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.204650    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-163.ec2.internal" event="NodeHasSufficientPID"
Sep 11 21:05:53.204719 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.204689    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-163.ec2.internal"
Sep 11 21:05:53.211303 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.211280    2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-163.ec2.internal"
Sep 11 21:05:53.211364 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:53.211311    2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-163.ec2.internal\": node \"ip-10-0-137-163.ec2.internal\" not found"
Sep 11 21:05:53.215296 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.215270    2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-163.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-163.ec2.internal"]
Sep 11 21:05:53.215370 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.215352    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 21:05:53.216756 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.216734    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-163.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 21:05:53.216886 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.216769    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-163.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 21:05:53.216886 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.216783    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-163.ec2.internal" event="NodeHasSufficientPID"
Sep 11 21:05:53.219152 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.219132    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 21:05:53.219303 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.219286    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-163.ec2.internal"
Sep 11 21:05:53.219354 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.219334    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 21:05:53.221524 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.221187    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-163.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 21:05:53.221524 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.221226    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-163.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 21:05:53.221524 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.221248    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-163.ec2.internal" event="NodeHasSufficientPID"
Sep 11 21:05:53.221749 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.221671    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-163.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 21:05:53.221749 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.221698    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-163.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 21:05:53.221749 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.221731    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-163.ec2.internal" event="NodeHasSufficientPID"
Sep 11 21:05:53.223735 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.223715    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-163.ec2.internal"
Sep 11 21:05:53.223840 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.223752    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 21:05:53.224594 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.224568    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-163.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 21:05:53.224716 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.224608    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-163.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 21:05:53.224716 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.224623    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-163.ec2.internal" event="NodeHasSufficientPID"
Sep 11 21:05:53.231568 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:53.231542    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-163.ec2.internal\" not found"
Sep 11 21:05:53.249677 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:53.249643    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-163.ec2.internal\" not found" node="ip-10-0-137-163.ec2.internal"
Sep 11 21:05:53.254300 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:53.254281    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-163.ec2.internal\" not found" node="ip-10-0-137-163.ec2.internal"
Sep 11 21:05:53.332615 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:53.332577    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-163.ec2.internal\" not found"
Sep 11 21:05:53.344166 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.344127    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/de7ebdcdf2700e0582a4401358202032-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-163.ec2.internal\" (UID: \"de7ebdcdf2700e0582a4401358202032\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-163.ec2.internal"
Sep 11 21:05:53.344282 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.344174    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/de7ebdcdf2700e0582a4401358202032-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-163.ec2.internal\" (UID: \"de7ebdcdf2700e0582a4401358202032\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-163.ec2.internal"
Sep 11 21:05:53.344282 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:53.344205    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/75a23667c2d6b01bd21de457ebee8e0a-config\") pod \"kube-apiserver-proxy-ip-10-0-137-163.ec2.internal\" (UID: \"75a23667c2d6b01bd21de457ebee8e0a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-163.ec2.internal"
Sep 11 21:05:55.348617 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:55.348578    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-163.ec2.internal\" not found"
Sep 11 21:05:55.361002 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.360971    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/de7ebdcdf2700e0582a4401358202032-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-163.ec2.internal\" (UID: \"de7ebdcdf2700e0582a4401358202032\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-163.ec2.internal"
Sep 11 21:05:55.361091 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.361019    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/de7ebdcdf2700e0582a4401358202032-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-163.ec2.internal\" (UID: \"de7ebdcdf2700e0582a4401358202032\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-163.ec2.internal"
Sep 11 21:05:55.361091 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.361040    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/75a23667c2d6b01bd21de457ebee8e0a-config\") pod \"kube-apiserver-proxy-ip-10-0-137-163.ec2.internal\" (UID: \"75a23667c2d6b01bd21de457ebee8e0a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-163.ec2.internal"
Sep 11 21:05:55.361164 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.361091    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/75a23667c2d6b01bd21de457ebee8e0a-config\") pod \"kube-apiserver-proxy-ip-10-0-137-163.ec2.internal\" (UID: \"75a23667c2d6b01bd21de457ebee8e0a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-163.ec2.internal"
Sep 11 21:05:55.361164 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.361120    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/de7ebdcdf2700e0582a4401358202032-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-163.ec2.internal\" (UID: \"de7ebdcdf2700e0582a4401358202032\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-163.ec2.internal"
Sep 11 21:05:55.361164 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.361119    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/de7ebdcdf2700e0582a4401358202032-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-163.ec2.internal\" (UID: \"de7ebdcdf2700e0582a4401358202032\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-163.ec2.internal"
Sep 11 21:05:55.449508 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:55.449428    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-163.ec2.internal\" not found"
Sep 11 21:05:55.468055 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.468019    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-163.ec2.internal"
Sep 11 21:05:55.474124 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.474096    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-163.ec2.internal"
Sep 11 21:05:55.550026 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:55.549984    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-163.ec2.internal\" not found"
Sep 11 21:05:55.650572 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:55.650542    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-163.ec2.internal\" not found"
Sep 11 21:05:55.751270 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:55.751181    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-163.ec2.internal\" not found"
Sep 11 21:05:55.777728 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.777696    2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 21:05:55.858875 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.858833    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-163.ec2.internal"
Sep 11 21:05:55.870257 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.870228    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 21:05:55.871959 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.871941    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-163.ec2.internal"
Sep 11 21:05:55.879074 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.879047    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 21:05:55.894203 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.894176    2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 11 21:05:55.894359 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.894326    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 21:05:55.894422 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.894360    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 21:05:55.935564 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.935517    2560 apiserver.go:52] "Watching apiserver"
Sep 11 21:05:55.952851 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.952812    2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 11 21:05:55.953194 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.953170    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-rr9d4","openshift-ovn-kubernetes/ovnkube-node-qpwdk","kube-system/global-pull-secret-syncer-vxlb2","kube-system/konnectivity-agent-7d7s4","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcr9m","openshift-cluster-node-tuning-operator/tuned-9bcdv","openshift-image-registry/node-ca-b7sx4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-163.ec2.internal","openshift-multus/multus-additional-cni-plugins-v4sq2","openshift-multus/multus-xzdlq","kube-system/kube-apiserver-proxy-ip-10-0-137-163.ec2.internal","openshift-dns/node-resolver-wwnsp","openshift-multus/network-metrics-daemon-6nwfd","openshift-network-diagnostics/network-check-target-sxs24"]
Sep 11 21:05:55.955578 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.955553    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rr9d4"
Sep 11 21:05:55.956741 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.956716    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 11 21:05:55.957743 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.957720    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:55.957971 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.957893    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hx7qn\""
Sep 11 21:05:55.958277 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.958261    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 11 21:05:55.958335 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.958301    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 11 21:05:55.958554 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.958538    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 11 21:05:55.959895 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.959866    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vxlb2"
Sep 11 21:05:55.959995 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:55.959963    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vxlb2" podUID="0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc"
Sep 11 21:05:55.960284 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.960264    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 11 21:05:55.960546 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.960525    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 11 21:05:55.960940 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.960755    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 11 21:05:55.960940 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.960772    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 11 21:05:55.960940 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.960787    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 11 21:05:55.960940 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.960818    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rcb92\""
Sep 11 21:05:55.960940 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.960862    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 11 21:05:55.962138 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.962118    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7d7s4"
Sep 11 21:05:55.965095 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.964585    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/17493773-1416-44a9-8a25-b05d1daccc37-host-kubelet\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:55.965095 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.964623    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/17493773-1416-44a9-8a25-b05d1daccc37-run-systemd\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:55.965095 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.964659    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/17493773-1416-44a9-8a25-b05d1daccc37-ovnkube-script-lib\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:55.965095 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.964691    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4ktm\" (UniqueName: \"kubernetes.io/projected/17493773-1416-44a9-8a25-b05d1daccc37-kube-api-access-w4ktm\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:55.965095 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.964722    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc-dbus\") pod \"global-pull-secret-syncer-vxlb2\" (UID: \"0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc\") " pod="kube-system/global-pull-secret-syncer-vxlb2"
Sep 11 21:05:55.965095 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.964750    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5k8d\" (UniqueName: \"kubernetes.io/projected/3c8f606b-293c-477a-a7ea-62542fe22b78-kube-api-access-c5k8d\") pod \"iptables-alerter-rr9d4\" (UID: \"3c8f606b-293c-477a-a7ea-62542fe22b78\") " pod="openshift-network-operator/iptables-alerter-rr9d4"
Sep 11 21:05:55.965095 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.964778    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/17493773-1416-44a9-8a25-b05d1daccc37-host-cni-bin\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:55.965095 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.964806    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/17493773-1416-44a9-8a25-b05d1daccc37-systemd-units\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:55.965095 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.964836    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/17493773-1416-44a9-8a25-b05d1daccc37-host-slash\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:55.965095 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.964865    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/17493773-1416-44a9-8a25-b05d1daccc37-host-run-netns\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:55.965095 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.964777    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mtxvm\""
Sep 11 21:05:55.965095 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.964934    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 11 21:05:55.965095 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.964998    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/17493773-1416-44a9-8a25-b05d1daccc37-run-ovn\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:55.965095 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.965035    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/17493773-1416-44a9-8a25-b05d1daccc37-env-overrides\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:55.965095 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.965067    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3c8f606b-293c-477a-a7ea-62542fe22b78-host-slash\") pod \"iptables-alerter-rr9d4\" (UID: \"3c8f606b-293c-477a-a7ea-62542fe22b78\") " pod="openshift-network-operator/iptables-alerter-rr9d4"
Sep 11 21:05:55.965717 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.965130    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/17493773-1416-44a9-8a25-b05d1daccc37-node-log\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:55.965717 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.965207    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/17493773-1416-44a9-8a25-b05d1daccc37-host-cni-netd\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:55.965717 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.965239    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc-original-pull-secret\") pod \"global-pull-secret-syncer-vxlb2\" (UID: \"0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc\") " pod="kube-system/global-pull-secret-syncer-vxlb2"
Sep 11 21:05:55.965717 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.965267    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/17493773-1416-44a9-8a25-b05d1daccc37-var-lib-openvswitch\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:55.965717 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.965269    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 11 21:05:55.965717 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.965329    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17493773-1416-44a9-8a25-b05d1daccc37-host-run-ovn-kubernetes\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:55.965717 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.965418    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/17493773-1416-44a9-8a25-b05d1daccc37-ovnkube-config\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:55.965717 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.965443    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/17493773-1416-44a9-8a25-b05d1daccc37-etc-openvswitch\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:55.965717 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.965462    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/17493773-1416-44a9-8a25-b05d1daccc37-run-openvswitch\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:55.965717 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.965487    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/17493773-1416-44a9-8a25-b05d1daccc37-log-socket\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:55.965717 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.965576    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17493773-1416-44a9-8a25-b05d1daccc37-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:55.966094 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.965903    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/17493773-1416-44a9-8a25-b05d1daccc37-ovn-node-metrics-cert\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:55.966094 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.965587    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-10 21:00:54 +0000 UTC" deadline="2028-05-07 00:56:08.552228681 +0000 UTC"
Sep 11 21:05:55.966094 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.965937    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14475h50m12.586300701s"
Sep 11 21:05:55.966094 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.965944    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc-kubelet-config\") pod \"global-pull-secret-syncer-vxlb2\" (UID: \"0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc\") " pod="kube-system/global-pull-secret-syncer-vxlb2"
Sep 11 21:05:55.966094 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.965967    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3c8f606b-293c-477a-a7ea-62542fe22b78-iptables-alerter-script\") pod \"iptables-alerter-rr9d4\" (UID: \"3c8f606b-293c-477a-a7ea-62542fe22b78\") " pod="openshift-network-operator/iptables-alerter-rr9d4"
Sep 11 21:05:55.966404 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.966371    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcr9m"
Sep 11 21:05:55.968572 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.968552    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9bcdv"
Sep 11 21:05:55.968702 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.968609    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 11 21:05:55.968764 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.968745    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 11 21:05:55.969024 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.969009    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 11 21:05:55.969150 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.969135    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xf542\""
Sep 11 21:05:55.970371 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.970354    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 21:05:55.970929 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.970913    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b7sx4"
Sep 11 21:05:55.971013 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.970957    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 11 21:05:55.971070 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.971058    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 11 21:05:55.971348 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.971312    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-q8xbd\""
Sep 11 21:05:55.973275 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.973251    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v4sq2"
Sep 11 21:05:55.974621 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.974591    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 11 21:05:55.974732 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.974622    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 11 21:05:55.974732 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.974684    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 11 21:05:55.974732 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.974711    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xfxkc\""
Sep 11 21:05:55.975446 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.975428    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 11 21:05:55.975571 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.975555    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xzdlq"
Sep 11 21:05:55.975770 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.975752    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 11 21:05:55.976001 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.975988    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 11 21:05:55.976075 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.976034    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-tmkkr\""
Sep 11 21:05:55.976130 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.976090    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 11 21:05:55.976395 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.976365    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 11 21:05:55.978116 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.978096    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wwnsp"
Sep 11 21:05:55.979616 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.979598    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 11 21:05:55.979796 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.979782    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-pjmdx\""
Sep 11 21:05:55.979920 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.979904    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 11 21:05:55.980527 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.980506    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 11 21:05:55.980616 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.980516    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qzc66\""
Sep 11 21:05:55.980733 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.980716    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6nwfd"
Sep 11 21:05:55.980803 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:55.980783    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6nwfd" podUID="5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3"
Sep 11 21:05:55.982987 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.982966    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sxs24"
Sep 11 21:05:55.983091 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:55.983040    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sxs24" podUID="394b71c4-7749-4e24-a7ef-b7060c4b4864"
Sep 11 21:05:55.996328 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:55.996300    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9ksh8"
Sep 11 21:05:56.007812 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.007746    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9ksh8"
Sep 11 21:05:56.059837 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.059811    2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 11 21:05:56.069105 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.066888    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/585342c4-6023-45ad-b2b3-b68072a36bca-multus-conf-dir\") pod \"multus-xzdlq\" (UID: \"585342c4-6023-45ad-b2b3-b68072a36bca\") " pod="openshift-multus/multus-xzdlq"
Sep 11 21:05:56.069105 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.066940    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/585342c4-6023-45ad-b2b3-b68072a36bca-multus-daemon-config\") pod \"multus-xzdlq\" (UID: \"585342c4-6023-45ad-b2b3-b68072a36bca\") " pod="openshift-multus/multus-xzdlq"
Sep 11 21:05:56.069105 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.066984    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/585342c4-6023-45ad-b2b3-b68072a36bca-host-run-multus-certs\") pod \"multus-xzdlq\" (UID: \"585342c4-6023-45ad-b2b3-b68072a36bca\") " pod="openshift-multus/multus-xzdlq"
Sep 11 21:05:56.069105 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.067065    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/61773d0c-6a2a-4a1b-8d98-30897e76ae6b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v4sq2\" (UID: \"61773d0c-6a2a-4a1b-8d98-30897e76ae6b\") " pod="openshift-multus/multus-additional-cni-plugins-v4sq2"
Sep 11 21:05:56.069105 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.067123    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/17493773-1416-44a9-8a25-b05d1daccc37-log-socket\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:56.069105 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.067151    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/17493773-1416-44a9-8a25-b05d1daccc37-ovn-node-metrics-cert\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:56.069105 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.067205    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/585342c4-6023-45ad-b2b3-b68072a36bca-host-var-lib-cni-bin\") pod \"multus-xzdlq\" (UID: \"585342c4-6023-45ad-b2b3-b68072a36bca\") " pod="openshift-multus/multus-xzdlq"
Sep 11 21:05:56.069105 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.067239    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/342a8a16-663e-4958-ab55-a6a8f04d9222-etc-sysconfig\") pod \"tuned-9bcdv\" (UID: \"342a8a16-663e-4958-ab55-a6a8f04d9222\") " pod="openshift-cluster-node-tuning-operator/tuned-9bcdv"
Sep 11 21:05:56.069105 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.067270    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/61773d0c-6a2a-4a1b-8d98-30897e76ae6b-system-cni-dir\") pod \"multus-additional-cni-plugins-v4sq2\" (UID: \"61773d0c-6a2a-4a1b-8d98-30897e76ae6b\") " pod="openshift-multus/multus-additional-cni-plugins-v4sq2"
Sep 11 21:05:56.069105 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.067302    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-896m2\" (UniqueName: \"kubernetes.io/projected/585342c4-6023-45ad-b2b3-b68072a36bca-kube-api-access-896m2\") pod \"multus-xzdlq\" (UID: \"585342c4-6023-45ad-b2b3-b68072a36bca\") " pod="openshift-multus/multus-xzdlq"
Sep 11 21:05:56.069105 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.067340    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/17493773-1416-44a9-8a25-b05d1daccc37-host-kubelet\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:56.069105 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.067364    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/516a2da5-32a7-4c55-82e4-734bbf607583-socket-dir\") pod \"aws-ebs-csi-driver-node-pcr9m\" (UID: \"516a2da5-32a7-4c55-82e4-734bbf607583\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcr9m"
Sep 11 21:05:56.069105 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.067409    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/585342c4-6023-45ad-b2b3-b68072a36bca-multus-socket-dir-parent\") pod \"multus-xzdlq\" (UID: \"585342c4-6023-45ad-b2b3-b68072a36bca\") " pod="openshift-multus/multus-xzdlq"
Sep 11 21:05:56.069105 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.067440    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/342a8a16-663e-4958-ab55-a6a8f04d9222-var-lib-kubelet\") pod \"tuned-9bcdv\" (UID: \"342a8a16-663e-4958-ab55-a6a8f04d9222\") " pod="openshift-cluster-node-tuning-operator/tuned-9bcdv"
Sep 11 21:05:56.069105 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.067471    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52734055-1949-4e54-a2dc-623f80a5c1ac-tmp-dir\") pod \"node-resolver-wwnsp\" (UID: \"52734055-1949-4e54-a2dc-623f80a5c1ac\") " pod="openshift-dns/node-resolver-wwnsp"
Sep 11 21:05:56.069105 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.067506    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9e88e074-d628-4e0b-a23c-ce95b8a44c21-serviceca\") pod \"node-ca-b7sx4\" (UID: \"9e88e074-d628-4e0b-a23c-ce95b8a44c21\") " pod="openshift-image-registry/node-ca-b7sx4"
Sep 11 21:05:56.069105 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.067538    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/17493773-1416-44a9-8a25-b05d1daccc37-run-systemd\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:56.069976 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.067567    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/17493773-1416-44a9-8a25-b05d1daccc37-ovnkube-script-lib\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:56.069976 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.067602    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4ktm\" (UniqueName: \"kubernetes.io/projected/17493773-1416-44a9-8a25-b05d1daccc37-kube-api-access-w4ktm\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:56.069976 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.067630    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc-dbus\") pod \"global-pull-secret-syncer-vxlb2\" (UID: \"0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc\") " pod="kube-system/global-pull-secret-syncer-vxlb2"
Sep 11 21:05:56.069976 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.067655    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5k8d\" (UniqueName: \"kubernetes.io/projected/3c8f606b-293c-477a-a7ea-62542fe22b78-kube-api-access-c5k8d\") pod \"iptables-alerter-rr9d4\" (UID: \"3c8f606b-293c-477a-a7ea-62542fe22b78\") " pod="openshift-network-operator/iptables-alerter-rr9d4"
Sep 11 21:05:56.069976 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.067688    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/516a2da5-32a7-4c55-82e4-734bbf607583-registration-dir\") pod \"aws-ebs-csi-driver-node-pcr9m\" (UID: \"516a2da5-32a7-4c55-82e4-734bbf607583\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcr9m"
Sep 11 21:05:56.069976 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.067717    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/516a2da5-32a7-4c55-82e4-734bbf607583-device-dir\") pod \"aws-ebs-csi-driver-node-pcr9m\" (UID: \"516a2da5-32a7-4c55-82e4-734bbf607583\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcr9m"
Sep 11 21:05:56.069976 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.067749    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/17493773-1416-44a9-8a25-b05d1daccc37-host-cni-bin\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:56.069976 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.067779    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/342a8a16-663e-4958-ab55-a6a8f04d9222-sys\") pod \"tuned-9bcdv\" (UID: \"342a8a16-663e-4958-ab55-a6a8f04d9222\") " pod="openshift-cluster-node-tuning-operator/tuned-9bcdv"
Sep 11 21:05:56.069976 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.067810    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/61773d0c-6a2a-4a1b-8d98-30897e76ae6b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v4sq2\" (UID: \"61773d0c-6a2a-4a1b-8d98-30897e76ae6b\") " pod="openshift-multus/multus-additional-cni-plugins-v4sq2"
Sep 11 21:05:56.069976 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.067836    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/17493773-1416-44a9-8a25-b05d1daccc37-systemd-units\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:56.069976 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.067894    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/585342c4-6023-45ad-b2b3-b68072a36bca-host-run-k8s-cni-cncf-io\") pod \"multus-xzdlq\" (UID: \"585342c4-6023-45ad-b2b3-b68072a36bca\") " pod="openshift-multus/multus-xzdlq"
Sep 11 21:05:56.069976 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.067929    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3c8f606b-293c-477a-a7ea-62542fe22b78-host-slash\") pod \"iptables-alerter-rr9d4\" (UID: \"3c8f606b-293c-477a-a7ea-62542fe22b78\") " pod="openshift-network-operator/iptables-alerter-rr9d4"
Sep 11 21:05:56.069976 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.067965    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6159eecf-1d1a-4d36-9c12-906f8b272142-konnectivity-ca\") pod \"konnectivity-agent-7d7s4\" (UID: \"6159eecf-1d1a-4d36-9c12-906f8b272142\") " pod="kube-system/konnectivity-agent-7d7s4"
Sep 11 21:05:56.069976 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.068006    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/342a8a16-663e-4958-ab55-a6a8f04d9222-lib-modules\") pod \"tuned-9bcdv\" (UID: \"342a8a16-663e-4958-ab55-a6a8f04d9222\") " pod="openshift-cluster-node-tuning-operator/tuned-9bcdv"
Sep 11 21:05:56.069976 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.068048    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/17493773-1416-44a9-8a25-b05d1daccc37-host-cni-netd\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:56.069976 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.068080    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc-original-pull-secret\") pod \"global-pull-secret-syncer-vxlb2\" (UID: \"0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc\") " pod="kube-system/global-pull-secret-syncer-vxlb2"
Sep 11 21:05:56.069976 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.068115    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bxnh\" (UniqueName: \"kubernetes.io/projected/9e88e074-d628-4e0b-a23c-ce95b8a44c21-kube-api-access-7bxnh\") pod \"node-ca-b7sx4\" (UID: \"9e88e074-d628-4e0b-a23c-ce95b8a44c21\") " pod="openshift-image-registry/node-ca-b7sx4"
Sep 11 21:05:56.070732 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.068145    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6159eecf-1d1a-4d36-9c12-906f8b272142-agent-certs\") pod \"konnectivity-agent-7d7s4\" (UID: \"6159eecf-1d1a-4d36-9c12-906f8b272142\") " pod="kube-system/konnectivity-agent-7d7s4"
Sep 11 21:05:56.070732 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.068173    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/342a8a16-663e-4958-ab55-a6a8f04d9222-etc-modprobe-d\") pod \"tuned-9bcdv\" (UID: \"342a8a16-663e-4958-ab55-a6a8f04d9222\") " pod="openshift-cluster-node-tuning-operator/tuned-9bcdv"
Sep 11 21:05:56.070732 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.068207    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17493773-1416-44a9-8a25-b05d1daccc37-host-run-ovn-kubernetes\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:56.070732 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.068252    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/585342c4-6023-45ad-b2b3-b68072a36bca-host-var-lib-kubelet\") pod \"multus-xzdlq\" (UID: \"585342c4-6023-45ad-b2b3-b68072a36bca\") " pod="openshift-multus/multus-xzdlq"
Sep 11 21:05:56.070732 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.068292    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/342a8a16-663e-4958-ab55-a6a8f04d9222-run\") pod \"tuned-9bcdv\" (UID: \"342a8a16-663e-4958-ab55-a6a8f04d9222\") " pod="openshift-cluster-node-tuning-operator/tuned-9bcdv"
Sep 11 21:05:56.070732 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.068322    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/342a8a16-663e-4958-ab55-a6a8f04d9222-etc-tuned\") pod \"tuned-9bcdv\" (UID: \"342a8a16-663e-4958-ab55-a6a8f04d9222\") " pod="openshift-cluster-node-tuning-operator/tuned-9bcdv"
Sep 11 21:05:56.070732 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.068350    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq8c8\" (UniqueName: \"kubernetes.io/projected/342a8a16-663e-4958-ab55-a6a8f04d9222-kube-api-access-tq8c8\") pod \"tuned-9bcdv\" (UID: \"342a8a16-663e-4958-ab55-a6a8f04d9222\") " pod="openshift-cluster-node-tuning-operator/tuned-9bcdv"
Sep 11 21:05:56.070732 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.068400    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9g72t\" (UniqueName: \"kubernetes.io/projected/61773d0c-6a2a-4a1b-8d98-30897e76ae6b-kube-api-access-9g72t\") pod \"multus-additional-cni-plugins-v4sq2\" (UID: \"61773d0c-6a2a-4a1b-8d98-30897e76ae6b\") " pod="openshift-multus/multus-additional-cni-plugins-v4sq2"
Sep 11 21:05:56.070732 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.068429    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/52734055-1949-4e54-a2dc-623f80a5c1ac-hosts-file\") pod \"node-resolver-wwnsp\" (UID: \"52734055-1949-4e54-a2dc-623f80a5c1ac\") " pod="openshift-dns/node-resolver-wwnsp"
Sep 11 21:05:56.070732 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.068463    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxt48\" (UniqueName: \"kubernetes.io/projected/52734055-1949-4e54-a2dc-623f80a5c1ac-kube-api-access-mxt48\") pod \"node-resolver-wwnsp\" (UID: \"52734055-1949-4e54-a2dc-623f80a5c1ac\") " pod="openshift-dns/node-resolver-wwnsp"
Sep 11 21:05:56.070732 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.068498    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/17493773-1416-44a9-8a25-b05d1daccc37-etc-openvswitch\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:56.070732 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.068531    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/17493773-1416-44a9-8a25-b05d1daccc37-run-openvswitch\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:56.070732 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.068559    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17493773-1416-44a9-8a25-b05d1daccc37-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:56.070732 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.068592    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc-kubelet-config\") pod \"global-pull-secret-syncer-vxlb2\" (UID: \"0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc\") " pod="kube-system/global-pull-secret-syncer-vxlb2"
Sep 11 21:05:56.070732 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.068624    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3c8f606b-293c-477a-a7ea-62542fe22b78-iptables-alerter-script\") pod \"iptables-alerter-rr9d4\" (UID: \"3c8f606b-293c-477a-a7ea-62542fe22b78\") " pod="openshift-network-operator/iptables-alerter-rr9d4"
Sep 11 21:05:56.070732 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.068653    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9e88e074-d628-4e0b-a23c-ce95b8a44c21-host\") pod \"node-ca-b7sx4\" (UID: \"9e88e074-d628-4e0b-a23c-ce95b8a44c21\") " pod="openshift-image-registry/node-ca-b7sx4"
Sep 11 21:05:56.070732 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.068683    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/585342c4-6023-45ad-b2b3-b68072a36bca-multus-cni-dir\") pod \"multus-xzdlq\" (UID: \"585342c4-6023-45ad-b2b3-b68072a36bca\") " pod="openshift-multus/multus-xzdlq"
Sep 11 21:05:56.071454 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.068708    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/516a2da5-32a7-4c55-82e4-734bbf607583-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pcr9m\" (UID: \"516a2da5-32a7-4c55-82e4-734bbf607583\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcr9m"
Sep 11 21:05:56.071454 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.068741    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/342a8a16-663e-4958-ab55-a6a8f04d9222-etc-sysctl-d\") pod \"tuned-9bcdv\" (UID: \"342a8a16-663e-4958-ab55-a6a8f04d9222\") " pod="openshift-cluster-node-tuning-operator/tuned-9bcdv"
Sep 11 21:05:56.071454 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.068772    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/61773d0c-6a2a-4a1b-8d98-30897e76ae6b-cni-binary-copy\") pod \"multus-additional-cni-plugins-v4sq2\" (UID: \"61773d0c-6a2a-4a1b-8d98-30897e76ae6b\") " pod="openshift-multus/multus-additional-cni-plugins-v4sq2"
Sep 11 21:05:56.071454 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.068803    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/61773d0c-6a2a-4a1b-8d98-30897e76ae6b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v4sq2\" (UID: \"61773d0c-6a2a-4a1b-8d98-30897e76ae6b\") " pod="openshift-multus/multus-additional-cni-plugins-v4sq2"
Sep 11 21:05:56.071454 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.068835    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3-metrics-certs\") pod \"network-metrics-daemon-6nwfd\" (UID: \"5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3\") " pod="openshift-multus/network-metrics-daemon-6nwfd"
Sep 11 21:05:56.071454 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.068863    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wj6v8\" (UniqueName: \"kubernetes.io/projected/5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3-kube-api-access-wj6v8\") pod \"network-metrics-daemon-6nwfd\" (UID: \"5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3\") " pod="openshift-multus/network-metrics-daemon-6nwfd"
Sep 11 21:05:56.071454 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.068893    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/585342c4-6023-45ad-b2b3-b68072a36bca-cnibin\") pod \"multus-xzdlq\" (UID: \"585342c4-6023-45ad-b2b3-b68072a36bca\") " pod="openshift-multus/multus-xzdlq"
Sep 11 21:05:56.071454 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.068922    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/585342c4-6023-45ad-b2b3-b68072a36bca-cni-binary-copy\") pod \"multus-xzdlq\" (UID: \"585342c4-6023-45ad-b2b3-b68072a36bca\") " pod="openshift-multus/multus-xzdlq"
Sep 11 21:05:56.071454 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.068951    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/585342c4-6023-45ad-b2b3-b68072a36bca-etc-kubernetes\") pod \"multus-xzdlq\" (UID: \"585342c4-6023-45ad-b2b3-b68072a36bca\") " pod="openshift-multus/multus-xzdlq"
Sep 11 21:05:56.071454 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.068976    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/516a2da5-32a7-4c55-82e4-734bbf607583-etc-selinux\") pod \"aws-ebs-csi-driver-node-pcr9m\" (UID: \"516a2da5-32a7-4c55-82e4-734bbf607583\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcr9m"
Sep 11 21:05:56.071454 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.069004    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/342a8a16-663e-4958-ab55-a6a8f04d9222-tmp\") pod \"tuned-9bcdv\" (UID: \"342a8a16-663e-4958-ab55-a6a8f04d9222\") " pod="openshift-cluster-node-tuning-operator/tuned-9bcdv"
Sep 11 21:05:56.071454 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.069138    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nbvm\" (UniqueName: \"kubernetes.io/projected/516a2da5-32a7-4c55-82e4-734bbf607583-kube-api-access-2nbvm\") pod \"aws-ebs-csi-driver-node-pcr9m\" (UID: \"516a2da5-32a7-4c55-82e4-734bbf607583\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcr9m"
Sep 11 21:05:56.071454 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.069178    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/585342c4-6023-45ad-b2b3-b68072a36bca-host-var-lib-cni-multus\") pod \"multus-xzdlq\" (UID: \"585342c4-6023-45ad-b2b3-b68072a36bca\") " pod="openshift-multus/multus-xzdlq"
Sep 11 21:05:56.071454 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:56.069195    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 21:05:56.071454 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.069266    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/585342c4-6023-45ad-b2b3-b68072a36bca-hostroot\") pod \"multus-xzdlq\" (UID: \"585342c4-6023-45ad-b2b3-b68072a36bca\") " pod="openshift-multus/multus-xzdlq"
Sep 11 21:05:56.071454 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.069283    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3c8f606b-293c-477a-a7ea-62542fe22b78-host-slash\") pod \"iptables-alerter-rr9d4\" (UID: \"3c8f606b-293c-477a-a7ea-62542fe22b78\") " pod="openshift-network-operator/iptables-alerter-rr9d4"
Sep 11 21:05:56.071454 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.069300    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/342a8a16-663e-4958-ab55-a6a8f04d9222-etc-kubernetes\") pod \"tuned-9bcdv\" (UID: \"342a8a16-663e-4958-ab55-a6a8f04d9222\") " pod="openshift-cluster-node-tuning-operator/tuned-9bcdv"
Sep 11 21:05:56.071960 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.069319    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/17493773-1416-44a9-8a25-b05d1daccc37-systemd-units\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:56.071960 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.069331    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/342a8a16-663e-4958-ab55-a6a8f04d9222-etc-sysctl-conf\") pod \"tuned-9bcdv\" (UID: \"342a8a16-663e-4958-ab55-a6a8f04d9222\") " pod="openshift-cluster-node-tuning-operator/tuned-9bcdv"
Sep 11 21:05:56.071960 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.069651    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/342a8a16-663e-4958-ab55-a6a8f04d9222-etc-systemd\") pod \"tuned-9bcdv\" (UID: \"342a8a16-663e-4958-ab55-a6a8f04d9222\") " pod="openshift-cluster-node-tuning-operator/tuned-9bcdv"
Sep 11 21:05:56.071960 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:56.069689    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc-original-pull-secret podName:0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc nodeName:}" failed. No retries permitted until 2026-09-11 21:05:56.569399251 +0000 UTC m=+2.047711087 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc-original-pull-secret") pod "global-pull-secret-syncer-vxlb2" (UID: "0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc") : object "kube-system"/"original-pull-secret" not registered
Sep 11 21:05:56.071960 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.069738    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/516a2da5-32a7-4c55-82e4-734bbf607583-sys-fs\") pod \"aws-ebs-csi-driver-node-pcr9m\" (UID: \"516a2da5-32a7-4c55-82e4-734bbf607583\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcr9m"
Sep 11 21:05:56.071960 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.069743    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/17493773-1416-44a9-8a25-b05d1daccc37-etc-openvswitch\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:56.071960 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.069790    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/585342c4-6023-45ad-b2b3-b68072a36bca-system-cni-dir\") pod \"multus-xzdlq\" (UID: \"585342c4-6023-45ad-b2b3-b68072a36bca\") " pod="openshift-multus/multus-xzdlq"
Sep 11 21:05:56.071960 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.069801    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc-kubelet-config\") pod \"global-pull-secret-syncer-vxlb2\" (UID: \"0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc\") " pod="kube-system/global-pull-secret-syncer-vxlb2"
Sep 11 21:05:56.071960 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.069824    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/585342c4-6023-45ad-b2b3-b68072a36bca-host-run-netns\") pod \"multus-xzdlq\" (UID: \"585342c4-6023-45ad-b2b3-b68072a36bca\") " pod="openshift-multus/multus-xzdlq"
Sep 11 21:05:56.071960 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.069879    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/17493773-1416-44a9-8a25-b05d1daccc37-host-slash\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:56.071960 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.069887    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc-dbus\") pod \"global-pull-secret-syncer-vxlb2\" (UID: \"0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc\") " pod="kube-system/global-pull-secret-syncer-vxlb2"
Sep 11 21:05:56.071960 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.069880    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/17493773-1416-44a9-8a25-b05d1daccc37-host-kubelet\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:56.071960 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.069909    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/17493773-1416-44a9-8a25-b05d1daccc37-log-socket\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:56.071960 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.069938    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/17493773-1416-44a9-8a25-b05d1daccc37-host-cni-netd\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:56.071960 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.069955    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/17493773-1416-44a9-8a25-b05d1daccc37-host-slash\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:56.071960 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.069991    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17493773-1416-44a9-8a25-b05d1daccc37-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:56.072468 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.070078    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/17493773-1416-44a9-8a25-b05d1daccc37-host-run-netns\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:56.072468 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.070107    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17493773-1416-44a9-8a25-b05d1daccc37-host-run-ovn-kubernetes\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:56.072468 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.070200    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/17493773-1416-44a9-8a25-b05d1daccc37-host-cni-bin\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:56.072468 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.070207    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/17493773-1416-44a9-8a25-b05d1daccc37-run-ovn\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:56.072468 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.070205    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/17493773-1416-44a9-8a25-b05d1daccc37-host-run-netns\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:56.072468 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.070225    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/17493773-1416-44a9-8a25-b05d1daccc37-run-systemd\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:56.072468 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.070262    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/17493773-1416-44a9-8a25-b05d1daccc37-env-overrides\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:56.072468 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.070299    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc5t8\" (UniqueName: \"kubernetes.io/projected/394b71c4-7749-4e24-a7ef-b7060c4b4864-kube-api-access-vc5t8\") pod \"network-check-target-sxs24\" (UID: \"394b71c4-7749-4e24-a7ef-b7060c4b4864\") " pod="openshift-network-diagnostics/network-check-target-sxs24"
Sep 11 21:05:56.072468 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.070304    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/17493773-1416-44a9-8a25-b05d1daccc37-run-openvswitch\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:56.072468 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.070335    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/342a8a16-663e-4958-ab55-a6a8f04d9222-host\") pod \"tuned-9bcdv\" (UID: \"342a8a16-663e-4958-ab55-a6a8f04d9222\") " pod="openshift-cluster-node-tuning-operator/tuned-9bcdv"
Sep 11 21:05:56.072468 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.070411    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/17493773-1416-44a9-8a25-b05d1daccc37-node-log\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:56.072468 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.070445    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/17493773-1416-44a9-8a25-b05d1daccc37-run-ovn\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:56.072468 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.070496    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/61773d0c-6a2a-4a1b-8d98-30897e76ae6b-cnibin\") pod \"multus-additional-cni-plugins-v4sq2\" (UID: \"61773d0c-6a2a-4a1b-8d98-30897e76ae6b\") " pod="openshift-multus/multus-additional-cni-plugins-v4sq2"
Sep 11 21:05:56.072468 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.070535    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/17493773-1416-44a9-8a25-b05d1daccc37-var-lib-openvswitch\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:56.072468 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.070587    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/17493773-1416-44a9-8a25-b05d1daccc37-ovnkube-config\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:56.072468 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.070699    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/17493773-1416-44a9-8a25-b05d1daccc37-node-log\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:56.072468 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.070728    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/17493773-1416-44a9-8a25-b05d1daccc37-ovnkube-script-lib\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:56.072959 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.070751    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/17493773-1416-44a9-8a25-b05d1daccc37-var-lib-openvswitch\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:56.072959 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.070765    2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 11 21:05:56.072959 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.070890    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/17493773-1416-44a9-8a25-b05d1daccc37-env-overrides\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:56.072959 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.071237    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/17493773-1416-44a9-8a25-b05d1daccc37-ovnkube-config\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:56.072959 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.071288    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3c8f606b-293c-477a-a7ea-62542fe22b78-iptables-alerter-script\") pod \"iptables-alerter-rr9d4\" (UID: \"3c8f606b-293c-477a-a7ea-62542fe22b78\") " pod="openshift-network-operator/iptables-alerter-rr9d4"
Sep 11 21:05:56.074317 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.074295    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/17493773-1416-44a9-8a25-b05d1daccc37-ovn-node-metrics-cert\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:56.082320 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.082286    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5k8d\" (UniqueName: \"kubernetes.io/projected/3c8f606b-293c-477a-a7ea-62542fe22b78-kube-api-access-c5k8d\") pod \"iptables-alerter-rr9d4\" (UID: \"3c8f606b-293c-477a-a7ea-62542fe22b78\") " pod="openshift-network-operator/iptables-alerter-rr9d4"
Sep 11 21:05:56.083982 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.083954    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4ktm\" (UniqueName: \"kubernetes.io/projected/17493773-1416-44a9-8a25-b05d1daccc37-kube-api-access-w4ktm\") pod \"ovnkube-node-qpwdk\" (UID: \"17493773-1416-44a9-8a25-b05d1daccc37\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:56.108763 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:56.108711    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75a23667c2d6b01bd21de457ebee8e0a.slice/crio-f597e0908b2a374949a20703484a024443f83baa7ea3f65e4abffdb171e0c95e WatchSource:0}: Error finding container f597e0908b2a374949a20703484a024443f83baa7ea3f65e4abffdb171e0c95e: Status 404 returned error can't find the container with id f597e0908b2a374949a20703484a024443f83baa7ea3f65e4abffdb171e0c95e
Sep 11 21:05:56.108961 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:56.108937    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde7ebdcdf2700e0582a4401358202032.slice/crio-ee3c725bdf7b58b068ce9c7162840b50986e6932cafadf4c102cc3b82b85a35f WatchSource:0}: Error finding container ee3c725bdf7b58b068ce9c7162840b50986e6932cafadf4c102cc3b82b85a35f: Status 404 returned error can't find the container with id ee3c725bdf7b58b068ce9c7162840b50986e6932cafadf4c102cc3b82b85a35f
Sep 11 21:05:56.113843 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.113821    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 21:05:56.170813 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.170774    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9e88e074-d628-4e0b-a23c-ce95b8a44c21-serviceca\") pod \"node-ca-b7sx4\" (UID: \"9e88e074-d628-4e0b-a23c-ce95b8a44c21\") " pod="openshift-image-registry/node-ca-b7sx4"
Sep 11 21:05:56.170813 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.170813    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/516a2da5-32a7-4c55-82e4-734bbf607583-registration-dir\") pod \"aws-ebs-csi-driver-node-pcr9m\" (UID: \"516a2da5-32a7-4c55-82e4-734bbf607583\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcr9m"
Sep 11 21:05:56.171044 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.170838    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/516a2da5-32a7-4c55-82e4-734bbf607583-device-dir\") pod \"aws-ebs-csi-driver-node-pcr9m\" (UID: \"516a2da5-32a7-4c55-82e4-734bbf607583\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcr9m"
Sep 11 21:05:56.171044 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.170863    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/342a8a16-663e-4958-ab55-a6a8f04d9222-sys\") pod \"tuned-9bcdv\" (UID: \"342a8a16-663e-4958-ab55-a6a8f04d9222\") " pod="openshift-cluster-node-tuning-operator/tuned-9bcdv"
Sep 11 21:05:56.171044 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.170886    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/61773d0c-6a2a-4a1b-8d98-30897e76ae6b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v4sq2\" (UID: \"61773d0c-6a2a-4a1b-8d98-30897e76ae6b\") " pod="openshift-multus/multus-additional-cni-plugins-v4sq2"
Sep 11 21:05:56.171044 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.170910    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/585342c4-6023-45ad-b2b3-b68072a36bca-host-run-k8s-cni-cncf-io\") pod \"multus-xzdlq\" (UID: \"585342c4-6023-45ad-b2b3-b68072a36bca\") " pod="openshift-multus/multus-xzdlq"
Sep 11 21:05:56.171044 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.170932    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6159eecf-1d1a-4d36-9c12-906f8b272142-konnectivity-ca\") pod \"konnectivity-agent-7d7s4\" (UID: \"6159eecf-1d1a-4d36-9c12-906f8b272142\") " pod="kube-system/konnectivity-agent-7d7s4"
Sep 11 21:05:56.171044 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.170934    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/516a2da5-32a7-4c55-82e4-734bbf607583-registration-dir\") pod \"aws-ebs-csi-driver-node-pcr9m\" (UID: \"516a2da5-32a7-4c55-82e4-734bbf607583\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcr9m"
Sep 11 21:05:56.171044 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.170934    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/516a2da5-32a7-4c55-82e4-734bbf607583-device-dir\") pod \"aws-ebs-csi-driver-node-pcr9m\" (UID: \"516a2da5-32a7-4c55-82e4-734bbf607583\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcr9m"
Sep 11 21:05:56.171044 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.170956    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/342a8a16-663e-4958-ab55-a6a8f04d9222-lib-modules\") pod \"tuned-9bcdv\" (UID: \"342a8a16-663e-4958-ab55-a6a8f04d9222\") " pod="openshift-cluster-node-tuning-operator/tuned-9bcdv"
Sep 11 21:05:56.171044 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.170971    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/585342c4-6023-45ad-b2b3-b68072a36bca-host-run-k8s-cni-cncf-io\") pod \"multus-xzdlq\" (UID: \"585342c4-6023-45ad-b2b3-b68072a36bca\") " pod="openshift-multus/multus-xzdlq"
Sep 11 21:05:56.171044 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.170978    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/342a8a16-663e-4958-ab55-a6a8f04d9222-sys\") pod \"tuned-9bcdv\" (UID: \"342a8a16-663e-4958-ab55-a6a8f04d9222\") " pod="openshift-cluster-node-tuning-operator/tuned-9bcdv"
Sep 11 21:05:56.171044 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.171009    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bxnh\" (UniqueName: \"kubernetes.io/projected/9e88e074-d628-4e0b-a23c-ce95b8a44c21-kube-api-access-7bxnh\") pod \"node-ca-b7sx4\" (UID: \"9e88e074-d628-4e0b-a23c-ce95b8a44c21\") " pod="openshift-image-registry/node-ca-b7sx4"
Sep 11 21:05:56.171666 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.171154    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6159eecf-1d1a-4d36-9c12-906f8b272142-agent-certs\") pod \"konnectivity-agent-7d7s4\" (UID: \"6159eecf-1d1a-4d36-9c12-906f8b272142\") " pod="kube-system/konnectivity-agent-7d7s4"
Sep 11 21:05:56.171666 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.171185    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/342a8a16-663e-4958-ab55-a6a8f04d9222-lib-modules\") pod \"tuned-9bcdv\" (UID: \"342a8a16-663e-4958-ab55-a6a8f04d9222\") " pod="openshift-cluster-node-tuning-operator/tuned-9bcdv"
Sep 11 21:05:56.171666 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.171186    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/342a8a16-663e-4958-ab55-a6a8f04d9222-etc-modprobe-d\") pod \"tuned-9bcdv\" (UID: \"342a8a16-663e-4958-ab55-a6a8f04d9222\") " pod="openshift-cluster-node-tuning-operator/tuned-9bcdv"
Sep 11 21:05:56.171666 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.171239    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/585342c4-6023-45ad-b2b3-b68072a36bca-host-var-lib-kubelet\") pod \"multus-xzdlq\" (UID: \"585342c4-6023-45ad-b2b3-b68072a36bca\") " pod="openshift-multus/multus-xzdlq"
Sep 11 21:05:56.171666 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.171266    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/342a8a16-663e-4958-ab55-a6a8f04d9222-run\") pod \"tuned-9bcdv\" (UID: \"342a8a16-663e-4958-ab55-a6a8f04d9222\") " pod="openshift-cluster-node-tuning-operator/tuned-9bcdv"
Sep 11 21:05:56.171666 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.171288    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/342a8a16-663e-4958-ab55-a6a8f04d9222-etc-tuned\") pod \"tuned-9bcdv\" (UID: \"342a8a16-663e-4958-ab55-a6a8f04d9222\") " pod="openshift-cluster-node-tuning-operator/tuned-9bcdv"
Sep 11 21:05:56.171666 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.171309    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tq8c8\" (UniqueName: \"kubernetes.io/projected/342a8a16-663e-4958-ab55-a6a8f04d9222-kube-api-access-tq8c8\") pod \"tuned-9bcdv\" (UID: \"342a8a16-663e-4958-ab55-a6a8f04d9222\") " pod="openshift-cluster-node-tuning-operator/tuned-9bcdv"
Sep 11 21:05:56.171666 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.171313    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/585342c4-6023-45ad-b2b3-b68072a36bca-host-var-lib-kubelet\") pod \"multus-xzdlq\" (UID: \"585342c4-6023-45ad-b2b3-b68072a36bca\") " pod="openshift-multus/multus-xzdlq"
Sep 11 21:05:56.171666 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.171336    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9g72t\" (UniqueName: \"kubernetes.io/projected/61773d0c-6a2a-4a1b-8d98-30897e76ae6b-kube-api-access-9g72t\") pod \"multus-additional-cni-plugins-v4sq2\" (UID: \"61773d0c-6a2a-4a1b-8d98-30897e76ae6b\") " pod="openshift-multus/multus-additional-cni-plugins-v4sq2"
Sep 11 21:05:56.171666 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.171363    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/52734055-1949-4e54-a2dc-623f80a5c1ac-hosts-file\") pod \"node-resolver-wwnsp\" (UID: \"52734055-1949-4e54-a2dc-623f80a5c1ac\") " pod="openshift-dns/node-resolver-wwnsp"
Sep 11 21:05:56.171666 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.171414    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxt48\" (UniqueName: \"kubernetes.io/projected/52734055-1949-4e54-a2dc-623f80a5c1ac-kube-api-access-mxt48\") pod \"node-resolver-wwnsp\" (UID: \"52734055-1949-4e54-a2dc-623f80a5c1ac\") " pod="openshift-dns/node-resolver-wwnsp"
Sep 11 21:05:56.171666 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.171416    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9e88e074-d628-4e0b-a23c-ce95b8a44c21-serviceca\") pod \"node-ca-b7sx4\" (UID: \"9e88e074-d628-4e0b-a23c-ce95b8a44c21\") " pod="openshift-image-registry/node-ca-b7sx4"
Sep 11 21:05:56.171666 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.171336    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/342a8a16-663e-4958-ab55-a6a8f04d9222-etc-modprobe-d\") pod \"tuned-9bcdv\" (UID: \"342a8a16-663e-4958-ab55-a6a8f04d9222\") " pod="openshift-cluster-node-tuning-operator/tuned-9bcdv"
Sep 11 21:05:56.171666 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.171492    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/52734055-1949-4e54-a2dc-623f80a5c1ac-hosts-file\") pod \"node-resolver-wwnsp\" (UID: \"52734055-1949-4e54-a2dc-623f80a5c1ac\") " pod="openshift-dns/node-resolver-wwnsp"
Sep 11 21:05:56.171666 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.171555    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/61773d0c-6a2a-4a1b-8d98-30897e76ae6b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v4sq2\" (UID: \"61773d0c-6a2a-4a1b-8d98-30897e76ae6b\") " pod="openshift-multus/multus-additional-cni-plugins-v4sq2"
Sep 11 21:05:56.171666 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.171444    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9e88e074-d628-4e0b-a23c-ce95b8a44c21-host\") pod \"node-ca-b7sx4\" (UID: \"9e88e074-d628-4e0b-a23c-ce95b8a44c21\") " pod="openshift-image-registry/node-ca-b7sx4"
Sep 11 21:05:56.171666 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.171607    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/585342c4-6023-45ad-b2b3-b68072a36bca-multus-cni-dir\") pod \"multus-xzdlq\" (UID: \"585342c4-6023-45ad-b2b3-b68072a36bca\") " pod="openshift-multus/multus-xzdlq"
Sep 11 21:05:56.171666 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.171615    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/342a8a16-663e-4958-ab55-a6a8f04d9222-run\") pod \"tuned-9bcdv\" (UID: \"342a8a16-663e-4958-ab55-a6a8f04d9222\") " pod="openshift-cluster-node-tuning-operator/tuned-9bcdv"
Sep 11 21:05:56.172544 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.171633    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/516a2da5-32a7-4c55-82e4-734bbf607583-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pcr9m\" (UID: \"516a2da5-32a7-4c55-82e4-734bbf607583\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcr9m"
Sep 11 21:05:56.172544 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.171638    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9e88e074-d628-4e0b-a23c-ce95b8a44c21-host\") pod \"node-ca-b7sx4\" (UID: \"9e88e074-d628-4e0b-a23c-ce95b8a44c21\") " pod="openshift-image-registry/node-ca-b7sx4"
Sep 11 21:05:56.172544 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.171664    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/342a8a16-663e-4958-ab55-a6a8f04d9222-etc-sysctl-d\") pod \"tuned-9bcdv\" (UID: \"342a8a16-663e-4958-ab55-a6a8f04d9222\") " pod="openshift-cluster-node-tuning-operator/tuned-9bcdv"
Sep 11 21:05:56.172544 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.171673    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6159eecf-1d1a-4d36-9c12-906f8b272142-konnectivity-ca\") pod \"konnectivity-agent-7d7s4\" (UID: \"6159eecf-1d1a-4d36-9c12-906f8b272142\") " pod="kube-system/konnectivity-agent-7d7s4"
Sep 11 21:05:56.172544 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.171686    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/516a2da5-32a7-4c55-82e4-734bbf607583-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pcr9m\" (UID: \"516a2da5-32a7-4c55-82e4-734bbf607583\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcr9m"
Sep 11 21:05:56.172544 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.171689    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/61773d0c-6a2a-4a1b-8d98-30897e76ae6b-cni-binary-copy\") pod \"multus-additional-cni-plugins-v4sq2\" (UID: \"61773d0c-6a2a-4a1b-8d98-30897e76ae6b\") " pod="openshift-multus/multus-additional-cni-plugins-v4sq2"
Sep 11 21:05:56.172544 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.171676    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/585342c4-6023-45ad-b2b3-b68072a36bca-multus-cni-dir\") pod \"multus-xzdlq\" (UID: \"585342c4-6023-45ad-b2b3-b68072a36bca\") " pod="openshift-multus/multus-xzdlq"
Sep 11 21:05:56.172544 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.171727    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/61773d0c-6a2a-4a1b-8d98-30897e76ae6b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v4sq2\" (UID: \"61773d0c-6a2a-4a1b-8d98-30897e76ae6b\") " pod="openshift-multus/multus-additional-cni-plugins-v4sq2"
Sep 11 21:05:56.172544 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.171767    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/342a8a16-663e-4958-ab55-a6a8f04d9222-etc-sysctl-d\") pod \"tuned-9bcdv\" (UID: \"342a8a16-663e-4958-ab55-a6a8f04d9222\") " pod="openshift-cluster-node-tuning-operator/tuned-9bcdv"
Sep 11 21:05:56.172544 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.171789    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3-metrics-certs\") pod \"network-metrics-daemon-6nwfd\" (UID: \"5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3\") " pod="openshift-multus/network-metrics-daemon-6nwfd"
Sep 11 21:05:56.172544 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.171815    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wj6v8\" (UniqueName: \"kubernetes.io/projected/5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3-kube-api-access-wj6v8\") pod \"network-metrics-daemon-6nwfd\" (UID: \"5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3\") " pod="openshift-multus/network-metrics-daemon-6nwfd"
Sep 11 21:05:56.172544 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.171830    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/585342c4-6023-45ad-b2b3-b68072a36bca-cnibin\") pod \"multus-xzdlq\" (UID: \"585342c4-6023-45ad-b2b3-b68072a36bca\") " pod="openshift-multus/multus-xzdlq"
Sep 11 21:05:56.172544 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.171851    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/585342c4-6023-45ad-b2b3-b68072a36bca-cni-binary-copy\") pod \"multus-xzdlq\" (UID: \"585342c4-6023-45ad-b2b3-b68072a36bca\") " pod="openshift-multus/multus-xzdlq"
Sep 11 21:05:56.172544 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.171875    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/585342c4-6023-45ad-b2b3-b68072a36bca-etc-kubernetes\") pod \"multus-xzdlq\" (UID: \"585342c4-6023-45ad-b2b3-b68072a36bca\") " pod="openshift-multus/multus-xzdlq"
Sep 11 21:05:56.172544 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.171899    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/516a2da5-32a7-4c55-82e4-734bbf607583-etc-selinux\") pod \"aws-ebs-csi-driver-node-pcr9m\" (UID: \"516a2da5-32a7-4c55-82e4-734bbf607583\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcr9m"
Sep 11 21:05:56.172544 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:56.171901    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:05:56.172544 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.171905    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/585342c4-6023-45ad-b2b3-b68072a36bca-cnibin\") pod \"multus-xzdlq\" (UID: \"585342c4-6023-45ad-b2b3-b68072a36bca\") " pod="openshift-multus/multus-xzdlq"
Sep 11 21:05:56.172544 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.171924    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/61773d0c-6a2a-4a1b-8d98-30897e76ae6b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v4sq2\" (UID: \"61773d0c-6a2a-4a1b-8d98-30897e76ae6b\") " pod="openshift-multus/multus-additional-cni-plugins-v4sq2"
Sep 11 21:05:56.173429 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:56.171988    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3-metrics-certs podName:5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3 nodeName:}" failed. No retries permitted until 2026-09-11 21:05:56.671973641 +0000 UTC m=+2.150285467 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3-metrics-certs") pod "network-metrics-daemon-6nwfd" (UID: "5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:05:56.173429 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.172051    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/585342c4-6023-45ad-b2b3-b68072a36bca-etc-kubernetes\") pod \"multus-xzdlq\" (UID: \"585342c4-6023-45ad-b2b3-b68072a36bca\") " pod="openshift-multus/multus-xzdlq"
Sep 11 21:05:56.173429 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.172096    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/342a8a16-663e-4958-ab55-a6a8f04d9222-tmp\") pod \"tuned-9bcdv\" (UID: \"342a8a16-663e-4958-ab55-a6a8f04d9222\") " pod="openshift-cluster-node-tuning-operator/tuned-9bcdv"
Sep 11 21:05:56.173429 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.172152    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/516a2da5-32a7-4c55-82e4-734bbf607583-etc-selinux\") pod \"aws-ebs-csi-driver-node-pcr9m\" (UID: \"516a2da5-32a7-4c55-82e4-734bbf607583\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcr9m"
Sep 11 21:05:56.173429 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.172155    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nbvm\" (UniqueName: \"kubernetes.io/projected/516a2da5-32a7-4c55-82e4-734bbf607583-kube-api-access-2nbvm\") pod \"aws-ebs-csi-driver-node-pcr9m\" (UID: \"516a2da5-32a7-4c55-82e4-734bbf607583\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcr9m"
Sep 11 21:05:56.173429 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.172212    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/61773d0c-6a2a-4a1b-8d98-30897e76ae6b-cni-binary-copy\") pod \"multus-additional-cni-plugins-v4sq2\" (UID: \"61773d0c-6a2a-4a1b-8d98-30897e76ae6b\") " pod="openshift-multus/multus-additional-cni-plugins-v4sq2"
Sep 11 21:05:56.173429 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.172261    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/585342c4-6023-45ad-b2b3-b68072a36bca-host-var-lib-cni-multus\") pod \"multus-xzdlq\" (UID: \"585342c4-6023-45ad-b2b3-b68072a36bca\") " pod="openshift-multus/multus-xzdlq"
Sep 11 21:05:56.173429 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.172291    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/585342c4-6023-45ad-b2b3-b68072a36bca-hostroot\") pod \"multus-xzdlq\" (UID: \"585342c4-6023-45ad-b2b3-b68072a36bca\") " pod="openshift-multus/multus-xzdlq"
Sep 11 21:05:56.173429 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.172318    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/342a8a16-663e-4958-ab55-a6a8f04d9222-etc-kubernetes\") pod \"tuned-9bcdv\" (UID: \"342a8a16-663e-4958-ab55-a6a8f04d9222\") " pod="openshift-cluster-node-tuning-operator/tuned-9bcdv"
Sep 11 21:05:56.173429 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.172342    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/342a8a16-663e-4958-ab55-a6a8f04d9222-etc-sysctl-conf\") pod \"tuned-9bcdv\" (UID: \"342a8a16-663e-4958-ab55-a6a8f04d9222\") " pod="openshift-cluster-node-tuning-operator/tuned-9bcdv"
Sep 11 21:05:56.173429 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.172367    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/342a8a16-663e-4958-ab55-a6a8f04d9222-etc-systemd\") pod \"tuned-9bcdv\" (UID: \"342a8a16-663e-4958-ab55-a6a8f04d9222\") " pod="openshift-cluster-node-tuning-operator/tuned-9bcdv"
Sep 11 21:05:56.173429 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.172411    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/516a2da5-32a7-4c55-82e4-734bbf607583-sys-fs\") pod \"aws-ebs-csi-driver-node-pcr9m\" (UID: \"516a2da5-32a7-4c55-82e4-734bbf607583\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcr9m"
Sep 11 21:05:56.173429 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.172366    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/585342c4-6023-45ad-b2b3-b68072a36bca-hostroot\") pod \"multus-xzdlq\" (UID: \"585342c4-6023-45ad-b2b3-b68072a36bca\") " pod="openshift-multus/multus-xzdlq"
Sep 11 21:05:56.173429 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.172343    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/585342c4-6023-45ad-b2b3-b68072a36bca-host-var-lib-cni-multus\") pod \"multus-xzdlq\" (UID: \"585342c4-6023-45ad-b2b3-b68072a36bca\") " pod="openshift-multus/multus-xzdlq"
Sep 11 21:05:56.173429 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.172435    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/585342c4-6023-45ad-b2b3-b68072a36bca-system-cni-dir\") pod \"multus-xzdlq\" (UID: \"585342c4-6023-45ad-b2b3-b68072a36bca\") " pod="openshift-multus/multus-xzdlq"
Sep 11 21:05:56.173429 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.172445    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/342a8a16-663e-4958-ab55-a6a8f04d9222-etc-kubernetes\") pod \"tuned-9bcdv\" (UID: \"342a8a16-663e-4958-ab55-a6a8f04d9222\") " pod="openshift-cluster-node-tuning-operator/tuned-9bcdv"
Sep 11 21:05:56.173429 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.172482    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/585342c4-6023-45ad-b2b3-b68072a36bca-host-run-netns\") pod \"multus-xzdlq\" (UID: \"585342c4-6023-45ad-b2b3-b68072a36bca\") " pod="openshift-multus/multus-xzdlq"
Sep 11 21:05:56.173979 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.172487    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/585342c4-6023-45ad-b2b3-b68072a36bca-system-cni-dir\") pod \"multus-xzdlq\" (UID: \"585342c4-6023-45ad-b2b3-b68072a36bca\") " pod="openshift-multus/multus-xzdlq"
Sep 11 21:05:56.173979 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.172515    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vc5t8\" (UniqueName: \"kubernetes.io/projected/394b71c4-7749-4e24-a7ef-b7060c4b4864-kube-api-access-vc5t8\") pod \"network-check-target-sxs24\" (UID: \"394b71c4-7749-4e24-a7ef-b7060c4b4864\") " pod="openshift-network-diagnostics/network-check-target-sxs24"
Sep 11 21:05:56.173979 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.172540    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/342a8a16-663e-4958-ab55-a6a8f04d9222-host\") pod \"tuned-9bcdv\" (UID: \"342a8a16-663e-4958-ab55-a6a8f04d9222\") " pod="openshift-cluster-node-tuning-operator/tuned-9bcdv"
Sep 11 21:05:56.173979 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.172546    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/342a8a16-663e-4958-ab55-a6a8f04d9222-etc-systemd\") pod \"tuned-9bcdv\" (UID: \"342a8a16-663e-4958-ab55-a6a8f04d9222\") " pod="openshift-cluster-node-tuning-operator/tuned-9bcdv"
Sep 11 21:05:56.173979 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.172564    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/342a8a16-663e-4958-ab55-a6a8f04d9222-etc-sysctl-conf\") pod \"tuned-9bcdv\" (UID: \"342a8a16-663e-4958-ab55-a6a8f04d9222\") " pod="openshift-cluster-node-tuning-operator/tuned-9bcdv"
Sep 11 21:05:56.173979 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.172566    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/61773d0c-6a2a-4a1b-8d98-30897e76ae6b-cnibin\") pod \"multus-additional-cni-plugins-v4sq2\" (UID: \"61773d0c-6a2a-4a1b-8d98-30897e76ae6b\") " pod="openshift-multus/multus-additional-cni-plugins-v4sq2"
Sep 11 21:05:56.173979 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.172598    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/516a2da5-32a7-4c55-82e4-734bbf607583-sys-fs\") pod \"aws-ebs-csi-driver-node-pcr9m\" (UID: \"516a2da5-32a7-4c55-82e4-734bbf607583\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcr9m"
Sep 11 21:05:56.173979 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.172607    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/585342c4-6023-45ad-b2b3-b68072a36bca-multus-conf-dir\") pod \"multus-xzdlq\" (UID: \"585342c4-6023-45ad-b2b3-b68072a36bca\") " pod="openshift-multus/multus-xzdlq"
Sep 11 21:05:56.173979 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.172599    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/585342c4-6023-45ad-b2b3-b68072a36bca-host-run-netns\") pod \"multus-xzdlq\" (UID: \"585342c4-6023-45ad-b2b3-b68072a36bca\") " pod="openshift-multus/multus-xzdlq"
Sep 11 21:05:56.173979 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.172636    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/585342c4-6023-45ad-b2b3-b68072a36bca-multus-daemon-config\") pod \"multus-xzdlq\" (UID: \"585342c4-6023-45ad-b2b3-b68072a36bca\") " pod="openshift-multus/multus-xzdlq"
Sep 11 21:05:56.173979 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.172660    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/342a8a16-663e-4958-ab55-a6a8f04d9222-host\") pod \"tuned-9bcdv\" (UID: \"342a8a16-663e-4958-ab55-a6a8f04d9222\") " pod="openshift-cluster-node-tuning-operator/tuned-9bcdv"
Sep 11 21:05:56.173979 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.172694    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/585342c4-6023-45ad-b2b3-b68072a36bca-multus-conf-dir\") pod \"multus-xzdlq\" (UID: \"585342c4-6023-45ad-b2b3-b68072a36bca\") " pod="openshift-multus/multus-xzdlq"
Sep 11 21:05:56.173979 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.172699    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/585342c4-6023-45ad-b2b3-b68072a36bca-host-run-multus-certs\") pod \"multus-xzdlq\" (UID: \"585342c4-6023-45ad-b2b3-b68072a36bca\") " pod="openshift-multus/multus-xzdlq"
Sep 11 21:05:56.173979 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.172661    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/585342c4-6023-45ad-b2b3-b68072a36bca-host-run-multus-certs\") pod \"multus-xzdlq\" (UID: \"585342c4-6023-45ad-b2b3-b68072a36bca\") " pod="openshift-multus/multus-xzdlq"
Sep 11 21:05:56.173979 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.172721    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/585342c4-6023-45ad-b2b3-b68072a36bca-cni-binary-copy\") pod \"multus-xzdlq\" (UID: \"585342c4-6023-45ad-b2b3-b68072a36bca\") " pod="openshift-multus/multus-xzdlq"
Sep 11 21:05:56.173979 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.172741    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/61773d0c-6a2a-4a1b-8d98-30897e76ae6b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v4sq2\" (UID: \"61773d0c-6a2a-4a1b-8d98-30897e76ae6b\") " pod="openshift-multus/multus-additional-cni-plugins-v4sq2"
Sep 11 21:05:56.173979 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.172771    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/585342c4-6023-45ad-b2b3-b68072a36bca-host-var-lib-cni-bin\") pod \"multus-xzdlq\" (UID: \"585342c4-6023-45ad-b2b3-b68072a36bca\") " pod="openshift-multus/multus-xzdlq"
Sep 11 21:05:56.173979 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.172784    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/61773d0c-6a2a-4a1b-8d98-30897e76ae6b-cnibin\") pod \"multus-additional-cni-plugins-v4sq2\" (UID: \"61773d0c-6a2a-4a1b-8d98-30897e76ae6b\") " pod="openshift-multus/multus-additional-cni-plugins-v4sq2"
Sep 11 21:05:56.174532 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.172795    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/342a8a16-663e-4958-ab55-a6a8f04d9222-etc-sysconfig\") pod \"tuned-9bcdv\" (UID: \"342a8a16-663e-4958-ab55-a6a8f04d9222\") " pod="openshift-cluster-node-tuning-operator/tuned-9bcdv"
Sep 11 21:05:56.174532 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.172820    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/61773d0c-6a2a-4a1b-8d98-30897e76ae6b-system-cni-dir\") pod \"multus-additional-cni-plugins-v4sq2\" (UID: \"61773d0c-6a2a-4a1b-8d98-30897e76ae6b\") " pod="openshift-multus/multus-additional-cni-plugins-v4sq2"
Sep 11 21:05:56.174532 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.172826    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/585342c4-6023-45ad-b2b3-b68072a36bca-host-var-lib-cni-bin\") pod \"multus-xzdlq\" (UID: \"585342c4-6023-45ad-b2b3-b68072a36bca\") " pod="openshift-multus/multus-xzdlq"
Sep 11 21:05:56.174532 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.172879    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-896m2\" (UniqueName: \"kubernetes.io/projected/585342c4-6023-45ad-b2b3-b68072a36bca-kube-api-access-896m2\") pod \"multus-xzdlq\" (UID: \"585342c4-6023-45ad-b2b3-b68072a36bca\") " pod="openshift-multus/multus-xzdlq"
Sep 11 21:05:56.174532 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.172911    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/516a2da5-32a7-4c55-82e4-734bbf607583-socket-dir\") pod \"aws-ebs-csi-driver-node-pcr9m\" (UID: \"516a2da5-32a7-4c55-82e4-734bbf607583\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcr9m"
Sep 11 21:05:56.174532 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.172935    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/585342c4-6023-45ad-b2b3-b68072a36bca-multus-socket-dir-parent\") pod \"multus-xzdlq\" (UID: \"585342c4-6023-45ad-b2b3-b68072a36bca\") " pod="openshift-multus/multus-xzdlq"
Sep 11 21:05:56.174532 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.172959    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/342a8a16-663e-4958-ab55-a6a8f04d9222-var-lib-kubelet\") pod \"tuned-9bcdv\" (UID: \"342a8a16-663e-4958-ab55-a6a8f04d9222\") " pod="openshift-cluster-node-tuning-operator/tuned-9bcdv"
Sep 11 21:05:56.174532 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.173008    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/342a8a16-663e-4958-ab55-a6a8f04d9222-var-lib-kubelet\") pod \"tuned-9bcdv\" (UID: \"342a8a16-663e-4958-ab55-a6a8f04d9222\") " pod="openshift-cluster-node-tuning-operator/tuned-9bcdv"
Sep 11 21:05:56.174532 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.173123    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/516a2da5-32a7-4c55-82e4-734bbf607583-socket-dir\") pod \"aws-ebs-csi-driver-node-pcr9m\" (UID: \"516a2da5-32a7-4c55-82e4-734bbf607583\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcr9m"
Sep 11 21:05:56.174532 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.173169    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52734055-1949-4e54-a2dc-623f80a5c1ac-tmp-dir\") pod \"node-resolver-wwnsp\" (UID: \"52734055-1949-4e54-a2dc-623f80a5c1ac\") " pod="openshift-dns/node-resolver-wwnsp"
Sep 11 21:05:56.174532 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.173182    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/585342c4-6023-45ad-b2b3-b68072a36bca-multus-socket-dir-parent\") pod \"multus-xzdlq\" (UID: \"585342c4-6023-45ad-b2b3-b68072a36bca\") " pod="openshift-multus/multus-xzdlq"
Sep 11 21:05:56.174532 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.173186    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/585342c4-6023-45ad-b2b3-b68072a36bca-multus-daemon-config\") pod \"multus-xzdlq\" (UID: \"585342c4-6023-45ad-b2b3-b68072a36bca\") " pod="openshift-multus/multus-xzdlq"
Sep 11 21:05:56.174532 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.173218    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/61773d0c-6a2a-4a1b-8d98-30897e76ae6b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v4sq2\" (UID: \"61773d0c-6a2a-4a1b-8d98-30897e76ae6b\") " pod="openshift-multus/multus-additional-cni-plugins-v4sq2"
Sep 11 21:05:56.174532 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.173224    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/342a8a16-663e-4958-ab55-a6a8f04d9222-etc-sysconfig\") pod \"tuned-9bcdv\" (UID: \"342a8a16-663e-4958-ab55-a6a8f04d9222\") " pod="openshift-cluster-node-tuning-operator/tuned-9bcdv"
Sep 11 21:05:56.174532 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.173243    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/61773d0c-6a2a-4a1b-8d98-30897e76ae6b-system-cni-dir\") pod \"multus-additional-cni-plugins-v4sq2\" (UID: \"61773d0c-6a2a-4a1b-8d98-30897e76ae6b\") " pod="openshift-multus/multus-additional-cni-plugins-v4sq2"
Sep 11 21:05:56.174532 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.173509    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52734055-1949-4e54-a2dc-623f80a5c1ac-tmp-dir\") pod \"node-resolver-wwnsp\" (UID: \"52734055-1949-4e54-a2dc-623f80a5c1ac\") " pod="openshift-dns/node-resolver-wwnsp"
Sep 11 21:05:56.174532 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.174511    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/342a8a16-663e-4958-ab55-a6a8f04d9222-etc-tuned\") pod \"tuned-9bcdv\" (UID: \"342a8a16-663e-4958-ab55-a6a8f04d9222\") " pod="openshift-cluster-node-tuning-operator/tuned-9bcdv"
Sep 11 21:05:56.175082 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.174688    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6159eecf-1d1a-4d36-9c12-906f8b272142-agent-certs\") pod \"konnectivity-agent-7d7s4\" (UID: \"6159eecf-1d1a-4d36-9c12-906f8b272142\") " pod="kube-system/konnectivity-agent-7d7s4"
Sep 11 21:05:56.175082 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.174743    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/342a8a16-663e-4958-ab55-a6a8f04d9222-tmp\") pod \"tuned-9bcdv\" (UID: \"342a8a16-663e-4958-ab55-a6a8f04d9222\") " pod="openshift-cluster-node-tuning-operator/tuned-9bcdv"
Sep 11 21:05:56.178697 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.178672    2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 21:05:56.180113 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:56.180089    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 21:05:56.180113 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:56.180110    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 21:05:56.180253 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:56.180121    2560 projected.go:196] Error preparing data for projected volume kube-api-access-vc5t8 for pod openshift-network-diagnostics/network-check-target-sxs24: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:05:56.180253 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:56.180185    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/394b71c4-7749-4e24-a7ef-b7060c4b4864-kube-api-access-vc5t8 podName:394b71c4-7749-4e24-a7ef-b7060c4b4864 nodeName:}" failed. No retries permitted until 2026-09-11 21:05:56.680168295 +0000 UTC m=+2.158480155 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vc5t8" (UniqueName: "kubernetes.io/projected/394b71c4-7749-4e24-a7ef-b7060c4b4864-kube-api-access-vc5t8") pod "network-check-target-sxs24" (UID: "394b71c4-7749-4e24-a7ef-b7060c4b4864") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:05:56.181436 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.181358    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq8c8\" (UniqueName: \"kubernetes.io/projected/342a8a16-663e-4958-ab55-a6a8f04d9222-kube-api-access-tq8c8\") pod \"tuned-9bcdv\" (UID: \"342a8a16-663e-4958-ab55-a6a8f04d9222\") " pod="openshift-cluster-node-tuning-operator/tuned-9bcdv"
Sep 11 21:05:56.182401 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.182356    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bxnh\" (UniqueName: \"kubernetes.io/projected/9e88e074-d628-4e0b-a23c-ce95b8a44c21-kube-api-access-7bxnh\") pod \"node-ca-b7sx4\" (UID: \"9e88e074-d628-4e0b-a23c-ce95b8a44c21\") " pod="openshift-image-registry/node-ca-b7sx4"
Sep 11 21:05:56.182985 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.182952    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wj6v8\" (UniqueName: \"kubernetes.io/projected/5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3-kube-api-access-wj6v8\") pod \"network-metrics-daemon-6nwfd\" (UID: \"5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3\") " pod="openshift-multus/network-metrics-daemon-6nwfd"
Sep 11 21:05:56.183277 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.183255    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-896m2\" (UniqueName: \"kubernetes.io/projected/585342c4-6023-45ad-b2b3-b68072a36bca-kube-api-access-896m2\") pod \"multus-xzdlq\" (UID: \"585342c4-6023-45ad-b2b3-b68072a36bca\") " pod="openshift-multus/multus-xzdlq"
Sep 11 21:05:56.183924 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.183904    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxt48\" (UniqueName: \"kubernetes.io/projected/52734055-1949-4e54-a2dc-623f80a5c1ac-kube-api-access-mxt48\") pod \"node-resolver-wwnsp\" (UID: \"52734055-1949-4e54-a2dc-623f80a5c1ac\") " pod="openshift-dns/node-resolver-wwnsp"
Sep 11 21:05:56.184633 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.184614    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9g72t\" (UniqueName: \"kubernetes.io/projected/61773d0c-6a2a-4a1b-8d98-30897e76ae6b-kube-api-access-9g72t\") pod \"multus-additional-cni-plugins-v4sq2\" (UID: \"61773d0c-6a2a-4a1b-8d98-30897e76ae6b\") " pod="openshift-multus/multus-additional-cni-plugins-v4sq2"
Sep 11 21:05:56.184991 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.184974    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nbvm\" (UniqueName: \"kubernetes.io/projected/516a2da5-32a7-4c55-82e4-734bbf607583-kube-api-access-2nbvm\") pod \"aws-ebs-csi-driver-node-pcr9m\" (UID: \"516a2da5-32a7-4c55-82e4-734bbf607583\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcr9m"
Sep 11 21:05:56.286547 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.286452    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rr9d4"
Sep 11 21:05:56.296881 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:56.296828    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c8f606b_293c_477a_a7ea_62542fe22b78.slice/crio-cc6bba907b37f16cef7870fdc3c999fda22bc8f030ac07373d138698fc8e910f WatchSource:0}: Error finding container cc6bba907b37f16cef7870fdc3c999fda22bc8f030ac07373d138698fc8e910f: Status 404 returned error can't find the container with id cc6bba907b37f16cef7870fdc3c999fda22bc8f030ac07373d138698fc8e910f
Sep 11 21:05:56.308370 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.308334    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:05:56.313622 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.313588    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7d7s4"
Sep 11 21:05:56.317980 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:56.317944    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17493773_1416_44a9_8a25_b05d1daccc37.slice/crio-85e254800160e36ac62b82db0cb4e90fcc3cb610c15b6f591d99e5da9adfb277 WatchSource:0}: Error finding container 85e254800160e36ac62b82db0cb4e90fcc3cb610c15b6f591d99e5da9adfb277: Status 404 returned error can't find the container with id 85e254800160e36ac62b82db0cb4e90fcc3cb610c15b6f591d99e5da9adfb277
Sep 11 21:05:56.323095 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:56.323067    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6159eecf_1d1a_4d36_9c12_906f8b272142.slice/crio-079dc7d9d63810b4e26816e6d57d0a139b9720ebeb3665b7976411aa03a969c4 WatchSource:0}: Error finding container 079dc7d9d63810b4e26816e6d57d0a139b9720ebeb3665b7976411aa03a969c4: Status 404 returned error can't find the container with id 079dc7d9d63810b4e26816e6d57d0a139b9720ebeb3665b7976411aa03a969c4
Sep 11 21:05:56.335124 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.335093    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcr9m"
Sep 11 21:05:56.346784 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:56.346754    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod516a2da5_32a7_4c55_82e4_734bbf607583.slice/crio-65e15fce9d6560ade3f0184a03edf432438b547cc50e3e79ce47f235e997e336 WatchSource:0}: Error finding container 65e15fce9d6560ade3f0184a03edf432438b547cc50e3e79ce47f235e997e336: Status 404 returned error can't find the container with id 65e15fce9d6560ade3f0184a03edf432438b547cc50e3e79ce47f235e997e336
Sep 11 21:05:56.362054 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.362025    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9bcdv"
Sep 11 21:05:56.371666 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:56.371412    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod342a8a16_663e_4958_ab55_a6a8f04d9222.slice/crio-62cbde336a331d0fd068fbbc0c755781946ba575af713c784ea19c8c7c8877c9 WatchSource:0}: Error finding container 62cbde336a331d0fd068fbbc0c755781946ba575af713c784ea19c8c7c8877c9: Status 404 returned error can't find the container with id 62cbde336a331d0fd068fbbc0c755781946ba575af713c784ea19c8c7c8877c9
Sep 11 21:05:56.383307 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.383271    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b7sx4"
Sep 11 21:05:56.392958 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:56.392928    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e88e074_d628_4e0b_a23c_ce95b8a44c21.slice/crio-d80697df2ed874ee4259bd00cc53e6b27d9779db80b760af24a1116411ee863f WatchSource:0}: Error finding container d80697df2ed874ee4259bd00cc53e6b27d9779db80b760af24a1116411ee863f: Status 404 returned error can't find the container with id d80697df2ed874ee4259bd00cc53e6b27d9779db80b760af24a1116411ee863f
Sep 11 21:05:56.404110 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.404074    2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 21:05:56.414282 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.414251    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v4sq2"
Sep 11 21:05:56.419442 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.419420    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xzdlq"
Sep 11 21:05:56.423833 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:56.423806    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61773d0c_6a2a_4a1b_8d98_30897e76ae6b.slice/crio-e750e5dd34608102b3610f4f4f9fc60e5c18d69f50d7a4751189b0495869da71 WatchSource:0}: Error finding container e750e5dd34608102b3610f4f4f9fc60e5c18d69f50d7a4751189b0495869da71: Status 404 returned error can't find the container with id e750e5dd34608102b3610f4f4f9fc60e5c18d69f50d7a4751189b0495869da71
Sep 11 21:05:56.424403 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.424369    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wwnsp"
Sep 11 21:05:56.428581 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:56.428559    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod585342c4_6023_45ad_b2b3_b68072a36bca.slice/crio-6b168ae8c16cffa0407fc6b3e90aa2844733ffe3bcb34561c4e3dbf1903e32f4 WatchSource:0}: Error finding container 6b168ae8c16cffa0407fc6b3e90aa2844733ffe3bcb34561c4e3dbf1903e32f4: Status 404 returned error can't find the container with id 6b168ae8c16cffa0407fc6b3e90aa2844733ffe3bcb34561c4e3dbf1903e32f4
Sep 11 21:05:56.434654 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:05:56.434625    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52734055_1949_4e54_a2dc_623f80a5c1ac.slice/crio-32be580189b849275db6ec28671e296f7dc17b3d201d65bb1f010934c545df41 WatchSource:0}: Error finding container 32be580189b849275db6ec28671e296f7dc17b3d201d65bb1f010934c545df41: Status 404 returned error can't find the container with id 32be580189b849275db6ec28671e296f7dc17b3d201d65bb1f010934c545df41
Sep 11 21:05:56.576363 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.576277    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc-original-pull-secret\") pod \"global-pull-secret-syncer-vxlb2\" (UID: \"0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc\") " pod="kube-system/global-pull-secret-syncer-vxlb2"
Sep 11 21:05:56.576529 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:56.576402    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 21:05:56.576529 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:56.576457    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc-original-pull-secret podName:0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc nodeName:}" failed. No retries permitted until 2026-09-11 21:05:57.576441786 +0000 UTC m=+3.054753621 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc-original-pull-secret") pod "global-pull-secret-syncer-vxlb2" (UID: "0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc") : object "kube-system"/"original-pull-secret" not registered
Sep 11 21:05:56.677000 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.676962    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3-metrics-certs\") pod \"network-metrics-daemon-6nwfd\" (UID: \"5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3\") " pod="openshift-multus/network-metrics-daemon-6nwfd"
Sep 11 21:05:56.677179 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:56.677109    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:05:56.677252 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:56.677181    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3-metrics-certs podName:5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3 nodeName:}" failed. No retries permitted until 2026-09-11 21:05:57.677161117 +0000 UTC m=+3.155472953 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3-metrics-certs") pod "network-metrics-daemon-6nwfd" (UID: "5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:05:56.778355 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:56.778305    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vc5t8\" (UniqueName: \"kubernetes.io/projected/394b71c4-7749-4e24-a7ef-b7060c4b4864-kube-api-access-vc5t8\") pod \"network-check-target-sxs24\" (UID: \"394b71c4-7749-4e24-a7ef-b7060c4b4864\") " pod="openshift-network-diagnostics/network-check-target-sxs24"
Sep 11 21:05:56.778576 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:56.778556    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 21:05:56.778647 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:56.778583    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 21:05:56.778647 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:56.778596    2560 projected.go:196] Error preparing data for projected volume kube-api-access-vc5t8 for pod openshift-network-diagnostics/network-check-target-sxs24: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:05:56.778742 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:56.778660    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/394b71c4-7749-4e24-a7ef-b7060c4b4864-kube-api-access-vc5t8 podName:394b71c4-7749-4e24-a7ef-b7060c4b4864 nodeName:}" failed. No retries permitted until 2026-09-11 21:05:57.778641425 +0000 UTC m=+3.256953315 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vc5t8" (UniqueName: "kubernetes.io/projected/394b71c4-7749-4e24-a7ef-b7060c4b4864-kube-api-access-vc5t8") pod "network-check-target-sxs24" (UID: "394b71c4-7749-4e24-a7ef-b7060c4b4864") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:05:57.011325 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:57.011194    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 21:00:55 +0000 UTC" deadline="2028-06-19 18:19:42.852721518 +0000 UTC"
Sep 11 21:05:57.011325 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:57.011266    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15525h13m45.841460239s"
Sep 11 21:05:57.059641 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:57.059526    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xzdlq" event={"ID":"585342c4-6023-45ad-b2b3-b68072a36bca","Type":"ContainerStarted","Data":"6b168ae8c16cffa0407fc6b3e90aa2844733ffe3bcb34561c4e3dbf1903e32f4"}
Sep 11 21:05:57.069258 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:57.069217    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v4sq2" event={"ID":"61773d0c-6a2a-4a1b-8d98-30897e76ae6b","Type":"ContainerStarted","Data":"e750e5dd34608102b3610f4f4f9fc60e5c18d69f50d7a4751189b0495869da71"}
Sep 11 21:05:57.076267 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:57.076233    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 21:05:57.093045 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:57.092991    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b7sx4" event={"ID":"9e88e074-d628-4e0b-a23c-ce95b8a44c21","Type":"ContainerStarted","Data":"d80697df2ed874ee4259bd00cc53e6b27d9779db80b760af24a1116411ee863f"}
Sep 11 21:05:57.099050 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:57.099005    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9bcdv" event={"ID":"342a8a16-663e-4958-ab55-a6a8f04d9222","Type":"ContainerStarted","Data":"62cbde336a331d0fd068fbbc0c755781946ba575af713c784ea19c8c7c8877c9"}
Sep 11 21:05:57.121472 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:57.121428    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcr9m" event={"ID":"516a2da5-32a7-4c55-82e4-734bbf607583","Type":"ContainerStarted","Data":"65e15fce9d6560ade3f0184a03edf432438b547cc50e3e79ce47f235e997e336"}
Sep 11 21:05:57.130191 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:57.130150    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7d7s4" event={"ID":"6159eecf-1d1a-4d36-9c12-906f8b272142","Type":"ContainerStarted","Data":"079dc7d9d63810b4e26816e6d57d0a139b9720ebeb3665b7976411aa03a969c4"}
Sep 11 21:05:57.142312 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:57.142264    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk" event={"ID":"17493773-1416-44a9-8a25-b05d1daccc37","Type":"ContainerStarted","Data":"85e254800160e36ac62b82db0cb4e90fcc3cb610c15b6f591d99e5da9adfb277"}
Sep 11 21:05:57.153164 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:57.153123    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rr9d4" event={"ID":"3c8f606b-293c-477a-a7ea-62542fe22b78","Type":"ContainerStarted","Data":"cc6bba907b37f16cef7870fdc3c999fda22bc8f030ac07373d138698fc8e910f"}
Sep 11 21:05:57.169833 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:57.168568    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-163.ec2.internal" event={"ID":"75a23667c2d6b01bd21de457ebee8e0a","Type":"ContainerStarted","Data":"f597e0908b2a374949a20703484a024443f83baa7ea3f65e4abffdb171e0c95e"}
Sep 11 21:05:57.191266 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:57.191223    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-163.ec2.internal" event={"ID":"de7ebdcdf2700e0582a4401358202032","Type":"ContainerStarted","Data":"ee3c725bdf7b58b068ce9c7162840b50986e6932cafadf4c102cc3b82b85a35f"}
Sep 11 21:05:57.203306 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:57.203250    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wwnsp" event={"ID":"52734055-1949-4e54-a2dc-623f80a5c1ac","Type":"ContainerStarted","Data":"32be580189b849275db6ec28671e296f7dc17b3d201d65bb1f010934c545df41"}
Sep 11 21:05:57.585655 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:57.585615    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc-original-pull-secret\") pod \"global-pull-secret-syncer-vxlb2\" (UID: \"0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc\") " pod="kube-system/global-pull-secret-syncer-vxlb2"
Sep 11 21:05:57.585848 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:57.585830    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 21:05:57.585922 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:57.585896    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc-original-pull-secret podName:0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc nodeName:}" failed. No retries permitted until 2026-09-11 21:05:59.585877117 +0000 UTC m=+5.064188944 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc-original-pull-secret") pod "global-pull-secret-syncer-vxlb2" (UID: "0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc") : object "kube-system"/"original-pull-secret" not registered
Sep 11 21:05:57.686689 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:57.686648    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3-metrics-certs\") pod \"network-metrics-daemon-6nwfd\" (UID: \"5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3\") " pod="openshift-multus/network-metrics-daemon-6nwfd"
Sep 11 21:05:57.686891 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:57.686827    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:05:57.686965 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:57.686893    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3-metrics-certs podName:5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3 nodeName:}" failed. No retries permitted until 2026-09-11 21:05:59.68687325 +0000 UTC m=+5.165185085 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3-metrics-certs") pod "network-metrics-daemon-6nwfd" (UID: "5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:05:57.787749 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:57.787682    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vc5t8\" (UniqueName: \"kubernetes.io/projected/394b71c4-7749-4e24-a7ef-b7060c4b4864-kube-api-access-vc5t8\") pod \"network-check-target-sxs24\" (UID: \"394b71c4-7749-4e24-a7ef-b7060c4b4864\") " pod="openshift-network-diagnostics/network-check-target-sxs24"
Sep 11 21:05:57.787957 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:57.787884    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 21:05:57.787957 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:57.787916    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 21:05:57.787957 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:57.787931    2560 projected.go:196] Error preparing data for projected volume kube-api-access-vc5t8 for pod openshift-network-diagnostics/network-check-target-sxs24: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:05:57.788120 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:57.787998    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/394b71c4-7749-4e24-a7ef-b7060c4b4864-kube-api-access-vc5t8 podName:394b71c4-7749-4e24-a7ef-b7060c4b4864 nodeName:}" failed. No retries permitted until 2026-09-11 21:05:59.787978109 +0000 UTC m=+5.266289938 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vc5t8" (UniqueName: "kubernetes.io/projected/394b71c4-7749-4e24-a7ef-b7060c4b4864-kube-api-access-vc5t8") pod "network-check-target-sxs24" (UID: "394b71c4-7749-4e24-a7ef-b7060c4b4864") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:05:58.012513 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:58.012336    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 21:00:55 +0000 UTC" deadline="2028-04-07 10:22:20.857435257 +0000 UTC"
Sep 11 21:05:58.012513 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:58.012393    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13765h16m22.845059868s"
Sep 11 21:05:58.032493 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:58.031556    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6nwfd"
Sep 11 21:05:58.032493 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:58.031723    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6nwfd" podUID="5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3"
Sep 11 21:05:58.032493 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:58.032169    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sxs24"
Sep 11 21:05:58.032493 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:58.032274    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sxs24" podUID="394b71c4-7749-4e24-a7ef-b7060c4b4864"
Sep 11 21:05:58.032493 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:58.032342    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vxlb2"
Sep 11 21:05:58.032493 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:58.032440    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vxlb2" podUID="0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc"
Sep 11 21:05:58.625233 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:58.625201    2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 21:05:59.605131 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:59.604518    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc-original-pull-secret\") pod \"global-pull-secret-syncer-vxlb2\" (UID: \"0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc\") " pod="kube-system/global-pull-secret-syncer-vxlb2"
Sep 11 21:05:59.605131 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:59.604689    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 21:05:59.605131 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:59.604754    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc-original-pull-secret podName:0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc nodeName:}" failed. No retries permitted until 2026-09-11 21:06:03.604734805 +0000 UTC m=+9.083046646 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc-original-pull-secret") pod "global-pull-secret-syncer-vxlb2" (UID: "0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc") : object "kube-system"/"original-pull-secret" not registered
Sep 11 21:05:59.706615 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:59.705903    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3-metrics-certs\") pod \"network-metrics-daemon-6nwfd\" (UID: \"5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3\") " pod="openshift-multus/network-metrics-daemon-6nwfd"
Sep 11 21:05:59.706615 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:59.706113    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:05:59.706615 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:59.706185    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3-metrics-certs podName:5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3 nodeName:}" failed. No retries permitted until 2026-09-11 21:06:03.70616605 +0000 UTC m=+9.184477887 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3-metrics-certs") pod "network-metrics-daemon-6nwfd" (UID: "5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:05:59.807152 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:05:59.807045    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vc5t8\" (UniqueName: \"kubernetes.io/projected/394b71c4-7749-4e24-a7ef-b7060c4b4864-kube-api-access-vc5t8\") pod \"network-check-target-sxs24\" (UID: \"394b71c4-7749-4e24-a7ef-b7060c4b4864\") " pod="openshift-network-diagnostics/network-check-target-sxs24"
Sep 11 21:05:59.807323 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:59.807232    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 21:05:59.807323 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:59.807257    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 21:05:59.807323 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:59.807269    2560 projected.go:196] Error preparing data for projected volume kube-api-access-vc5t8 for pod openshift-network-diagnostics/network-check-target-sxs24: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:05:59.807507 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:05:59.807334    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/394b71c4-7749-4e24-a7ef-b7060c4b4864-kube-api-access-vc5t8 podName:394b71c4-7749-4e24-a7ef-b7060c4b4864 nodeName:}" failed. No retries permitted until 2026-09-11 21:06:03.807314653 +0000 UTC m=+9.285626480 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vc5t8" (UniqueName: "kubernetes.io/projected/394b71c4-7749-4e24-a7ef-b7060c4b4864-kube-api-access-vc5t8") pod "network-check-target-sxs24" (UID: "394b71c4-7749-4e24-a7ef-b7060c4b4864") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:06:00.031602 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:00.031543    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6nwfd"
Sep 11 21:06:00.031773 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:00.031744    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6nwfd" podUID="5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3"
Sep 11 21:06:00.031831 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:00.031795    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sxs24"
Sep 11 21:06:00.032092 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:00.031905    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sxs24" podUID="394b71c4-7749-4e24-a7ef-b7060c4b4864"
Sep 11 21:06:00.032092 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:00.031978    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vxlb2"
Sep 11 21:06:00.032092 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:00.032049    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vxlb2" podUID="0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc"
Sep 11 21:06:01.036322 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:01.035797    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vxlb2"
Sep 11 21:06:01.036322 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:01.035931    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vxlb2" podUID="0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc"
Sep 11 21:06:02.031311 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:02.031270    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sxs24"
Sep 11 21:06:02.031531 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:02.031270    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6nwfd"
Sep 11 21:06:02.031603 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:02.031543    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6nwfd" podUID="5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3"
Sep 11 21:06:02.031603 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:02.031433    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sxs24" podUID="394b71c4-7749-4e24-a7ef-b7060c4b4864"
Sep 11 21:06:03.031838 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:03.031802    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vxlb2"
Sep 11 21:06:03.032296 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:03.031961    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vxlb2" podUID="0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc"
Sep 11 21:06:03.639285 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:03.639223    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc-original-pull-secret\") pod \"global-pull-secret-syncer-vxlb2\" (UID: \"0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc\") " pod="kube-system/global-pull-secret-syncer-vxlb2"
Sep 11 21:06:03.639471 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:03.639448    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 21:06:03.639532 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:03.639505    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc-original-pull-secret podName:0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc nodeName:}" failed. No retries permitted until 2026-09-11 21:06:11.639491466 +0000 UTC m=+17.117803301 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc-original-pull-secret") pod "global-pull-secret-syncer-vxlb2" (UID: "0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc") : object "kube-system"/"original-pull-secret" not registered
Sep 11 21:06:03.740528 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:03.740490    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3-metrics-certs\") pod \"network-metrics-daemon-6nwfd\" (UID: \"5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3\") " pod="openshift-multus/network-metrics-daemon-6nwfd"
Sep 11 21:06:03.740722 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:03.740637    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:06:03.740722 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:03.740712    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3-metrics-certs podName:5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3 nodeName:}" failed. No retries permitted until 2026-09-11 21:06:11.740691852 +0000 UTC m=+17.219003690 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3-metrics-certs") pod "network-metrics-daemon-6nwfd" (UID: "5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:06:03.841784 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:03.841750    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vc5t8\" (UniqueName: \"kubernetes.io/projected/394b71c4-7749-4e24-a7ef-b7060c4b4864-kube-api-access-vc5t8\") pod \"network-check-target-sxs24\" (UID: \"394b71c4-7749-4e24-a7ef-b7060c4b4864\") " pod="openshift-network-diagnostics/network-check-target-sxs24"
Sep 11 21:06:03.841973 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:03.841911    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 21:06:03.841973 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:03.841931    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 21:06:03.841973 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:03.841943    2560 projected.go:196] Error preparing data for projected volume kube-api-access-vc5t8 for pod openshift-network-diagnostics/network-check-target-sxs24: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:06:03.842149 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:03.842003    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/394b71c4-7749-4e24-a7ef-b7060c4b4864-kube-api-access-vc5t8 podName:394b71c4-7749-4e24-a7ef-b7060c4b4864 nodeName:}" failed. No retries permitted until 2026-09-11 21:06:11.84198949 +0000 UTC m=+17.320301312 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vc5t8" (UniqueName: "kubernetes.io/projected/394b71c4-7749-4e24-a7ef-b7060c4b4864-kube-api-access-vc5t8") pod "network-check-target-sxs24" (UID: "394b71c4-7749-4e24-a7ef-b7060c4b4864") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:06:04.031752 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:04.031492    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sxs24"
Sep 11 21:06:04.031752 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:04.031650    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sxs24" podUID="394b71c4-7749-4e24-a7ef-b7060c4b4864"
Sep 11 21:06:04.031752 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:04.031733    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6nwfd"
Sep 11 21:06:04.032344 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:04.031832    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6nwfd" podUID="5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3"
Sep 11 21:06:05.032055 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:05.032018    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vxlb2"
Sep 11 21:06:05.032676 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:05.032129    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vxlb2" podUID="0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc"
Sep 11 21:06:06.031973 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:06.031876    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sxs24"
Sep 11 21:06:06.032148 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:06.032026    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sxs24" podUID="394b71c4-7749-4e24-a7ef-b7060c4b4864"
Sep 11 21:06:06.032148 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:06.032038    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6nwfd"
Sep 11 21:06:06.032548 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:06.032150    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6nwfd" podUID="5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3"
Sep 11 21:06:07.031053 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:07.031011    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vxlb2"
Sep 11 21:06:07.031250 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:07.031152    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vxlb2" podUID="0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc"
Sep 11 21:06:08.031509 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:08.031470    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6nwfd"
Sep 11 21:06:08.031896 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:08.031487    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sxs24"
Sep 11 21:06:08.031896 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:08.031588    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6nwfd" podUID="5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3"
Sep 11 21:06:08.031896 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:08.031638    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sxs24" podUID="394b71c4-7749-4e24-a7ef-b7060c4b4864"
Sep 11 21:06:09.031635 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:09.031589    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vxlb2"
Sep 11 21:06:09.032114 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:09.031743    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vxlb2" podUID="0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc"
Sep 11 21:06:10.031893 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:10.031850    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6nwfd"
Sep 11 21:06:10.032377 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:10.032082    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6nwfd" podUID="5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3"
Sep 11 21:06:10.032377 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:10.032119    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sxs24"
Sep 11 21:06:10.032377 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:10.032257    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sxs24" podUID="394b71c4-7749-4e24-a7ef-b7060c4b4864"
Sep 11 21:06:11.031204 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:11.031171    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vxlb2"
Sep 11 21:06:11.031418 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:11.031301    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vxlb2" podUID="0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc"
Sep 11 21:06:11.705623 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:11.705580    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc-original-pull-secret\") pod \"global-pull-secret-syncer-vxlb2\" (UID: \"0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc\") " pod="kube-system/global-pull-secret-syncer-vxlb2"
Sep 11 21:06:11.706128 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:11.705739    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 21:06:11.706128 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:11.705826    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc-original-pull-secret podName:0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc nodeName:}" failed. No retries permitted until 2026-09-11 21:06:27.705804378 +0000 UTC m=+33.184116219 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc-original-pull-secret") pod "global-pull-secret-syncer-vxlb2" (UID: "0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc") : object "kube-system"/"original-pull-secret" not registered
Sep 11 21:06:11.806172 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:11.806075    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3-metrics-certs\") pod \"network-metrics-daemon-6nwfd\" (UID: \"5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3\") " pod="openshift-multus/network-metrics-daemon-6nwfd"
Sep 11 21:06:11.806341 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:11.806215    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:06:11.806341 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:11.806271    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3-metrics-certs podName:5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3 nodeName:}" failed. No retries permitted until 2026-09-11 21:06:27.806259352 +0000 UTC m=+33.284571173 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3-metrics-certs") pod "network-metrics-daemon-6nwfd" (UID: "5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:06:11.907003 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:11.906959    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vc5t8\" (UniqueName: \"kubernetes.io/projected/394b71c4-7749-4e24-a7ef-b7060c4b4864-kube-api-access-vc5t8\") pod \"network-check-target-sxs24\" (UID: \"394b71c4-7749-4e24-a7ef-b7060c4b4864\") " pod="openshift-network-diagnostics/network-check-target-sxs24"
Sep 11 21:06:11.907189 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:11.907156    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 21:06:11.907189 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:11.907187    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 21:06:11.907284 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:11.907203    2560 projected.go:196] Error preparing data for projected volume kube-api-access-vc5t8 for pod openshift-network-diagnostics/network-check-target-sxs24: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:06:11.907331 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:11.907290    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/394b71c4-7749-4e24-a7ef-b7060c4b4864-kube-api-access-vc5t8 podName:394b71c4-7749-4e24-a7ef-b7060c4b4864 nodeName:}" failed. No retries permitted until 2026-09-11 21:06:27.907271441 +0000 UTC m=+33.385583266 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vc5t8" (UniqueName: "kubernetes.io/projected/394b71c4-7749-4e24-a7ef-b7060c4b4864-kube-api-access-vc5t8") pod "network-check-target-sxs24" (UID: "394b71c4-7749-4e24-a7ef-b7060c4b4864") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:06:12.031162 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:12.031118    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sxs24"
Sep 11 21:06:12.031360 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:12.031258    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sxs24" podUID="394b71c4-7749-4e24-a7ef-b7060c4b4864"
Sep 11 21:06:12.031360 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:12.031313    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6nwfd"
Sep 11 21:06:12.031499 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:12.031471    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6nwfd" podUID="5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3"
Sep 11 21:06:13.031118 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:13.031081    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vxlb2"
Sep 11 21:06:13.031595 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:13.031210    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vxlb2" podUID="0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc"
Sep 11 21:06:14.031752 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:14.031706    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sxs24"
Sep 11 21:06:14.032196 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:14.031842    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sxs24" podUID="394b71c4-7749-4e24-a7ef-b7060c4b4864"
Sep 11 21:06:14.032196 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:14.031876    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6nwfd"
Sep 11 21:06:14.032196 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:14.031936    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6nwfd" podUID="5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3"
Sep 11 21:06:15.031892 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:15.031857    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vxlb2"
Sep 11 21:06:15.032421 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:15.031951    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vxlb2" podUID="0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc"
Sep 11 21:06:16.031872 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:16.031584    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sxs24"
Sep 11 21:06:16.032070 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:16.031974    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sxs24" podUID="394b71c4-7749-4e24-a7ef-b7060c4b4864"
Sep 11 21:06:16.032728 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:16.031637    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6nwfd"
Sep 11 21:06:16.032728 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:16.032321    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6nwfd" podUID="5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3"
Sep 11 21:06:16.255467 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:16.255232    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xzdlq" event={"ID":"585342c4-6023-45ad-b2b3-b68072a36bca","Type":"ContainerStarted","Data":"70a369092d91f5e73de16d3dd6d84dd8ebd0e96f22ce37c0cca49ae4e3b95d6a"}
Sep 11 21:06:16.262487 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:16.262416    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9bcdv" event={"ID":"342a8a16-663e-4958-ab55-a6a8f04d9222","Type":"ContainerStarted","Data":"b95a897d33fa8e45bcf5c30d096a8093548115e8459bacc4c304addb8c3bf9f8"}
Sep 11 21:06:16.265056 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:16.265020    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcr9m" event={"ID":"516a2da5-32a7-4c55-82e4-734bbf607583","Type":"ContainerStarted","Data":"741bdd17f70298cce98f70042762096f1ab3f5333ee7f4ac1d12301a300a85fd"}
Sep 11 21:06:16.266695 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:16.266662    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7d7s4" event={"ID":"6159eecf-1d1a-4d36-9c12-906f8b272142","Type":"ContainerStarted","Data":"7a95b837b95c4f43f78e2c952937580353d139427d5d1a323e7039a4cd14d8c6"}
Sep 11 21:06:16.269638 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:16.269607    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk" event={"ID":"17493773-1416-44a9-8a25-b05d1daccc37","Type":"ContainerStarted","Data":"524588db05cf903050fee444924b65b214d26817131e6a3d00a9b709f9980336"}
Sep 11 21:06:16.269756 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:16.269691    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk" event={"ID":"17493773-1416-44a9-8a25-b05d1daccc37","Type":"ContainerStarted","Data":"05a67a1c28b80b0a650f98c205ee85f29d964461988acf00ffaeb43200536515"}
Sep 11 21:06:16.269756 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:16.269733    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk" event={"ID":"17493773-1416-44a9-8a25-b05d1daccc37","Type":"ContainerStarted","Data":"69e62c97ff2b1bac29cdc739e9e28b6b72583ecfc2a07f1c0d3866868e067f84"}
Sep 11 21:06:16.271355 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:16.271316    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-163.ec2.internal" event={"ID":"75a23667c2d6b01bd21de457ebee8e0a","Type":"ContainerStarted","Data":"2780afd167b513c6b1493220ad43200301d11635a9ac328b0ddd76a343af9dd9"}
Sep 11 21:06:16.277643 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:16.277590    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xzdlq" podStartSLOduration=2.21788824 podStartE2EDuration="21.277573679s" totalImagesPullingTime="19.059685439s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:05:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:06:16.276858397 +0000 UTC m=+21.755170244" watchObservedRunningTime="2026-09-11 21:06:16.277573679 +0000 UTC m=+21.755885524"
Sep 11 21:06:16.305575 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:16.305522    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-163.ec2.internal" podStartSLOduration=21.30550535 podStartE2EDuration="21.30550535s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:05:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:06:16.30525647 +0000 UTC m=+21.783568312" watchObservedRunningTime="2026-09-11 21:06:16.30550535 +0000 UTC m=+21.783817185"
Sep 11 21:06:16.321169 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:16.321105    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7d7s4" podStartSLOduration=6.182353964 podStartE2EDuration="21.32108531s" totalImagesPullingTime="15.138731346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:05:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:06:16.320549383 +0000 UTC m=+21.798861228" watchObservedRunningTime="2026-09-11 21:06:16.32108531 +0000 UTC m=+21.799397155"
Sep 11 21:06:16.337168 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:16.337114    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-b7sx4" podStartSLOduration=2.310172983 podStartE2EDuration="21.337096752s" totalImagesPullingTime="19.026923769s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:05:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:06:16.336641381 +0000 UTC m=+21.814953238" watchObservedRunningTime="2026-09-11 21:06:16.337096752 +0000 UTC m=+21.815408595"
Sep 11 21:06:16.382691 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:16.382632    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9bcdv" podStartSLOduration=2.301522243 podStartE2EDuration="21.382615175s" totalImagesPullingTime="19.081092932s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:05:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:06:16.382108956 +0000 UTC m=+21.860420801" watchObservedRunningTime="2026-09-11 21:06:16.382615175 +0000 UTC m=+21.860927109"
Sep 11 21:06:17.032021 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:17.031976    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vxlb2"
Sep 11 21:06:17.032273 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:17.032092    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vxlb2" podUID="0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc"
Sep 11 21:06:17.277789 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:17.277755    2560 generic.go:356] "Generic (PLEG): container finished" podID="61773d0c-6a2a-4a1b-8d98-30897e76ae6b" containerID="4f9ca68683c95ad51d84e703473fdb6f5ec0ef6083488bfed26ead088bd1b222" exitCode=0
Sep 11 21:06:17.277985 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:17.277835    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v4sq2" event={"ID":"61773d0c-6a2a-4a1b-8d98-30897e76ae6b","Type":"ContainerDied","Data":"4f9ca68683c95ad51d84e703473fdb6f5ec0ef6083488bfed26ead088bd1b222"}
Sep 11 21:06:17.279727 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:17.279692    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b7sx4" event={"ID":"9e88e074-d628-4e0b-a23c-ce95b8a44c21","Type":"ContainerStarted","Data":"7a552024345b3e47da2e4c948ec71016c7c94b1c9585f01af4465bc63e92fa6e"}
Sep 11 21:06:17.283576 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:17.283498    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk" event={"ID":"17493773-1416-44a9-8a25-b05d1daccc37","Type":"ContainerStarted","Data":"30517540742f80a6f37e39d8c7e4b3eda7fbab3e7dd31c3bb2f3c8cb4e5233f1"}
Sep 11 21:06:17.283706 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:17.283595    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk" event={"ID":"17493773-1416-44a9-8a25-b05d1daccc37","Type":"ContainerStarted","Data":"0b60814137cce9dd534fa627419b202ea02f670d4bc9dfa353471a734bf278ed"}
Sep 11 21:06:17.283706 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:17.283646    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk" event={"ID":"17493773-1416-44a9-8a25-b05d1daccc37","Type":"ContainerStarted","Data":"148cc107672713fd89bc4e572a468b7a4b2e5857e0db4e15acc9c58d1d4be321"}
Sep 11 21:06:17.285424 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:17.285378    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rr9d4" event={"ID":"3c8f606b-293c-477a-a7ea-62542fe22b78","Type":"ContainerStarted","Data":"06fe0598b09384b76533252881ef6ccb0b091347b51e836337856316b3ec396a"}
Sep 11 21:06:17.287526 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:17.287497    2560 generic.go:356] "Generic (PLEG): container finished" podID="de7ebdcdf2700e0582a4401358202032" containerID="91bce165a1620bc849aac3a424837ec767921666c3aa588512353bd37c15d8e1" exitCode=0
Sep 11 21:06:17.287668 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:17.287595    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-163.ec2.internal" event={"ID":"de7ebdcdf2700e0582a4401358202032","Type":"ContainerDied","Data":"91bce165a1620bc849aac3a424837ec767921666c3aa588512353bd37c15d8e1"}
Sep 11 21:06:17.287668 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:17.287631    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-163.ec2.internal" event={"ID":"de7ebdcdf2700e0582a4401358202032","Type":"ContainerStarted","Data":"2541571c01ec7da6f93fb3ba10c0ad27bd24b53ed24c22cc506d8cb12340f575"}
Sep 11 21:06:17.289404 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:17.289365    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wwnsp" event={"ID":"52734055-1949-4e54-a2dc-623f80a5c1ac","Type":"ContainerStarted","Data":"001ce68f3aa578b2816c2a8449e692d5a7d598b3db34b28445d5bb9b3400ddeb"}
Sep 11 21:06:17.326060 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:17.325998    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-wwnsp" podStartSLOduration=3.340965389 podStartE2EDuration="22.325980333s" totalImagesPullingTime="18.985014944s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:05:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:06:17.311823628 +0000 UTC m=+22.790135474" watchObservedRunningTime="2026-09-11 21:06:17.325980333 +0000 UTC m=+22.804292197"
Sep 11 21:06:17.326263 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:17.326203    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rr9d4" podStartSLOduration=3.174759185 podStartE2EDuration="22.326191951s" totalImagesPullingTime="19.151432766s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:05:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:06:17.32612215 +0000 UTC m=+22.804433974" watchObservedRunningTime="2026-09-11 21:06:17.326191951 +0000 UTC m=+22.804503795"
Sep 11 21:06:17.342601 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:17.342556    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-163.ec2.internal" podStartSLOduration=22.342539114 podStartE2EDuration="22.342539114s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:05:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:06:17.342215744 +0000 UTC m=+22.820527588" watchObservedRunningTime="2026-09-11 21:06:17.342539114 +0000 UTC m=+22.820850958"
Sep 11 21:06:17.426095 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:17.426072    2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 11 21:06:18.031271 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:18.031158    2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-11T21:06:17.426091003Z","UUID":"0c0846d7-bcbd-4156-8372-3d8aede6e3f8","Handler":null,"Name":"","Endpoint":""}
Sep 11 21:06:18.031567 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:18.031303    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6nwfd"
Sep 11 21:06:18.031567 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:18.031322    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sxs24"
Sep 11 21:06:18.031567 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:18.031476    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6nwfd" podUID="5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3"
Sep 11 21:06:18.031726 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:18.031578    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sxs24" podUID="394b71c4-7749-4e24-a7ef-b7060c4b4864"
Sep 11 21:06:18.033069 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:18.033045    2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 11 21:06:18.033631 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:18.033082    2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 11 21:06:18.100947 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:18.100901    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7d7s4"
Sep 11 21:06:18.101918 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:18.101899    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7d7s4"
Sep 11 21:06:18.294187 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:18.294100    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcr9m" event={"ID":"516a2da5-32a7-4c55-82e4-734bbf607583","Type":"ContainerStarted","Data":"06dbcb46d1ad960592e17aa562ceb6b6556ae59676dfd17b0db27bbb8114b4ef"}
Sep 11 21:06:19.031417 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:19.031318    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vxlb2"
Sep 11 21:06:19.031570 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:19.031441    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vxlb2" podUID="0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc"
Sep 11 21:06:19.299131 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:19.298778    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcr9m" event={"ID":"516a2da5-32a7-4c55-82e4-734bbf607583","Type":"ContainerStarted","Data":"048a0f1fb9fd3025c77b01d545f0c9828685fb3a70f154a683b0c9e70b4a518b"}
Sep 11 21:06:19.302927 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:19.302894    2560 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 11 21:06:19.303110 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:19.302884    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk" event={"ID":"17493773-1416-44a9-8a25-b05d1daccc37","Type":"ContainerStarted","Data":"27363a2a74f0ef7a53fa3b5b15f3fa6d6b14f4a557748a943a0df6f929983ee8"}
Sep 11 21:06:20.031594 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:20.031562    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6nwfd"
Sep 11 21:06:20.031809 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:20.031562    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sxs24"
Sep 11 21:06:20.031809 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:20.031674    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6nwfd" podUID="5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3"
Sep 11 21:06:20.031809 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:20.031757    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sxs24" podUID="394b71c4-7749-4e24-a7ef-b7060c4b4864"
Sep 11 21:06:21.031459 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:21.031370    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vxlb2"
Sep 11 21:06:21.032071 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:21.031526    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vxlb2" podUID="0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc"
Sep 11 21:06:21.311515 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:21.311421    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk" event={"ID":"17493773-1416-44a9-8a25-b05d1daccc37","Type":"ContainerStarted","Data":"6a3e3376058eb7ed56a854d448f8fae116720d5ad54a1ce72cec3dd4d2740602"}
Sep 11 21:06:21.311729 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:21.311709    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:06:21.327736 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:21.327704    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:06:21.339652 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:21.339601    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk" podStartSLOduration=6.6941556 podStartE2EDuration="26.339584236s" totalImagesPullingTime="19.645428636s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:05:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:06:21.338294145 +0000 UTC m=+26.816605989" watchObservedRunningTime="2026-09-11 21:06:21.339584236 +0000 UTC m=+26.817896080"
Sep 11 21:06:21.339838 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:21.339803    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcr9m" podStartSLOduration=5.291032352 podStartE2EDuration="26.339799607s" totalImagesPullingTime="21.048767255s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:05:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:06:19.336098973 +0000 UTC m=+24.814410820" watchObservedRunningTime="2026-09-11 21:06:21.339799607 +0000 UTC m=+26.818111461"
Sep 11 21:06:22.031306 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:22.031260    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sxs24"
Sep 11 21:06:22.031518 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:22.031426    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sxs24" podUID="394b71c4-7749-4e24-a7ef-b7060c4b4864"
Sep 11 21:06:22.031518 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:22.031465    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6nwfd"
Sep 11 21:06:22.032015 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:22.031622    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6nwfd" podUID="5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3"
Sep 11 21:06:22.314597 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:22.314508    2560 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 11 21:06:22.315135 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:22.315107    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:06:22.333112 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:22.333083    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:06:22.871495 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:22.871135    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sxs24"]
Sep 11 21:06:22.871716 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:22.871539    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sxs24"
Sep 11 21:06:22.871716 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:22.871659    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sxs24" podUID="394b71c4-7749-4e24-a7ef-b7060c4b4864"
Sep 11 21:06:22.872140 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:22.871834    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vxlb2"]
Sep 11 21:06:22.872140 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:22.871935    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vxlb2"
Sep 11 21:06:22.872140 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:22.872021    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vxlb2" podUID="0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc"
Sep 11 21:06:22.872716 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:22.872692    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6nwfd"]
Sep 11 21:06:22.872829 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:22.872789    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6nwfd"
Sep 11 21:06:22.872975 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:22.872939    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6nwfd" podUID="5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3"
Sep 11 21:06:23.316752 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:23.316719    2560 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 11 21:06:23.339469 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:23.339432    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7d7s4"
Sep 11 21:06:23.339590 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:23.339576    2560 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 11 21:06:23.340842 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:23.340406    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7d7s4"
Sep 11 21:06:23.680919 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:23.680891    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wwnsp_52734055-1949-4e54-a2dc-623f80a5c1ac/dns-node-resolver/0.log"
Sep 11 21:06:23.725999 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:23.725966    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:06:24.031844 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:24.031805    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6nwfd"
Sep 11 21:06:24.032037 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:24.031925    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6nwfd" podUID="5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3"
Sep 11 21:06:24.253573 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:24.253543    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b7sx4_9e88e074-d628-4e0b-a23c-ce95b8a44c21/node-ca/0.log"
Sep 11 21:06:24.320371 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:24.320286    2560 generic.go:356] "Generic (PLEG): container finished" podID="61773d0c-6a2a-4a1b-8d98-30897e76ae6b" containerID="4b8f09c29a95b3563f3b57b35b56da359f1fcd2806a7bd27b7e21bb34b8613af" exitCode=0
Sep 11 21:06:24.320371 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:24.320362    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v4sq2" event={"ID":"61773d0c-6a2a-4a1b-8d98-30897e76ae6b","Type":"ContainerDied","Data":"4b8f09c29a95b3563f3b57b35b56da359f1fcd2806a7bd27b7e21bb34b8613af"}
Sep 11 21:06:25.031846 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:25.031822    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sxs24"
Sep 11 21:06:25.031972 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:25.031898    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vxlb2"
Sep 11 21:06:25.031972 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:25.031926    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sxs24" podUID="394b71c4-7749-4e24-a7ef-b7060c4b4864"
Sep 11 21:06:25.032081 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:25.032022    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vxlb2" podUID="0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc"
Sep 11 21:06:25.327855 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:25.327775    2560 generic.go:356] "Generic (PLEG): container finished" podID="61773d0c-6a2a-4a1b-8d98-30897e76ae6b" containerID="8044a30d10d3bf5063a7a4167db98df09893dea3718d92dded5e0fa10fe6b4f3" exitCode=0
Sep 11 21:06:25.327855 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:25.327842    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v4sq2" event={"ID":"61773d0c-6a2a-4a1b-8d98-30897e76ae6b","Type":"ContainerDied","Data":"8044a30d10d3bf5063a7a4167db98df09893dea3718d92dded5e0fa10fe6b4f3"}
Sep 11 21:06:25.340277 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:25.340231    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk" podUID="17493773-1416-44a9-8a25-b05d1daccc37" containerName="ovnkube-controller" probeResult="failure" output=""
Sep 11 21:06:26.031910 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:26.031727    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6nwfd"
Sep 11 21:06:26.032024 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:26.032006    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6nwfd" podUID="5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3"
Sep 11 21:06:26.333170 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:26.333084    2560 generic.go:356] "Generic (PLEG): container finished" podID="61773d0c-6a2a-4a1b-8d98-30897e76ae6b" containerID="865add1f6cb112046dd937fea49c0c194b3ed1cb7f6c72bf2c49a369ef35e721" exitCode=0
Sep 11 21:06:26.333170 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:26.333128    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v4sq2" event={"ID":"61773d0c-6a2a-4a1b-8d98-30897e76ae6b","Type":"ContainerDied","Data":"865add1f6cb112046dd937fea49c0c194b3ed1cb7f6c72bf2c49a369ef35e721"}
Sep 11 21:06:27.031844 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:27.031807    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vxlb2"
Sep 11 21:06:27.032042 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:27.031950    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vxlb2" podUID="0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc"
Sep 11 21:06:27.032042 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:27.032000    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sxs24"
Sep 11 21:06:27.032161 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:27.032116    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sxs24" podUID="394b71c4-7749-4e24-a7ef-b7060c4b4864"
Sep 11 21:06:27.722808 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:27.722768    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc-original-pull-secret\") pod \"global-pull-secret-syncer-vxlb2\" (UID: \"0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc\") " pod="kube-system/global-pull-secret-syncer-vxlb2"
Sep 11 21:06:27.723193 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:27.722918    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 21:06:27.723193 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:27.722990    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc-original-pull-secret podName:0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc nodeName:}" failed. No retries permitted until 2026-09-11 21:06:59.722974874 +0000 UTC m=+65.201286701 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc-original-pull-secret") pod "global-pull-secret-syncer-vxlb2" (UID: "0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc") : object "kube-system"/"original-pull-secret" not registered
Sep 11 21:06:27.823232 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:27.823195    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3-metrics-certs\") pod \"network-metrics-daemon-6nwfd\" (UID: \"5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3\") " pod="openshift-multus/network-metrics-daemon-6nwfd"
Sep 11 21:06:27.823456 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:27.823321    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:06:27.823456 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:27.823396    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3-metrics-certs podName:5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3 nodeName:}" failed. No retries permitted until 2026-09-11 21:06:59.823369489 +0000 UTC m=+65.301681311 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3-metrics-certs") pod "network-metrics-daemon-6nwfd" (UID: "5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:06:27.923620 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:27.923511    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vc5t8\" (UniqueName: \"kubernetes.io/projected/394b71c4-7749-4e24-a7ef-b7060c4b4864-kube-api-access-vc5t8\") pod \"network-check-target-sxs24\" (UID: \"394b71c4-7749-4e24-a7ef-b7060c4b4864\") " pod="openshift-network-diagnostics/network-check-target-sxs24"
Sep 11 21:06:27.923780 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:27.923688    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 21:06:27.923780 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:27.923718    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 21:06:27.923780 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:27.923731    2560 projected.go:196] Error preparing data for projected volume kube-api-access-vc5t8 for pod openshift-network-diagnostics/network-check-target-sxs24: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:06:27.923901 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:27.923789    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/394b71c4-7749-4e24-a7ef-b7060c4b4864-kube-api-access-vc5t8 podName:394b71c4-7749-4e24-a7ef-b7060c4b4864 nodeName:}" failed. No retries permitted until 2026-09-11 21:06:59.923773124 +0000 UTC m=+65.402084959 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vc5t8" (UniqueName: "kubernetes.io/projected/394b71c4-7749-4e24-a7ef-b7060c4b4864-kube-api-access-vc5t8") pod "network-check-target-sxs24" (UID: "394b71c4-7749-4e24-a7ef-b7060c4b4864") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:06:28.030947 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:28.030902    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6nwfd"
Sep 11 21:06:28.031134 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:28.031043    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6nwfd" podUID="5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3"
Sep 11 21:06:29.031101 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:29.031012    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sxs24"
Sep 11 21:06:29.031513 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:29.031024    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vxlb2"
Sep 11 21:06:29.031513 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:29.031159    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sxs24" podUID="394b71c4-7749-4e24-a7ef-b7060c4b4864"
Sep 11 21:06:29.031513 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:29.031199    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vxlb2" podUID="0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc"
Sep 11 21:06:30.031229 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:30.031191    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6nwfd"
Sep 11 21:06:30.031687 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:30.031343    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6nwfd" podUID="5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3"
Sep 11 21:06:31.031438 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:31.031396    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vxlb2"
Sep 11 21:06:31.031438 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:31.031427    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sxs24"
Sep 11 21:06:31.031952 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:31.031530    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vxlb2" podUID="0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc"
Sep 11 21:06:31.031952 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:31.031640    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sxs24" podUID="394b71c4-7749-4e24-a7ef-b7060c4b4864"
Sep 11 21:06:32.031097 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:32.031061    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6nwfd"
Sep 11 21:06:32.031270 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:32.031185    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6nwfd" podUID="5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3"
Sep 11 21:06:32.355029 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:32.354943    2560 generic.go:356] "Generic (PLEG): container finished" podID="61773d0c-6a2a-4a1b-8d98-30897e76ae6b" containerID="48ba87b927e0b437b585dcd1423a01bf73e9de7d0ba334937ffceab58a899e5d" exitCode=0
Sep 11 21:06:32.355029 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:32.354998    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v4sq2" event={"ID":"61773d0c-6a2a-4a1b-8d98-30897e76ae6b","Type":"ContainerDied","Data":"48ba87b927e0b437b585dcd1423a01bf73e9de7d0ba334937ffceab58a899e5d"}
Sep 11 21:06:33.031640 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:33.031531    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vxlb2"
Sep 11 21:06:33.031640 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:33.031568    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sxs24"
Sep 11 21:06:33.031864 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:33.031676    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vxlb2" podUID="0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc"
Sep 11 21:06:33.031864 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:33.031772    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sxs24" podUID="394b71c4-7749-4e24-a7ef-b7060c4b4864"
Sep 11 21:06:33.362896 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:33.362805    2560 generic.go:356] "Generic (PLEG): container finished" podID="61773d0c-6a2a-4a1b-8d98-30897e76ae6b" containerID="fd9e8a3d3dffaa16e21134df50c0c2f4be1e7525b9a72fe1c025e83693ca4c81" exitCode=0
Sep 11 21:06:33.362896 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:33.362852    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v4sq2" event={"ID":"61773d0c-6a2a-4a1b-8d98-30897e76ae6b","Type":"ContainerDied","Data":"fd9e8a3d3dffaa16e21134df50c0c2f4be1e7525b9a72fe1c025e83693ca4c81"}
Sep 11 21:06:34.032062 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:34.031870    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6nwfd"
Sep 11 21:06:34.032240 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:34.032169    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6nwfd" podUID="5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3"
Sep 11 21:06:34.369143 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:34.369112    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v4sq2" event={"ID":"61773d0c-6a2a-4a1b-8d98-30897e76ae6b","Type":"ContainerStarted","Data":"e36e07f242d0de05740ffa6da4c046bc66c91467f4e7c4b34ff7fdfea9ad6a1c"}
Sep 11 21:06:34.397513 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:34.397450    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-v4sq2" podStartSLOduration=7.926054011 podStartE2EDuration="39.397431863s" totalImagesPullingTime="31.471377852s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:05:55 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:06:34.396671808 +0000 UTC m=+39.874983652" watchObservedRunningTime="2026-09-11 21:06:34.397431863 +0000 UTC m=+39.875743707"
Sep 11 21:06:35.031953 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:35.031919    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vxlb2"
Sep 11 21:06:35.032128 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:35.032033    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vxlb2" podUID="0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc"
Sep 11 21:06:35.032128 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:35.032056    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sxs24"
Sep 11 21:06:35.032249 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:35.032177    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sxs24" podUID="394b71c4-7749-4e24-a7ef-b7060c4b4864"
Sep 11 21:06:36.031956 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:36.031917    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6nwfd"
Sep 11 21:06:36.032455 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:36.032061    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6nwfd" podUID="5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3"
Sep 11 21:06:37.031351 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:37.031308    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sxs24"
Sep 11 21:06:37.031581 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:37.031468    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sxs24" podUID="394b71c4-7749-4e24-a7ef-b7060c4b4864"
Sep 11 21:06:37.031581 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:37.031523    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vxlb2"
Sep 11 21:06:37.031703 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:37.031657    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vxlb2" podUID="0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc"
Sep 11 21:06:38.030995 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:38.030954    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6nwfd"
Sep 11 21:06:38.031498 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:38.031068    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6nwfd" podUID="5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3"
Sep 11 21:06:39.031353 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:39.031317    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sxs24"
Sep 11 21:06:39.031778 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:39.031449    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sxs24" podUID="394b71c4-7749-4e24-a7ef-b7060c4b4864"
Sep 11 21:06:39.031778 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:39.031502    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vxlb2"
Sep 11 21:06:39.031778 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:39.031592    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vxlb2" podUID="0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc"
Sep 11 21:06:40.031847 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:40.031811    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6nwfd"
Sep 11 21:06:40.032235 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:40.031926    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6nwfd" podUID="5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3"
Sep 11 21:06:41.031721 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:41.031636    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vxlb2"
Sep 11 21:06:41.031878 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:41.031637    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sxs24"
Sep 11 21:06:41.031878 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:41.031751    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vxlb2" podUID="0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc"
Sep 11 21:06:41.031878 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:41.031851    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sxs24" podUID="394b71c4-7749-4e24-a7ef-b7060c4b4864"
Sep 11 21:06:42.031899 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:42.031866    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6nwfd"
Sep 11 21:06:42.032311 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:42.031986    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6nwfd" podUID="5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3"
Sep 11 21:06:43.031189 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:43.031146    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sxs24"
Sep 11 21:06:43.031475 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:43.031145    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vxlb2"
Sep 11 21:06:43.031475 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:43.031255    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sxs24" podUID="394b71c4-7749-4e24-a7ef-b7060c4b4864"
Sep 11 21:06:43.031475 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:43.031350    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vxlb2" podUID="0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc"
Sep 11 21:06:44.031825 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:44.031782    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6nwfd"
Sep 11 21:06:44.032213 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:44.031901    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6nwfd" podUID="5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3"
Sep 11 21:06:45.031909 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:45.031869    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sxs24"
Sep 11 21:06:45.032367 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:45.031969    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sxs24" podUID="394b71c4-7749-4e24-a7ef-b7060c4b4864"
Sep 11 21:06:45.032367 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:45.032052    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vxlb2"
Sep 11 21:06:45.032367 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:45.032157    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vxlb2" podUID="0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc"
Sep 11 21:06:46.031232 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:46.031196    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6nwfd"
Sep 11 21:06:46.031432 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:46.031308    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6nwfd" podUID="5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3"
Sep 11 21:06:47.031432 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:47.031397    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vxlb2"
Sep 11 21:06:47.031861 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:47.031408    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sxs24"
Sep 11 21:06:47.031861 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:47.031509    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vxlb2" podUID="0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc"
Sep 11 21:06:47.031861 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:47.031582    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sxs24" podUID="394b71c4-7749-4e24-a7ef-b7060c4b4864"
Sep 11 21:06:48.031341 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:48.031289    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6nwfd"
Sep 11 21:06:48.031628 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:48.031462    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6nwfd" podUID="5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3"
Sep 11 21:06:49.031653 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:49.031611    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sxs24"
Sep 11 21:06:49.032232 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:49.031611    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vxlb2"
Sep 11 21:06:49.032232 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:49.031725    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sxs24" podUID="394b71c4-7749-4e24-a7ef-b7060c4b4864"
Sep 11 21:06:49.032232 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:49.031789    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vxlb2" podUID="0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc"
Sep 11 21:06:50.031681 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:50.031650    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6nwfd"
Sep 11 21:06:50.032067 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:50.031763    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6nwfd" podUID="5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3"
Sep 11 21:06:50.819272 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:50.819246    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-163.ec2.internal" event="NodeReady"
Sep 11 21:06:50.819487 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:50.819362    2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 11 21:06:50.868102 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:50.868065    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-d6c5fdb9f-hsmww"]
Sep 11 21:06:50.869967 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:50.869948    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d6c5fdb9f-hsmww"
Sep 11 21:06:50.874195 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:50.874162    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 11 21:06:50.874448 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:50.874429    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 11 21:06:50.875076 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:50.875054    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 11 21:06:50.875157 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:50.875060    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-j64xm\""
Sep 11 21:06:50.879226 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:50.879203    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 11 21:06:50.886199 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:50.886170    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gjb5r"]
Sep 11 21:06:50.888153 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:50.888130    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hpv5x"]
Sep 11 21:06:50.888269 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:50.888249    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gjb5r"
Sep 11 21:06:50.890116 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:50.890095    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hpv5x"
Sep 11 21:06:50.891228 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:50.891202    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 11 21:06:50.891472 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:50.891450    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d6c5fdb9f-hsmww"]
Sep 11 21:06:50.891566 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:50.891517    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 11 21:06:50.891613 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:50.891517    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-f5khd\""
Sep 11 21:06:50.893887 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:50.893866    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 11 21:06:50.893987 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:50.893963    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 11 21:06:50.894502 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:50.894410    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 11 21:06:50.894502 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:50.894486    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rvmq7\""
Sep 11 21:06:50.901877 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:50.901847    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gjb5r"]
Sep 11 21:06:50.916487 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:50.916455    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hpv5x"]
Sep 11 21:06:50.983595 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:50.983562    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/35f8548d-cfd3-4665-a6d7-5953767772dd-registry-tls\") pod \"image-registry-d6c5fdb9f-hsmww\" (UID: \"35f8548d-cfd3-4665-a6d7-5953767772dd\") " pod="openshift-image-registry/image-registry-d6c5fdb9f-hsmww"
Sep 11 21:06:50.983595 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:50.983602    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/35f8548d-cfd3-4665-a6d7-5953767772dd-image-registry-private-configuration\") pod \"image-registry-d6c5fdb9f-hsmww\" (UID: \"35f8548d-cfd3-4665-a6d7-5953767772dd\") " pod="openshift-image-registry/image-registry-d6c5fdb9f-hsmww"
Sep 11 21:06:50.983831 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:50.983627    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0e1e0d4-3580-41ab-8521-ea2881163256-metrics-tls\") pod \"dns-default-gjb5r\" (UID: \"a0e1e0d4-3580-41ab-8521-ea2881163256\") " pod="openshift-dns/dns-default-gjb5r"
Sep 11 21:06:50.983831 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:50.983709    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kv7l\" (UniqueName: \"kubernetes.io/projected/35f8548d-cfd3-4665-a6d7-5953767772dd-kube-api-access-4kv7l\") pod \"image-registry-d6c5fdb9f-hsmww\" (UID: \"35f8548d-cfd3-4665-a6d7-5953767772dd\") " pod="openshift-image-registry/image-registry-d6c5fdb9f-hsmww"
Sep 11 21:06:50.983831 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:50.983762    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a0e1e0d4-3580-41ab-8521-ea2881163256-config-volume\") pod \"dns-default-gjb5r\" (UID: \"a0e1e0d4-3580-41ab-8521-ea2881163256\") " pod="openshift-dns/dns-default-gjb5r"
Sep 11 21:06:50.983831 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:50.983786    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0e1e0d4-3580-41ab-8521-ea2881163256-tmp-dir\") pod \"dns-default-gjb5r\" (UID: \"a0e1e0d4-3580-41ab-8521-ea2881163256\") " pod="openshift-dns/dns-default-gjb5r"
Sep 11 21:06:50.983831 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:50.983806    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e1ff2609-425e-4d14-93a4-b85b5b3bb3c9-cert\") pod \"ingress-canary-hpv5x\" (UID: \"e1ff2609-425e-4d14-93a4-b85b5b3bb3c9\") " pod="openshift-ingress-canary/ingress-canary-hpv5x"
Sep 11 21:06:50.983996 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:50.983832    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/35f8548d-cfd3-4665-a6d7-5953767772dd-bound-sa-token\") pod \"image-registry-d6c5fdb9f-hsmww\" (UID: \"35f8548d-cfd3-4665-a6d7-5953767772dd\") " pod="openshift-image-registry/image-registry-d6c5fdb9f-hsmww"
Sep 11 21:06:50.983996 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:50.983863    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/35f8548d-cfd3-4665-a6d7-5953767772dd-trusted-ca\") pod \"image-registry-d6c5fdb9f-hsmww\" (UID: \"35f8548d-cfd3-4665-a6d7-5953767772dd\") " pod="openshift-image-registry/image-registry-d6c5fdb9f-hsmww"
Sep 11 21:06:50.983996 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:50.983896    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npbqm\" (UniqueName: \"kubernetes.io/projected/a0e1e0d4-3580-41ab-8521-ea2881163256-kube-api-access-npbqm\") pod \"dns-default-gjb5r\" (UID: \"a0e1e0d4-3580-41ab-8521-ea2881163256\") " pod="openshift-dns/dns-default-gjb5r"
Sep 11 21:06:50.983996 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:50.983910    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ggts\" (UniqueName: \"kubernetes.io/projected/e1ff2609-425e-4d14-93a4-b85b5b3bb3c9-kube-api-access-2ggts\") pod \"ingress-canary-hpv5x\" (UID: \"e1ff2609-425e-4d14-93a4-b85b5b3bb3c9\") " pod="openshift-ingress-canary/ingress-canary-hpv5x"
Sep 11 21:06:50.983996 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:50.983961    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/35f8548d-cfd3-4665-a6d7-5953767772dd-ca-trust-extracted\") pod \"image-registry-d6c5fdb9f-hsmww\" (UID: \"35f8548d-cfd3-4665-a6d7-5953767772dd\") " pod="openshift-image-registry/image-registry-d6c5fdb9f-hsmww"
Sep 11 21:06:50.984289 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:50.983996    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/35f8548d-cfd3-4665-a6d7-5953767772dd-installation-pull-secrets\") pod \"image-registry-d6c5fdb9f-hsmww\" (UID: \"35f8548d-cfd3-4665-a6d7-5953767772dd\") " pod="openshift-image-registry/image-registry-d6c5fdb9f-hsmww"
Sep 11 21:06:50.984289 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:50.984017    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/35f8548d-cfd3-4665-a6d7-5953767772dd-registry-certificates\") pod \"image-registry-d6c5fdb9f-hsmww\" (UID: \"35f8548d-cfd3-4665-a6d7-5953767772dd\") " pod="openshift-image-registry/image-registry-d6c5fdb9f-hsmww"
Sep 11 21:06:50.988279 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:50.988251    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wn4bh"]
Sep 11 21:06:50.990485 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:50.990468    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wn4bh"
Sep 11 21:06:50.992979 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:50.992956    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 11 21:06:50.993401 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:50.993367    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 11 21:06:50.993520 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:50.993505    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 11 21:06:50.993659 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:50.993643    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gq824\""
Sep 11 21:06:50.994135 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:50.994119    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 11 21:06:51.003633 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.003603    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wn4bh"]
Sep 11 21:06:51.031481 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.031440    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sxs24"
Sep 11 21:06:51.031689 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.031444    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vxlb2"
Sep 11 21:06:51.034182 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.034156    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 21:06:51.034690 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.034156    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 21:06:51.034690 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.034164    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 21:06:51.034690 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.034261    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mwzls\""
Sep 11 21:06:51.084690 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.084598    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npbqm\" (UniqueName: \"kubernetes.io/projected/a0e1e0d4-3580-41ab-8521-ea2881163256-kube-api-access-npbqm\") pod \"dns-default-gjb5r\" (UID: \"a0e1e0d4-3580-41ab-8521-ea2881163256\") " pod="openshift-dns/dns-default-gjb5r"
Sep 11 21:06:51.084690 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.084634    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ggts\" (UniqueName: \"kubernetes.io/projected/e1ff2609-425e-4d14-93a4-b85b5b3bb3c9-kube-api-access-2ggts\") pod \"ingress-canary-hpv5x\" (UID: \"e1ff2609-425e-4d14-93a4-b85b5b3bb3c9\") " pod="openshift-ingress-canary/ingress-canary-hpv5x"
Sep 11 21:06:51.084690 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.084655    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/35f8548d-cfd3-4665-a6d7-5953767772dd-ca-trust-extracted\") pod \"image-registry-d6c5fdb9f-hsmww\" (UID: \"35f8548d-cfd3-4665-a6d7-5953767772dd\") " pod="openshift-image-registry/image-registry-d6c5fdb9f-hsmww"
Sep 11 21:06:51.084690 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.084674    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/27ff1327-d08c-4a2e-b1c5-4fef5a22362e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wn4bh\" (UID: \"27ff1327-d08c-4a2e-b1c5-4fef5a22362e\") " pod="openshift-insights/insights-runtime-extractor-wn4bh"
Sep 11 21:06:51.084690 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.084691    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7jw8\" (UniqueName: \"kubernetes.io/projected/27ff1327-d08c-4a2e-b1c5-4fef5a22362e-kube-api-access-s7jw8\") pod \"insights-runtime-extractor-wn4bh\" (UID: \"27ff1327-d08c-4a2e-b1c5-4fef5a22362e\") " pod="openshift-insights/insights-runtime-extractor-wn4bh"
Sep 11 21:06:51.085063 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.084809    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/35f8548d-cfd3-4665-a6d7-5953767772dd-installation-pull-secrets\") pod \"image-registry-d6c5fdb9f-hsmww\" (UID: \"35f8548d-cfd3-4665-a6d7-5953767772dd\") " pod="openshift-image-registry/image-registry-d6c5fdb9f-hsmww"
Sep 11 21:06:51.085063 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.084854    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/35f8548d-cfd3-4665-a6d7-5953767772dd-registry-certificates\") pod \"image-registry-d6c5fdb9f-hsmww\" (UID: \"35f8548d-cfd3-4665-a6d7-5953767772dd\") " pod="openshift-image-registry/image-registry-d6c5fdb9f-hsmww"
Sep 11 21:06:51.085063 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.084888    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/27ff1327-d08c-4a2e-b1c5-4fef5a22362e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wn4bh\" (UID: \"27ff1327-d08c-4a2e-b1c5-4fef5a22362e\") " pod="openshift-insights/insights-runtime-extractor-wn4bh"
Sep 11 21:06:51.085063 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.084936    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/35f8548d-cfd3-4665-a6d7-5953767772dd-registry-tls\") pod \"image-registry-d6c5fdb9f-hsmww\" (UID: \"35f8548d-cfd3-4665-a6d7-5953767772dd\") " pod="openshift-image-registry/image-registry-d6c5fdb9f-hsmww"
Sep 11 21:06:51.085063 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.084968    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/35f8548d-cfd3-4665-a6d7-5953767772dd-image-registry-private-configuration\") pod \"image-registry-d6c5fdb9f-hsmww\" (UID: \"35f8548d-cfd3-4665-a6d7-5953767772dd\") " pod="openshift-image-registry/image-registry-d6c5fdb9f-hsmww"
Sep 11 21:06:51.085063 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.084993    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/27ff1327-d08c-4a2e-b1c5-4fef5a22362e-crio-socket\") pod \"insights-runtime-extractor-wn4bh\" (UID: \"27ff1327-d08c-4a2e-b1c5-4fef5a22362e\") " pod="openshift-insights/insights-runtime-extractor-wn4bh"
Sep 11 21:06:51.085063 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.085023    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0e1e0d4-3580-41ab-8521-ea2881163256-metrics-tls\") pod \"dns-default-gjb5r\" (UID: \"a0e1e0d4-3580-41ab-8521-ea2881163256\") " pod="openshift-dns/dns-default-gjb5r"
Sep 11 21:06:51.085063 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.085055    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/27ff1327-d08c-4a2e-b1c5-4fef5a22362e-data-volume\") pod \"insights-runtime-extractor-wn4bh\" (UID: \"27ff1327-d08c-4a2e-b1c5-4fef5a22362e\") " pod="openshift-insights/insights-runtime-extractor-wn4bh"
Sep 11 21:06:51.085063 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.085061    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/35f8548d-cfd3-4665-a6d7-5953767772dd-ca-trust-extracted\") pod \"image-registry-d6c5fdb9f-hsmww\" (UID: \"35f8548d-cfd3-4665-a6d7-5953767772dd\") " pod="openshift-image-registry/image-registry-d6c5fdb9f-hsmww"
Sep 11 21:06:51.085535 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.085123    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kv7l\" (UniqueName: \"kubernetes.io/projected/35f8548d-cfd3-4665-a6d7-5953767772dd-kube-api-access-4kv7l\") pod \"image-registry-d6c5fdb9f-hsmww\" (UID: \"35f8548d-cfd3-4665-a6d7-5953767772dd\") " pod="openshift-image-registry/image-registry-d6c5fdb9f-hsmww"
Sep 11 21:06:51.085535 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.085158    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a0e1e0d4-3580-41ab-8521-ea2881163256-config-volume\") pod \"dns-default-gjb5r\" (UID: \"a0e1e0d4-3580-41ab-8521-ea2881163256\") " pod="openshift-dns/dns-default-gjb5r"
Sep 11 21:06:51.085535 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.085182    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0e1e0d4-3580-41ab-8521-ea2881163256-tmp-dir\") pod \"dns-default-gjb5r\" (UID: \"a0e1e0d4-3580-41ab-8521-ea2881163256\") " pod="openshift-dns/dns-default-gjb5r"
Sep 11 21:06:51.085535 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.085208    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e1ff2609-425e-4d14-93a4-b85b5b3bb3c9-cert\") pod \"ingress-canary-hpv5x\" (UID: \"e1ff2609-425e-4d14-93a4-b85b5b3bb3c9\") " pod="openshift-ingress-canary/ingress-canary-hpv5x"
Sep 11 21:06:51.085535 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.085234    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/35f8548d-cfd3-4665-a6d7-5953767772dd-bound-sa-token\") pod \"image-registry-d6c5fdb9f-hsmww\" (UID: \"35f8548d-cfd3-4665-a6d7-5953767772dd\") " pod="openshift-image-registry/image-registry-d6c5fdb9f-hsmww"
Sep 11 21:06:51.085535 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.085274    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/35f8548d-cfd3-4665-a6d7-5953767772dd-trusted-ca\") pod \"image-registry-d6c5fdb9f-hsmww\" (UID: \"35f8548d-cfd3-4665-a6d7-5953767772dd\") " pod="openshift-image-registry/image-registry-d6c5fdb9f-hsmww"
Sep 11 21:06:51.085830 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.085657    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0e1e0d4-3580-41ab-8521-ea2881163256-tmp-dir\") pod \"dns-default-gjb5r\" (UID: \"a0e1e0d4-3580-41ab-8521-ea2881163256\") " pod="openshift-dns/dns-default-gjb5r"
Sep 11 21:06:51.085830 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.085720    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/35f8548d-cfd3-4665-a6d7-5953767772dd-registry-certificates\") pod \"image-registry-d6c5fdb9f-hsmww\" (UID: \"35f8548d-cfd3-4665-a6d7-5953767772dd\") " pod="openshift-image-registry/image-registry-d6c5fdb9f-hsmww"
Sep 11 21:06:51.087117 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.086754    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a0e1e0d4-3580-41ab-8521-ea2881163256-config-volume\") pod \"dns-default-gjb5r\" (UID: \"a0e1e0d4-3580-41ab-8521-ea2881163256\") " pod="openshift-dns/dns-default-gjb5r"
Sep 11 21:06:51.087117 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.087036    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/35f8548d-cfd3-4665-a6d7-5953767772dd-trusted-ca\") pod \"image-registry-d6c5fdb9f-hsmww\" (UID: \"35f8548d-cfd3-4665-a6d7-5953767772dd\") " pod="openshift-image-registry/image-registry-d6c5fdb9f-hsmww"
Sep 11 21:06:51.090098 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.090069    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0e1e0d4-3580-41ab-8521-ea2881163256-metrics-tls\") pod \"dns-default-gjb5r\" (UID: \"a0e1e0d4-3580-41ab-8521-ea2881163256\") " pod="openshift-dns/dns-default-gjb5r"
Sep 11 21:06:51.090231 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.090125    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/35f8548d-cfd3-4665-a6d7-5953767772dd-image-registry-private-configuration\") pod \"image-registry-d6c5fdb9f-hsmww\" (UID: \"35f8548d-cfd3-4665-a6d7-5953767772dd\") " pod="openshift-image-registry/image-registry-d6c5fdb9f-hsmww"
Sep 11 21:06:51.090231 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.090170    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/35f8548d-cfd3-4665-a6d7-5953767772dd-registry-tls\") pod \"image-registry-d6c5fdb9f-hsmww\" (UID: \"35f8548d-cfd3-4665-a6d7-5953767772dd\") " pod="openshift-image-registry/image-registry-d6c5fdb9f-hsmww"
Sep 11 21:06:51.090231 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.090190    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/35f8548d-cfd3-4665-a6d7-5953767772dd-installation-pull-secrets\") pod \"image-registry-d6c5fdb9f-hsmww\" (UID: \"35f8548d-cfd3-4665-a6d7-5953767772dd\") " pod="openshift-image-registry/image-registry-d6c5fdb9f-hsmww"
Sep 11 21:06:51.093179 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.093118    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e1ff2609-425e-4d14-93a4-b85b5b3bb3c9-cert\") pod \"ingress-canary-hpv5x\" (UID: \"e1ff2609-425e-4d14-93a4-b85b5b3bb3c9\") " pod="openshift-ingress-canary/ingress-canary-hpv5x"
Sep 11 21:06:51.095118 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.095079    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npbqm\" (UniqueName: \"kubernetes.io/projected/a0e1e0d4-3580-41ab-8521-ea2881163256-kube-api-access-npbqm\") pod \"dns-default-gjb5r\" (UID: \"a0e1e0d4-3580-41ab-8521-ea2881163256\") " pod="openshift-dns/dns-default-gjb5r"
Sep 11 21:06:51.095257 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.095159    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kv7l\" (UniqueName: \"kubernetes.io/projected/35f8548d-cfd3-4665-a6d7-5953767772dd-kube-api-access-4kv7l\") pod \"image-registry-d6c5fdb9f-hsmww\" (UID: \"35f8548d-cfd3-4665-a6d7-5953767772dd\") " pod="openshift-image-registry/image-registry-d6c5fdb9f-hsmww"
Sep 11 21:06:51.095257 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.095212    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/35f8548d-cfd3-4665-a6d7-5953767772dd-bound-sa-token\") pod \"image-registry-d6c5fdb9f-hsmww\" (UID: \"35f8548d-cfd3-4665-a6d7-5953767772dd\") " pod="openshift-image-registry/image-registry-d6c5fdb9f-hsmww"
Sep 11 21:06:51.095334 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.095299    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ggts\" (UniqueName: \"kubernetes.io/projected/e1ff2609-425e-4d14-93a4-b85b5b3bb3c9-kube-api-access-2ggts\") pod \"ingress-canary-hpv5x\" (UID: \"e1ff2609-425e-4d14-93a4-b85b5b3bb3c9\") " pod="openshift-ingress-canary/ingress-canary-hpv5x"
Sep 11 21:06:51.180378 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.180324    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d6c5fdb9f-hsmww"
Sep 11 21:06:51.186632 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.186603    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/27ff1327-d08c-4a2e-b1c5-4fef5a22362e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wn4bh\" (UID: \"27ff1327-d08c-4a2e-b1c5-4fef5a22362e\") " pod="openshift-insights/insights-runtime-extractor-wn4bh"
Sep 11 21:06:51.186701 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.186644    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7jw8\" (UniqueName: \"kubernetes.io/projected/27ff1327-d08c-4a2e-b1c5-4fef5a22362e-kube-api-access-s7jw8\") pod \"insights-runtime-extractor-wn4bh\" (UID: \"27ff1327-d08c-4a2e-b1c5-4fef5a22362e\") " pod="openshift-insights/insights-runtime-extractor-wn4bh"
Sep 11 21:06:51.186701 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.186674    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/27ff1327-d08c-4a2e-b1c5-4fef5a22362e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wn4bh\" (UID: \"27ff1327-d08c-4a2e-b1c5-4fef5a22362e\") " pod="openshift-insights/insights-runtime-extractor-wn4bh"
Sep 11 21:06:51.186785 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.186713    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/27ff1327-d08c-4a2e-b1c5-4fef5a22362e-crio-socket\") pod \"insights-runtime-extractor-wn4bh\" (UID: \"27ff1327-d08c-4a2e-b1c5-4fef5a22362e\") " pod="openshift-insights/insights-runtime-extractor-wn4bh"
Sep 11 21:06:51.186785 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.186740    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/27ff1327-d08c-4a2e-b1c5-4fef5a22362e-data-volume\") pod \"insights-runtime-extractor-wn4bh\" (UID: \"27ff1327-d08c-4a2e-b1c5-4fef5a22362e\") " pod="openshift-insights/insights-runtime-extractor-wn4bh"
Sep 11 21:06:51.187022 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.186977    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/27ff1327-d08c-4a2e-b1c5-4fef5a22362e-crio-socket\") pod \"insights-runtime-extractor-wn4bh\" (UID: \"27ff1327-d08c-4a2e-b1c5-4fef5a22362e\") " pod="openshift-insights/insights-runtime-extractor-wn4bh"
Sep 11 21:06:51.187123 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.187105    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/27ff1327-d08c-4a2e-b1c5-4fef5a22362e-data-volume\") pod \"insights-runtime-extractor-wn4bh\" (UID: \"27ff1327-d08c-4a2e-b1c5-4fef5a22362e\") " pod="openshift-insights/insights-runtime-extractor-wn4bh"
Sep 11 21:06:51.187489 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.187467    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/27ff1327-d08c-4a2e-b1c5-4fef5a22362e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wn4bh\" (UID: \"27ff1327-d08c-4a2e-b1c5-4fef5a22362e\") " pod="openshift-insights/insights-runtime-extractor-wn4bh"
Sep 11 21:06:51.189010 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.188989    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/27ff1327-d08c-4a2e-b1c5-4fef5a22362e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wn4bh\" (UID: \"27ff1327-d08c-4a2e-b1c5-4fef5a22362e\") " pod="openshift-insights/insights-runtime-extractor-wn4bh"
Sep 11 21:06:51.196020 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.195988    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7jw8\" (UniqueName: \"kubernetes.io/projected/27ff1327-d08c-4a2e-b1c5-4fef5a22362e-kube-api-access-s7jw8\") pod \"insights-runtime-extractor-wn4bh\" (UID: \"27ff1327-d08c-4a2e-b1c5-4fef5a22362e\") " pod="openshift-insights/insights-runtime-extractor-wn4bh"
Sep 11 21:06:51.198722 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.198692    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gjb5r"
Sep 11 21:06:51.205592 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.205561    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hpv5x"
Sep 11 21:06:51.300143 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.299595    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wn4bh"
Sep 11 21:06:51.476759 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.476725    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d6c5fdb9f-hsmww"]
Sep 11 21:06:51.480378 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:06:51.480347    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35f8548d_cfd3_4665_a6d7_5953767772dd.slice/crio-cc8c4307af439554f8c6df3e7bf16c28b6dff9d622f0dc00af8ca5991dbb2f19 WatchSource:0}: Error finding container cc8c4307af439554f8c6df3e7bf16c28b6dff9d622f0dc00af8ca5991dbb2f19: Status 404 returned error can't find the container with id cc8c4307af439554f8c6df3e7bf16c28b6dff9d622f0dc00af8ca5991dbb2f19
Sep 11 21:06:51.505880 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.505844    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hpv5x"]
Sep 11 21:06:51.508119 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.508093    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gjb5r"]
Sep 11 21:06:51.509607 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:06:51.509571    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1ff2609_425e_4d14_93a4_b85b5b3bb3c9.slice/crio-41b22adff72efae02e84f3e78cf2f59f3be3c6939d502c5ebd52efb59c37ccd1 WatchSource:0}: Error finding container 41b22adff72efae02e84f3e78cf2f59f3be3c6939d502c5ebd52efb59c37ccd1: Status 404 returned error can't find the container with id 41b22adff72efae02e84f3e78cf2f59f3be3c6939d502c5ebd52efb59c37ccd1
Sep 11 21:06:51.511619 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:06:51.511591    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0e1e0d4_3580_41ab_8521_ea2881163256.slice/crio-46e061453717eacfa7e10caa292da198effbd8168b4039b81bc76f0500b50c6e WatchSource:0}: Error finding container 46e061453717eacfa7e10caa292da198effbd8168b4039b81bc76f0500b50c6e: Status 404 returned error can't find the container with id 46e061453717eacfa7e10caa292da198effbd8168b4039b81bc76f0500b50c6e
Sep 11 21:06:51.573681 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:51.573650    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wn4bh"]
Sep 11 21:06:51.577530 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:06:51.577503    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27ff1327_d08c_4a2e_b1c5_4fef5a22362e.slice/crio-eba33407812531650ac000b293d5998503a810b49fba9f6b69d61f17d4f4c831 WatchSource:0}: Error finding container eba33407812531650ac000b293d5998503a810b49fba9f6b69d61f17d4f4c831: Status 404 returned error can't find the container with id eba33407812531650ac000b293d5998503a810b49fba9f6b69d61f17d4f4c831
Sep 11 21:06:52.031457 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:52.031420    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6nwfd"
Sep 11 21:06:52.034507 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:52.034480    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 21:06:52.034912 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:52.034551    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mpnkz\""
Sep 11 21:06:52.412705 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:52.412628    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hpv5x" event={"ID":"e1ff2609-425e-4d14-93a4-b85b5b3bb3c9","Type":"ContainerStarted","Data":"41b22adff72efae02e84f3e78cf2f59f3be3c6939d502c5ebd52efb59c37ccd1"}
Sep 11 21:06:52.414455 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:52.414419    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d6c5fdb9f-hsmww" event={"ID":"35f8548d-cfd3-4665-a6d7-5953767772dd","Type":"ContainerStarted","Data":"b5b324a7784d40ed03c4d47429d7c8cbaf0fc6a5b01e3c8be9ad69ed9ede7026"}
Sep 11 21:06:52.414613 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:52.414484    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d6c5fdb9f-hsmww" event={"ID":"35f8548d-cfd3-4665-a6d7-5953767772dd","Type":"ContainerStarted","Data":"cc8c4307af439554f8c6df3e7bf16c28b6dff9d622f0dc00af8ca5991dbb2f19"}
Sep 11 21:06:52.414613 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:52.414522    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-d6c5fdb9f-hsmww"
Sep 11 21:06:52.416576 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:52.416538    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wn4bh" event={"ID":"27ff1327-d08c-4a2e-b1c5-4fef5a22362e","Type":"ContainerStarted","Data":"a73dc1b1d1fdb0c3bde5d577a33dfca389c7576e440985d09ad8abb430213314"}
Sep 11 21:06:52.416733 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:52.416603    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wn4bh" event={"ID":"27ff1327-d08c-4a2e-b1c5-4fef5a22362e","Type":"ContainerStarted","Data":"eba33407812531650ac000b293d5998503a810b49fba9f6b69d61f17d4f4c831"}
Sep 11 21:06:52.418376 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:52.418305    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gjb5r" event={"ID":"a0e1e0d4-3580-41ab-8521-ea2881163256","Type":"ContainerStarted","Data":"46e061453717eacfa7e10caa292da198effbd8168b4039b81bc76f0500b50c6e"}
Sep 11 21:06:53.423307 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:53.423269    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wn4bh" event={"ID":"27ff1327-d08c-4a2e-b1c5-4fef5a22362e","Type":"ContainerStarted","Data":"c069ddbc4b9629b83983306756f916bcb3799759fc734e870ffe0e5639ef9fa9"}
Sep 11 21:06:53.751469 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:53.750654    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-d6c5fdb9f-hsmww" podStartSLOduration=4.750634885 podStartE2EDuration="4.750634885s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:06:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:06:52.438596021 +0000 UTC m=+57.916907871" watchObservedRunningTime="2026-09-11 21:06:53.750634885 +0000 UTC m=+59.228946729"
Sep 11 21:06:53.751469 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:53.751398    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b5bc766dd-p5t9g"]
Sep 11 21:06:53.773195 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:53.773112    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b5bc766dd-p5t9g"]
Sep 11 21:06:53.773195 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:53.773172    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b5bc766dd-p5t9g"
Sep 11 21:06:53.776068 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:53.776026    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 11 21:06:53.776230 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:53.776090    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 11 21:06:53.776230 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:53.776026    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 11 21:06:53.776790 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:53.776767    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 11 21:06:53.776933 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:53.776818    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 11 21:06:53.776933 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:53.776842    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 11 21:06:53.777096 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:53.777080    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 11 21:06:53.777413 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:53.777220    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jgwp6\""
Sep 11 21:06:53.785719 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:53.785685    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 11 21:06:53.911866 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:53.911823    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7b9bc750-7710-45a8-bcf7-8b75ce9246c6-console-serving-cert\") pod \"console-b5bc766dd-p5t9g\" (UID: \"7b9bc750-7710-45a8-bcf7-8b75ce9246c6\") " pod="openshift-console/console-b5bc766dd-p5t9g"
Sep 11 21:06:53.912083 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:53.911963    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7b9bc750-7710-45a8-bcf7-8b75ce9246c6-oauth-serving-cert\") pod \"console-b5bc766dd-p5t9g\" (UID: \"7b9bc750-7710-45a8-bcf7-8b75ce9246c6\") " pod="openshift-console/console-b5bc766dd-p5t9g"
Sep 11 21:06:53.912083 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:53.912029    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7b9bc750-7710-45a8-bcf7-8b75ce9246c6-console-config\") pod \"console-b5bc766dd-p5t9g\" (UID: \"7b9bc750-7710-45a8-bcf7-8b75ce9246c6\") " pod="openshift-console/console-b5bc766dd-p5t9g"
Sep 11 21:06:53.912200 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:53.912131    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7b9bc750-7710-45a8-bcf7-8b75ce9246c6-console-oauth-config\") pod \"console-b5bc766dd-p5t9g\" (UID: \"7b9bc750-7710-45a8-bcf7-8b75ce9246c6\") " pod="openshift-console/console-b5bc766dd-p5t9g"
Sep 11 21:06:53.912200 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:53.912161    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4lrq\" (UniqueName: \"kubernetes.io/projected/7b9bc750-7710-45a8-bcf7-8b75ce9246c6-kube-api-access-p4lrq\") pod \"console-b5bc766dd-p5t9g\" (UID: \"7b9bc750-7710-45a8-bcf7-8b75ce9246c6\") " pod="openshift-console/console-b5bc766dd-p5t9g"
Sep 11 21:06:53.912200 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:53.912191    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b9bc750-7710-45a8-bcf7-8b75ce9246c6-trusted-ca-bundle\") pod \"console-b5bc766dd-p5t9g\" (UID: \"7b9bc750-7710-45a8-bcf7-8b75ce9246c6\") " pod="openshift-console/console-b5bc766dd-p5t9g"
Sep 11 21:06:53.912361 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:53.912220    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7b9bc750-7710-45a8-bcf7-8b75ce9246c6-service-ca\") pod \"console-b5bc766dd-p5t9g\" (UID: \"7b9bc750-7710-45a8-bcf7-8b75ce9246c6\") " pod="openshift-console/console-b5bc766dd-p5t9g"
Sep 11 21:06:54.013269 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:54.013168    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7b9bc750-7710-45a8-bcf7-8b75ce9246c6-service-ca\") pod \"console-b5bc766dd-p5t9g\" (UID: \"7b9bc750-7710-45a8-bcf7-8b75ce9246c6\") " pod="openshift-console/console-b5bc766dd-p5t9g"
Sep 11 21:06:54.013269 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:54.013237    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7b9bc750-7710-45a8-bcf7-8b75ce9246c6-console-serving-cert\") pod \"console-b5bc766dd-p5t9g\" (UID: \"7b9bc750-7710-45a8-bcf7-8b75ce9246c6\") " pod="openshift-console/console-b5bc766dd-p5t9g"
Sep 11 21:06:54.013519 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:54.013300    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7b9bc750-7710-45a8-bcf7-8b75ce9246c6-oauth-serving-cert\") pod \"console-b5bc766dd-p5t9g\" (UID: \"7b9bc750-7710-45a8-bcf7-8b75ce9246c6\") " pod="openshift-console/console-b5bc766dd-p5t9g"
Sep 11 21:06:54.013519 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:54.013338    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7b9bc750-7710-45a8-bcf7-8b75ce9246c6-console-config\") pod \"console-b5bc766dd-p5t9g\" (UID: \"7b9bc750-7710-45a8-bcf7-8b75ce9246c6\") " pod="openshift-console/console-b5bc766dd-p5t9g"
Sep 11 21:06:54.013519 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:54.013406    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7b9bc750-7710-45a8-bcf7-8b75ce9246c6-console-oauth-config\") pod \"console-b5bc766dd-p5t9g\" (UID: \"7b9bc750-7710-45a8-bcf7-8b75ce9246c6\") " pod="openshift-console/console-b5bc766dd-p5t9g"
Sep 11 21:06:54.013519 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:54.013431    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4lrq\" (UniqueName: \"kubernetes.io/projected/7b9bc750-7710-45a8-bcf7-8b75ce9246c6-kube-api-access-p4lrq\") pod \"console-b5bc766dd-p5t9g\" (UID: \"7b9bc750-7710-45a8-bcf7-8b75ce9246c6\") " pod="openshift-console/console-b5bc766dd-p5t9g"
Sep 11 21:06:54.014502 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:54.013779    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b9bc750-7710-45a8-bcf7-8b75ce9246c6-trusted-ca-bundle\") pod \"console-b5bc766dd-p5t9g\" (UID: \"7b9bc750-7710-45a8-bcf7-8b75ce9246c6\") " pod="openshift-console/console-b5bc766dd-p5t9g"
Sep 11 21:06:54.014502 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:54.014061    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7b9bc750-7710-45a8-bcf7-8b75ce9246c6-service-ca\") pod \"console-b5bc766dd-p5t9g\" (UID: \"7b9bc750-7710-45a8-bcf7-8b75ce9246c6\") " pod="openshift-console/console-b5bc766dd-p5t9g"
Sep 11 21:06:54.014502 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:54.014123    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7b9bc750-7710-45a8-bcf7-8b75ce9246c6-oauth-serving-cert\") pod \"console-b5bc766dd-p5t9g\" (UID: \"7b9bc750-7710-45a8-bcf7-8b75ce9246c6\") " pod="openshift-console/console-b5bc766dd-p5t9g"
Sep 11 21:06:54.014502 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:54.014188    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7b9bc750-7710-45a8-bcf7-8b75ce9246c6-console-config\") pod \"console-b5bc766dd-p5t9g\" (UID: \"7b9bc750-7710-45a8-bcf7-8b75ce9246c6\") " pod="openshift-console/console-b5bc766dd-p5t9g"
Sep 11 21:06:54.014742 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:54.014574    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b9bc750-7710-45a8-bcf7-8b75ce9246c6-trusted-ca-bundle\") pod \"console-b5bc766dd-p5t9g\" (UID: \"7b9bc750-7710-45a8-bcf7-8b75ce9246c6\") " pod="openshift-console/console-b5bc766dd-p5t9g"
Sep 11 21:06:54.016565 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:54.016540    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7b9bc750-7710-45a8-bcf7-8b75ce9246c6-console-oauth-config\") pod \"console-b5bc766dd-p5t9g\" (UID: \"7b9bc750-7710-45a8-bcf7-8b75ce9246c6\") " pod="openshift-console/console-b5bc766dd-p5t9g"
Sep 11 21:06:54.016852 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:54.016833    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7b9bc750-7710-45a8-bcf7-8b75ce9246c6-console-serving-cert\") pod \"console-b5bc766dd-p5t9g\" (UID: \"7b9bc750-7710-45a8-bcf7-8b75ce9246c6\") " pod="openshift-console/console-b5bc766dd-p5t9g"
Sep 11 21:06:54.023110 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:54.023078    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4lrq\" (UniqueName: \"kubernetes.io/projected/7b9bc750-7710-45a8-bcf7-8b75ce9246c6-kube-api-access-p4lrq\") pod \"console-b5bc766dd-p5t9g\" (UID: \"7b9bc750-7710-45a8-bcf7-8b75ce9246c6\") " pod="openshift-console/console-b5bc766dd-p5t9g"
Sep 11 21:06:54.086594 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:54.086558    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b5bc766dd-p5t9g"
Sep 11 21:06:54.428423 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:54.428362    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gjb5r" event={"ID":"a0e1e0d4-3580-41ab-8521-ea2881163256","Type":"ContainerStarted","Data":"43506b290d8f8f1ec2d296fdf79c095be8432fb7eff5dd093c8fa6dccc359961"}
Sep 11 21:06:54.430169 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:54.430112    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hpv5x" event={"ID":"e1ff2609-425e-4d14-93a4-b85b5b3bb3c9","Type":"ContainerStarted","Data":"4bf6754bb161190f1b3ce57efe18d901bf97f867f762788358f1eeb9f87619fb"}
Sep 11 21:06:54.448577 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:54.448511    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hpv5x" podStartSLOduration=1.772411808 podStartE2EDuration="4.448493423s" totalImagesPullingTime="2.676081615s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:06:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:06:54.447542111 +0000 UTC m=+59.925853954" watchObservedRunningTime="2026-09-11 21:06:54.448493423 +0000 UTC m=+59.926805267"
Sep 11 21:06:54.462732 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:54.462692    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b5bc766dd-p5t9g"]
Sep 11 21:06:54.683238 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:06:54.683203    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b9bc750_7710_45a8_bcf7_8b75ce9246c6.slice/crio-c2a47d56aba0b4d9aa71d9112846d80fe23044bdffecf352f3e02e0dc992c1b9 WatchSource:0}: Error finding container c2a47d56aba0b4d9aa71d9112846d80fe23044bdffecf352f3e02e0dc992c1b9: Status 404 returned error can't find the container with id c2a47d56aba0b4d9aa71d9112846d80fe23044bdffecf352f3e02e0dc992c1b9
Sep 11 21:06:55.339860 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:55.339823    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qpwdk"
Sep 11 21:06:55.436699 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:55.436653    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gjb5r" event={"ID":"a0e1e0d4-3580-41ab-8521-ea2881163256","Type":"ContainerStarted","Data":"f23af7a7937cac6493476373049bca4a4fd5a86d89c7f69cec4f400d96d99476"}
Sep 11 21:06:55.437166 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:55.436775    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gjb5r"
Sep 11 21:06:55.438171 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:55.438142    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b5bc766dd-p5t9g" event={"ID":"7b9bc750-7710-45a8-bcf7-8b75ce9246c6","Type":"ContainerStarted","Data":"c2a47d56aba0b4d9aa71d9112846d80fe23044bdffecf352f3e02e0dc992c1b9"}
Sep 11 21:06:55.440681 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:55.440651    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wn4bh" event={"ID":"27ff1327-d08c-4a2e-b1c5-4fef5a22362e","Type":"ContainerStarted","Data":"37e5b2fc4898947f3454106fc2b2fec6e9d014c9f9bf0935bad9426ecab2b589"}
Sep 11 21:06:55.455427 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:55.455351    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-gjb5r" podStartSLOduration=2.788867536 podStartE2EDuration="5.455331118s" totalImagesPullingTime="2.666463582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:06:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:06:55.455030077 +0000 UTC m=+60.933341923" watchObservedRunningTime="2026-09-11 21:06:55.455331118 +0000 UTC m=+60.933642963"
Sep 11 21:06:55.473334 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:55.473277    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wn4bh" podStartSLOduration=2.52755393 podStartE2EDuration="5.473258906s" totalImagesPullingTime="2.945704976s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:06:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:06:55.472680562 +0000 UTC m=+60.950992432" watchObservedRunningTime="2026-09-11 21:06:55.473258906 +0000 UTC m=+60.951570748"
Sep 11 21:06:57.314979 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:57.314947    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-9g9nr"]
Sep 11 21:06:57.317602 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:57.317581    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-9g9nr"
Sep 11 21:06:57.321270 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:57.321242    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 11 21:06:57.321270 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:57.321240    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 11 21:06:57.321501 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:57.321283    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 11 21:06:57.321501 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:57.321299    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 11 21:06:57.321748 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:57.321681    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-6nh8h\""
Sep 11 21:06:57.321899 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:57.321887    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 11 21:06:57.327894 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:57.327860    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-9g9nr"]
Sep 11 21:06:57.339208 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:57.339158    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d1ebbfa3-a39f-4298-bd0d-f0668131e8ca-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-9g9nr\" (UID: \"d1ebbfa3-a39f-4298-bd0d-f0668131e8ca\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-9g9nr"
Sep 11 21:06:57.339364 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:57.339217    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d1ebbfa3-a39f-4298-bd0d-f0668131e8ca-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-9g9nr\" (UID: \"d1ebbfa3-a39f-4298-bd0d-f0668131e8ca\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-9g9nr"
Sep 11 21:06:57.339364 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:57.339327    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zntnz\" (UniqueName: \"kubernetes.io/projected/d1ebbfa3-a39f-4298-bd0d-f0668131e8ca-kube-api-access-zntnz\") pod \"prometheus-operator-68bcd7f987-9g9nr\" (UID: \"d1ebbfa3-a39f-4298-bd0d-f0668131e8ca\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-9g9nr"
Sep 11 21:06:57.339481 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:57.339401    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d1ebbfa3-a39f-4298-bd0d-f0668131e8ca-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-9g9nr\" (UID: \"d1ebbfa3-a39f-4298-bd0d-f0668131e8ca\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-9g9nr"
Sep 11 21:06:57.439927 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:57.439891    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d1ebbfa3-a39f-4298-bd0d-f0668131e8ca-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-9g9nr\" (UID: \"d1ebbfa3-a39f-4298-bd0d-f0668131e8ca\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-9g9nr"
Sep 11 21:06:57.440087 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:57.439955    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zntnz\" (UniqueName: \"kubernetes.io/projected/d1ebbfa3-a39f-4298-bd0d-f0668131e8ca-kube-api-access-zntnz\") pod \"prometheus-operator-68bcd7f987-9g9nr\" (UID: \"d1ebbfa3-a39f-4298-bd0d-f0668131e8ca\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-9g9nr"
Sep 11 21:06:57.440087 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:57.440017    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d1ebbfa3-a39f-4298-bd0d-f0668131e8ca-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-9g9nr\" (UID: \"d1ebbfa3-a39f-4298-bd0d-f0668131e8ca\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-9g9nr"
Sep 11 21:06:57.440087 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:57.440049    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d1ebbfa3-a39f-4298-bd0d-f0668131e8ca-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-9g9nr\" (UID: \"d1ebbfa3-a39f-4298-bd0d-f0668131e8ca\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-9g9nr"
Sep 11 21:06:57.440226 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:57.440155    2560 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Sep 11 21:06:57.440226 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:06:57.440223    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1ebbfa3-a39f-4298-bd0d-f0668131e8ca-prometheus-operator-tls podName:d1ebbfa3-a39f-4298-bd0d-f0668131e8ca nodeName:}" failed. No retries permitted until 2026-09-11 21:06:57.940199115 +0000 UTC m=+63.418510937 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/d1ebbfa3-a39f-4298-bd0d-f0668131e8ca-prometheus-operator-tls") pod "prometheus-operator-68bcd7f987-9g9nr" (UID: "d1ebbfa3-a39f-4298-bd0d-f0668131e8ca") : secret "prometheus-operator-tls" not found
Sep 11 21:06:57.440743 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:57.440722    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d1ebbfa3-a39f-4298-bd0d-f0668131e8ca-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-9g9nr\" (UID: \"d1ebbfa3-a39f-4298-bd0d-f0668131e8ca\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-9g9nr"
Sep 11 21:06:57.442592 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:57.442573    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d1ebbfa3-a39f-4298-bd0d-f0668131e8ca-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-9g9nr\" (UID: \"d1ebbfa3-a39f-4298-bd0d-f0668131e8ca\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-9g9nr"
Sep 11 21:06:57.448678 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:57.448647    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zntnz\" (UniqueName: \"kubernetes.io/projected/d1ebbfa3-a39f-4298-bd0d-f0668131e8ca-kube-api-access-zntnz\") pod \"prometheus-operator-68bcd7f987-9g9nr\" (UID: \"d1ebbfa3-a39f-4298-bd0d-f0668131e8ca\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-9g9nr"
Sep 11 21:06:57.453766 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:57.453735    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b5bc766dd-p5t9g" event={"ID":"7b9bc750-7710-45a8-bcf7-8b75ce9246c6","Type":"ContainerStarted","Data":"afad7e4065dc0562417fc3cd2f4b574765601a63408a9455fa7dd4ae58b58760"}
Sep 11 21:06:57.471828 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:57.471758    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b5bc766dd-p5t9g" podStartSLOduration=1.902082777 podStartE2EDuration="4.471735896s" totalImagesPullingTime="2.569653119s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:06:57.470880198 +0000 UTC m=+62.949192055" watchObservedRunningTime="2026-09-11 21:06:57.471735896 +0000 UTC m=+62.950047740"
Sep 11 21:06:57.942880 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:57.942841    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d1ebbfa3-a39f-4298-bd0d-f0668131e8ca-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-9g9nr\" (UID: \"d1ebbfa3-a39f-4298-bd0d-f0668131e8ca\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-9g9nr"
Sep 11 21:06:57.945369 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:57.945335    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d1ebbfa3-a39f-4298-bd0d-f0668131e8ca-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-9g9nr\" (UID: \"d1ebbfa3-a39f-4298-bd0d-f0668131e8ca\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-9g9nr"
Sep 11 21:06:58.228155 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:58.228061    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-9g9nr"
Sep 11 21:06:58.501124 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:58.501035    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-9g9nr"]
Sep 11 21:06:58.504531 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:06:58.504503    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1ebbfa3_a39f_4298_bd0d_f0668131e8ca.slice/crio-36e4458f2ce629015979f7452e58030b31e789b019225a5127d91978f5fb5ca8 WatchSource:0}: Error finding container 36e4458f2ce629015979f7452e58030b31e789b019225a5127d91978f5fb5ca8: Status 404 returned error can't find the container with id 36e4458f2ce629015979f7452e58030b31e789b019225a5127d91978f5fb5ca8
Sep 11 21:06:59.461831 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:59.461788    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-9g9nr" event={"ID":"d1ebbfa3-a39f-4298-bd0d-f0668131e8ca","Type":"ContainerStarted","Data":"36e4458f2ce629015979f7452e58030b31e789b019225a5127d91978f5fb5ca8"}
Sep 11 21:06:59.760748 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:59.760643    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc-original-pull-secret\") pod \"global-pull-secret-syncer-vxlb2\" (UID: \"0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc\") " pod="kube-system/global-pull-secret-syncer-vxlb2"
Sep 11 21:06:59.763518 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:59.763493    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 21:06:59.774260 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:59.774231    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc-original-pull-secret\") pod \"global-pull-secret-syncer-vxlb2\" (UID: \"0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc\") " pod="kube-system/global-pull-secret-syncer-vxlb2"
Sep 11 21:06:59.862010 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:59.861968    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3-metrics-certs\") pod \"network-metrics-daemon-6nwfd\" (UID: \"5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3\") " pod="openshift-multus/network-metrics-daemon-6nwfd"
Sep 11 21:06:59.864971 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:59.864707    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 21:06:59.874798 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:59.874765    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3-metrics-certs\") pod \"network-metrics-daemon-6nwfd\" (UID: \"5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3\") " pod="openshift-multus/network-metrics-daemon-6nwfd"
Sep 11 21:06:59.962987 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:59.962939    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vc5t8\" (UniqueName: \"kubernetes.io/projected/394b71c4-7749-4e24-a7ef-b7060c4b4864-kube-api-access-vc5t8\") pod \"network-check-target-sxs24\" (UID: \"394b71c4-7749-4e24-a7ef-b7060c4b4864\") " pod="openshift-network-diagnostics/network-check-target-sxs24"
Sep 11 21:06:59.965554 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:59.965526    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 21:06:59.975672 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:59.975639    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 21:06:59.986143 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:06:59.986104    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc5t8\" (UniqueName: \"kubernetes.io/projected/394b71c4-7749-4e24-a7ef-b7060c4b4864-kube-api-access-vc5t8\") pod \"network-check-target-sxs24\" (UID: \"394b71c4-7749-4e24-a7ef-b7060c4b4864\") " pod="openshift-network-diagnostics/network-check-target-sxs24"
Sep 11 21:07:00.044681 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:00.044420    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mwzls\""
Sep 11 21:07:00.047488 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:00.047452    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vxlb2"
Sep 11 21:07:00.053039 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:00.052804    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sxs24"
Sep 11 21:07:00.143309 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:00.143283    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mpnkz\""
Sep 11 21:07:00.151570 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:00.151529    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6nwfd"
Sep 11 21:07:00.352834 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:07:00.352799    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0af5ea62_b0cd_4a1e_ad1e_91f527a2e1fc.slice/crio-4498358b386f39121fdebbdcc05fc8c8826b7168ad7965c71a0e9fd8baa2f965 WatchSource:0}: Error finding container 4498358b386f39121fdebbdcc05fc8c8826b7168ad7965c71a0e9fd8baa2f965: Status 404 returned error can't find the container with id 4498358b386f39121fdebbdcc05fc8c8826b7168ad7965c71a0e9fd8baa2f965
Sep 11 21:07:00.353106 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:00.353085    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vxlb2"]
Sep 11 21:07:00.360518 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:00.360489    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sxs24"]
Sep 11 21:07:00.363819 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:07:00.363794    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod394b71c4_7749_4e24_a7ef_b7060c4b4864.slice/crio-d76bd4a70fc76c3f04260b0de912bd0b9c846a431a98c60dca9e276a9ffef463 WatchSource:0}: Error finding container d76bd4a70fc76c3f04260b0de912bd0b9c846a431a98c60dca9e276a9ffef463: Status 404 returned error can't find the container with id d76bd4a70fc76c3f04260b0de912bd0b9c846a431a98c60dca9e276a9ffef463
Sep 11 21:07:00.422276 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:00.422244    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6nwfd"]
Sep 11 21:07:00.425636 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:07:00.425608    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b1a2772_837e_4a37_bfa3_a2a3dda2c8d3.slice/crio-5252f507e71ea587c0c596701863e791c430b6a30fadf9466c4b36c2803c02d1 WatchSource:0}: Error finding container 5252f507e71ea587c0c596701863e791c430b6a30fadf9466c4b36c2803c02d1: Status 404 returned error can't find the container with id 5252f507e71ea587c0c596701863e791c430b6a30fadf9466c4b36c2803c02d1
Sep 11 21:07:00.466875 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:00.466843    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-9g9nr" event={"ID":"d1ebbfa3-a39f-4298-bd0d-f0668131e8ca","Type":"ContainerStarted","Data":"62d4a485702329cd914d4e9ae2d6937831f838e22babc5f0d0f3c928043f09ba"}
Sep 11 21:07:00.467063 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:00.466902    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-9g9nr" event={"ID":"d1ebbfa3-a39f-4298-bd0d-f0668131e8ca","Type":"ContainerStarted","Data":"a666f25adeecfa6e7d7765a95286bee3f0fec01713b20385f993fa83758d8cf8"}
Sep 11 21:07:00.468113 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:00.468082    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vxlb2" event={"ID":"0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc","Type":"ContainerStarted","Data":"4498358b386f39121fdebbdcc05fc8c8826b7168ad7965c71a0e9fd8baa2f965"}
Sep 11 21:07:00.469256 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:00.469226    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sxs24" event={"ID":"394b71c4-7749-4e24-a7ef-b7060c4b4864","Type":"ContainerStarted","Data":"d76bd4a70fc76c3f04260b0de912bd0b9c846a431a98c60dca9e276a9ffef463"}
Sep 11 21:07:00.470524 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:00.470500    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6nwfd" event={"ID":"5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3","Type":"ContainerStarted","Data":"5252f507e71ea587c0c596701863e791c430b6a30fadf9466c4b36c2803c02d1"}
Sep 11 21:07:00.490668 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:00.490608    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-9g9nr" podStartSLOduration=2.16336883 podStartE2EDuration="3.490587904s" totalImagesPullingTime="1.327219074s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:06:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:07:00.489730281 +0000 UTC m=+65.968042126" watchObservedRunningTime="2026-09-11 21:07:00.490587904 +0000 UTC m=+65.968899748"
Sep 11 21:07:02.487241 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.487200    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6nwfd" event={"ID":"5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3","Type":"ContainerStarted","Data":"37cf80e157c4b2bfa05fedb953b06c0d9654433d7461fb4d43556fc8c65d1d02"}
Sep 11 21:07:02.487768 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.487307    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6nwfd" event={"ID":"5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3","Type":"ContainerStarted","Data":"56ae0c19fe9801f8a253e78bfc555dbfb630252b0471b91de356fb7dcd2042f0"}
Sep 11 21:07:02.512143 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.512062    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6nwfd" podStartSLOduration=66.39151047 podStartE2EDuration="1m7.5120376s" totalImagesPullingTime="1.12052713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:05:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:07:02.510941736 +0000 UTC m=+67.989253580" watchObservedRunningTime="2026-09-11 21:07:02.5120376 +0000 UTC m=+67.990349445"
Sep 11 21:07:02.821894 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.821807    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-rhcd6"]
Sep 11 21:07:02.826170 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.826137    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rhcd6"
Sep 11 21:07:02.828803 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.828771    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 11 21:07:02.829073 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.829056    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 11 21:07:02.829593 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.829571    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-zgb6f\""
Sep 11 21:07:02.838325 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.838287    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-rhcd6"]
Sep 11 21:07:02.850563 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.850518    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-mg2bk"]
Sep 11 21:07:02.853585 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.853551    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mg2bk"
Sep 11 21:07:02.856971 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.856939    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 11 21:07:02.857659 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.857312    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 11 21:07:02.857659 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.857367    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-grm67\""
Sep 11 21:07:02.857659 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.857493    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 11 21:07:02.870700 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.870669    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-mg2bk"]
Sep 11 21:07:02.884940 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.884892    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3c7a33a-d572-4476-83cc-941b5bba5804-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-rhcd6\" (UID: \"c3c7a33a-d572-4476-83cc-941b5bba5804\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rhcd6"
Sep 11 21:07:02.885141 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.884954    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nqpv\" (UniqueName: \"kubernetes.io/projected/c3c7a33a-d572-4476-83cc-941b5bba5804-kube-api-access-9nqpv\") pod \"openshift-state-metrics-67dcf8c979-rhcd6\" (UID: \"c3c7a33a-d572-4476-83cc-941b5bba5804\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rhcd6"
Sep 11 21:07:02.885141 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.884986    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dg9pz\" (UniqueName: \"kubernetes.io/projected/85cfef09-44c0-4cb4-97d1-97bce96e79c3-kube-api-access-dg9pz\") pod \"kube-state-metrics-59fbdd77d-mg2bk\" (UID: \"85cfef09-44c0-4cb4-97d1-97bce96e79c3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mg2bk"
Sep 11 21:07:02.885141 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.885018    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/85cfef09-44c0-4cb4-97d1-97bce96e79c3-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-mg2bk\" (UID: \"85cfef09-44c0-4cb4-97d1-97bce96e79c3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mg2bk"
Sep 11 21:07:02.885141 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.885072    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/85cfef09-44c0-4cb4-97d1-97bce96e79c3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-mg2bk\" (UID: \"85cfef09-44c0-4cb4-97d1-97bce96e79c3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mg2bk"
Sep 11 21:07:02.885141 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.885138    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/85cfef09-44c0-4cb4-97d1-97bce96e79c3-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-mg2bk\" (UID: \"85cfef09-44c0-4cb4-97d1-97bce96e79c3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mg2bk"
Sep 11 21:07:02.885429 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.885195    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/85cfef09-44c0-4cb4-97d1-97bce96e79c3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-mg2bk\" (UID: \"85cfef09-44c0-4cb4-97d1-97bce96e79c3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mg2bk"
Sep 11 21:07:02.885429 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.885235    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85cfef09-44c0-4cb4-97d1-97bce96e79c3-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-mg2bk\" (UID: \"85cfef09-44c0-4cb4-97d1-97bce96e79c3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mg2bk"
Sep 11 21:07:02.885429 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.885262    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c3c7a33a-d572-4476-83cc-941b5bba5804-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-rhcd6\" (UID: \"c3c7a33a-d572-4476-83cc-941b5bba5804\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rhcd6"
Sep 11 21:07:02.885429 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.885287    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3c7a33a-d572-4476-83cc-941b5bba5804-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-rhcd6\" (UID: \"c3c7a33a-d572-4476-83cc-941b5bba5804\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rhcd6"
Sep 11 21:07:02.888915 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.888873    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2t2wn"]
Sep 11 21:07:02.891848 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.891813    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2t2wn"
Sep 11 21:07:02.894895 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.894865    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 11 21:07:02.895248 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.895229    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 11 21:07:02.895372 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.895310    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fhhrl\""
Sep 11 21:07:02.895464 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.895405    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 11 21:07:02.986206 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.986165    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77d51833-213b-47d4-8179-7d871d60a85f-metrics-client-ca\") pod \"node-exporter-2t2wn\" (UID: \"77d51833-213b-47d4-8179-7d871d60a85f\") " pod="openshift-monitoring/node-exporter-2t2wn"
Sep 11 21:07:02.986431 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.986222    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/85cfef09-44c0-4cb4-97d1-97bce96e79c3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-mg2bk\" (UID: \"85cfef09-44c0-4cb4-97d1-97bce96e79c3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mg2bk"
Sep 11 21:07:02.986431 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.986308    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/77d51833-213b-47d4-8179-7d871d60a85f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2t2wn\" (UID: \"77d51833-213b-47d4-8179-7d871d60a85f\") " pod="openshift-monitoring/node-exporter-2t2wn"
Sep 11 21:07:02.986431 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.986348    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t754r\" (UniqueName: \"kubernetes.io/projected/77d51833-213b-47d4-8179-7d871d60a85f-kube-api-access-t754r\") pod \"node-exporter-2t2wn\" (UID: \"77d51833-213b-47d4-8179-7d871d60a85f\") " pod="openshift-monitoring/node-exporter-2t2wn"
Sep 11 21:07:02.986431 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.986404    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/77d51833-213b-47d4-8179-7d871d60a85f-node-exporter-textfile\") pod \"node-exporter-2t2wn\" (UID: \"77d51833-213b-47d4-8179-7d871d60a85f\") " pod="openshift-monitoring/node-exporter-2t2wn"
Sep 11 21:07:02.986652 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.986441    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85cfef09-44c0-4cb4-97d1-97bce96e79c3-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-mg2bk\" (UID: \"85cfef09-44c0-4cb4-97d1-97bce96e79c3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mg2bk"
Sep 11 21:07:02.986652 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.986482    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c3c7a33a-d572-4476-83cc-941b5bba5804-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-rhcd6\" (UID: \"c3c7a33a-d572-4476-83cc-941b5bba5804\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rhcd6"
Sep 11 21:07:02.986652 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.986513    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3c7a33a-d572-4476-83cc-941b5bba5804-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-rhcd6\" (UID: \"c3c7a33a-d572-4476-83cc-941b5bba5804\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rhcd6"
Sep 11 21:07:02.986652 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.986536    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/77d51833-213b-47d4-8179-7d871d60a85f-node-exporter-tls\") pod \"node-exporter-2t2wn\" (UID: \"77d51833-213b-47d4-8179-7d871d60a85f\") " pod="openshift-monitoring/node-exporter-2t2wn"
Sep 11 21:07:02.986652 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.986568    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/77d51833-213b-47d4-8179-7d871d60a85f-node-exporter-wtmp\") pod \"node-exporter-2t2wn\" (UID: \"77d51833-213b-47d4-8179-7d871d60a85f\") " pod="openshift-monitoring/node-exporter-2t2wn"
Sep 11 21:07:02.986652 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.986623    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3c7a33a-d572-4476-83cc-941b5bba5804-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-rhcd6\" (UID: \"c3c7a33a-d572-4476-83cc-941b5bba5804\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rhcd6"
Sep 11 21:07:02.986948 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.986653    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77d51833-213b-47d4-8179-7d871d60a85f-sys\") pod \"node-exporter-2t2wn\" (UID: \"77d51833-213b-47d4-8179-7d871d60a85f\") " pod="openshift-monitoring/node-exporter-2t2wn"
Sep 11 21:07:02.986948 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.986681    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/77d51833-213b-47d4-8179-7d871d60a85f-node-exporter-accelerators-collector-config\") pod \"node-exporter-2t2wn\" (UID: \"77d51833-213b-47d4-8179-7d871d60a85f\") " pod="openshift-monitoring/node-exporter-2t2wn"
Sep 11 21:07:02.986948 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.986714    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nqpv\" (UniqueName: \"kubernetes.io/projected/c3c7a33a-d572-4476-83cc-941b5bba5804-kube-api-access-9nqpv\") pod \"openshift-state-metrics-67dcf8c979-rhcd6\" (UID: \"c3c7a33a-d572-4476-83cc-941b5bba5804\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rhcd6"
Sep 11 21:07:02.986948 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.986745    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dg9pz\" (UniqueName: \"kubernetes.io/projected/85cfef09-44c0-4cb4-97d1-97bce96e79c3-kube-api-access-dg9pz\") pod \"kube-state-metrics-59fbdd77d-mg2bk\" (UID: \"85cfef09-44c0-4cb4-97d1-97bce96e79c3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mg2bk"
Sep 11 21:07:02.986948 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.986786    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/85cfef09-44c0-4cb4-97d1-97bce96e79c3-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-mg2bk\" (UID: \"85cfef09-44c0-4cb4-97d1-97bce96e79c3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mg2bk"
Sep 11 21:07:02.986948 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.986826    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/85cfef09-44c0-4cb4-97d1-97bce96e79c3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-mg2bk\" (UID: \"85cfef09-44c0-4cb4-97d1-97bce96e79c3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mg2bk"
Sep 11 21:07:02.986948 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.986858    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/85cfef09-44c0-4cb4-97d1-97bce96e79c3-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-mg2bk\" (UID: \"85cfef09-44c0-4cb4-97d1-97bce96e79c3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mg2bk"
Sep 11 21:07:02.986948 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.986887    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/77d51833-213b-47d4-8179-7d871d60a85f-root\") pod \"node-exporter-2t2wn\" (UID: \"77d51833-213b-47d4-8179-7d871d60a85f\") " pod="openshift-monitoring/node-exporter-2t2wn"
Sep 11 21:07:02.987323 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:07:02.987044    2560 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Sep 11 21:07:02.987323 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:07:02.987119    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3c7a33a-d572-4476-83cc-941b5bba5804-openshift-state-metrics-tls podName:c3c7a33a-d572-4476-83cc-941b5bba5804 nodeName:}" failed. No retries permitted until 2026-09-11 21:07:03.487094822 +0000 UTC m=+68.965406666 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/c3c7a33a-d572-4476-83cc-941b5bba5804-openshift-state-metrics-tls") pod "openshift-state-metrics-67dcf8c979-rhcd6" (UID: "c3c7a33a-d572-4476-83cc-941b5bba5804") : secret "openshift-state-metrics-tls" not found
Sep 11 21:07:02.987323 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.987155    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/85cfef09-44c0-4cb4-97d1-97bce96e79c3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-mg2bk\" (UID: \"85cfef09-44c0-4cb4-97d1-97bce96e79c3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mg2bk"
Sep 11 21:07:02.987323 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.987218    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85cfef09-44c0-4cb4-97d1-97bce96e79c3-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-mg2bk\" (UID: \"85cfef09-44c0-4cb4-97d1-97bce96e79c3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mg2bk"
Sep 11 21:07:02.987754 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.987731    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/85cfef09-44c0-4cb4-97d1-97bce96e79c3-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-mg2bk\" (UID: \"85cfef09-44c0-4cb4-97d1-97bce96e79c3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mg2bk"
Sep 11 21:07:02.988403 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.988354    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3c7a33a-d572-4476-83cc-941b5bba5804-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-rhcd6\" (UID: \"c3c7a33a-d572-4476-83cc-941b5bba5804\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rhcd6"
Sep 11 21:07:02.990435 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.990406    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c3c7a33a-d572-4476-83cc-941b5bba5804-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-rhcd6\" (UID: \"c3c7a33a-d572-4476-83cc-941b5bba5804\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rhcd6"
Sep 11 21:07:02.990841 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.990812    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/85cfef09-44c0-4cb4-97d1-97bce96e79c3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-mg2bk\" (UID: \"85cfef09-44c0-4cb4-97d1-97bce96e79c3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mg2bk"
Sep 11 21:07:02.991003 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:02.990987    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/85cfef09-44c0-4cb4-97d1-97bce96e79c3-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-mg2bk\" (UID: \"85cfef09-44c0-4cb4-97d1-97bce96e79c3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mg2bk"
Sep 11 21:07:03.005894 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.005451    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dg9pz\" (UniqueName: \"kubernetes.io/projected/85cfef09-44c0-4cb4-97d1-97bce96e79c3-kube-api-access-dg9pz\") pod \"kube-state-metrics-59fbdd77d-mg2bk\" (UID: \"85cfef09-44c0-4cb4-97d1-97bce96e79c3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mg2bk"
Sep 11 21:07:03.005894 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.005449    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nqpv\" (UniqueName: \"kubernetes.io/projected/c3c7a33a-d572-4476-83cc-941b5bba5804-kube-api-access-9nqpv\") pod \"openshift-state-metrics-67dcf8c979-rhcd6\" (UID: \"c3c7a33a-d572-4476-83cc-941b5bba5804\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rhcd6"
Sep 11 21:07:03.087434 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.087318    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/77d51833-213b-47d4-8179-7d871d60a85f-node-exporter-tls\") pod \"node-exporter-2t2wn\" (UID: \"77d51833-213b-47d4-8179-7d871d60a85f\") " pod="openshift-monitoring/node-exporter-2t2wn"
Sep 11 21:07:03.087434 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.087379    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/77d51833-213b-47d4-8179-7d871d60a85f-node-exporter-wtmp\") pod \"node-exporter-2t2wn\" (UID: \"77d51833-213b-47d4-8179-7d871d60a85f\") " pod="openshift-monitoring/node-exporter-2t2wn"
Sep 11 21:07:03.087692 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.087443    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77d51833-213b-47d4-8179-7d871d60a85f-sys\") pod \"node-exporter-2t2wn\" (UID: \"77d51833-213b-47d4-8179-7d871d60a85f\") " pod="openshift-monitoring/node-exporter-2t2wn"
Sep 11 21:07:03.087692 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.087471    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/77d51833-213b-47d4-8179-7d871d60a85f-node-exporter-accelerators-collector-config\") pod \"node-exporter-2t2wn\" (UID: \"77d51833-213b-47d4-8179-7d871d60a85f\") " pod="openshift-monitoring/node-exporter-2t2wn"
Sep 11 21:07:03.087692 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.087533    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/77d51833-213b-47d4-8179-7d871d60a85f-root\") pod \"node-exporter-2t2wn\" (UID: \"77d51833-213b-47d4-8179-7d871d60a85f\") " pod="openshift-monitoring/node-exporter-2t2wn"
Sep 11 21:07:03.087692 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.087576    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77d51833-213b-47d4-8179-7d871d60a85f-metrics-client-ca\") pod \"node-exporter-2t2wn\" (UID: \"77d51833-213b-47d4-8179-7d871d60a85f\") " pod="openshift-monitoring/node-exporter-2t2wn"
Sep 11 21:07:03.087692 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.087614    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/77d51833-213b-47d4-8179-7d871d60a85f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2t2wn\" (UID: \"77d51833-213b-47d4-8179-7d871d60a85f\") " pod="openshift-monitoring/node-exporter-2t2wn"
Sep 11 21:07:03.087692 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.087642    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t754r\" (UniqueName: \"kubernetes.io/projected/77d51833-213b-47d4-8179-7d871d60a85f-kube-api-access-t754r\") pod \"node-exporter-2t2wn\" (UID: \"77d51833-213b-47d4-8179-7d871d60a85f\") " pod="openshift-monitoring/node-exporter-2t2wn"
Sep 11 21:07:03.087692 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.087669    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/77d51833-213b-47d4-8179-7d871d60a85f-node-exporter-textfile\") pod \"node-exporter-2t2wn\" (UID: \"77d51833-213b-47d4-8179-7d871d60a85f\") " pod="openshift-monitoring/node-exporter-2t2wn"
Sep 11 21:07:03.088047 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.087721    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/77d51833-213b-47d4-8179-7d871d60a85f-node-exporter-wtmp\") pod \"node-exporter-2t2wn\" (UID: \"77d51833-213b-47d4-8179-7d871d60a85f\") " pod="openshift-monitoring/node-exporter-2t2wn"
Sep 11 21:07:03.088047 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.087788    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/77d51833-213b-47d4-8179-7d871d60a85f-root\") pod \"node-exporter-2t2wn\" (UID: \"77d51833-213b-47d4-8179-7d871d60a85f\") " pod="openshift-monitoring/node-exporter-2t2wn"
Sep 11 21:07:03.088047 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.087838    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77d51833-213b-47d4-8179-7d871d60a85f-sys\") pod \"node-exporter-2t2wn\" (UID: \"77d51833-213b-47d4-8179-7d871d60a85f\") " pod="openshift-monitoring/node-exporter-2t2wn"
Sep 11 21:07:03.088337 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.088314    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/77d51833-213b-47d4-8179-7d871d60a85f-node-exporter-textfile\") pod \"node-exporter-2t2wn\" (UID: \"77d51833-213b-47d4-8179-7d871d60a85f\") " pod="openshift-monitoring/node-exporter-2t2wn"
Sep 11 21:07:03.088893 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.088851    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/77d51833-213b-47d4-8179-7d871d60a85f-node-exporter-accelerators-collector-config\") pod \"node-exporter-2t2wn\" (UID: \"77d51833-213b-47d4-8179-7d871d60a85f\") " pod="openshift-monitoring/node-exporter-2t2wn"
Sep 11 21:07:03.089441 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.089418    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77d51833-213b-47d4-8179-7d871d60a85f-metrics-client-ca\") pod \"node-exporter-2t2wn\" (UID: \"77d51833-213b-47d4-8179-7d871d60a85f\") " pod="openshift-monitoring/node-exporter-2t2wn"
Sep 11 21:07:03.091128 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.091103    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/77d51833-213b-47d4-8179-7d871d60a85f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2t2wn\" (UID: \"77d51833-213b-47d4-8179-7d871d60a85f\") " pod="openshift-monitoring/node-exporter-2t2wn"
Sep 11 21:07:03.091743 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.091719    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/77d51833-213b-47d4-8179-7d871d60a85f-node-exporter-tls\") pod \"node-exporter-2t2wn\" (UID: \"77d51833-213b-47d4-8179-7d871d60a85f\") " pod="openshift-monitoring/node-exporter-2t2wn"
Sep 11 21:07:03.097654 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.097584    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t754r\" (UniqueName: \"kubernetes.io/projected/77d51833-213b-47d4-8179-7d871d60a85f-kube-api-access-t754r\") pod \"node-exporter-2t2wn\" (UID: \"77d51833-213b-47d4-8179-7d871d60a85f\") " pod="openshift-monitoring/node-exporter-2t2wn"
Sep 11 21:07:03.167070 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.167027    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mg2bk"
Sep 11 21:07:03.204903 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.204865    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2t2wn"
Sep 11 21:07:03.490552 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.490494    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3c7a33a-d572-4476-83cc-941b5bba5804-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-rhcd6\" (UID: \"c3c7a33a-d572-4476-83cc-941b5bba5804\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rhcd6"
Sep 11 21:07:03.493368 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.493339    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3c7a33a-d572-4476-83cc-941b5bba5804-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-rhcd6\" (UID: \"c3c7a33a-d572-4476-83cc-941b5bba5804\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rhcd6"
Sep 11 21:07:03.740465 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.740429    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rhcd6"
Sep 11 21:07:03.796146 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.796104    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 21:07:03.800122 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.800091    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:07:03.802608 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.802573    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 11 21:07:03.802608 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.802572    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 11 21:07:03.802904 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.802888    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 11 21:07:03.803072 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.803046    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 11 21:07:03.803192 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.803083    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 11 21:07:03.803192 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.803131    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 11 21:07:03.803192 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.803081    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 11 21:07:03.803537 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.803397    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 11 21:07:03.803537 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.803420    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 11 21:07:03.803537 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.803439    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-w6z9g\""
Sep 11 21:07:03.817042 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.817007    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 21:07:03.895422 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.894990    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d7fd3e1c-67ab-43e7-b405-ab8fced3c872-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d7fd3e1c-67ab-43e7-b405-ab8fced3c872\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:07:03.895422 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.895042    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d7fd3e1c-67ab-43e7-b405-ab8fced3c872-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d7fd3e1c-67ab-43e7-b405-ab8fced3c872\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:07:03.895422 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.895070    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzbgv\" (UniqueName: \"kubernetes.io/projected/d7fd3e1c-67ab-43e7-b405-ab8fced3c872-kube-api-access-hzbgv\") pod \"alertmanager-main-0\" (UID: \"d7fd3e1c-67ab-43e7-b405-ab8fced3c872\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:07:03.895422 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.895100    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d7fd3e1c-67ab-43e7-b405-ab8fced3c872-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d7fd3e1c-67ab-43e7-b405-ab8fced3c872\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:07:03.895422 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.895129    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d7fd3e1c-67ab-43e7-b405-ab8fced3c872-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d7fd3e1c-67ab-43e7-b405-ab8fced3c872\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:07:03.895422 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.895157    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d7fd3e1c-67ab-43e7-b405-ab8fced3c872-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d7fd3e1c-67ab-43e7-b405-ab8fced3c872\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:07:03.895422 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.895191    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7fd3e1c-67ab-43e7-b405-ab8fced3c872-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d7fd3e1c-67ab-43e7-b405-ab8fced3c872\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:07:03.895422 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.895228    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d7fd3e1c-67ab-43e7-b405-ab8fced3c872-config-out\") pod \"alertmanager-main-0\" (UID: \"d7fd3e1c-67ab-43e7-b405-ab8fced3c872\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:07:03.895422 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.895265    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d7fd3e1c-67ab-43e7-b405-ab8fced3c872-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d7fd3e1c-67ab-43e7-b405-ab8fced3c872\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:07:03.895422 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.895289    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d7fd3e1c-67ab-43e7-b405-ab8fced3c872-web-config\") pod \"alertmanager-main-0\" (UID: \"d7fd3e1c-67ab-43e7-b405-ab8fced3c872\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:07:03.895422 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.895331    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d7fd3e1c-67ab-43e7-b405-ab8fced3c872-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d7fd3e1c-67ab-43e7-b405-ab8fced3c872\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:07:03.895422 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.895353    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7fd3e1c-67ab-43e7-b405-ab8fced3c872-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d7fd3e1c-67ab-43e7-b405-ab8fced3c872\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:07:03.896282 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.895378    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d7fd3e1c-67ab-43e7-b405-ab8fced3c872-config-volume\") pod \"alertmanager-main-0\" (UID: \"d7fd3e1c-67ab-43e7-b405-ab8fced3c872\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:07:03.996997 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.996808    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d7fd3e1c-67ab-43e7-b405-ab8fced3c872-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d7fd3e1c-67ab-43e7-b405-ab8fced3c872\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:07:03.996997 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.996862    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d7fd3e1c-67ab-43e7-b405-ab8fced3c872-web-config\") pod \"alertmanager-main-0\" (UID: \"d7fd3e1c-67ab-43e7-b405-ab8fced3c872\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:07:03.997329 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.997137    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d7fd3e1c-67ab-43e7-b405-ab8fced3c872-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d7fd3e1c-67ab-43e7-b405-ab8fced3c872\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:07:03.997329 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.997179    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7fd3e1c-67ab-43e7-b405-ab8fced3c872-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d7fd3e1c-67ab-43e7-b405-ab8fced3c872\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:07:03.997329 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.997213    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d7fd3e1c-67ab-43e7-b405-ab8fced3c872-config-volume\") pod \"alertmanager-main-0\" (UID: \"d7fd3e1c-67ab-43e7-b405-ab8fced3c872\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:07:03.997329 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.997269    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d7fd3e1c-67ab-43e7-b405-ab8fced3c872-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d7fd3e1c-67ab-43e7-b405-ab8fced3c872\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:07:03.997329 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.997294    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d7fd3e1c-67ab-43e7-b405-ab8fced3c872-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d7fd3e1c-67ab-43e7-b405-ab8fced3c872\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:07:03.997329 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.997323    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzbgv\" (UniqueName: \"kubernetes.io/projected/d7fd3e1c-67ab-43e7-b405-ab8fced3c872-kube-api-access-hzbgv\") pod \"alertmanager-main-0\" (UID: \"d7fd3e1c-67ab-43e7-b405-ab8fced3c872\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:07:03.997631 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.997353    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d7fd3e1c-67ab-43e7-b405-ab8fced3c872-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d7fd3e1c-67ab-43e7-b405-ab8fced3c872\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:07:03.997631 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.997403    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d7fd3e1c-67ab-43e7-b405-ab8fced3c872-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d7fd3e1c-67ab-43e7-b405-ab8fced3c872\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:07:03.997631 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.997438    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d7fd3e1c-67ab-43e7-b405-ab8fced3c872-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d7fd3e1c-67ab-43e7-b405-ab8fced3c872\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:07:03.997631 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.997476    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7fd3e1c-67ab-43e7-b405-ab8fced3c872-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d7fd3e1c-67ab-43e7-b405-ab8fced3c872\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:07:03.997631 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:07:03.997542    2560 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Sep 11 21:07:03.997631 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:07:03.997624    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7fd3e1c-67ab-43e7-b405-ab8fced3c872-secret-alertmanager-main-tls podName:d7fd3e1c-67ab-43e7-b405-ab8fced3c872 nodeName:}" failed. No retries permitted until 2026-09-11 21:07:04.497600831 +0000 UTC m=+69.975912725 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/d7fd3e1c-67ab-43e7-b405-ab8fced3c872-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "d7fd3e1c-67ab-43e7-b405-ab8fced3c872") : secret "alertmanager-main-tls" not found
Sep 11 21:07:03.998342 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.998205    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d7fd3e1c-67ab-43e7-b405-ab8fced3c872-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d7fd3e1c-67ab-43e7-b405-ab8fced3c872\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:07:03.998342 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.998268    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7fd3e1c-67ab-43e7-b405-ab8fced3c872-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d7fd3e1c-67ab-43e7-b405-ab8fced3c872\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:07:03.998991 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.998632    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d7fd3e1c-67ab-43e7-b405-ab8fced3c872-config-out\") pod \"alertmanager-main-0\" (UID: \"d7fd3e1c-67ab-43e7-b405-ab8fced3c872\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:07:03.999098 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:03.999070    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7fd3e1c-67ab-43e7-b405-ab8fced3c872-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d7fd3e1c-67ab-43e7-b405-ab8fced3c872\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:07:04.000758 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:04.000707    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d7fd3e1c-67ab-43e7-b405-ab8fced3c872-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d7fd3e1c-67ab-43e7-b405-ab8fced3c872\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:07:04.000870 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:04.000781    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d7fd3e1c-67ab-43e7-b405-ab8fced3c872-web-config\") pod \"alertmanager-main-0\" (UID: \"d7fd3e1c-67ab-43e7-b405-ab8fced3c872\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:07:04.001289 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:04.001244    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d7fd3e1c-67ab-43e7-b405-ab8fced3c872-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d7fd3e1c-67ab-43e7-b405-ab8fced3c872\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:07:04.001805 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:04.001761    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d7fd3e1c-67ab-43e7-b405-ab8fced3c872-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d7fd3e1c-67ab-43e7-b405-ab8fced3c872\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:07:04.002400 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:04.002344    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d7fd3e1c-67ab-43e7-b405-ab8fced3c872-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d7fd3e1c-67ab-43e7-b405-ab8fced3c872\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:07:04.003083 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:04.002914    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d7fd3e1c-67ab-43e7-b405-ab8fced3c872-config-out\") pod \"alertmanager-main-0\" (UID: \"d7fd3e1c-67ab-43e7-b405-ab8fced3c872\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:07:04.003184 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:04.003131    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d7fd3e1c-67ab-43e7-b405-ab8fced3c872-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d7fd3e1c-67ab-43e7-b405-ab8fced3c872\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:07:04.005459 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:04.005404    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d7fd3e1c-67ab-43e7-b405-ab8fced3c872-config-volume\") pod \"alertmanager-main-0\" (UID: \"d7fd3e1c-67ab-43e7-b405-ab8fced3c872\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:07:04.009349 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:04.009325    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzbgv\" (UniqueName: \"kubernetes.io/projected/d7fd3e1c-67ab-43e7-b405-ab8fced3c872-kube-api-access-hzbgv\") pod \"alertmanager-main-0\" (UID: \"d7fd3e1c-67ab-43e7-b405-ab8fced3c872\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:07:04.087630 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:04.087591    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b5bc766dd-p5t9g"
Sep 11 21:07:04.087832 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:04.087713    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b5bc766dd-p5t9g"
Sep 11 21:07:04.093274 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:04.093246    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b5bc766dd-p5t9g"
Sep 11 21:07:04.500909 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:04.500873    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b5bc766dd-p5t9g"
Sep 11 21:07:04.503931 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:04.503897    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d7fd3e1c-67ab-43e7-b405-ab8fced3c872-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d7fd3e1c-67ab-43e7-b405-ab8fced3c872\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:07:04.506781 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:04.506747    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d7fd3e1c-67ab-43e7-b405-ab8fced3c872-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d7fd3e1c-67ab-43e7-b405-ab8fced3c872\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:07:04.712324 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:04.712284    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:07:05.451086 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:05.451047    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gjb5r"
Sep 11 21:07:05.594992 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:07:05.594949    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77d51833_213b_47d4_8179_7d871d60a85f.slice/crio-17634d09e57062fe269035f3466da2a5e591da76eb1665f103fd65f430ab4d7b WatchSource:0}: Error finding container 17634d09e57062fe269035f3466da2a5e591da76eb1665f103fd65f430ab4d7b: Status 404 returned error can't find the container with id 17634d09e57062fe269035f3466da2a5e591da76eb1665f103fd65f430ab4d7b
Sep 11 21:07:05.709416 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:05.708791    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-74fff8fc89-c86nr"]
Sep 11 21:07:05.734245 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:05.734205    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-74fff8fc89-c86nr"]
Sep 11 21:07:05.734440 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:05.734347    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-74fff8fc89-c86nr"
Sep 11 21:07:05.736942 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:05.736907    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 11 21:07:05.737126 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:05.736981    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 11 21:07:05.737126 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:05.737031    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-k282k\""
Sep 11 21:07:05.737496 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:05.737252    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 11 21:07:05.737496 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:05.737256    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 11 21:07:05.737496 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:05.737289    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-dgtdppk62j3kf\""
Sep 11 21:07:05.737496 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:05.737342    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 11 21:07:05.817361 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:05.817323    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/10f1b472-a3b1-4f05-a9ad-8e189031e75c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-74fff8fc89-c86nr\" (UID: \"10f1b472-a3b1-4f05-a9ad-8e189031e75c\") " pod="openshift-monitoring/thanos-querier-74fff8fc89-c86nr"
Sep 11 21:07:05.817569 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:05.817401    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/10f1b472-a3b1-4f05-a9ad-8e189031e75c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-74fff8fc89-c86nr\" (UID: \"10f1b472-a3b1-4f05-a9ad-8e189031e75c\") " pod="openshift-monitoring/thanos-querier-74fff8fc89-c86nr"
Sep 11 21:07:05.817569 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:05.817430    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dx7g\" (UniqueName: \"kubernetes.io/projected/10f1b472-a3b1-4f05-a9ad-8e189031e75c-kube-api-access-8dx7g\") pod \"thanos-querier-74fff8fc89-c86nr\" (UID: \"10f1b472-a3b1-4f05-a9ad-8e189031e75c\") " pod="openshift-monitoring/thanos-querier-74fff8fc89-c86nr"
Sep 11 21:07:05.817569 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:05.817457    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/10f1b472-a3b1-4f05-a9ad-8e189031e75c-secret-thanos-querier-tls\") pod \"thanos-querier-74fff8fc89-c86nr\" (UID: \"10f1b472-a3b1-4f05-a9ad-8e189031e75c\") " pod="openshift-monitoring/thanos-querier-74fff8fc89-c86nr"
Sep 11 21:07:05.817569 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:05.817523    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/10f1b472-a3b1-4f05-a9ad-8e189031e75c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-74fff8fc89-c86nr\" (UID: \"10f1b472-a3b1-4f05-a9ad-8e189031e75c\") " pod="openshift-monitoring/thanos-querier-74fff8fc89-c86nr"
Sep 11 21:07:05.817723 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:05.817569    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/10f1b472-a3b1-4f05-a9ad-8e189031e75c-secret-grpc-tls\") pod \"thanos-querier-74fff8fc89-c86nr\" (UID: \"10f1b472-a3b1-4f05-a9ad-8e189031e75c\") " pod="openshift-monitoring/thanos-querier-74fff8fc89-c86nr"
Sep 11 21:07:05.817723 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:05.817608    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10f1b472-a3b1-4f05-a9ad-8e189031e75c-metrics-client-ca\") pod \"thanos-querier-74fff8fc89-c86nr\" (UID: \"10f1b472-a3b1-4f05-a9ad-8e189031e75c\") " pod="openshift-monitoring/thanos-querier-74fff8fc89-c86nr"
Sep 11 21:07:05.817723 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:05.817682    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/10f1b472-a3b1-4f05-a9ad-8e189031e75c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-74fff8fc89-c86nr\" (UID: \"10f1b472-a3b1-4f05-a9ad-8e189031e75c\") " pod="openshift-monitoring/thanos-querier-74fff8fc89-c86nr"
Sep 11 21:07:05.864098 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:05.864061    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-rhcd6"]
Sep 11 21:07:05.867186 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:07:05.867156    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3c7a33a_d572_4476_83cc_941b5bba5804.slice/crio-cdcee80f3a08e0584194f447fd810220e02ff511431390ba720fe194600f6042 WatchSource:0}: Error finding container cdcee80f3a08e0584194f447fd810220e02ff511431390ba720fe194600f6042: Status 404 returned error can't find the container with id cdcee80f3a08e0584194f447fd810220e02ff511431390ba720fe194600f6042
Sep 11 21:07:05.873493 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:05.873468    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-mg2bk"]
Sep 11 21:07:05.875993 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:07:05.875964    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85cfef09_44c0_4cb4_97d1_97bce96e79c3.slice/crio-855b102780a70d7e8bf9f954cb436938365c4b3aeef035fea75ef923e7f77c6e WatchSource:0}: Error finding container 855b102780a70d7e8bf9f954cb436938365c4b3aeef035fea75ef923e7f77c6e: Status 404 returned error can't find the container with id 855b102780a70d7e8bf9f954cb436938365c4b3aeef035fea75ef923e7f77c6e
Sep 11 21:07:05.882717 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:05.882688    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 21:07:05.886670 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:07:05.886641    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7fd3e1c_67ab_43e7_b405_ab8fced3c872.slice/crio-ab300e50df1fc25cb4486308493e6afde9f9cc26a2a7d6ab4d97190a9de62550 WatchSource:0}: Error finding container ab300e50df1fc25cb4486308493e6afde9f9cc26a2a7d6ab4d97190a9de62550: Status 404 returned error can't find the container with id ab300e50df1fc25cb4486308493e6afde9f9cc26a2a7d6ab4d97190a9de62550
Sep 11 21:07:05.919056 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:05.919022    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/10f1b472-a3b1-4f05-a9ad-8e189031e75c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-74fff8fc89-c86nr\" (UID: \"10f1b472-a3b1-4f05-a9ad-8e189031e75c\") " pod="openshift-monitoring/thanos-querier-74fff8fc89-c86nr"
Sep 11 21:07:05.919157 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:05.919073    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dx7g\" (UniqueName: \"kubernetes.io/projected/10f1b472-a3b1-4f05-a9ad-8e189031e75c-kube-api-access-8dx7g\") pod \"thanos-querier-74fff8fc89-c86nr\" (UID: \"10f1b472-a3b1-4f05-a9ad-8e189031e75c\") " pod="openshift-monitoring/thanos-querier-74fff8fc89-c86nr"
Sep 11 21:07:05.919157 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:05.919119    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/10f1b472-a3b1-4f05-a9ad-8e189031e75c-secret-thanos-querier-tls\") pod \"thanos-querier-74fff8fc89-c86nr\" (UID: \"10f1b472-a3b1-4f05-a9ad-8e189031e75c\") " pod="openshift-monitoring/thanos-querier-74fff8fc89-c86nr"
Sep 11 21:07:05.919260 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:05.919164    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/10f1b472-a3b1-4f05-a9ad-8e189031e75c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-74fff8fc89-c86nr\" (UID: \"10f1b472-a3b1-4f05-a9ad-8e189031e75c\") " pod="openshift-monitoring/thanos-querier-74fff8fc89-c86nr"
Sep 11 21:07:05.919260 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:05.919191    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/10f1b472-a3b1-4f05-a9ad-8e189031e75c-secret-grpc-tls\") pod \"thanos-querier-74fff8fc89-c86nr\" (UID: \"10f1b472-a3b1-4f05-a9ad-8e189031e75c\") " pod="openshift-monitoring/thanos-querier-74fff8fc89-c86nr"
Sep 11 21:07:05.919260 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:05.919222    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10f1b472-a3b1-4f05-a9ad-8e189031e75c-metrics-client-ca\") pod \"thanos-querier-74fff8fc89-c86nr\" (UID: \"10f1b472-a3b1-4f05-a9ad-8e189031e75c\") " pod="openshift-monitoring/thanos-querier-74fff8fc89-c86nr"
Sep 11 21:07:05.919260 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:05.919256    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/10f1b472-a3b1-4f05-a9ad-8e189031e75c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-74fff8fc89-c86nr\" (UID: \"10f1b472-a3b1-4f05-a9ad-8e189031e75c\") " pod="openshift-monitoring/thanos-querier-74fff8fc89-c86nr"
Sep 11 21:07:05.919470 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:05.919314    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/10f1b472-a3b1-4f05-a9ad-8e189031e75c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-74fff8fc89-c86nr\" (UID: \"10f1b472-a3b1-4f05-a9ad-8e189031e75c\") " pod="openshift-monitoring/thanos-querier-74fff8fc89-c86nr"
Sep 11 21:07:05.920248 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:05.920183    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10f1b472-a3b1-4f05-a9ad-8e189031e75c-metrics-client-ca\") pod \"thanos-querier-74fff8fc89-c86nr\" (UID: \"10f1b472-a3b1-4f05-a9ad-8e189031e75c\") " pod="openshift-monitoring/thanos-querier-74fff8fc89-c86nr"
Sep 11 21:07:05.922619 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:05.922559    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/10f1b472-a3b1-4f05-a9ad-8e189031e75c-secret-thanos-querier-tls\") pod \"thanos-querier-74fff8fc89-c86nr\" (UID: \"10f1b472-a3b1-4f05-a9ad-8e189031e75c\") " pod="openshift-monitoring/thanos-querier-74fff8fc89-c86nr"
Sep 11 21:07:05.922848 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:05.922814    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/10f1b472-a3b1-4f05-a9ad-8e189031e75c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-74fff8fc89-c86nr\" (UID: \"10f1b472-a3b1-4f05-a9ad-8e189031e75c\") " pod="openshift-monitoring/thanos-querier-74fff8fc89-c86nr"
Sep 11 21:07:05.922929 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:05.922865    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/10f1b472-a3b1-4f05-a9ad-8e189031e75c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-74fff8fc89-c86nr\" (UID: \"10f1b472-a3b1-4f05-a9ad-8e189031e75c\") " pod="openshift-monitoring/thanos-querier-74fff8fc89-c86nr"
Sep 11 21:07:05.923048 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:05.923026    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/10f1b472-a3b1-4f05-a9ad-8e189031e75c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-74fff8fc89-c86nr\" (UID: \"10f1b472-a3b1-4f05-a9ad-8e189031e75c\") " pod="openshift-monitoring/thanos-querier-74fff8fc89-c86nr"
Sep 11 21:07:05.923104 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:05.923085    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/10f1b472-a3b1-4f05-a9ad-8e189031e75c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-74fff8fc89-c86nr\" (UID: \"10f1b472-a3b1-4f05-a9ad-8e189031e75c\") " pod="openshift-monitoring/thanos-querier-74fff8fc89-c86nr"
Sep 11 21:07:05.923156 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:05.923094    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/10f1b472-a3b1-4f05-a9ad-8e189031e75c-secret-grpc-tls\") pod \"thanos-querier-74fff8fc89-c86nr\" (UID: \"10f1b472-a3b1-4f05-a9ad-8e189031e75c\") " pod="openshift-monitoring/thanos-querier-74fff8fc89-c86nr"
Sep 11 21:07:05.928823 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:05.928788    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dx7g\" (UniqueName: \"kubernetes.io/projected/10f1b472-a3b1-4f05-a9ad-8e189031e75c-kube-api-access-8dx7g\") pod \"thanos-querier-74fff8fc89-c86nr\" (UID: \"10f1b472-a3b1-4f05-a9ad-8e189031e75c\") " pod="openshift-monitoring/thanos-querier-74fff8fc89-c86nr"
Sep 11 21:07:06.064449 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:06.064414    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-74fff8fc89-c86nr"
Sep 11 21:07:06.387476 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:06.387347    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-74fff8fc89-c86nr"]
Sep 11 21:07:06.432354 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:07:06.432314    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10f1b472_a3b1_4f05_a9ad_8e189031e75c.slice/crio-429d1bc30096c588bfd8dbfa371260917ecb6d53b6c27944474d32cefb5ee5d5 WatchSource:0}: Error finding container 429d1bc30096c588bfd8dbfa371260917ecb6d53b6c27944474d32cefb5ee5d5: Status 404 returned error can't find the container with id 429d1bc30096c588bfd8dbfa371260917ecb6d53b6c27944474d32cefb5ee5d5
Sep 11 21:07:06.504893 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:06.504857    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74fff8fc89-c86nr" event={"ID":"10f1b472-a3b1-4f05-a9ad-8e189031e75c","Type":"ContainerStarted","Data":"429d1bc30096c588bfd8dbfa371260917ecb6d53b6c27944474d32cefb5ee5d5"}
Sep 11 21:07:06.506078 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:06.506051    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mg2bk" event={"ID":"85cfef09-44c0-4cb4-97d1-97bce96e79c3","Type":"ContainerStarted","Data":"855b102780a70d7e8bf9f954cb436938365c4b3aeef035fea75ef923e7f77c6e"}
Sep 11 21:07:06.508072 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:06.508042    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rhcd6" event={"ID":"c3c7a33a-d572-4476-83cc-941b5bba5804","Type":"ContainerStarted","Data":"742c8be8f11a46cc90060b33952a8c9ff53a40ae43a057dca37d315054e69297"}
Sep 11 21:07:06.508179 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:06.508101    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rhcd6" event={"ID":"c3c7a33a-d572-4476-83cc-941b5bba5804","Type":"ContainerStarted","Data":"0b2bdc7eda2b8b999c7ee929a327a900c12c11420967230c4d276682addd1e55"}
Sep 11 21:07:06.508179 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:06.508133    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rhcd6" event={"ID":"c3c7a33a-d572-4476-83cc-941b5bba5804","Type":"ContainerStarted","Data":"cdcee80f3a08e0584194f447fd810220e02ff511431390ba720fe194600f6042"}
Sep 11 21:07:06.514445 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:06.514409    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vxlb2" event={"ID":"0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc","Type":"ContainerStarted","Data":"9f0538bdf488250046501f90fbf18b07153b14b3d6525546e51193cd918758e8"}
Sep 11 21:07:06.515770 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:06.515749    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2t2wn" event={"ID":"77d51833-213b-47d4-8179-7d871d60a85f","Type":"ContainerStarted","Data":"17634d09e57062fe269035f3466da2a5e591da76eb1665f103fd65f430ab4d7b"}
Sep 11 21:07:06.517187 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:06.517164    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d7fd3e1c-67ab-43e7-b405-ab8fced3c872","Type":"ContainerStarted","Data":"ab300e50df1fc25cb4486308493e6afde9f9cc26a2a7d6ab4d97190a9de62550"}
Sep 11 21:07:06.518625 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:06.518603    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sxs24" event={"ID":"394b71c4-7749-4e24-a7ef-b7060c4b4864","Type":"ContainerStarted","Data":"1dea15751b6937f8a02e8a5e45a4e7eaecf62b79b6102df4d8192cfafcc1ccf2"}
Sep 11 21:07:06.518754 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:06.518735    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-sxs24"
Sep 11 21:07:06.536264 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:06.536207    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vxlb2" podStartSLOduration=66.287564378 podStartE2EDuration="1m11.536190444s" totalImagesPullingTime="5.248626066s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:05:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:07:06.534739999 +0000 UTC m=+72.013051843" watchObservedRunningTime="2026-09-11 21:07:06.536190444 +0000 UTC m=+72.014502288"
Sep 11 21:07:07.166141 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:07.166050    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-sxs24" podStartSLOduration=66.938028824 podStartE2EDuration="1m12.166025819s" totalImagesPullingTime="5.227996995s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:05:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:07:06.552398179 +0000 UTC m=+72.030710031" watchObservedRunningTime="2026-09-11 21:07:07.166025819 +0000 UTC m=+72.644337659"
Sep 11 21:07:07.166628 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:07.166593    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-66f4bd5b6-fggr7"]
Sep 11 21:07:07.169268 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:07.169238    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-66f4bd5b6-fggr7"
Sep 11 21:07:07.171840 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:07.171810    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 11 21:07:07.172833 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:07.172797    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 11 21:07:07.172943 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:07.172875    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 11 21:07:07.172943 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:07.172908    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 11 21:07:07.173177 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:07.173161    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-d5nmqe1ocu2fe\""
Sep 11 21:07:07.173254 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:07.173194    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-t7s84\""
Sep 11 21:07:07.180671 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:07.180642    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-66f4bd5b6-fggr7"]
Sep 11 21:07:07.233397 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:07.233359    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ead66865-003d-43f6-b361-92d2676c4a93-secret-metrics-server-client-certs\") pod \"metrics-server-66f4bd5b6-fggr7\" (UID: \"ead66865-003d-43f6-b361-92d2676c4a93\") " pod="openshift-monitoring/metrics-server-66f4bd5b6-fggr7"
Sep 11 21:07:07.233610 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:07.233443    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ead66865-003d-43f6-b361-92d2676c4a93-metrics-server-audit-profiles\") pod \"metrics-server-66f4bd5b6-fggr7\" (UID: \"ead66865-003d-43f6-b361-92d2676c4a93\") " pod="openshift-monitoring/metrics-server-66f4bd5b6-fggr7"
Sep 11 21:07:07.233610 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:07.233464    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ead66865-003d-43f6-b361-92d2676c4a93-client-ca-bundle\") pod \"metrics-server-66f4bd5b6-fggr7\" (UID: \"ead66865-003d-43f6-b361-92d2676c4a93\") " pod="openshift-monitoring/metrics-server-66f4bd5b6-fggr7"
Sep 11 21:07:07.233610 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:07.233491    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8prdt\" (UniqueName: \"kubernetes.io/projected/ead66865-003d-43f6-b361-92d2676c4a93-kube-api-access-8prdt\") pod \"metrics-server-66f4bd5b6-fggr7\" (UID: \"ead66865-003d-43f6-b361-92d2676c4a93\") " pod="openshift-monitoring/metrics-server-66f4bd5b6-fggr7"
Sep 11 21:07:07.233610 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:07.233570    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ead66865-003d-43f6-b361-92d2676c4a93-secret-metrics-server-tls\") pod \"metrics-server-66f4bd5b6-fggr7\" (UID: \"ead66865-003d-43f6-b361-92d2676c4a93\") " pod="openshift-monitoring/metrics-server-66f4bd5b6-fggr7"
Sep 11 21:07:07.233837 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:07.233632    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ead66865-003d-43f6-b361-92d2676c4a93-audit-log\") pod \"metrics-server-66f4bd5b6-fggr7\" (UID: \"ead66865-003d-43f6-b361-92d2676c4a93\") " pod="openshift-monitoring/metrics-server-66f4bd5b6-fggr7"
Sep 11 21:07:07.233837 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:07.233664    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ead66865-003d-43f6-b361-92d2676c4a93-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-66f4bd5b6-fggr7\" (UID: \"ead66865-003d-43f6-b361-92d2676c4a93\") " pod="openshift-monitoring/metrics-server-66f4bd5b6-fggr7"
Sep 11 21:07:07.334792 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:07.334747    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ead66865-003d-43f6-b361-92d2676c4a93-metrics-server-audit-profiles\") pod \"metrics-server-66f4bd5b6-fggr7\" (UID: \"ead66865-003d-43f6-b361-92d2676c4a93\") " pod="openshift-monitoring/metrics-server-66f4bd5b6-fggr7"
Sep 11 21:07:07.334792 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:07.334797    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ead66865-003d-43f6-b361-92d2676c4a93-client-ca-bundle\") pod \"metrics-server-66f4bd5b6-fggr7\" (UID: \"ead66865-003d-43f6-b361-92d2676c4a93\") " pod="openshift-monitoring/metrics-server-66f4bd5b6-fggr7"
Sep 11 21:07:07.335041 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:07.334836    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8prdt\" (UniqueName: \"kubernetes.io/projected/ead66865-003d-43f6-b361-92d2676c4a93-kube-api-access-8prdt\") pod \"metrics-server-66f4bd5b6-fggr7\" (UID: \"ead66865-003d-43f6-b361-92d2676c4a93\") " pod="openshift-monitoring/metrics-server-66f4bd5b6-fggr7"
Sep 11 21:07:07.335041 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:07.334887    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ead66865-003d-43f6-b361-92d2676c4a93-secret-metrics-server-tls\") pod \"metrics-server-66f4bd5b6-fggr7\" (UID: \"ead66865-003d-43f6-b361-92d2676c4a93\") " pod="openshift-monitoring/metrics-server-66f4bd5b6-fggr7"
Sep 11 21:07:07.335041 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:07.334965    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ead66865-003d-43f6-b361-92d2676c4a93-audit-log\") pod \"metrics-server-66f4bd5b6-fggr7\" (UID: \"ead66865-003d-43f6-b361-92d2676c4a93\") " pod="openshift-monitoring/metrics-server-66f4bd5b6-fggr7"
Sep 11 21:07:07.335041 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:07.334997    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ead66865-003d-43f6-b361-92d2676c4a93-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-66f4bd5b6-fggr7\" (UID: \"ead66865-003d-43f6-b361-92d2676c4a93\") " pod="openshift-monitoring/metrics-server-66f4bd5b6-fggr7"
Sep 11 21:07:07.335236 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:07.335057    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ead66865-003d-43f6-b361-92d2676c4a93-secret-metrics-server-client-certs\") pod \"metrics-server-66f4bd5b6-fggr7\" (UID: \"ead66865-003d-43f6-b361-92d2676c4a93\") " pod="openshift-monitoring/metrics-server-66f4bd5b6-fggr7"
Sep 11 21:07:07.335660 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:07.335627    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ead66865-003d-43f6-b361-92d2676c4a93-audit-log\") pod \"metrics-server-66f4bd5b6-fggr7\" (UID: \"ead66865-003d-43f6-b361-92d2676c4a93\") " pod="openshift-monitoring/metrics-server-66f4bd5b6-fggr7"
Sep 11 21:07:07.336002 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:07.335940    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ead66865-003d-43f6-b361-92d2676c4a93-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-66f4bd5b6-fggr7\" (UID: \"ead66865-003d-43f6-b361-92d2676c4a93\") " pod="openshift-monitoring/metrics-server-66f4bd5b6-fggr7"
Sep 11 21:07:07.336002 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:07.335948    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ead66865-003d-43f6-b361-92d2676c4a93-metrics-server-audit-profiles\") pod \"metrics-server-66f4bd5b6-fggr7\" (UID: \"ead66865-003d-43f6-b361-92d2676c4a93\") " pod="openshift-monitoring/metrics-server-66f4bd5b6-fggr7"
Sep 11 21:07:07.338219 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:07.338193    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ead66865-003d-43f6-b361-92d2676c4a93-secret-metrics-server-tls\") pod \"metrics-server-66f4bd5b6-fggr7\" (UID: \"ead66865-003d-43f6-b361-92d2676c4a93\") " pod="openshift-monitoring/metrics-server-66f4bd5b6-fggr7"
Sep 11 21:07:07.338423 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:07.338400    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ead66865-003d-43f6-b361-92d2676c4a93-client-ca-bundle\") pod \"metrics-server-66f4bd5b6-fggr7\" (UID: \"ead66865-003d-43f6-b361-92d2676c4a93\") " pod="openshift-monitoring/metrics-server-66f4bd5b6-fggr7"
Sep 11 21:07:07.339142 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:07.339118    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ead66865-003d-43f6-b361-92d2676c4a93-secret-metrics-server-client-certs\") pod \"metrics-server-66f4bd5b6-fggr7\" (UID: \"ead66865-003d-43f6-b361-92d2676c4a93\") " pod="openshift-monitoring/metrics-server-66f4bd5b6-fggr7"
Sep 11 21:07:07.344476 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:07.344417    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8prdt\" (UniqueName: \"kubernetes.io/projected/ead66865-003d-43f6-b361-92d2676c4a93-kube-api-access-8prdt\") pod \"metrics-server-66f4bd5b6-fggr7\" (UID: \"ead66865-003d-43f6-b361-92d2676c4a93\") " pod="openshift-monitoring/metrics-server-66f4bd5b6-fggr7"
Sep 11 21:07:07.452608 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:07.452508    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-kzkz6"]
Sep 11 21:07:07.455077 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:07.455045    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-kzkz6"
Sep 11 21:07:07.457393 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:07.457362    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 11 21:07:07.457527 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:07.457477    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-kmvtk\""
Sep 11 21:07:07.468445 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:07.465690    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-kzkz6"]
Sep 11 21:07:07.483131 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:07.482911    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-66f4bd5b6-fggr7"
Sep 11 21:07:07.527231 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:07.527151    2560 generic.go:356] "Generic (PLEG): container finished" podID="77d51833-213b-47d4-8179-7d871d60a85f" containerID="41ca7f65ad5ee3a762047c790b30db5f08172c629f7ee1018a3eb6beb74acabf" exitCode=0
Sep 11 21:07:07.527440 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:07.527242    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2t2wn" event={"ID":"77d51833-213b-47d4-8179-7d871d60a85f","Type":"ContainerDied","Data":"41ca7f65ad5ee3a762047c790b30db5f08172c629f7ee1018a3eb6beb74acabf"}
Sep 11 21:07:07.537340 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:07.537248    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d4be4c17-b9be-40b0-b9f7-e0869b578a28-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-kzkz6\" (UID: \"d4be4c17-b9be-40b0-b9f7-e0869b578a28\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-kzkz6"
Sep 11 21:07:07.537340 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:07.537298    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7txtx\" (UniqueName: \"kubernetes.io/projected/d4be4c17-b9be-40b0-b9f7-e0869b578a28-kube-api-access-7txtx\") pod \"monitoring-plugin-5d85778b9d-kzkz6\" (UID: \"d4be4c17-b9be-40b0-b9f7-e0869b578a28\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-kzkz6"
Sep 11 21:07:07.638955 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:07.638907    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d4be4c17-b9be-40b0-b9f7-e0869b578a28-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-kzkz6\" (UID: \"d4be4c17-b9be-40b0-b9f7-e0869b578a28\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-kzkz6"
Sep 11 21:07:07.638955 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:07.638957    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7txtx\" (UniqueName: \"kubernetes.io/projected/d4be4c17-b9be-40b0-b9f7-e0869b578a28-kube-api-access-7txtx\") pod \"monitoring-plugin-5d85778b9d-kzkz6\" (UID: \"d4be4c17-b9be-40b0-b9f7-e0869b578a28\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-kzkz6"
Sep 11 21:07:07.642697 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:07.642630    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d4be4c17-b9be-40b0-b9f7-e0869b578a28-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-kzkz6\" (UID: \"d4be4c17-b9be-40b0-b9f7-e0869b578a28\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-kzkz6"
Sep 11 21:07:07.648922 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:07.648889    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7txtx\" (UniqueName: \"kubernetes.io/projected/d4be4c17-b9be-40b0-b9f7-e0869b578a28-kube-api-access-7txtx\") pod \"monitoring-plugin-5d85778b9d-kzkz6\" (UID: \"d4be4c17-b9be-40b0-b9f7-e0869b578a28\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-kzkz6"
Sep 11 21:07:07.767855 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:07.767753    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-kzkz6"
Sep 11 21:07:08.067728 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.067627    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-684cbc884-fv8sf"]
Sep 11 21:07:08.071147 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.071116    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-684cbc884-fv8sf"
Sep 11 21:07:08.074286 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.074259    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 11 21:07:08.074467 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.074291    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-jxtq9\""
Sep 11 21:07:08.074467 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.074298    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 11 21:07:08.074467 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.074456    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 11 21:07:08.074654 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.074484    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 11 21:07:08.074654 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.074632    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 11 21:07:08.082857 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.082797    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 11 21:07:08.085050 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.085018    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-684cbc884-fv8sf"]
Sep 11 21:07:08.144526 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.144478    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/29ab3f71-aaf7-4e7c-a66a-575ab8ddae03-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-684cbc884-fv8sf\" (UID: \"29ab3f71-aaf7-4e7c-a66a-575ab8ddae03\") " pod="openshift-monitoring/telemeter-client-684cbc884-fv8sf"
Sep 11 21:07:08.144725 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.144548    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/29ab3f71-aaf7-4e7c-a66a-575ab8ddae03-telemeter-client-tls\") pod \"telemeter-client-684cbc884-fv8sf\" (UID: \"29ab3f71-aaf7-4e7c-a66a-575ab8ddae03\") " pod="openshift-monitoring/telemeter-client-684cbc884-fv8sf"
Sep 11 21:07:08.144725 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.144616    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29ab3f71-aaf7-4e7c-a66a-575ab8ddae03-telemeter-trusted-ca-bundle\") pod \"telemeter-client-684cbc884-fv8sf\" (UID: \"29ab3f71-aaf7-4e7c-a66a-575ab8ddae03\") " pod="openshift-monitoring/telemeter-client-684cbc884-fv8sf"
Sep 11 21:07:08.144725 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.144662    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29ab3f71-aaf7-4e7c-a66a-575ab8ddae03-serving-certs-ca-bundle\") pod \"telemeter-client-684cbc884-fv8sf\" (UID: \"29ab3f71-aaf7-4e7c-a66a-575ab8ddae03\") " pod="openshift-monitoring/telemeter-client-684cbc884-fv8sf"
Sep 11 21:07:08.144725 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.144686    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwhdz\" (UniqueName: \"kubernetes.io/projected/29ab3f71-aaf7-4e7c-a66a-575ab8ddae03-kube-api-access-mwhdz\") pod \"telemeter-client-684cbc884-fv8sf\" (UID: \"29ab3f71-aaf7-4e7c-a66a-575ab8ddae03\") " pod="openshift-monitoring/telemeter-client-684cbc884-fv8sf"
Sep 11 21:07:08.144938 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.144741    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/29ab3f71-aaf7-4e7c-a66a-575ab8ddae03-metrics-client-ca\") pod \"telemeter-client-684cbc884-fv8sf\" (UID: \"29ab3f71-aaf7-4e7c-a66a-575ab8ddae03\") " pod="openshift-monitoring/telemeter-client-684cbc884-fv8sf"
Sep 11 21:07:08.144938 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.144825    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/29ab3f71-aaf7-4e7c-a66a-575ab8ddae03-federate-client-tls\") pod \"telemeter-client-684cbc884-fv8sf\" (UID: \"29ab3f71-aaf7-4e7c-a66a-575ab8ddae03\") " pod="openshift-monitoring/telemeter-client-684cbc884-fv8sf"
Sep 11 21:07:08.144938 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.144855    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/29ab3f71-aaf7-4e7c-a66a-575ab8ddae03-secret-telemeter-client\") pod \"telemeter-client-684cbc884-fv8sf\" (UID: \"29ab3f71-aaf7-4e7c-a66a-575ab8ddae03\") " pod="openshift-monitoring/telemeter-client-684cbc884-fv8sf"
Sep 11 21:07:08.245316 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.245266    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/29ab3f71-aaf7-4e7c-a66a-575ab8ddae03-metrics-client-ca\") pod \"telemeter-client-684cbc884-fv8sf\" (UID: \"29ab3f71-aaf7-4e7c-a66a-575ab8ddae03\") " pod="openshift-monitoring/telemeter-client-684cbc884-fv8sf"
Sep 11 21:07:08.245798 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.245344    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/29ab3f71-aaf7-4e7c-a66a-575ab8ddae03-federate-client-tls\") pod \"telemeter-client-684cbc884-fv8sf\" (UID: \"29ab3f71-aaf7-4e7c-a66a-575ab8ddae03\") " pod="openshift-monitoring/telemeter-client-684cbc884-fv8sf"
Sep 11 21:07:08.245798 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.245395    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/29ab3f71-aaf7-4e7c-a66a-575ab8ddae03-secret-telemeter-client\") pod \"telemeter-client-684cbc884-fv8sf\" (UID: \"29ab3f71-aaf7-4e7c-a66a-575ab8ddae03\") " pod="openshift-monitoring/telemeter-client-684cbc884-fv8sf"
Sep 11 21:07:08.245798 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.245432    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/29ab3f71-aaf7-4e7c-a66a-575ab8ddae03-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-684cbc884-fv8sf\" (UID: \"29ab3f71-aaf7-4e7c-a66a-575ab8ddae03\") " pod="openshift-monitoring/telemeter-client-684cbc884-fv8sf"
Sep 11 21:07:08.245798 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.245467    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/29ab3f71-aaf7-4e7c-a66a-575ab8ddae03-telemeter-client-tls\") pod \"telemeter-client-684cbc884-fv8sf\" (UID: \"29ab3f71-aaf7-4e7c-a66a-575ab8ddae03\") " pod="openshift-monitoring/telemeter-client-684cbc884-fv8sf"
Sep 11 21:07:08.245798 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.245497    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29ab3f71-aaf7-4e7c-a66a-575ab8ddae03-telemeter-trusted-ca-bundle\") pod \"telemeter-client-684cbc884-fv8sf\" (UID: \"29ab3f71-aaf7-4e7c-a66a-575ab8ddae03\") " pod="openshift-monitoring/telemeter-client-684cbc884-fv8sf"
Sep 11 21:07:08.245798 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.245537    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29ab3f71-aaf7-4e7c-a66a-575ab8ddae03-serving-certs-ca-bundle\") pod \"telemeter-client-684cbc884-fv8sf\" (UID: \"29ab3f71-aaf7-4e7c-a66a-575ab8ddae03\") " pod="openshift-monitoring/telemeter-client-684cbc884-fv8sf"
Sep 11 21:07:08.245798 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.245563    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwhdz\" (UniqueName: \"kubernetes.io/projected/29ab3f71-aaf7-4e7c-a66a-575ab8ddae03-kube-api-access-mwhdz\") pod \"telemeter-client-684cbc884-fv8sf\" (UID: \"29ab3f71-aaf7-4e7c-a66a-575ab8ddae03\") " pod="openshift-monitoring/telemeter-client-684cbc884-fv8sf"
Sep 11 21:07:08.246301 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.246253    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29ab3f71-aaf7-4e7c-a66a-575ab8ddae03-serving-certs-ca-bundle\") pod \"telemeter-client-684cbc884-fv8sf\" (UID: \"29ab3f71-aaf7-4e7c-a66a-575ab8ddae03\") " pod="openshift-monitoring/telemeter-client-684cbc884-fv8sf"
Sep 11 21:07:08.247425 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.246587    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/29ab3f71-aaf7-4e7c-a66a-575ab8ddae03-metrics-client-ca\") pod \"telemeter-client-684cbc884-fv8sf\" (UID: \"29ab3f71-aaf7-4e7c-a66a-575ab8ddae03\") " pod="openshift-monitoring/telemeter-client-684cbc884-fv8sf"
Sep 11 21:07:08.247529 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.247427    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29ab3f71-aaf7-4e7c-a66a-575ab8ddae03-telemeter-trusted-ca-bundle\") pod \"telemeter-client-684cbc884-fv8sf\" (UID: \"29ab3f71-aaf7-4e7c-a66a-575ab8ddae03\") " pod="openshift-monitoring/telemeter-client-684cbc884-fv8sf"
Sep 11 21:07:08.248989 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.248867    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/29ab3f71-aaf7-4e7c-a66a-575ab8ddae03-federate-client-tls\") pod \"telemeter-client-684cbc884-fv8sf\" (UID: \"29ab3f71-aaf7-4e7c-a66a-575ab8ddae03\") " pod="openshift-monitoring/telemeter-client-684cbc884-fv8sf"
Sep 11 21:07:08.251523 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.251098    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/29ab3f71-aaf7-4e7c-a66a-575ab8ddae03-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-684cbc884-fv8sf\" (UID: \"29ab3f71-aaf7-4e7c-a66a-575ab8ddae03\") " pod="openshift-monitoring/telemeter-client-684cbc884-fv8sf"
Sep 11 21:07:08.251523 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.251291    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/29ab3f71-aaf7-4e7c-a66a-575ab8ddae03-secret-telemeter-client\") pod \"telemeter-client-684cbc884-fv8sf\" (UID: \"29ab3f71-aaf7-4e7c-a66a-575ab8ddae03\") " pod="openshift-monitoring/telemeter-client-684cbc884-fv8sf"
Sep 11 21:07:08.253713 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.253049    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/29ab3f71-aaf7-4e7c-a66a-575ab8ddae03-telemeter-client-tls\") pod \"telemeter-client-684cbc884-fv8sf\" (UID: \"29ab3f71-aaf7-4e7c-a66a-575ab8ddae03\") " pod="openshift-monitoring/telemeter-client-684cbc884-fv8sf"
Sep 11 21:07:08.255768 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.255742    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwhdz\" (UniqueName: \"kubernetes.io/projected/29ab3f71-aaf7-4e7c-a66a-575ab8ddae03-kube-api-access-mwhdz\") pod \"telemeter-client-684cbc884-fv8sf\" (UID: \"29ab3f71-aaf7-4e7c-a66a-575ab8ddae03\") " pod="openshift-monitoring/telemeter-client-684cbc884-fv8sf"
Sep 11 21:07:08.389677 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.382950    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-684cbc884-fv8sf"
Sep 11 21:07:08.534593 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.534550    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74fff8fc89-c86nr" event={"ID":"10f1b472-a3b1-4f05-a9ad-8e189031e75c","Type":"ContainerStarted","Data":"1756c77761073a9a13e2e1b938249e96ba8f70c416c46bf7cde8a12c139403c7"}
Sep 11 21:07:08.537822 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.537688    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mg2bk" event={"ID":"85cfef09-44c0-4cb4-97d1-97bce96e79c3","Type":"ContainerStarted","Data":"44a25abc76f11a9e405c0decc5950639795b69d32c992df0eeef3a5c73f0987d"}
Sep 11 21:07:08.541546 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.541514    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rhcd6" event={"ID":"c3c7a33a-d572-4476-83cc-941b5bba5804","Type":"ContainerStarted","Data":"edf7a722e489de2b469c40daa79c2fbec085f522bf0e2bf456d2d205a0dfa1f1"}
Sep 11 21:07:08.545158 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.545124    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2t2wn" event={"ID":"77d51833-213b-47d4-8179-7d871d60a85f","Type":"ContainerStarted","Data":"324ee5c3ebfc4f02e8ff9c037661fe2ebc7f1060b4c96c0be9e1123e41b66f66"}
Sep 11 21:07:08.548130 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.548102    2560 generic.go:356] "Generic (PLEG): container finished" podID="d7fd3e1c-67ab-43e7-b405-ab8fced3c872" containerID="372c5a9808e043627fd4955a2ed666eaa7367a2d981a816a4f2ddd188f031403" exitCode=0
Sep 11 21:07:08.548300 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.548173    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d7fd3e1c-67ab-43e7-b405-ab8fced3c872","Type":"ContainerDied","Data":"372c5a9808e043627fd4955a2ed666eaa7367a2d981a816a4f2ddd188f031403"}
Sep 11 21:07:08.562353 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.561762    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6df86bb8bb-zlw2g"]
Sep 11 21:07:08.566005 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.565965    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6df86bb8bb-zlw2g"
Sep 11 21:07:08.568780 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.568511    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rhcd6" podStartSLOduration=4.386250833 podStartE2EDuration="6.568489472s" totalImagesPullingTime="2.182238639s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:07:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:07:08.567540545 +0000 UTC m=+74.045852391" watchObservedRunningTime="2026-09-11 21:07:08.568489472 +0000 UTC m=+74.046801319"
Sep 11 21:07:08.579548 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.577842    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6df86bb8bb-zlw2g"]
Sep 11 21:07:08.611751 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.611716    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-kzkz6"]
Sep 11 21:07:08.616286 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.616220    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-66f4bd5b6-fggr7"]
Sep 11 21:07:08.650008 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.649347    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae44ee83-b45e-4f4e-8660-d3bdb2afd02d-trusted-ca-bundle\") pod \"console-6df86bb8bb-zlw2g\" (UID: \"ae44ee83-b45e-4f4e-8660-d3bdb2afd02d\") " pod="openshift-console/console-6df86bb8bb-zlw2g"
Sep 11 21:07:08.650008 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.649480    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae44ee83-b45e-4f4e-8660-d3bdb2afd02d-oauth-serving-cert\") pod \"console-6df86bb8bb-zlw2g\" (UID: \"ae44ee83-b45e-4f4e-8660-d3bdb2afd02d\") " pod="openshift-console/console-6df86bb8bb-zlw2g"
Sep 11 21:07:08.650008 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.649647    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-524dw\" (UniqueName: \"kubernetes.io/projected/ae44ee83-b45e-4f4e-8660-d3bdb2afd02d-kube-api-access-524dw\") pod \"console-6df86bb8bb-zlw2g\" (UID: \"ae44ee83-b45e-4f4e-8660-d3bdb2afd02d\") " pod="openshift-console/console-6df86bb8bb-zlw2g"
Sep 11 21:07:08.650008 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.649677    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae44ee83-b45e-4f4e-8660-d3bdb2afd02d-service-ca\") pod \"console-6df86bb8bb-zlw2g\" (UID: \"ae44ee83-b45e-4f4e-8660-d3bdb2afd02d\") " pod="openshift-console/console-6df86bb8bb-zlw2g"
Sep 11 21:07:08.650008 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.649828    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae44ee83-b45e-4f4e-8660-d3bdb2afd02d-console-serving-cert\") pod \"console-6df86bb8bb-zlw2g\" (UID: \"ae44ee83-b45e-4f4e-8660-d3bdb2afd02d\") " pod="openshift-console/console-6df86bb8bb-zlw2g"
Sep 11 21:07:08.650008 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.649888    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae44ee83-b45e-4f4e-8660-d3bdb2afd02d-console-oauth-config\") pod \"console-6df86bb8bb-zlw2g\" (UID: \"ae44ee83-b45e-4f4e-8660-d3bdb2afd02d\") " pod="openshift-console/console-6df86bb8bb-zlw2g"
Sep 11 21:07:08.650008 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.649932    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae44ee83-b45e-4f4e-8660-d3bdb2afd02d-console-config\") pod \"console-6df86bb8bb-zlw2g\" (UID: \"ae44ee83-b45e-4f4e-8660-d3bdb2afd02d\") " pod="openshift-console/console-6df86bb8bb-zlw2g"
Sep 11 21:07:08.710956 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.710864    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-684cbc884-fv8sf"]
Sep 11 21:07:08.716246 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:07:08.716027    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29ab3f71_aaf7_4e7c_a66a_575ab8ddae03.slice/crio-5d01db4aaeb86a916ede0b397fa9152270d1181f212f1a4d7ce1fce0f72e3804 WatchSource:0}: Error finding container 5d01db4aaeb86a916ede0b397fa9152270d1181f212f1a4d7ce1fce0f72e3804: Status 404 returned error can't find the container with id 5d01db4aaeb86a916ede0b397fa9152270d1181f212f1a4d7ce1fce0f72e3804
Sep 11 21:07:08.754405 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.751447    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae44ee83-b45e-4f4e-8660-d3bdb2afd02d-trusted-ca-bundle\") pod \"console-6df86bb8bb-zlw2g\" (UID: \"ae44ee83-b45e-4f4e-8660-d3bdb2afd02d\") " pod="openshift-console/console-6df86bb8bb-zlw2g"
Sep 11 21:07:08.754405 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.751519    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae44ee83-b45e-4f4e-8660-d3bdb2afd02d-oauth-serving-cert\") pod \"console-6df86bb8bb-zlw2g\" (UID: \"ae44ee83-b45e-4f4e-8660-d3bdb2afd02d\") " pod="openshift-console/console-6df86bb8bb-zlw2g"
Sep 11 21:07:08.754405 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.751593    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-524dw\" (UniqueName: \"kubernetes.io/projected/ae44ee83-b45e-4f4e-8660-d3bdb2afd02d-kube-api-access-524dw\") pod \"console-6df86bb8bb-zlw2g\" (UID: \"ae44ee83-b45e-4f4e-8660-d3bdb2afd02d\") " pod="openshift-console/console-6df86bb8bb-zlw2g"
Sep 11 21:07:08.754405 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.751640    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae44ee83-b45e-4f4e-8660-d3bdb2afd02d-service-ca\") pod \"console-6df86bb8bb-zlw2g\" (UID: \"ae44ee83-b45e-4f4e-8660-d3bdb2afd02d\") " pod="openshift-console/console-6df86bb8bb-zlw2g"
Sep 11 21:07:08.754405 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.751696    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae44ee83-b45e-4f4e-8660-d3bdb2afd02d-console-serving-cert\") pod \"console-6df86bb8bb-zlw2g\" (UID: \"ae44ee83-b45e-4f4e-8660-d3bdb2afd02d\") " pod="openshift-console/console-6df86bb8bb-zlw2g"
Sep 11 21:07:08.754405 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.751743    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae44ee83-b45e-4f4e-8660-d3bdb2afd02d-console-oauth-config\") pod \"console-6df86bb8bb-zlw2g\" (UID: \"ae44ee83-b45e-4f4e-8660-d3bdb2afd02d\") " pod="openshift-console/console-6df86bb8bb-zlw2g"
Sep 11 21:07:08.754405 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.751776    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae44ee83-b45e-4f4e-8660-d3bdb2afd02d-console-config\") pod \"console-6df86bb8bb-zlw2g\" (UID: \"ae44ee83-b45e-4f4e-8660-d3bdb2afd02d\") " pod="openshift-console/console-6df86bb8bb-zlw2g"
Sep 11 21:07:08.754405 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.752551    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae44ee83-b45e-4f4e-8660-d3bdb2afd02d-console-config\") pod \"console-6df86bb8bb-zlw2g\" (UID: \"ae44ee83-b45e-4f4e-8660-d3bdb2afd02d\") " pod="openshift-console/console-6df86bb8bb-zlw2g"
Sep 11 21:07:08.754405 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.753705    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae44ee83-b45e-4f4e-8660-d3bdb2afd02d-trusted-ca-bundle\") pod \"console-6df86bb8bb-zlw2g\" (UID: \"ae44ee83-b45e-4f4e-8660-d3bdb2afd02d\") " pod="openshift-console/console-6df86bb8bb-zlw2g"
Sep 11 21:07:08.754405 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.754298    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae44ee83-b45e-4f4e-8660-d3bdb2afd02d-oauth-serving-cert\") pod \"console-6df86bb8bb-zlw2g\" (UID: \"ae44ee83-b45e-4f4e-8660-d3bdb2afd02d\") " pod="openshift-console/console-6df86bb8bb-zlw2g"
Sep 11 21:07:08.757579 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.755969    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae44ee83-b45e-4f4e-8660-d3bdb2afd02d-service-ca\") pod \"console-6df86bb8bb-zlw2g\" (UID: \"ae44ee83-b45e-4f4e-8660-d3bdb2afd02d\") " pod="openshift-console/console-6df86bb8bb-zlw2g"
Sep 11 21:07:08.760765 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.760739    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae44ee83-b45e-4f4e-8660-d3bdb2afd02d-console-oauth-config\") pod \"console-6df86bb8bb-zlw2g\" (UID: \"ae44ee83-b45e-4f4e-8660-d3bdb2afd02d\") " pod="openshift-console/console-6df86bb8bb-zlw2g"
Sep 11 21:07:08.762065 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.762033    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae44ee83-b45e-4f4e-8660-d3bdb2afd02d-console-serving-cert\") pod \"console-6df86bb8bb-zlw2g\" (UID: \"ae44ee83-b45e-4f4e-8660-d3bdb2afd02d\") " pod="openshift-console/console-6df86bb8bb-zlw2g"
Sep 11 21:07:08.772245 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.772087    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-524dw\" (UniqueName: \"kubernetes.io/projected/ae44ee83-b45e-4f4e-8660-d3bdb2afd02d-kube-api-access-524dw\") pod \"console-6df86bb8bb-zlw2g\" (UID: \"ae44ee83-b45e-4f4e-8660-d3bdb2afd02d\") " pod="openshift-console/console-6df86bb8bb-zlw2g"
Sep 11 21:07:08.912603 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.912561    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6df86bb8bb-zlw2g"
Sep 11 21:07:08.968800 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.968761    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 21:07:08.974627 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.974578    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:08.977435 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.977133    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 11 21:07:08.979719 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.977810    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 11 21:07:08.979719 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.978807    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-lmptb\""
Sep 11 21:07:08.979719 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.978901    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 11 21:07:08.979719 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.979131    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 11 21:07:08.979719 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.979425    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 11 21:07:08.979719 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.979502    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 11 21:07:08.989618 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.979784    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 11 21:07:08.989618 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.980163    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 11 21:07:08.989618 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.985623    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 11 21:07:08.989618 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.986181    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 11 21:07:08.989618 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.986921    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 11 21:07:08.990242 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.990214    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 11 21:07:08.990913 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.990888    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-87d5b8qm4lgtb\""
Sep 11 21:07:08.993734 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:08.993703    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 11 21:07:09.010975 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.010950    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 11 21:07:09.013817 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.013789    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 21:07:09.055662 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.055569    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd936aef-bea6-4735-8f72-83f0218c5551-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.055924 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.055902    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bd936aef-bea6-4735-8f72-83f0218c5551-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.056038 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.056025    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bd936aef-bea6-4735-8f72-83f0218c5551-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.056136 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.056125    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bd936aef-bea6-4735-8f72-83f0218c5551-config-out\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.056228 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.056215    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bd936aef-bea6-4735-8f72-83f0218c5551-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.056318 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.056305    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68pj7\" (UniqueName: \"kubernetes.io/projected/bd936aef-bea6-4735-8f72-83f0218c5551-kube-api-access-68pj7\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.056454 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.056439    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bd936aef-bea6-4735-8f72-83f0218c5551-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.056567 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.056555    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bd936aef-bea6-4735-8f72-83f0218c5551-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.056693 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.056679    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bd936aef-bea6-4735-8f72-83f0218c5551-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.056785 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.056773    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bd936aef-bea6-4735-8f72-83f0218c5551-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.056875 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.056863    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd936aef-bea6-4735-8f72-83f0218c5551-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.056967 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.056955    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bd936aef-bea6-4735-8f72-83f0218c5551-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.057053 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.057042    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bd936aef-bea6-4735-8f72-83f0218c5551-config\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.057153 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.057141    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd936aef-bea6-4735-8f72-83f0218c5551-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.057251 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.057239    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bd936aef-bea6-4735-8f72-83f0218c5551-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.057369 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.057354    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bd936aef-bea6-4735-8f72-83f0218c5551-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.057563 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.057473    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bd936aef-bea6-4735-8f72-83f0218c5551-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.057686 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.057666    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd936aef-bea6-4735-8f72-83f0218c5551-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.057750 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.057700    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bd936aef-bea6-4735-8f72-83f0218c5551-web-config\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.057750 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.057734    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bd936aef-bea6-4735-8f72-83f0218c5551-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.159282 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.159242    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bd936aef-bea6-4735-8f72-83f0218c5551-config\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.159511 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.159296    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd936aef-bea6-4735-8f72-83f0218c5551-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.159511 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.159331    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bd936aef-bea6-4735-8f72-83f0218c5551-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.159511 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.159371    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bd936aef-bea6-4735-8f72-83f0218c5551-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.159511 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.159413    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bd936aef-bea6-4735-8f72-83f0218c5551-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.159511 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.159442    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd936aef-bea6-4735-8f72-83f0218c5551-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.159511 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.159466    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bd936aef-bea6-4735-8f72-83f0218c5551-web-config\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.159511 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.159489    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bd936aef-bea6-4735-8f72-83f0218c5551-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.159511 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.159511    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd936aef-bea6-4735-8f72-83f0218c5551-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.159997 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.159537    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bd936aef-bea6-4735-8f72-83f0218c5551-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.159997 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.159573    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bd936aef-bea6-4735-8f72-83f0218c5551-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.159997 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.159616    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bd936aef-bea6-4735-8f72-83f0218c5551-config-out\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.159997 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.159651    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bd936aef-bea6-4735-8f72-83f0218c5551-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.159997 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.159680    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68pj7\" (UniqueName: \"kubernetes.io/projected/bd936aef-bea6-4735-8f72-83f0218c5551-kube-api-access-68pj7\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.159997 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.159708    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bd936aef-bea6-4735-8f72-83f0218c5551-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.159997 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.159769    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bd936aef-bea6-4735-8f72-83f0218c5551-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.159997 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.159845    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bd936aef-bea6-4735-8f72-83f0218c5551-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.160434 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.160049    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bd936aef-bea6-4735-8f72-83f0218c5551-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.160434 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.160101    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd936aef-bea6-4735-8f72-83f0218c5551-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.160434 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.160136    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bd936aef-bea6-4735-8f72-83f0218c5551-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.160434 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.160213    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd936aef-bea6-4735-8f72-83f0218c5551-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.165158 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.161339    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bd936aef-bea6-4735-8f72-83f0218c5551-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.165158 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.162920    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd936aef-bea6-4735-8f72-83f0218c5551-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.165158 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.163551    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd936aef-bea6-4735-8f72-83f0218c5551-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.165158 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.164704    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bd936aef-bea6-4735-8f72-83f0218c5551-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.165158 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.164741    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bd936aef-bea6-4735-8f72-83f0218c5551-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.165158 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.165067    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bd936aef-bea6-4735-8f72-83f0218c5551-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.165569 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.165208    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bd936aef-bea6-4735-8f72-83f0218c5551-config-out\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.165835 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.165788    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bd936aef-bea6-4735-8f72-83f0218c5551-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.166066 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.166023    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd936aef-bea6-4735-8f72-83f0218c5551-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.166361 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.166339    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bd936aef-bea6-4735-8f72-83f0218c5551-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.167073 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.166745    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bd936aef-bea6-4735-8f72-83f0218c5551-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.168030 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.167972    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bd936aef-bea6-4735-8f72-83f0218c5551-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.169141 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.169092    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bd936aef-bea6-4735-8f72-83f0218c5551-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.169791 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.169739    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/bd936aef-bea6-4735-8f72-83f0218c5551-config\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.170085 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.170057    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bd936aef-bea6-4735-8f72-83f0218c5551-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.170626 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.170599    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bd936aef-bea6-4735-8f72-83f0218c5551-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.172072 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.172048    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68pj7\" (UniqueName: \"kubernetes.io/projected/bd936aef-bea6-4735-8f72-83f0218c5551-kube-api-access-68pj7\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.172733 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.172710    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bd936aef-bea6-4735-8f72-83f0218c5551-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.172826 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.172758    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bd936aef-bea6-4735-8f72-83f0218c5551-web-config\") pod \"prometheus-k8s-0\" (UID: \"bd936aef-bea6-4735-8f72-83f0218c5551\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.209896 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.209842    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6df86bb8bb-zlw2g"]
Sep 11 21:07:09.215617 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:07:09.215573    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae44ee83_b45e_4f4e_8660_d3bdb2afd02d.slice/crio-797ad453df78c8b687c278b4ecdf342a03fe14809e91e855f5086282d9f11975 WatchSource:0}: Error finding container 797ad453df78c8b687c278b4ecdf342a03fe14809e91e855f5086282d9f11975: Status 404 returned error can't find the container with id 797ad453df78c8b687c278b4ecdf342a03fe14809e91e855f5086282d9f11975
Sep 11 21:07:09.313695 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.313650    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:09.567816 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.567710    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2t2wn" event={"ID":"77d51833-213b-47d4-8179-7d871d60a85f","Type":"ContainerStarted","Data":"160bb00acb796737eb8aa177924d9eff86263a76670816e5b3e5abea33d9d007"}
Sep 11 21:07:09.571499 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.571459    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-kzkz6" event={"ID":"d4be4c17-b9be-40b0-b9f7-e0869b578a28","Type":"ContainerStarted","Data":"d273398dc4f90ebac2ed391992821d374e5eef47a8434e7faa0a1dbf697e0d84"}
Sep 11 21:07:09.578633 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.577755    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mg2bk" event={"ID":"85cfef09-44c0-4cb4-97d1-97bce96e79c3","Type":"ContainerStarted","Data":"639a5ff056b20f4fcf7768fe232abe6257a7e01487c0c5cd6586e39dd5ea0398"}
Sep 11 21:07:09.578633 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.577828    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mg2bk" event={"ID":"85cfef09-44c0-4cb4-97d1-97bce96e79c3","Type":"ContainerStarted","Data":"c0559e73edede1517dff088faae6334fc7f2ae968164fb0cf8ce7daf63fe2026"}
Sep 11 21:07:09.583012 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.582829    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6df86bb8bb-zlw2g" event={"ID":"ae44ee83-b45e-4f4e-8660-d3bdb2afd02d","Type":"ContainerStarted","Data":"17b484a76f35fefc8bcd4287274d5c24c7cccdd163936811ecf0778cc4962b05"}
Sep 11 21:07:09.583012 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.582892    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6df86bb8bb-zlw2g" event={"ID":"ae44ee83-b45e-4f4e-8660-d3bdb2afd02d","Type":"ContainerStarted","Data":"797ad453df78c8b687c278b4ecdf342a03fe14809e91e855f5086282d9f11975"}
Sep 11 21:07:09.591345 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.587783    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-66f4bd5b6-fggr7" event={"ID":"ead66865-003d-43f6-b361-92d2676c4a93","Type":"ContainerStarted","Data":"e8b8c1143c2e3fe8db0d61602238e096ba1eec30ab928927d5c8cbf0ee74d075"}
Sep 11 21:07:09.591345 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.589721    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2t2wn" podStartSLOduration=6.6475841540000005 podStartE2EDuration="7.589698976s" totalImagesPullingTime="858.811034ms" totalInitContainerRuntime="83.303788ms" isStatefulPod=true podCreationTimestamp="2026-09-11 21:07:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:07:09.586998973 +0000 UTC m=+75.065310819" watchObservedRunningTime="2026-09-11 21:07:09.589698976 +0000 UTC m=+75.068010824"
Sep 11 21:07:09.593903 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.593856    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-684cbc884-fv8sf" event={"ID":"29ab3f71-aaf7-4e7c-a66a-575ab8ddae03","Type":"ContainerStarted","Data":"5d01db4aaeb86a916ede0b397fa9152270d1181f212f1a4d7ce1fce0f72e3804"}
Sep 11 21:07:09.602828 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.602783    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74fff8fc89-c86nr" event={"ID":"10f1b472-a3b1-4f05-a9ad-8e189031e75c","Type":"ContainerStarted","Data":"edd74c378adea78ca47c90c01f2276739b505b66a0d5630a58a9634aeebee98e"}
Sep 11 21:07:09.602995 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.602869    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74fff8fc89-c86nr" event={"ID":"10f1b472-a3b1-4f05-a9ad-8e189031e75c","Type":"ContainerStarted","Data":"c41fa54eb21ba5b84f418c4fb946ec3aa51ad4ac880d185384e89d963422afe7"}
Sep 11 21:07:09.629951 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.628113    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6df86bb8bb-zlw2g" podStartSLOduration=1.628087502 podStartE2EDuration="1.628087502s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:07:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:07:09.60816017 +0000 UTC m=+75.086472015" watchObservedRunningTime="2026-09-11 21:07:09.628087502 +0000 UTC m=+75.106399346"
Sep 11 21:07:09.638481 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.637467    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-mg2bk" podStartSLOduration=5.169698694 podStartE2EDuration="7.637443223s" totalImagesPullingTime="2.467744529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:07:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:07:09.629608011 +0000 UTC m=+75.107919875" watchObservedRunningTime="2026-09-11 21:07:09.637443223 +0000 UTC m=+75.115755074"
Sep 11 21:07:09.638481 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:09.638367    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 21:07:09.643479 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:07:09.643431    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd936aef_bea6_4735_8f72_83f0218c5551.slice/crio-446bfd8e0d4cc9ce5ad0997fa12663260aeb8ba351d848e70daf9d174bb3182c WatchSource:0}: Error finding container 446bfd8e0d4cc9ce5ad0997fa12663260aeb8ba351d848e70daf9d174bb3182c: Status 404 returned error can't find the container with id 446bfd8e0d4cc9ce5ad0997fa12663260aeb8ba351d848e70daf9d174bb3182c
Sep 11 21:07:10.609792 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:10.609749    2560 generic.go:356] "Generic (PLEG): container finished" podID="bd936aef-bea6-4735-8f72-83f0218c5551" containerID="29e21dbeb1a2777d03d618a6e00cba06895cf99b4c29ab01a6177fc4be5a32e5" exitCode=0
Sep 11 21:07:10.610272 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:10.609854    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd936aef-bea6-4735-8f72-83f0218c5551","Type":"ContainerDied","Data":"29e21dbeb1a2777d03d618a6e00cba06895cf99b4c29ab01a6177fc4be5a32e5"}
Sep 11 21:07:10.610272 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:10.609981    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd936aef-bea6-4735-8f72-83f0218c5551","Type":"ContainerStarted","Data":"446bfd8e0d4cc9ce5ad0997fa12663260aeb8ba351d848e70daf9d174bb3182c"}
Sep 11 21:07:12.624018 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:12.623980    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-684cbc884-fv8sf" event={"ID":"29ab3f71-aaf7-4e7c-a66a-575ab8ddae03","Type":"ContainerStarted","Data":"1c7db7626176970b7ed9fba201d1326a224321e58e8b284077c6a5c7050bad98"}
Sep 11 21:07:12.624532 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:12.624090    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-684cbc884-fv8sf" event={"ID":"29ab3f71-aaf7-4e7c-a66a-575ab8ddae03","Type":"ContainerStarted","Data":"ad04cd1be5f148596067c4e29539e8250feb24588e1faf60a96c3f98d1690084"}
Sep 11 21:07:12.624532 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:12.624122    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-684cbc884-fv8sf" event={"ID":"29ab3f71-aaf7-4e7c-a66a-575ab8ddae03","Type":"ContainerStarted","Data":"a243fe0d1943ee2c2223c32383e31bc9fa38e452a52d17dee7701bca80e84323"}
Sep 11 21:07:12.627994 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:12.627950    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74fff8fc89-c86nr" event={"ID":"10f1b472-a3b1-4f05-a9ad-8e189031e75c","Type":"ContainerStarted","Data":"35ed395451405d3034a387ff351c57f8021704d6cef312712a48dd10aa3e4f71"}
Sep 11 21:07:12.628190 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:12.628045    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74fff8fc89-c86nr" event={"ID":"10f1b472-a3b1-4f05-a9ad-8e189031e75c","Type":"ContainerStarted","Data":"640b09ee63c2f6c52314ecb22bf93cb805e2313e6f5b5c6f7c969d83028aecef"}
Sep 11 21:07:12.628190 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:12.628091    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74fff8fc89-c86nr" event={"ID":"10f1b472-a3b1-4f05-a9ad-8e189031e75c","Type":"ContainerStarted","Data":"248a46db75b6447ac671e8b9cd0e164258f72660e49330475f3941598f6ab8b4"}
Sep 11 21:07:12.628190 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:12.628132    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-74fff8fc89-c86nr"
Sep 11 21:07:12.630829 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:12.630756    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-kzkz6" event={"ID":"d4be4c17-b9be-40b0-b9f7-e0869b578a28","Type":"ContainerStarted","Data":"578fd22c9ce198ed0b3c112aae797cb147f91643faf0b370bb076a1524b77856"}
Sep 11 21:07:12.631208 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:12.631030    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-kzkz6"
Sep 11 21:07:12.637993 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:12.637962    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-kzkz6"
Sep 11 21:07:12.639426 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:12.639396    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d7fd3e1c-67ab-43e7-b405-ab8fced3c872","Type":"ContainerStarted","Data":"11ff1ad0f3c05caa0beeea0ee0b50f30d43be3c064d10db0489c742619da4ee5"}
Sep 11 21:07:12.639550 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:12.639474    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d7fd3e1c-67ab-43e7-b405-ab8fced3c872","Type":"ContainerStarted","Data":"d3807da3a42b01225279a661c20964265015e506418c1ba41c2a28ff3768e9bf"}
Sep 11 21:07:12.639550 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:12.639520    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d7fd3e1c-67ab-43e7-b405-ab8fced3c872","Type":"ContainerStarted","Data":"deb4e1359363fb6255ed4bfe0bade4aafaae3f1f04cdd3c9f7a8827f326b7bb7"}
Sep 11 21:07:12.639678 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:12.639566    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d7fd3e1c-67ab-43e7-b405-ab8fced3c872","Type":"ContainerStarted","Data":"fa43a06c84f85263c128faaf98449c586cd0d5abfa85f719310568c12d94f8dc"}
Sep 11 21:07:12.639678 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:12.639612    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d7fd3e1c-67ab-43e7-b405-ab8fced3c872","Type":"ContainerStarted","Data":"d9f2c78745332a0ffb5d232033f0bf5fe62aa1dfaa4fb24b0f502920818c7925"}
Sep 11 21:07:12.639678 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:12.639651    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d7fd3e1c-67ab-43e7-b405-ab8fced3c872","Type":"ContainerStarted","Data":"eea4f16898712abc8ad079589acdd84d6ffa4f7124f17269eb1406bba69e35d8"}
Sep 11 21:07:12.642890 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:12.642856    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-66f4bd5b6-fggr7" event={"ID":"ead66865-003d-43f6-b361-92d2676c4a93","Type":"ContainerStarted","Data":"fe8913720f00f153decb57cccbe430904532012ab55ff0abe781f01937dc5d71"}
Sep 11 21:07:12.647184 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:12.647092    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-684cbc884-fv8sf" podStartSLOduration=1.5444569430000001 podStartE2EDuration="4.64707359s" totalImagesPullingTime="3.102616647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:07:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:07:12.646813748 +0000 UTC m=+78.125125606" watchObservedRunningTime="2026-09-11 21:07:12.64707359 +0000 UTC m=+78.125385432"
Sep 11 21:07:12.675279 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:12.675218    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.924801651 podStartE2EDuration="9.675198385s" totalImagesPullingTime="5.720045979s" totalInitContainerRuntime="30.350755ms" isStatefulPod=false podCreationTimestamp="2026-09-11 21:07:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:07:12.673350155 +0000 UTC m=+78.151662036" watchObservedRunningTime="2026-09-11 21:07:12.675198385 +0000 UTC m=+78.153510228"
Sep 11 21:07:12.692467 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:12.692408    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-kzkz6" podStartSLOduration=2.485926899 podStartE2EDuration="5.692372378s" totalImagesPullingTime="3.206445479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:07:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:07:12.691614175 +0000 UTC m=+78.169926017" watchObservedRunningTime="2026-09-11 21:07:12.692372378 +0000 UTC m=+78.170684223"
Sep 11 21:07:12.712597 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:12.712290    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-66f4bd5b6-fggr7" podStartSLOduration=2.508907374 podStartE2EDuration="5.712266138s" totalImagesPullingTime="3.203358764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:07:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:07:12.711181888 +0000 UTC m=+78.189494040" watchObservedRunningTime="2026-09-11 21:07:12.712266138 +0000 UTC m=+78.190577982"
Sep 11 21:07:12.741918 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:12.741865    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-74fff8fc89-c86nr" podStartSLOduration=2.7386988519999997 podStartE2EDuration="7.741844667s" totalImagesPullingTime="5.003145815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:07:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:07:12.740027555 +0000 UTC m=+78.218339398" watchObservedRunningTime="2026-09-11 21:07:12.741844667 +0000 UTC m=+78.220156512"
Sep 11 21:07:12.750218 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:12.750030    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6df86bb8bb-zlw2g"]
Sep 11 21:07:13.428668 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:13.428639    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-d6c5fdb9f-hsmww"
Sep 11 21:07:13.658288 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:13.658256    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-74fff8fc89-c86nr"
Sep 11 21:07:15.665662 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:15.665558    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd936aef-bea6-4735-8f72-83f0218c5551","Type":"ContainerStarted","Data":"06fcc39eb4ded5c016da8d96ab8669183e4cacd440b8dfd6194f853f370ee50f"}
Sep 11 21:07:15.666129 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:15.665677    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd936aef-bea6-4735-8f72-83f0218c5551","Type":"ContainerStarted","Data":"0ee01220662fdbc674f99b4b5777ea62aa80817eed73b11f88331d7b74366d6f"}
Sep 11 21:07:15.666129 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:15.665717    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd936aef-bea6-4735-8f72-83f0218c5551","Type":"ContainerStarted","Data":"0034f960967fb812f2b1d322ff927a274bd33d3ae10b68df30eb9fc7af30b2f7"}
Sep 11 21:07:15.666129 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:15.665764    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd936aef-bea6-4735-8f72-83f0218c5551","Type":"ContainerStarted","Data":"d673db85841f90a7d402b283ca9007aaeb379662b71fe945c06c770896ef6355"}
Sep 11 21:07:15.666129 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:15.665808    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd936aef-bea6-4735-8f72-83f0218c5551","Type":"ContainerStarted","Data":"edb198ad17e739aee53973bb5557086788bb74f753c2e947b9c2e481224cbb5c"}
Sep 11 21:07:15.666129 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:15.665851    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd936aef-bea6-4735-8f72-83f0218c5551","Type":"ContainerStarted","Data":"1b21f43c1286cce83745976825ea380b34ba118b513b0a3a49cbed42c5b646ab"}
Sep 11 21:07:15.698569 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:15.698506    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.154930461 podStartE2EDuration="7.698481459s" totalImagesPullingTime="4.518756833s" totalInitContainerRuntime="24.794165ms" isStatefulPod=false podCreationTimestamp="2026-09-11 21:07:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:07:15.696008904 +0000 UTC m=+81.174320761" watchObservedRunningTime="2026-09-11 21:07:15.698481459 +0000 UTC m=+81.176793305"
Sep 11 21:07:18.913802 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:18.913663    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6df86bb8bb-zlw2g"
Sep 11 21:07:19.314663 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:19.314567    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:07:23.463447 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:23.463406    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b5bc766dd-p5t9g"]
Sep 11 21:07:27.483343 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:27.483304    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-66f4bd5b6-fggr7"
Sep 11 21:07:27.483785 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:27.483375    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-66f4bd5b6-fggr7"
Sep 11 21:07:37.530195 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:37.530162    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-sxs24"
Sep 11 21:07:37.773287 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:37.773223    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6df86bb8bb-zlw2g" podUID="ae44ee83-b45e-4f4e-8660-d3bdb2afd02d" containerName="console" containerID="cri-o://17b484a76f35fefc8bcd4287274d5c24c7cccdd163936811ecf0778cc4962b05" gracePeriod=15
Sep 11 21:07:38.047528 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:38.047496    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6df86bb8bb-zlw2g"
Sep 11 21:07:38.149942 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:38.149910    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae44ee83-b45e-4f4e-8660-d3bdb2afd02d-console-serving-cert\") pod \"ae44ee83-b45e-4f4e-8660-d3bdb2afd02d\" (UID: \"ae44ee83-b45e-4f4e-8660-d3bdb2afd02d\") "
Sep 11 21:07:38.150130 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:38.149949    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae44ee83-b45e-4f4e-8660-d3bdb2afd02d-service-ca\") pod \"ae44ee83-b45e-4f4e-8660-d3bdb2afd02d\" (UID: \"ae44ee83-b45e-4f4e-8660-d3bdb2afd02d\") "
Sep 11 21:07:38.150130 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:38.149982    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-524dw\" (UniqueName: \"kubernetes.io/projected/ae44ee83-b45e-4f4e-8660-d3bdb2afd02d-kube-api-access-524dw\") pod \"ae44ee83-b45e-4f4e-8660-d3bdb2afd02d\" (UID: \"ae44ee83-b45e-4f4e-8660-d3bdb2afd02d\") "
Sep 11 21:07:38.150130 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:38.150026    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae44ee83-b45e-4f4e-8660-d3bdb2afd02d-trusted-ca-bundle\") pod \"ae44ee83-b45e-4f4e-8660-d3bdb2afd02d\" (UID: \"ae44ee83-b45e-4f4e-8660-d3bdb2afd02d\") "
Sep 11 21:07:38.150292 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:38.150144    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae44ee83-b45e-4f4e-8660-d3bdb2afd02d-oauth-serving-cert\") pod \"ae44ee83-b45e-4f4e-8660-d3bdb2afd02d\" (UID: \"ae44ee83-b45e-4f4e-8660-d3bdb2afd02d\") "
Sep 11 21:07:38.150292 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:38.150189    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae44ee83-b45e-4f4e-8660-d3bdb2afd02d-console-oauth-config\") pod \"ae44ee83-b45e-4f4e-8660-d3bdb2afd02d\" (UID: \"ae44ee83-b45e-4f4e-8660-d3bdb2afd02d\") "
Sep 11 21:07:38.150292 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:38.150222    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae44ee83-b45e-4f4e-8660-d3bdb2afd02d-console-config\") pod \"ae44ee83-b45e-4f4e-8660-d3bdb2afd02d\" (UID: \"ae44ee83-b45e-4f4e-8660-d3bdb2afd02d\") "
Sep 11 21:07:38.150468 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:38.150444    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae44ee83-b45e-4f4e-8660-d3bdb2afd02d-service-ca" (OuterVolumeSpecName: "service-ca") pod "ae44ee83-b45e-4f4e-8660-d3bdb2afd02d" (UID: "ae44ee83-b45e-4f4e-8660-d3bdb2afd02d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:07:38.150518 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:38.150463    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae44ee83-b45e-4f4e-8660-d3bdb2afd02d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ae44ee83-b45e-4f4e-8660-d3bdb2afd02d" (UID: "ae44ee83-b45e-4f4e-8660-d3bdb2afd02d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:07:38.150658 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:38.150641    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae44ee83-b45e-4f4e-8660-d3bdb2afd02d-service-ca\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:07:38.150715 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:38.150666    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae44ee83-b45e-4f4e-8660-d3bdb2afd02d-trusted-ca-bundle\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:07:38.150715 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:38.150677    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae44ee83-b45e-4f4e-8660-d3bdb2afd02d-console-config" (OuterVolumeSpecName: "console-config") pod "ae44ee83-b45e-4f4e-8660-d3bdb2afd02d" (UID: "ae44ee83-b45e-4f4e-8660-d3bdb2afd02d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:07:38.150841 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:38.150793    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae44ee83-b45e-4f4e-8660-d3bdb2afd02d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ae44ee83-b45e-4f4e-8660-d3bdb2afd02d" (UID: "ae44ee83-b45e-4f4e-8660-d3bdb2afd02d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:07:38.152446 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:38.152420    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae44ee83-b45e-4f4e-8660-d3bdb2afd02d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ae44ee83-b45e-4f4e-8660-d3bdb2afd02d" (UID: "ae44ee83-b45e-4f4e-8660-d3bdb2afd02d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:07:38.152515 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:38.152455    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae44ee83-b45e-4f4e-8660-d3bdb2afd02d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ae44ee83-b45e-4f4e-8660-d3bdb2afd02d" (UID: "ae44ee83-b45e-4f4e-8660-d3bdb2afd02d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:07:38.152549 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:38.152510    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae44ee83-b45e-4f4e-8660-d3bdb2afd02d-kube-api-access-524dw" (OuterVolumeSpecName: "kube-api-access-524dw") pod "ae44ee83-b45e-4f4e-8660-d3bdb2afd02d" (UID: "ae44ee83-b45e-4f4e-8660-d3bdb2afd02d"). InnerVolumeSpecName "kube-api-access-524dw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:07:38.252001 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:38.251946    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae44ee83-b45e-4f4e-8660-d3bdb2afd02d-console-serving-cert\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:07:38.252001 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:38.251992    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-524dw\" (UniqueName: \"kubernetes.io/projected/ae44ee83-b45e-4f4e-8660-d3bdb2afd02d-kube-api-access-524dw\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:07:38.252001 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:38.252002    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae44ee83-b45e-4f4e-8660-d3bdb2afd02d-oauth-serving-cert\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:07:38.252001 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:38.252011    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae44ee83-b45e-4f4e-8660-d3bdb2afd02d-console-oauth-config\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:07:38.252001 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:38.252022    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae44ee83-b45e-4f4e-8660-d3bdb2afd02d-console-config\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:07:38.773217 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:38.773178    2560 generic.go:356] "Generic (PLEG): container finished" podID="ae44ee83-b45e-4f4e-8660-d3bdb2afd02d" containerID="17b484a76f35fefc8bcd4287274d5c24c7cccdd163936811ecf0778cc4962b05" exitCode=0
Sep 11 21:07:38.773662 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:38.773233    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6df86bb8bb-zlw2g"
Sep 11 21:07:38.773662 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:38.773255    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6df86bb8bb-zlw2g" event={"ID":"ae44ee83-b45e-4f4e-8660-d3bdb2afd02d","Type":"ContainerDied","Data":"17b484a76f35fefc8bcd4287274d5c24c7cccdd163936811ecf0778cc4962b05"}
Sep 11 21:07:38.773662 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:38.773311    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6df86bb8bb-zlw2g" event={"ID":"ae44ee83-b45e-4f4e-8660-d3bdb2afd02d","Type":"ContainerDied","Data":"797ad453df78c8b687c278b4ecdf342a03fe14809e91e855f5086282d9f11975"}
Sep 11 21:07:38.773662 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:38.773333    2560 scope.go:117] "RemoveContainer" containerID="17b484a76f35fefc8bcd4287274d5c24c7cccdd163936811ecf0778cc4962b05"
Sep 11 21:07:38.783339 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:38.783322    2560 scope.go:117] "RemoveContainer" containerID="17b484a76f35fefc8bcd4287274d5c24c7cccdd163936811ecf0778cc4962b05"
Sep 11 21:07:38.783717 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:07:38.783698    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17b484a76f35fefc8bcd4287274d5c24c7cccdd163936811ecf0778cc4962b05\": container with ID starting with 17b484a76f35fefc8bcd4287274d5c24c7cccdd163936811ecf0778cc4962b05 not found: ID does not exist" containerID="17b484a76f35fefc8bcd4287274d5c24c7cccdd163936811ecf0778cc4962b05"
Sep 11 21:07:38.783766 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:38.783727    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17b484a76f35fefc8bcd4287274d5c24c7cccdd163936811ecf0778cc4962b05"} err="failed to get container status \"17b484a76f35fefc8bcd4287274d5c24c7cccdd163936811ecf0778cc4962b05\": rpc error: code = NotFound desc = could not find container \"17b484a76f35fefc8bcd4287274d5c24c7cccdd163936811ecf0778cc4962b05\": container with ID starting with 17b484a76f35fefc8bcd4287274d5c24c7cccdd163936811ecf0778cc4962b05 not found: ID does not exist"
Sep 11 21:07:38.802647 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:38.802603    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6df86bb8bb-zlw2g"]
Sep 11 21:07:38.812765 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:38.812736    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6df86bb8bb-zlw2g"]
Sep 11 21:07:39.036670 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:39.036594    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae44ee83-b45e-4f4e-8660-d3bdb2afd02d" path="/var/lib/kubelet/pods/ae44ee83-b45e-4f4e-8660-d3bdb2afd02d/volumes"
Sep 11 21:07:47.489493 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:47.489456    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-66f4bd5b6-fggr7"
Sep 11 21:07:47.494029 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:47.493998    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-66f4bd5b6-fggr7"
Sep 11 21:07:48.486222 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:48.486178    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-b5bc766dd-p5t9g" podUID="7b9bc750-7710-45a8-bcf7-8b75ce9246c6" containerName="console" containerID="cri-o://afad7e4065dc0562417fc3cd2f4b574765601a63408a9455fa7dd4ae58b58760" gracePeriod=15
Sep 11 21:07:48.772656 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:48.772623    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b5bc766dd-p5t9g"
Sep 11 21:07:48.827935 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:48.827898    2560 generic.go:356] "Generic (PLEG): container finished" podID="7b9bc750-7710-45a8-bcf7-8b75ce9246c6" containerID="afad7e4065dc0562417fc3cd2f4b574765601a63408a9455fa7dd4ae58b58760" exitCode=0
Sep 11 21:07:48.828140 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:48.827949    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b5bc766dd-p5t9g"
Sep 11 21:07:48.828140 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:48.827961    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b5bc766dd-p5t9g" event={"ID":"7b9bc750-7710-45a8-bcf7-8b75ce9246c6","Type":"ContainerDied","Data":"afad7e4065dc0562417fc3cd2f4b574765601a63408a9455fa7dd4ae58b58760"}
Sep 11 21:07:48.828140 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:48.828012    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b5bc766dd-p5t9g" event={"ID":"7b9bc750-7710-45a8-bcf7-8b75ce9246c6","Type":"ContainerDied","Data":"c2a47d56aba0b4d9aa71d9112846d80fe23044bdffecf352f3e02e0dc992c1b9"}
Sep 11 21:07:48.828140 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:48.828038    2560 scope.go:117] "RemoveContainer" containerID="afad7e4065dc0562417fc3cd2f4b574765601a63408a9455fa7dd4ae58b58760"
Sep 11 21:07:48.838016 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:48.837995    2560 scope.go:117] "RemoveContainer" containerID="afad7e4065dc0562417fc3cd2f4b574765601a63408a9455fa7dd4ae58b58760"
Sep 11 21:07:48.838489 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:07:48.838457    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afad7e4065dc0562417fc3cd2f4b574765601a63408a9455fa7dd4ae58b58760\": container with ID starting with afad7e4065dc0562417fc3cd2f4b574765601a63408a9455fa7dd4ae58b58760 not found: ID does not exist" containerID="afad7e4065dc0562417fc3cd2f4b574765601a63408a9455fa7dd4ae58b58760"
Sep 11 21:07:48.838643 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:48.838504    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afad7e4065dc0562417fc3cd2f4b574765601a63408a9455fa7dd4ae58b58760"} err="failed to get container status \"afad7e4065dc0562417fc3cd2f4b574765601a63408a9455fa7dd4ae58b58760\": rpc error: code = NotFound desc = could not find container \"afad7e4065dc0562417fc3cd2f4b574765601a63408a9455fa7dd4ae58b58760\": container with ID starting with afad7e4065dc0562417fc3cd2f4b574765601a63408a9455fa7dd4ae58b58760 not found: ID does not exist"
Sep 11 21:07:48.854824 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:48.854786    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7b9bc750-7710-45a8-bcf7-8b75ce9246c6-service-ca\") pod \"7b9bc750-7710-45a8-bcf7-8b75ce9246c6\" (UID: \"7b9bc750-7710-45a8-bcf7-8b75ce9246c6\") "
Sep 11 21:07:48.854985 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:48.854837    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7b9bc750-7710-45a8-bcf7-8b75ce9246c6-console-config\") pod \"7b9bc750-7710-45a8-bcf7-8b75ce9246c6\" (UID: \"7b9bc750-7710-45a8-bcf7-8b75ce9246c6\") "
Sep 11 21:07:48.854985 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:48.854871    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b9bc750-7710-45a8-bcf7-8b75ce9246c6-trusted-ca-bundle\") pod \"7b9bc750-7710-45a8-bcf7-8b75ce9246c6\" (UID: \"7b9bc750-7710-45a8-bcf7-8b75ce9246c6\") "
Sep 11 21:07:48.854985 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:48.854958    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p4lrq\" (UniqueName: \"kubernetes.io/projected/7b9bc750-7710-45a8-bcf7-8b75ce9246c6-kube-api-access-p4lrq\") pod \"7b9bc750-7710-45a8-bcf7-8b75ce9246c6\" (UID: \"7b9bc750-7710-45a8-bcf7-8b75ce9246c6\") "
Sep 11 21:07:48.855146 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:48.855034    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7b9bc750-7710-45a8-bcf7-8b75ce9246c6-console-oauth-config\") pod \"7b9bc750-7710-45a8-bcf7-8b75ce9246c6\" (UID: \"7b9bc750-7710-45a8-bcf7-8b75ce9246c6\") "
Sep 11 21:07:48.855146 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:48.855084    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7b9bc750-7710-45a8-bcf7-8b75ce9246c6-oauth-serving-cert\") pod \"7b9bc750-7710-45a8-bcf7-8b75ce9246c6\" (UID: \"7b9bc750-7710-45a8-bcf7-8b75ce9246c6\") "
Sep 11 21:07:48.855249 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:48.855156    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7b9bc750-7710-45a8-bcf7-8b75ce9246c6-console-serving-cert\") pod \"7b9bc750-7710-45a8-bcf7-8b75ce9246c6\" (UID: \"7b9bc750-7710-45a8-bcf7-8b75ce9246c6\") "
Sep 11 21:07:48.855249 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:48.855218    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b9bc750-7710-45a8-bcf7-8b75ce9246c6-service-ca" (OuterVolumeSpecName: "service-ca") pod "7b9bc750-7710-45a8-bcf7-8b75ce9246c6" (UID: "7b9bc750-7710-45a8-bcf7-8b75ce9246c6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:07:48.855343 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:48.855254    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b9bc750-7710-45a8-bcf7-8b75ce9246c6-console-config" (OuterVolumeSpecName: "console-config") pod "7b9bc750-7710-45a8-bcf7-8b75ce9246c6" (UID: "7b9bc750-7710-45a8-bcf7-8b75ce9246c6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:07:48.855343 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:48.855291    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b9bc750-7710-45a8-bcf7-8b75ce9246c6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7b9bc750-7710-45a8-bcf7-8b75ce9246c6" (UID: "7b9bc750-7710-45a8-bcf7-8b75ce9246c6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:07:48.855592 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:48.855553    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b9bc750-7710-45a8-bcf7-8b75ce9246c6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7b9bc750-7710-45a8-bcf7-8b75ce9246c6" (UID: "7b9bc750-7710-45a8-bcf7-8b75ce9246c6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:07:48.855737 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:48.855679    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7b9bc750-7710-45a8-bcf7-8b75ce9246c6-oauth-serving-cert\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:07:48.855737 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:48.855697    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7b9bc750-7710-45a8-bcf7-8b75ce9246c6-service-ca\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:07:48.855737 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:48.855711    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7b9bc750-7710-45a8-bcf7-8b75ce9246c6-console-config\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:07:48.855737 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:48.855722    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b9bc750-7710-45a8-bcf7-8b75ce9246c6-trusted-ca-bundle\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:07:48.857715 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:48.857552    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b9bc750-7710-45a8-bcf7-8b75ce9246c6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7b9bc750-7710-45a8-bcf7-8b75ce9246c6" (UID: "7b9bc750-7710-45a8-bcf7-8b75ce9246c6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:07:48.857890 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:48.857866    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b9bc750-7710-45a8-bcf7-8b75ce9246c6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7b9bc750-7710-45a8-bcf7-8b75ce9246c6" (UID: "7b9bc750-7710-45a8-bcf7-8b75ce9246c6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:07:48.857955 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:48.857866    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b9bc750-7710-45a8-bcf7-8b75ce9246c6-kube-api-access-p4lrq" (OuterVolumeSpecName: "kube-api-access-p4lrq") pod "7b9bc750-7710-45a8-bcf7-8b75ce9246c6" (UID: "7b9bc750-7710-45a8-bcf7-8b75ce9246c6"). InnerVolumeSpecName "kube-api-access-p4lrq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:07:48.956734 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:48.956698    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p4lrq\" (UniqueName: \"kubernetes.io/projected/7b9bc750-7710-45a8-bcf7-8b75ce9246c6-kube-api-access-p4lrq\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:07:48.956734 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:48.956730    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7b9bc750-7710-45a8-bcf7-8b75ce9246c6-console-oauth-config\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:07:48.956934 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:48.956744    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7b9bc750-7710-45a8-bcf7-8b75ce9246c6-console-serving-cert\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:07:49.144362 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:49.144331    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b5bc766dd-p5t9g"]
Sep 11 21:07:49.149682 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:49.149649    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b5bc766dd-p5t9g"]
Sep 11 21:07:51.036796 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:07:51.036758    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b9bc750-7710-45a8-bcf7-8b75ce9246c6" path="/var/lib/kubelet/pods/7b9bc750-7710-45a8-bcf7-8b75ce9246c6/volumes"
Sep 11 21:08:09.315185 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:08:09.315141    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:08:09.335778 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:08:09.335746    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:08:09.934333 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:08:09.934295    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 21:09:51.386684 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:09:51.386649    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-qdtps"]
Sep 11 21:09:51.387105 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:09:51.386993    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae44ee83-b45e-4f4e-8660-d3bdb2afd02d" containerName="console"
Sep 11 21:09:51.387105 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:09:51.387004    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae44ee83-b45e-4f4e-8660-d3bdb2afd02d" containerName="console"
Sep 11 21:09:51.387105 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:09:51.387011    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b9bc750-7710-45a8-bcf7-8b75ce9246c6" containerName="console"
Sep 11 21:09:51.387105 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:09:51.387017    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b9bc750-7710-45a8-bcf7-8b75ce9246c6" containerName="console"
Sep 11 21:09:51.387105 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:09:51.387089    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b9bc750-7710-45a8-bcf7-8b75ce9246c6" containerName="console"
Sep 11 21:09:51.387105 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:09:51.387100    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae44ee83-b45e-4f4e-8660-d3bdb2afd02d" containerName="console"
Sep 11 21:09:51.389079 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:09:51.389058    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-qdtps"
Sep 11 21:09:51.391850 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:09:51.391827    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 11 21:09:51.392594 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:09:51.392576    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 11 21:09:51.392683 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:09:51.392580    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-44xk8\""
Sep 11 21:09:51.399834 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:09:51.399807    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-qdtps"]
Sep 11 21:09:51.481782 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:09:51.481745    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5swkk\" (UniqueName: \"kubernetes.io/projected/8fd94b9c-e7e9-444c-9ec7-61da1c8e4c44-kube-api-access-5swkk\") pod \"cert-manager-webhook-6486ffd997-qdtps\" (UID: \"8fd94b9c-e7e9-444c-9ec7-61da1c8e4c44\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qdtps"
Sep 11 21:09:51.481952 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:09:51.481804    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8fd94b9c-e7e9-444c-9ec7-61da1c8e4c44-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-qdtps\" (UID: \"8fd94b9c-e7e9-444c-9ec7-61da1c8e4c44\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qdtps"
Sep 11 21:09:51.583287 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:09:51.583246    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8fd94b9c-e7e9-444c-9ec7-61da1c8e4c44-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-qdtps\" (UID: \"8fd94b9c-e7e9-444c-9ec7-61da1c8e4c44\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qdtps"
Sep 11 21:09:51.583499 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:09:51.583365    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5swkk\" (UniqueName: \"kubernetes.io/projected/8fd94b9c-e7e9-444c-9ec7-61da1c8e4c44-kube-api-access-5swkk\") pod \"cert-manager-webhook-6486ffd997-qdtps\" (UID: \"8fd94b9c-e7e9-444c-9ec7-61da1c8e4c44\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qdtps"
Sep 11 21:09:51.592494 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:09:51.592466    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5swkk\" (UniqueName: \"kubernetes.io/projected/8fd94b9c-e7e9-444c-9ec7-61da1c8e4c44-kube-api-access-5swkk\") pod \"cert-manager-webhook-6486ffd997-qdtps\" (UID: \"8fd94b9c-e7e9-444c-9ec7-61da1c8e4c44\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qdtps"
Sep 11 21:09:51.592627 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:09:51.592472    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8fd94b9c-e7e9-444c-9ec7-61da1c8e4c44-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-qdtps\" (UID: \"8fd94b9c-e7e9-444c-9ec7-61da1c8e4c44\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qdtps"
Sep 11 21:09:51.707781 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:09:51.707677    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-qdtps"
Sep 11 21:09:51.979772 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:09:51.979640    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-qdtps"]
Sep 11 21:09:51.982511 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:09:51.982475    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8fd94b9c_e7e9_444c_9ec7_61da1c8e4c44.slice/crio-7f5f59e35b23025bf5fd969f16a461514861faa58ab6fce7bdea28fb69c8514e WatchSource:0}: Error finding container 7f5f59e35b23025bf5fd969f16a461514861faa58ab6fce7bdea28fb69c8514e: Status 404 returned error can't find the container with id 7f5f59e35b23025bf5fd969f16a461514861faa58ab6fce7bdea28fb69c8514e
Sep 11 21:09:52.338638 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:09:52.338555    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-qdtps" event={"ID":"8fd94b9c-e7e9-444c-9ec7-61da1c8e4c44","Type":"ContainerStarted","Data":"7f5f59e35b23025bf5fd969f16a461514861faa58ab6fce7bdea28fb69c8514e"}
Sep 11 21:09:55.353988 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:09:55.353900    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-qdtps" event={"ID":"8fd94b9c-e7e9-444c-9ec7-61da1c8e4c44","Type":"ContainerStarted","Data":"cab3e5d58b79c17f640f7a2a72bca9b2ae8c61ac38b8e137d367d01a523a9cc0"}
Sep 11 21:09:55.354357 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:09:55.354041    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-qdtps"
Sep 11 21:09:55.382494 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:09:55.382426    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-qdtps" podStartSLOduration=1.4854889789999999 podStartE2EDuration="4.382377767s" totalImagesPullingTime="2.896888788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:09:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:09:55.381876961 +0000 UTC m=+240.860188822" watchObservedRunningTime="2026-09-11 21:09:55.382377767 +0000 UTC m=+240.860689611"
Sep 11 21:10:01.361546 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:01.361509    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-qdtps"
Sep 11 21:10:01.756877 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:01.756842    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-hbnjv"]
Sep 11 21:10:01.759265 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:01.759243    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-hbnjv"
Sep 11 21:10:01.762758 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:01.762736    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-q5plw\""
Sep 11 21:10:01.770018 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:01.769991    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-hbnjv"]
Sep 11 21:10:01.888718 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:01.888678    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpxbp\" (UniqueName: \"kubernetes.io/projected/a8dcd23a-52df-4e63-a024-3688c2b38970-kube-api-access-gpxbp\") pod \"cert-manager-55b4d954d5-hbnjv\" (UID: \"a8dcd23a-52df-4e63-a024-3688c2b38970\") " pod="cert-manager/cert-manager-55b4d954d5-hbnjv"
Sep 11 21:10:01.888898 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:01.888780    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a8dcd23a-52df-4e63-a024-3688c2b38970-bound-sa-token\") pod \"cert-manager-55b4d954d5-hbnjv\" (UID: \"a8dcd23a-52df-4e63-a024-3688c2b38970\") " pod="cert-manager/cert-manager-55b4d954d5-hbnjv"
Sep 11 21:10:01.989837 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:01.989794    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpxbp\" (UniqueName: \"kubernetes.io/projected/a8dcd23a-52df-4e63-a024-3688c2b38970-kube-api-access-gpxbp\") pod \"cert-manager-55b4d954d5-hbnjv\" (UID: \"a8dcd23a-52df-4e63-a024-3688c2b38970\") " pod="cert-manager/cert-manager-55b4d954d5-hbnjv"
Sep 11 21:10:01.990025 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:01.989871    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a8dcd23a-52df-4e63-a024-3688c2b38970-bound-sa-token\") pod \"cert-manager-55b4d954d5-hbnjv\" (UID: \"a8dcd23a-52df-4e63-a024-3688c2b38970\") " pod="cert-manager/cert-manager-55b4d954d5-hbnjv"
Sep 11 21:10:01.998377 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:01.998339    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpxbp\" (UniqueName: \"kubernetes.io/projected/a8dcd23a-52df-4e63-a024-3688c2b38970-kube-api-access-gpxbp\") pod \"cert-manager-55b4d954d5-hbnjv\" (UID: \"a8dcd23a-52df-4e63-a024-3688c2b38970\") " pod="cert-manager/cert-manager-55b4d954d5-hbnjv"
Sep 11 21:10:01.998532 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:01.998341    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a8dcd23a-52df-4e63-a024-3688c2b38970-bound-sa-token\") pod \"cert-manager-55b4d954d5-hbnjv\" (UID: \"a8dcd23a-52df-4e63-a024-3688c2b38970\") " pod="cert-manager/cert-manager-55b4d954d5-hbnjv"
Sep 11 21:10:02.069492 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:02.069375    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-hbnjv"
Sep 11 21:10:02.340710 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:02.340680    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-hbnjv"]
Sep 11 21:10:02.343483 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:10:02.343441    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda8dcd23a_52df_4e63_a024_3688c2b38970.slice/crio-777aad931c470f07bd41bb375ac95fd995f771d5bc3006f644fbdbee21cb4b2a WatchSource:0}: Error finding container 777aad931c470f07bd41bb375ac95fd995f771d5bc3006f644fbdbee21cb4b2a: Status 404 returned error can't find the container with id 777aad931c470f07bd41bb375ac95fd995f771d5bc3006f644fbdbee21cb4b2a
Sep 11 21:10:02.387962 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:02.387928    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-hbnjv" event={"ID":"a8dcd23a-52df-4e63-a024-3688c2b38970","Type":"ContainerStarted","Data":"777aad931c470f07bd41bb375ac95fd995f771d5bc3006f644fbdbee21cb4b2a"}
Sep 11 21:10:03.393531 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:03.393491    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-hbnjv" event={"ID":"a8dcd23a-52df-4e63-a024-3688c2b38970","Type":"ContainerStarted","Data":"72fb3f3cd75e2a7a2cab951e7e6e28e24a53b46ec70bfef1c439e5d003a52ff8"}
Sep 11 21:10:03.413949 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:03.413888    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-hbnjv" podStartSLOduration=2.413870075 podStartE2EDuration="2.413870075s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:10:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:10:03.412704178 +0000 UTC m=+248.891016021" watchObservedRunningTime="2026-09-11 21:10:03.413870075 +0000 UTC m=+248.892181918"
Sep 11 21:10:26.160891 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:26.160855    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8457b95c77-5fx2k"]
Sep 11 21:10:26.163267 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:26.163250    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8457b95c77-5fx2k"
Sep 11 21:10:26.168692 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:26.168667    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 11 21:10:26.169116 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:26.169096    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 11 21:10:26.169241 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:26.169219    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 11 21:10:26.169310 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:26.169219    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 11 21:10:26.169570 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:26.169552    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7vdb9\""
Sep 11 21:10:26.186279 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:26.186248    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8457b95c77-5fx2k"]
Sep 11 21:10:26.207755 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:26.207713    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dc0cf857-9126-4637-8d89-801895206e1e-webhook-cert\") pod \"opendatahub-operator-controller-manager-8457b95c77-5fx2k\" (UID: \"dc0cf857-9126-4637-8d89-801895206e1e\") " pod="opendatahub/opendatahub-operator-controller-manager-8457b95c77-5fx2k"
Sep 11 21:10:26.207967 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:26.207767    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/dc0cf857-9126-4637-8d89-801895206e1e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8457b95c77-5fx2k\" (UID: \"dc0cf857-9126-4637-8d89-801895206e1e\") " pod="opendatahub/opendatahub-operator-controller-manager-8457b95c77-5fx2k"
Sep 11 21:10:26.207967 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:26.207802    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5mw8\" (UniqueName: \"kubernetes.io/projected/dc0cf857-9126-4637-8d89-801895206e1e-kube-api-access-t5mw8\") pod \"opendatahub-operator-controller-manager-8457b95c77-5fx2k\" (UID: \"dc0cf857-9126-4637-8d89-801895206e1e\") " pod="opendatahub/opendatahub-operator-controller-manager-8457b95c77-5fx2k"
Sep 11 21:10:26.207967 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:26.207825    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc0cf857-9126-4637-8d89-801895206e1e-tmp\") pod \"opendatahub-operator-controller-manager-8457b95c77-5fx2k\" (UID: \"dc0cf857-9126-4637-8d89-801895206e1e\") " pod="opendatahub/opendatahub-operator-controller-manager-8457b95c77-5fx2k"
Sep 11 21:10:26.207967 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:26.207939    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/dc0cf857-9126-4637-8d89-801895206e1e-manifests\") pod \"opendatahub-operator-controller-manager-8457b95c77-5fx2k\" (UID: \"dc0cf857-9126-4637-8d89-801895206e1e\") " pod="opendatahub/opendatahub-operator-controller-manager-8457b95c77-5fx2k"
Sep 11 21:10:26.309150 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:26.309116    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/dc0cf857-9126-4637-8d89-801895206e1e-manifests\") pod \"opendatahub-operator-controller-manager-8457b95c77-5fx2k\" (UID: \"dc0cf857-9126-4637-8d89-801895206e1e\") " pod="opendatahub/opendatahub-operator-controller-manager-8457b95c77-5fx2k"
Sep 11 21:10:26.309352 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:26.309163    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dc0cf857-9126-4637-8d89-801895206e1e-webhook-cert\") pod \"opendatahub-operator-controller-manager-8457b95c77-5fx2k\" (UID: \"dc0cf857-9126-4637-8d89-801895206e1e\") " pod="opendatahub/opendatahub-operator-controller-manager-8457b95c77-5fx2k"
Sep 11 21:10:26.309352 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:26.309212    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/dc0cf857-9126-4637-8d89-801895206e1e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8457b95c77-5fx2k\" (UID: \"dc0cf857-9126-4637-8d89-801895206e1e\") " pod="opendatahub/opendatahub-operator-controller-manager-8457b95c77-5fx2k"
Sep 11 21:10:26.309352 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:26.309256    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5mw8\" (UniqueName: \"kubernetes.io/projected/dc0cf857-9126-4637-8d89-801895206e1e-kube-api-access-t5mw8\") pod \"opendatahub-operator-controller-manager-8457b95c77-5fx2k\" (UID: \"dc0cf857-9126-4637-8d89-801895206e1e\") " pod="opendatahub/opendatahub-operator-controller-manager-8457b95c77-5fx2k"
Sep 11 21:10:26.309352 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:26.309288    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc0cf857-9126-4637-8d89-801895206e1e-tmp\") pod \"opendatahub-operator-controller-manager-8457b95c77-5fx2k\" (UID: \"dc0cf857-9126-4637-8d89-801895206e1e\") " pod="opendatahub/opendatahub-operator-controller-manager-8457b95c77-5fx2k"
Sep 11 21:10:26.309608 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:26.309581    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/dc0cf857-9126-4637-8d89-801895206e1e-manifests\") pod \"opendatahub-operator-controller-manager-8457b95c77-5fx2k\" (UID: \"dc0cf857-9126-4637-8d89-801895206e1e\") " pod="opendatahub/opendatahub-operator-controller-manager-8457b95c77-5fx2k"
Sep 11 21:10:26.311633 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:26.311602    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc0cf857-9126-4637-8d89-801895206e1e-tmp\") pod \"opendatahub-operator-controller-manager-8457b95c77-5fx2k\" (UID: \"dc0cf857-9126-4637-8d89-801895206e1e\") " pod="opendatahub/opendatahub-operator-controller-manager-8457b95c77-5fx2k"
Sep 11 21:10:26.311852 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:26.311834    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/dc0cf857-9126-4637-8d89-801895206e1e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8457b95c77-5fx2k\" (UID: \"dc0cf857-9126-4637-8d89-801895206e1e\") " pod="opendatahub/opendatahub-operator-controller-manager-8457b95c77-5fx2k"
Sep 11 21:10:26.311973 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:26.311951    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dc0cf857-9126-4637-8d89-801895206e1e-webhook-cert\") pod \"opendatahub-operator-controller-manager-8457b95c77-5fx2k\" (UID: \"dc0cf857-9126-4637-8d89-801895206e1e\") " pod="opendatahub/opendatahub-operator-controller-manager-8457b95c77-5fx2k"
Sep 11 21:10:26.319080 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:26.319048    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5mw8\" (UniqueName: \"kubernetes.io/projected/dc0cf857-9126-4637-8d89-801895206e1e-kube-api-access-t5mw8\") pod \"opendatahub-operator-controller-manager-8457b95c77-5fx2k\" (UID: \"dc0cf857-9126-4637-8d89-801895206e1e\") " pod="opendatahub/opendatahub-operator-controller-manager-8457b95c77-5fx2k"
Sep 11 21:10:26.475040 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:26.474932    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8457b95c77-5fx2k"
Sep 11 21:10:26.758862 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:26.758832    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8457b95c77-5fx2k"]
Sep 11 21:10:26.761461 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:10:26.761426    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc0cf857_9126_4637_8d89_801895206e1e.slice/crio-2f3f81f2b1f202d34838ed5e7989184a2d85c47cd19bb4b00572d3d8abd4cc2c WatchSource:0}: Error finding container 2f3f81f2b1f202d34838ed5e7989184a2d85c47cd19bb4b00572d3d8abd4cc2c: Status 404 returned error can't find the container with id 2f3f81f2b1f202d34838ed5e7989184a2d85c47cd19bb4b00572d3d8abd4cc2c
Sep 11 21:10:27.507415 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:27.507352    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8457b95c77-5fx2k" event={"ID":"dc0cf857-9126-4637-8d89-801895206e1e","Type":"ContainerStarted","Data":"2f3f81f2b1f202d34838ed5e7989184a2d85c47cd19bb4b00572d3d8abd4cc2c"}
Sep 11 21:10:30.524162 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:30.524124    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8457b95c77-5fx2k" event={"ID":"dc0cf857-9126-4637-8d89-801895206e1e","Type":"ContainerStarted","Data":"c532449dfd72957e058045c95b670be78c318bde8b946123faa207944d1bc249"}
Sep 11 21:10:31.530482 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:31.530445    2560 generic.go:356] "Generic (PLEG): container finished" podID="dc0cf857-9126-4637-8d89-801895206e1e" containerID="c532449dfd72957e058045c95b670be78c318bde8b946123faa207944d1bc249" exitCode=0
Sep 11 21:10:31.530871 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:31.530527    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8457b95c77-5fx2k" event={"ID":"dc0cf857-9126-4637-8d89-801895206e1e","Type":"ContainerDied","Data":"c532449dfd72957e058045c95b670be78c318bde8b946123faa207944d1bc249"}
Sep 11 21:10:32.537429 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:32.537364    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8457b95c77-5fx2k" event={"ID":"dc0cf857-9126-4637-8d89-801895206e1e","Type":"ContainerStarted","Data":"ad0dd12ac7f60b7fc2b052a30a9da44acce44ea4eb5bef7c11c21f089a5e6a12"}
Sep 11 21:10:32.537842 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:32.537528    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-8457b95c77-5fx2k"
Sep 11 21:10:32.563195 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:32.563140    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-8457b95c77-5fx2k" podStartSLOduration=1.957009152 podStartE2EDuration="6.563120799s" totalImagesPullingTime="3.558541665s" totalInitContainerRuntime="1.047569982s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:10:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:10:32.561366234 +0000 UTC m=+278.039678080" watchObservedRunningTime="2026-09-11 21:10:32.563120799 +0000 UTC m=+278.041432642"
Sep 11 21:10:43.543833 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:43.543795    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-8457b95c77-5fx2k"
Sep 11 21:10:46.888659 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:46.888619    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-65cc4f94dc-hz7qj"]
Sep 11 21:10:46.891941 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:46.891922    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-65cc4f94dc-hz7qj"
Sep 11 21:10:46.895817 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:46.895789    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 11 21:10:46.896057 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:46.896028    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 11 21:10:46.896146 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:46.896076    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 11 21:10:46.896146 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:46.896090    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 11 21:10:46.896146 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:46.896122    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-9qf8r\""
Sep 11 21:10:46.896292 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:46.896076    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 11 21:10:46.903413 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:46.903374    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-65cc4f94dc-hz7qj"]
Sep 11 21:10:47.002052 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:47.002017    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/252bc330-8472-4403-8b79-f79d44371014-metrics-cert\") pod \"lws-controller-manager-65cc4f94dc-hz7qj\" (UID: \"252bc330-8472-4403-8b79-f79d44371014\") " pod="openshift-lws-operator/lws-controller-manager-65cc4f94dc-hz7qj"
Sep 11 21:10:47.002244 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:47.002072    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/252bc330-8472-4403-8b79-f79d44371014-manager-config\") pod \"lws-controller-manager-65cc4f94dc-hz7qj\" (UID: \"252bc330-8472-4403-8b79-f79d44371014\") " pod="openshift-lws-operator/lws-controller-manager-65cc4f94dc-hz7qj"
Sep 11 21:10:47.002244 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:47.002122    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/252bc330-8472-4403-8b79-f79d44371014-cert\") pod \"lws-controller-manager-65cc4f94dc-hz7qj\" (UID: \"252bc330-8472-4403-8b79-f79d44371014\") " pod="openshift-lws-operator/lws-controller-manager-65cc4f94dc-hz7qj"
Sep 11 21:10:47.002244 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:47.002201    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92nhs\" (UniqueName: \"kubernetes.io/projected/252bc330-8472-4403-8b79-f79d44371014-kube-api-access-92nhs\") pod \"lws-controller-manager-65cc4f94dc-hz7qj\" (UID: \"252bc330-8472-4403-8b79-f79d44371014\") " pod="openshift-lws-operator/lws-controller-manager-65cc4f94dc-hz7qj"
Sep 11 21:10:47.103733 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:47.103690    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/252bc330-8472-4403-8b79-f79d44371014-metrics-cert\") pod \"lws-controller-manager-65cc4f94dc-hz7qj\" (UID: \"252bc330-8472-4403-8b79-f79d44371014\") " pod="openshift-lws-operator/lws-controller-manager-65cc4f94dc-hz7qj"
Sep 11 21:10:47.103941 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:47.103744    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/252bc330-8472-4403-8b79-f79d44371014-manager-config\") pod \"lws-controller-manager-65cc4f94dc-hz7qj\" (UID: \"252bc330-8472-4403-8b79-f79d44371014\") " pod="openshift-lws-operator/lws-controller-manager-65cc4f94dc-hz7qj"
Sep 11 21:10:47.103941 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:47.103818    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/252bc330-8472-4403-8b79-f79d44371014-cert\") pod \"lws-controller-manager-65cc4f94dc-hz7qj\" (UID: \"252bc330-8472-4403-8b79-f79d44371014\") " pod="openshift-lws-operator/lws-controller-manager-65cc4f94dc-hz7qj"
Sep 11 21:10:47.103941 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:47.103872    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92nhs\" (UniqueName: \"kubernetes.io/projected/252bc330-8472-4403-8b79-f79d44371014-kube-api-access-92nhs\") pod \"lws-controller-manager-65cc4f94dc-hz7qj\" (UID: \"252bc330-8472-4403-8b79-f79d44371014\") " pod="openshift-lws-operator/lws-controller-manager-65cc4f94dc-hz7qj"
Sep 11 21:10:47.104492 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:47.104468    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/252bc330-8472-4403-8b79-f79d44371014-manager-config\") pod \"lws-controller-manager-65cc4f94dc-hz7qj\" (UID: \"252bc330-8472-4403-8b79-f79d44371014\") " pod="openshift-lws-operator/lws-controller-manager-65cc4f94dc-hz7qj"
Sep 11 21:10:47.106273 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:47.106242    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/252bc330-8472-4403-8b79-f79d44371014-metrics-cert\") pod \"lws-controller-manager-65cc4f94dc-hz7qj\" (UID: \"252bc330-8472-4403-8b79-f79d44371014\") " pod="openshift-lws-operator/lws-controller-manager-65cc4f94dc-hz7qj"
Sep 11 21:10:47.106428 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:47.106407    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/252bc330-8472-4403-8b79-f79d44371014-cert\") pod \"lws-controller-manager-65cc4f94dc-hz7qj\" (UID: \"252bc330-8472-4403-8b79-f79d44371014\") " pod="openshift-lws-operator/lws-controller-manager-65cc4f94dc-hz7qj"
Sep 11 21:10:47.115575 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:47.115543    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92nhs\" (UniqueName: \"kubernetes.io/projected/252bc330-8472-4403-8b79-f79d44371014-kube-api-access-92nhs\") pod \"lws-controller-manager-65cc4f94dc-hz7qj\" (UID: \"252bc330-8472-4403-8b79-f79d44371014\") " pod="openshift-lws-operator/lws-controller-manager-65cc4f94dc-hz7qj"
Sep 11 21:10:47.202512 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:47.202421    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-65cc4f94dc-hz7qj"
Sep 11 21:10:47.492046 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:47.492020    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-65cc4f94dc-hz7qj"]
Sep 11 21:10:47.494302 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:10:47.494275    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod252bc330_8472_4403_8b79_f79d44371014.slice/crio-328609893cd7097cca28b4ab4e6f69c65df7639e08381ba42992925dd2654d2f WatchSource:0}: Error finding container 328609893cd7097cca28b4ab4e6f69c65df7639e08381ba42992925dd2654d2f: Status 404 returned error can't find the container with id 328609893cd7097cca28b4ab4e6f69c65df7639e08381ba42992925dd2654d2f
Sep 11 21:10:47.622614 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:47.622577    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-65cc4f94dc-hz7qj" event={"ID":"252bc330-8472-4403-8b79-f79d44371014","Type":"ContainerStarted","Data":"328609893cd7097cca28b4ab4e6f69c65df7639e08381ba42992925dd2654d2f"}
Sep 11 21:10:50.640161 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:50.640125    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-65cc4f94dc-hz7qj" event={"ID":"252bc330-8472-4403-8b79-f79d44371014","Type":"ContainerStarted","Data":"52d2f10a41dba6db4970cbacf2a51d8a87a45642d0b051e69c1f1114f3ffc98c"}
Sep 11 21:10:50.640572 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:50.640212    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-65cc4f94dc-hz7qj"
Sep 11 21:10:50.659249 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:50.659186    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-65cc4f94dc-hz7qj" podStartSLOduration=1.888553567 podStartE2EDuration="4.659169104s" totalImagesPullingTime="2.770615537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:10:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:10:50.657498491 +0000 UTC m=+296.135810336" watchObservedRunningTime="2026-09-11 21:10:50.659169104 +0000 UTC m=+296.137480948"
Sep 11 21:10:52.715310 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:52.715280    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg"]
Sep 11 21:10:52.718824 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:52.718803    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg"
Sep 11 21:10:52.721811 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:52.721790    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 11 21:10:52.721944 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:52.721832    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 11 21:10:52.721944 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:52.721793    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-fn4j6\""
Sep 11 21:10:52.721944 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:52.721873    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 11 21:10:52.730448 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:52.730425    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg"]
Sep 11 21:10:52.860092 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:52.860052    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fdft\" (UniqueName: \"kubernetes.io/projected/79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d-kube-api-access-8fdft\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg\" (UID: \"79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg"
Sep 11 21:10:52.860092 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:52.860098    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg\" (UID: \"79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg"
Sep 11 21:10:52.860304 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:52.860119    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg\" (UID: \"79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg"
Sep 11 21:10:52.860304 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:52.860136    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg\" (UID: \"79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg"
Sep 11 21:10:52.860304 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:52.860200    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg\" (UID: \"79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg"
Sep 11 21:10:52.860304 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:52.860274    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg\" (UID: \"79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg"
Sep 11 21:10:52.860304 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:52.860300    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg\" (UID: \"79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg"
Sep 11 21:10:52.860498 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:52.860354    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg\" (UID: \"79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg"
Sep 11 21:10:52.860498 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:52.860371    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg\" (UID: \"79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg"
Sep 11 21:10:52.961912 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:52.961871    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg\" (UID: \"79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg"
Sep 11 21:10:52.961912 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:52.961914    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg\" (UID: \"79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg"
Sep 11 21:10:52.962224 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:52.961951    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg\" (UID: \"79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg"
Sep 11 21:10:52.962224 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:52.961968    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg\" (UID: \"79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg"
Sep 11 21:10:52.962224 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:52.961995    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fdft\" (UniqueName: \"kubernetes.io/projected/79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d-kube-api-access-8fdft\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg\" (UID: \"79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg"
Sep 11 21:10:52.962224 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:52.962016    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg\" (UID: \"79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg"
Sep 11 21:10:52.962224 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:52.962075    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg\" (UID: \"79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg"
Sep 11 21:10:52.962224 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:52.962118    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg\" (UID: \"79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg"
Sep 11 21:10:52.962224 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:52.962157    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg\" (UID: \"79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg"
Sep 11 21:10:52.962773 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:52.962706    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg\" (UID: \"79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg"
Sep 11 21:10:52.962872 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:52.962845    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg\" (UID: \"79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg"
Sep 11 21:10:52.962985 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:52.962353    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg\" (UID: \"79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg"
Sep 11 21:10:52.963093 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:52.962981    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg\" (UID: \"79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg"
Sep 11 21:10:52.963263 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:52.963235    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg\" (UID: \"79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg"
Sep 11 21:10:52.969318 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:52.965409    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg\" (UID: \"79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg"
Sep 11 21:10:52.970321 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:52.970293    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg\" (UID: \"79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg"
Sep 11 21:10:52.971272 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:52.971245    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg\" (UID: \"79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg"
Sep 11 21:10:52.971470 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:52.971450    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fdft\" (UniqueName: \"kubernetes.io/projected/79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d-kube-api-access-8fdft\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg\" (UID: \"79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg"
Sep 11 21:10:53.029558 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:53.029516    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg"
Sep 11 21:10:53.309820 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:53.309793    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg"]
Sep 11 21:10:53.311965 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:10:53.311936    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79dd5c97_fcb7_4d9a_9f8c_884d10ee9b6d.slice/crio-8cc90ca52af271a04eff54d5f3cdf52a508fa3094a62f49622f7fe7b03083890 WatchSource:0}: Error finding container 8cc90ca52af271a04eff54d5f3cdf52a508fa3094a62f49622f7fe7b03083890: Status 404 returned error can't find the container with id 8cc90ca52af271a04eff54d5f3cdf52a508fa3094a62f49622f7fe7b03083890
Sep 11 21:10:53.656460 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:53.656422    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg" event={"ID":"79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d","Type":"ContainerStarted","Data":"8cc90ca52af271a04eff54d5f3cdf52a508fa3094a62f49622f7fe7b03083890"}
Sep 11 21:10:55.000344 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:55.000314    2560 kubelet.go:1648] "Image garbage collection succeeded"
Sep 11 21:10:56.138927 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:56.138622    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:10:56.138927 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:56.138696    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:10:56.138927 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:56.138751    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:10:56.677780 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:56.677741    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg" event={"ID":"79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d","Type":"ContainerStarted","Data":"19a34502f107275aecde793558a73c32e5ee68f0ed84a39c666d52fb57aac67c"}
Sep 11 21:10:56.704678 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:56.699875    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg" podStartSLOduration=1.875690027 podStartE2EDuration="4.699849389s" totalImagesPullingTime="2.824159362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:10:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:10:56.697859211 +0000 UTC m=+302.176171056" watchObservedRunningTime="2026-09-11 21:10:56.699849389 +0000 UTC m=+302.178161234"
Sep 11 21:10:57.029905 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:57.029815    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg"
Sep 11 21:10:57.037333 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:57.037302    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg"
Sep 11 21:10:57.683054 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:57.683024    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg"
Sep 11 21:10:57.684164 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:10:57.684140    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg"
Sep 11 21:11:01.648609 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:11:01.648572    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-65cc4f94dc-hz7qj"
Sep 11 21:11:05.943035 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:11:05.942997    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-sdtcl"]
Sep 11 21:11:05.950805 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:11:05.950780    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sdtcl"
Sep 11 21:11:05.956487 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:11:05.956459    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 11 21:11:05.957758 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:11:05.957728    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-86zcx\""
Sep 11 21:11:05.964276 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:11:05.964251    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-sdtcl"]
Sep 11 21:11:05.986158 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:11:05.986127    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e86be524-7e9c-4e39-9e86-d10c3305bd4d-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-sdtcl\" (UID: \"e86be524-7e9c-4e39-9e86-d10c3305bd4d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sdtcl"
Sep 11 21:11:05.986328 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:11:05.986175    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j95r5\" (UniqueName: \"kubernetes.io/projected/e86be524-7e9c-4e39-9e86-d10c3305bd4d-kube-api-access-j95r5\") pod \"llmisvc-controller-manager-777c6bd7d5-sdtcl\" (UID: \"e86be524-7e9c-4e39-9e86-d10c3305bd4d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sdtcl"
Sep 11 21:11:06.086656 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:11:06.086618    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j95r5\" (UniqueName: \"kubernetes.io/projected/e86be524-7e9c-4e39-9e86-d10c3305bd4d-kube-api-access-j95r5\") pod \"llmisvc-controller-manager-777c6bd7d5-sdtcl\" (UID: \"e86be524-7e9c-4e39-9e86-d10c3305bd4d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sdtcl"
Sep 11 21:11:06.086827 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:11:06.086771    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e86be524-7e9c-4e39-9e86-d10c3305bd4d-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-sdtcl\" (UID: \"e86be524-7e9c-4e39-9e86-d10c3305bd4d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sdtcl"
Sep 11 21:11:06.086910 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:11:06.086893    2560 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Sep 11 21:11:06.086986 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:11:06.086975    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e86be524-7e9c-4e39-9e86-d10c3305bd4d-cert podName:e86be524-7e9c-4e39-9e86-d10c3305bd4d nodeName:}" failed. No retries permitted until 2026-09-11 21:11:06.586952719 +0000 UTC m=+312.065264565 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e86be524-7e9c-4e39-9e86-d10c3305bd4d-cert") pod "llmisvc-controller-manager-777c6bd7d5-sdtcl" (UID: "e86be524-7e9c-4e39-9e86-d10c3305bd4d") : secret "llmisvc-webhook-server-cert" not found
Sep 11 21:11:06.113026 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:11:06.112994    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j95r5\" (UniqueName: \"kubernetes.io/projected/e86be524-7e9c-4e39-9e86-d10c3305bd4d-kube-api-access-j95r5\") pod \"llmisvc-controller-manager-777c6bd7d5-sdtcl\" (UID: \"e86be524-7e9c-4e39-9e86-d10c3305bd4d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sdtcl"
Sep 11 21:11:06.590964 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:11:06.590918    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e86be524-7e9c-4e39-9e86-d10c3305bd4d-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-sdtcl\" (UID: \"e86be524-7e9c-4e39-9e86-d10c3305bd4d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sdtcl"
Sep 11 21:11:06.593521 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:11:06.593482    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e86be524-7e9c-4e39-9e86-d10c3305bd4d-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-sdtcl\" (UID: \"e86be524-7e9c-4e39-9e86-d10c3305bd4d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sdtcl"
Sep 11 21:11:06.862704 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:11:06.862617    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sdtcl"
Sep 11 21:11:07.147104 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:11:07.147080    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-sdtcl"]
Sep 11 21:11:07.149436 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:11:07.149405    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode86be524_7e9c_4e39_9e86_d10c3305bd4d.slice/crio-6a1a4f7645ffd203845b2bc4fecc0f0b6ae95fd4804794200c8d93d3a486eed2 WatchSource:0}: Error finding container 6a1a4f7645ffd203845b2bc4fecc0f0b6ae95fd4804794200c8d93d3a486eed2: Status 404 returned error can't find the container with id 6a1a4f7645ffd203845b2bc4fecc0f0b6ae95fd4804794200c8d93d3a486eed2
Sep 11 21:11:07.150966 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:11:07.150944    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 21:11:07.731751 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:11:07.731710    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sdtcl" event={"ID":"e86be524-7e9c-4e39-9e86-d10c3305bd4d","Type":"ContainerStarted","Data":"6a1a4f7645ffd203845b2bc4fecc0f0b6ae95fd4804794200c8d93d3a486eed2"}
Sep 11 21:11:10.747806 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:11:10.747762    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sdtcl" event={"ID":"e86be524-7e9c-4e39-9e86-d10c3305bd4d","Type":"ContainerStarted","Data":"5158ef4ecd09ce12223f01e5d40685effa096128199e8abe19d3aefc682c541f"}
Sep 11 21:11:10.748182 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:11:10.747836    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sdtcl"
Sep 11 21:11:41.754994 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:11:41.754963    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sdtcl"
Sep 11 21:11:41.773447 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:11:41.773368    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sdtcl" podStartSLOduration=34.045113984 podStartE2EDuration="36.773350122s" totalImagesPullingTime="2.728236138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:11:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:11:10.777803882 +0000 UTC m=+316.256115737" watchObservedRunningTime="2026-09-11 21:11:41.773350122 +0000 UTC m=+347.251661966"
Sep 11 21:12:12.034089 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:12.034003    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-545b6cc544-cj66x"]
Sep 11 21:12:12.037808 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:12.037786    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-545b6cc544-cj66x"
Sep 11 21:12:12.041413 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:12.041211    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 11 21:12:12.041413 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:12.041241    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 11 21:12:12.041413 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:12.041273    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 11 21:12:12.041413 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:12.041289    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 11 21:12:12.041413 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:12.041295    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 11 21:12:12.041413 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:12.041240    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 11 21:12:12.041413 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:12.041245    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 11 21:12:12.041883 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:12.041722    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jgwp6\""
Sep 11 21:12:12.046455 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:12.046436    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 11 21:12:12.050866 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:12.050842    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-545b6cc544-cj66x"]
Sep 11 21:12:12.213215 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:12.213180    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37f4ca1a-eab9-4c79-ae6b-5150b8d2e853-oauth-serving-cert\") pod \"console-545b6cc544-cj66x\" (UID: \"37f4ca1a-eab9-4c79-ae6b-5150b8d2e853\") " pod="openshift-console/console-545b6cc544-cj66x"
Sep 11 21:12:12.213215 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:12.213218    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37f4ca1a-eab9-4c79-ae6b-5150b8d2e853-console-config\") pod \"console-545b6cc544-cj66x\" (UID: \"37f4ca1a-eab9-4c79-ae6b-5150b8d2e853\") " pod="openshift-console/console-545b6cc544-cj66x"
Sep 11 21:12:12.213487 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:12.213237    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37f4ca1a-eab9-4c79-ae6b-5150b8d2e853-console-oauth-config\") pod \"console-545b6cc544-cj66x\" (UID: \"37f4ca1a-eab9-4c79-ae6b-5150b8d2e853\") " pod="openshift-console/console-545b6cc544-cj66x"
Sep 11 21:12:12.213487 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:12.213333    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvkzp\" (UniqueName: \"kubernetes.io/projected/37f4ca1a-eab9-4c79-ae6b-5150b8d2e853-kube-api-access-gvkzp\") pod \"console-545b6cc544-cj66x\" (UID: \"37f4ca1a-eab9-4c79-ae6b-5150b8d2e853\") " pod="openshift-console/console-545b6cc544-cj66x"
Sep 11 21:12:12.213487 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:12.213372    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37f4ca1a-eab9-4c79-ae6b-5150b8d2e853-console-serving-cert\") pod \"console-545b6cc544-cj66x\" (UID: \"37f4ca1a-eab9-4c79-ae6b-5150b8d2e853\") " pod="openshift-console/console-545b6cc544-cj66x"
Sep 11 21:12:12.213487 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:12.213403    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37f4ca1a-eab9-4c79-ae6b-5150b8d2e853-service-ca\") pod \"console-545b6cc544-cj66x\" (UID: \"37f4ca1a-eab9-4c79-ae6b-5150b8d2e853\") " pod="openshift-console/console-545b6cc544-cj66x"
Sep 11 21:12:12.213487 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:12.213426    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37f4ca1a-eab9-4c79-ae6b-5150b8d2e853-trusted-ca-bundle\") pod \"console-545b6cc544-cj66x\" (UID: \"37f4ca1a-eab9-4c79-ae6b-5150b8d2e853\") " pod="openshift-console/console-545b6cc544-cj66x"
Sep 11 21:12:12.315020 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:12.314931    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37f4ca1a-eab9-4c79-ae6b-5150b8d2e853-oauth-serving-cert\") pod \"console-545b6cc544-cj66x\" (UID: \"37f4ca1a-eab9-4c79-ae6b-5150b8d2e853\") " pod="openshift-console/console-545b6cc544-cj66x"
Sep 11 21:12:12.315020 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:12.314976    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37f4ca1a-eab9-4c79-ae6b-5150b8d2e853-console-config\") pod \"console-545b6cc544-cj66x\" (UID: \"37f4ca1a-eab9-4c79-ae6b-5150b8d2e853\") " pod="openshift-console/console-545b6cc544-cj66x"
Sep 11 21:12:12.315020 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:12.315001    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37f4ca1a-eab9-4c79-ae6b-5150b8d2e853-console-oauth-config\") pod \"console-545b6cc544-cj66x\" (UID: \"37f4ca1a-eab9-4c79-ae6b-5150b8d2e853\") " pod="openshift-console/console-545b6cc544-cj66x"
Sep 11 21:12:12.315311 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:12.315047    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvkzp\" (UniqueName: \"kubernetes.io/projected/37f4ca1a-eab9-4c79-ae6b-5150b8d2e853-kube-api-access-gvkzp\") pod \"console-545b6cc544-cj66x\" (UID: \"37f4ca1a-eab9-4c79-ae6b-5150b8d2e853\") " pod="openshift-console/console-545b6cc544-cj66x"
Sep 11 21:12:12.315311 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:12.315083    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37f4ca1a-eab9-4c79-ae6b-5150b8d2e853-console-serving-cert\") pod \"console-545b6cc544-cj66x\" (UID: \"37f4ca1a-eab9-4c79-ae6b-5150b8d2e853\") " pod="openshift-console/console-545b6cc544-cj66x"
Sep 11 21:12:12.315311 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:12.315105    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37f4ca1a-eab9-4c79-ae6b-5150b8d2e853-service-ca\") pod \"console-545b6cc544-cj66x\" (UID: \"37f4ca1a-eab9-4c79-ae6b-5150b8d2e853\") " pod="openshift-console/console-545b6cc544-cj66x"
Sep 11 21:12:12.315311 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:12.315132    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37f4ca1a-eab9-4c79-ae6b-5150b8d2e853-trusted-ca-bundle\") pod \"console-545b6cc544-cj66x\" (UID: \"37f4ca1a-eab9-4c79-ae6b-5150b8d2e853\") " pod="openshift-console/console-545b6cc544-cj66x"
Sep 11 21:12:12.315742 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:12.315715    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37f4ca1a-eab9-4c79-ae6b-5150b8d2e853-oauth-serving-cert\") pod \"console-545b6cc544-cj66x\" (UID: \"37f4ca1a-eab9-4c79-ae6b-5150b8d2e853\") " pod="openshift-console/console-545b6cc544-cj66x"
Sep 11 21:12:12.315901 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:12.315876    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37f4ca1a-eab9-4c79-ae6b-5150b8d2e853-console-config\") pod \"console-545b6cc544-cj66x\" (UID: \"37f4ca1a-eab9-4c79-ae6b-5150b8d2e853\") " pod="openshift-console/console-545b6cc544-cj66x"
Sep 11 21:12:12.316034 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:12.316013    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37f4ca1a-eab9-4c79-ae6b-5150b8d2e853-trusted-ca-bundle\") pod \"console-545b6cc544-cj66x\" (UID: \"37f4ca1a-eab9-4c79-ae6b-5150b8d2e853\") " pod="openshift-console/console-545b6cc544-cj66x"
Sep 11 21:12:12.316306 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:12.316291    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37f4ca1a-eab9-4c79-ae6b-5150b8d2e853-service-ca\") pod \"console-545b6cc544-cj66x\" (UID: \"37f4ca1a-eab9-4c79-ae6b-5150b8d2e853\") " pod="openshift-console/console-545b6cc544-cj66x"
Sep 11 21:12:12.317634 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:12.317613    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37f4ca1a-eab9-4c79-ae6b-5150b8d2e853-console-oauth-config\") pod \"console-545b6cc544-cj66x\" (UID: \"37f4ca1a-eab9-4c79-ae6b-5150b8d2e853\") " pod="openshift-console/console-545b6cc544-cj66x"
Sep 11 21:12:12.318037 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:12.318018    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37f4ca1a-eab9-4c79-ae6b-5150b8d2e853-console-serving-cert\") pod \"console-545b6cc544-cj66x\" (UID: \"37f4ca1a-eab9-4c79-ae6b-5150b8d2e853\") " pod="openshift-console/console-545b6cc544-cj66x"
Sep 11 21:12:12.323848 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:12.323818    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvkzp\" (UniqueName: \"kubernetes.io/projected/37f4ca1a-eab9-4c79-ae6b-5150b8d2e853-kube-api-access-gvkzp\") pod \"console-545b6cc544-cj66x\" (UID: \"37f4ca1a-eab9-4c79-ae6b-5150b8d2e853\") " pod="openshift-console/console-545b6cc544-cj66x"
Sep 11 21:12:12.348900 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:12.348878    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-545b6cc544-cj66x"
Sep 11 21:12:12.638300 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:12.638275    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-545b6cc544-cj66x"]
Sep 11 21:12:12.641145 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:12:12.641105    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37f4ca1a_eab9_4c79_ae6b_5150b8d2e853.slice/crio-5fe2bda82d935dbf277dd4fe165964444f1dae49ccfd6f57713aa9aa89495f3b WatchSource:0}: Error finding container 5fe2bda82d935dbf277dd4fe165964444f1dae49ccfd6f57713aa9aa89495f3b: Status 404 returned error can't find the container with id 5fe2bda82d935dbf277dd4fe165964444f1dae49ccfd6f57713aa9aa89495f3b
Sep 11 21:12:13.038137 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:13.038061    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-545b6cc544-cj66x" event={"ID":"37f4ca1a-eab9-4c79-ae6b-5150b8d2e853","Type":"ContainerStarted","Data":"106e5f3752ebcefc96924d1bc1e31e40be072a0cb058f39f1aae20ea218fbfca"}
Sep 11 21:12:13.038137 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:13.038105    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-545b6cc544-cj66x" event={"ID":"37f4ca1a-eab9-4c79-ae6b-5150b8d2e853","Type":"ContainerStarted","Data":"5fe2bda82d935dbf277dd4fe165964444f1dae49ccfd6f57713aa9aa89495f3b"}
Sep 11 21:12:13.066428 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:13.066361    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-545b6cc544-cj66x" podStartSLOduration=1.066344535 podStartE2EDuration="1.066344535s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:12:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:12:13.065201068 +0000 UTC m=+378.543512929" watchObservedRunningTime="2026-09-11 21:12:13.066344535 +0000 UTC m=+378.544656452"
Sep 11 21:12:16.875640 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:16.875605    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8shw6"]
Sep 11 21:12:16.879299 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:16.879280    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8shw6"
Sep 11 21:12:16.881821 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:16.881794    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-gv44l\""
Sep 11 21:12:16.881977 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:16.881798    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 11 21:12:16.882076 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:16.882060    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 11 21:12:16.896691 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:16.896657    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8shw6"]
Sep 11 21:12:17.061468 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:17.061433    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8mzq\" (UniqueName: \"kubernetes.io/projected/ad68f914-e2c0-408a-abcc-da4bc6f489be-kube-api-access-m8mzq\") pod \"kuadrant-operator-controller-manager-76f8f686bf-8shw6\" (UID: \"ad68f914-e2c0-408a-abcc-da4bc6f489be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8shw6"
Sep 11 21:12:17.061658 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:17.061485    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ad68f914-e2c0-408a-abcc-da4bc6f489be-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-8shw6\" (UID: \"ad68f914-e2c0-408a-abcc-da4bc6f489be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8shw6"
Sep 11 21:12:17.162896 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:17.162800    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8mzq\" (UniqueName: \"kubernetes.io/projected/ad68f914-e2c0-408a-abcc-da4bc6f489be-kube-api-access-m8mzq\") pod \"kuadrant-operator-controller-manager-76f8f686bf-8shw6\" (UID: \"ad68f914-e2c0-408a-abcc-da4bc6f489be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8shw6"
Sep 11 21:12:17.162896 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:17.162855    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ad68f914-e2c0-408a-abcc-da4bc6f489be-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-8shw6\" (UID: \"ad68f914-e2c0-408a-abcc-da4bc6f489be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8shw6"
Sep 11 21:12:17.163322 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:17.163303    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ad68f914-e2c0-408a-abcc-da4bc6f489be-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-8shw6\" (UID: \"ad68f914-e2c0-408a-abcc-da4bc6f489be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8shw6"
Sep 11 21:12:17.171957 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:17.171929    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8mzq\" (UniqueName: \"kubernetes.io/projected/ad68f914-e2c0-408a-abcc-da4bc6f489be-kube-api-access-m8mzq\") pod \"kuadrant-operator-controller-manager-76f8f686bf-8shw6\" (UID: \"ad68f914-e2c0-408a-abcc-da4bc6f489be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8shw6"
Sep 11 21:12:17.190633 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:17.190595    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8shw6"
Sep 11 21:12:17.474604 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:17.474580    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8shw6"]
Sep 11 21:12:17.476816 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:12:17.476784    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad68f914_e2c0_408a_abcc_da4bc6f489be.slice/crio-53a50dcdc4b0ad2d50012cd255e012d9350a8b03f654dd6cb87680cd62f064f3 WatchSource:0}: Error finding container 53a50dcdc4b0ad2d50012cd255e012d9350a8b03f654dd6cb87680cd62f064f3: Status 404 returned error can't find the container with id 53a50dcdc4b0ad2d50012cd255e012d9350a8b03f654dd6cb87680cd62f064f3
Sep 11 21:12:18.062363 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:18.062325    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8shw6" event={"ID":"ad68f914-e2c0-408a-abcc-da4bc6f489be","Type":"ContainerStarted","Data":"53a50dcdc4b0ad2d50012cd255e012d9350a8b03f654dd6cb87680cd62f064f3"}
Sep 11 21:12:21.342609 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:21.342575    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-hdcdf"]
Sep 11 21:12:21.346352 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:21.346328    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hdcdf"
Sep 11 21:12:21.348753 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:21.348731    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-t2gjs\""
Sep 11 21:12:21.365436 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:21.365410    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-hdcdf"]
Sep 11 21:12:21.410510 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:21.410477    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfwl2\" (UniqueName: \"kubernetes.io/projected/21f8dc9c-6a38-4c56-aa80-3e38c7cb1b6a-kube-api-access-zfwl2\") pod \"limitador-operator-controller-manager-74495c69f8-hdcdf\" (UID: \"21f8dc9c-6a38-4c56-aa80-3e38c7cb1b6a\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hdcdf"
Sep 11 21:12:21.511804 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:21.511770    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfwl2\" (UniqueName: \"kubernetes.io/projected/21f8dc9c-6a38-4c56-aa80-3e38c7cb1b6a-kube-api-access-zfwl2\") pod \"limitador-operator-controller-manager-74495c69f8-hdcdf\" (UID: \"21f8dc9c-6a38-4c56-aa80-3e38c7cb1b6a\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hdcdf"
Sep 11 21:12:21.523530 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:21.523498    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfwl2\" (UniqueName: \"kubernetes.io/projected/21f8dc9c-6a38-4c56-aa80-3e38c7cb1b6a-kube-api-access-zfwl2\") pod \"limitador-operator-controller-manager-74495c69f8-hdcdf\" (UID: \"21f8dc9c-6a38-4c56-aa80-3e38c7cb1b6a\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hdcdf"
Sep 11 21:12:21.657341 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:21.657300    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hdcdf"
Sep 11 21:12:21.932149 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:21.932111    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-hdcdf"]
Sep 11 21:12:21.934935 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:12:21.934903    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21f8dc9c_6a38_4c56_aa80_3e38c7cb1b6a.slice/crio-22bf35f7b5b37c995e6aa443ced69c217b4739ea93dc2cb52f81d2ea846d94a1 WatchSource:0}: Error finding container 22bf35f7b5b37c995e6aa443ced69c217b4739ea93dc2cb52f81d2ea846d94a1: Status 404 returned error can't find the container with id 22bf35f7b5b37c995e6aa443ced69c217b4739ea93dc2cb52f81d2ea846d94a1
Sep 11 21:12:22.086473 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:22.086434    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8shw6" event={"ID":"ad68f914-e2c0-408a-abcc-da4bc6f489be","Type":"ContainerStarted","Data":"1b70897a6af5b1b74c41f7e33616ef3f48d15feac952953e11823c26c2825354"}
Sep 11 21:12:22.086667 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:22.086547    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8shw6"
Sep 11 21:12:22.087881 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:22.087854    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hdcdf" event={"ID":"21f8dc9c-6a38-4c56-aa80-3e38c7cb1b6a","Type":"ContainerStarted","Data":"22bf35f7b5b37c995e6aa443ced69c217b4739ea93dc2cb52f81d2ea846d94a1"}
Sep 11 21:12:22.114676 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:22.114631    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8shw6" podStartSLOduration=2.24226229 podStartE2EDuration="6.114616362s" totalImagesPullingTime="3.872354072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:12:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:12:22.114031548 +0000 UTC m=+387.592343406" watchObservedRunningTime="2026-09-11 21:12:22.114616362 +0000 UTC m=+387.592928207"
Sep 11 21:12:22.349690 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:22.349605    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-545b6cc544-cj66x"
Sep 11 21:12:22.349690 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:22.349681    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-545b6cc544-cj66x"
Sep 11 21:12:22.354340 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:22.354311    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-545b6cc544-cj66x"
Sep 11 21:12:23.100017 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:23.099986    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-545b6cc544-cj66x"
Sep 11 21:12:24.105746 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:24.105645    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hdcdf" event={"ID":"21f8dc9c-6a38-4c56-aa80-3e38c7cb1b6a","Type":"ContainerStarted","Data":"c6491aede6ebfabda903f00a9f3c1bb4a1c98592131cbeee502422a40210a87f"}
Sep 11 21:12:24.126483 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:24.126416    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hdcdf" podStartSLOduration=1.409250772 podStartE2EDuration="3.126373549s" totalImagesPullingTime="1.717122777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:12:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:12:24.12424273 +0000 UTC m=+389.602554575" watchObservedRunningTime="2026-09-11 21:12:24.126373549 +0000 UTC m=+389.604685399"
Sep 11 21:12:25.110187 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:25.110152    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hdcdf"
Sep 11 21:12:33.097347 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:33.097315    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8shw6"
Sep 11 21:12:35.158692 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.158660    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-pfksh"]
Sep 11 21:12:35.162565 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.162543    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-pfksh"
Sep 11 21:12:35.178977 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.178948    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-pfksh"]
Sep 11 21:12:35.243301 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.243259    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/624bb14f-da75-4700-9c63-4306a49a808b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-pfksh\" (UID: \"624bb14f-da75-4700-9c63-4306a49a808b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-pfksh"
Sep 11 21:12:35.243524 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.243315    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv6cv\" (UniqueName: \"kubernetes.io/projected/624bb14f-da75-4700-9c63-4306a49a808b-kube-api-access-qv6cv\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-pfksh\" (UID: \"624bb14f-da75-4700-9c63-4306a49a808b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-pfksh"
Sep 11 21:12:35.292224 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.292190    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-pfksh"]
Sep 11 21:12:35.292537 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:12:35.292517    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-qv6cv], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-pfksh" podUID="624bb14f-da75-4700-9c63-4306a49a808b"
Sep 11 21:12:35.327238 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.327196    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8shw6"]
Sep 11 21:12:35.327457 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.327425    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8shw6" podUID="ad68f914-e2c0-408a-abcc-da4bc6f489be" containerName="manager" containerID="cri-o://1b70897a6af5b1b74c41f7e33616ef3f48d15feac952953e11823c26c2825354" gracePeriod=2
Sep 11 21:12:35.344636 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.344168    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/624bb14f-da75-4700-9c63-4306a49a808b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-pfksh\" (UID: \"624bb14f-da75-4700-9c63-4306a49a808b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-pfksh"
Sep 11 21:12:35.344636 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.344228    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qv6cv\" (UniqueName: \"kubernetes.io/projected/624bb14f-da75-4700-9c63-4306a49a808b-kube-api-access-qv6cv\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-pfksh\" (UID: \"624bb14f-da75-4700-9c63-4306a49a808b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-pfksh"
Sep 11 21:12:35.344866 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.344647    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/624bb14f-da75-4700-9c63-4306a49a808b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-pfksh\" (UID: \"624bb14f-da75-4700-9c63-4306a49a808b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-pfksh"
Sep 11 21:12:35.346114 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.346071    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8shw6"]
Sep 11 21:12:35.348193 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.348169    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-tsv5x"]
Sep 11 21:12:35.348671 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.348654    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad68f914-e2c0-408a-abcc-da4bc6f489be" containerName="manager"
Sep 11 21:12:35.348760 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.348673    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad68f914-e2c0-408a-abcc-da4bc6f489be" containerName="manager"
Sep 11 21:12:35.348815 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.348807    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad68f914-e2c0-408a-abcc-da4bc6f489be" containerName="manager"
Sep 11 21:12:35.360570 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.360527    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-tsv5x"
Sep 11 21:12:35.360570 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:12:35.360545    2560 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"ad68f914-e2c0-408a-abcc-da4bc6f489be\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-76f8f686bf-8shw6\": pods \"kuadrant-operator-controller-manager-76f8f686bf-8shw6\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8shw6"
Sep 11 21:12:35.363971 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:12:35.363116    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-8shw6\" is forbidden: User \"system:node:ip-10-0-137-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-163.ec2.internal' and this object" podUID="ad68f914-e2c0-408a-abcc-da4bc6f489be" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8shw6"
Sep 11 21:12:35.365728 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.365692    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-pfksh"]
Sep 11 21:12:35.366761 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.366738    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv6cv\" (UniqueName: \"kubernetes.io/projected/624bb14f-da75-4700-9c63-4306a49a808b-kube-api-access-qv6cv\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-pfksh\" (UID: \"624bb14f-da75-4700-9c63-4306a49a808b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-pfksh"
Sep 11 21:12:35.367892 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.367875    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-q7z6b"]
Sep 11 21:12:35.371423 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.371400    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-q7z6b"
Sep 11 21:12:35.373647 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.373620    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-tsv5x"]
Sep 11 21:12:35.378976 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.378950    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-pfksh"]
Sep 11 21:12:35.388822 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.388794    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-q7z6b"]
Sep 11 21:12:35.397313 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.397270    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-hdcdf"]
Sep 11 21:12:35.397629 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.397589    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hdcdf" podUID="21f8dc9c-6a38-4c56-aa80-3e38c7cb1b6a" containerName="manager" containerID="cri-o://c6491aede6ebfabda903f00a9f3c1bb4a1c98592131cbeee502422a40210a87f" gracePeriod=2
Sep 11 21:12:35.399810 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.399785    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hdcdf"
Sep 11 21:12:35.408179 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.408153    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-hdcdf"]
Sep 11 21:12:35.415566 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:12:35.415527    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-8shw6\" is forbidden: User \"system:node:ip-10-0-137-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-163.ec2.internal' and this object" podUID="ad68f914-e2c0-408a-abcc-da4bc6f489be" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8shw6"
Sep 11 21:12:35.417718 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:12:35.417680    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-hdcdf\" is forbidden: User \"system:node:ip-10-0-137-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-163.ec2.internal' and this object" podUID="21f8dc9c-6a38-4c56-aa80-3e38c7cb1b6a" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hdcdf"
Sep 11 21:12:35.419921 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:12:35.419885    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-8shw6\" is forbidden: User \"system:node:ip-10-0-137-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-163.ec2.internal' and this object" podUID="ad68f914-e2c0-408a-abcc-da4bc6f489be" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8shw6"
Sep 11 21:12:35.428283 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.428256    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-jvr59"]
Sep 11 21:12:35.428842 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.428819    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21f8dc9c-6a38-4c56-aa80-3e38c7cb1b6a" containerName="manager"
Sep 11 21:12:35.428842 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.428842    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="21f8dc9c-6a38-4c56-aa80-3e38c7cb1b6a" containerName="manager"
Sep 11 21:12:35.429235 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.429029    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="21f8dc9c-6a38-4c56-aa80-3e38c7cb1b6a" containerName="manager"
Sep 11 21:12:35.432828 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.432806    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-jvr59"
Sep 11 21:12:35.445595 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.445563    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4tzd\" (UniqueName: \"kubernetes.io/projected/55d8399a-943b-4e13-b9d2-3d06bba8eb99-kube-api-access-c4tzd\") pod \"kuadrant-operator-controller-manager-76f8f686bf-q7z6b\" (UID: \"55d8399a-943b-4e13-b9d2-3d06bba8eb99\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-q7z6b"
Sep 11 21:12:35.445767 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.445614    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/55d8399a-943b-4e13-b9d2-3d06bba8eb99-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-q7z6b\" (UID: \"55d8399a-943b-4e13-b9d2-3d06bba8eb99\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-q7z6b"
Sep 11 21:12:35.445767 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.445641    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42ppx\" (UniqueName: \"kubernetes.io/projected/9c8a9e63-523e-49ec-9f0d-d8e2e737c745-kube-api-access-42ppx\") pod \"kuadrant-operator-controller-manager-5769f99d9f-tsv5x\" (UID: \"9c8a9e63-523e-49ec-9f0d-d8e2e737c745\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-tsv5x"
Sep 11 21:12:35.445767 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.445685    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c8a9e63-523e-49ec-9f0d-d8e2e737c745-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-tsv5x\" (UID: \"9c8a9e63-523e-49ec-9f0d-d8e2e737c745\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-tsv5x"
Sep 11 21:12:35.446732 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.446706    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-jvr59"]
Sep 11 21:12:35.469614 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:12:35.469577    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-hdcdf\" is forbidden: User \"system:node:ip-10-0-137-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-163.ec2.internal' and this object" podUID="21f8dc9c-6a38-4c56-aa80-3e38c7cb1b6a" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hdcdf"
Sep 11 21:12:35.471588 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:12:35.471558    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-8shw6\" is forbidden: User \"system:node:ip-10-0-137-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-163.ec2.internal' and this object" podUID="ad68f914-e2c0-408a-abcc-da4bc6f489be" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8shw6"
Sep 11 21:12:35.546584 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.546545    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c8a9e63-523e-49ec-9f0d-d8e2e737c745-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-tsv5x\" (UID: \"9c8a9e63-523e-49ec-9f0d-d8e2e737c745\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-tsv5x"
Sep 11 21:12:35.546753 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.546620    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jc298\" (UniqueName: \"kubernetes.io/projected/16f08edd-7ea0-424d-90f4-b42a402ae84d-kube-api-access-jc298\") pod \"limitador-operator-controller-manager-74495c69f8-jvr59\" (UID: \"16f08edd-7ea0-424d-90f4-b42a402ae84d\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-jvr59"
Sep 11 21:12:35.546753 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.546687    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4tzd\" (UniqueName: \"kubernetes.io/projected/55d8399a-943b-4e13-b9d2-3d06bba8eb99-kube-api-access-c4tzd\") pod \"kuadrant-operator-controller-manager-76f8f686bf-q7z6b\" (UID: \"55d8399a-943b-4e13-b9d2-3d06bba8eb99\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-q7z6b"
Sep 11 21:12:35.546753 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.546727    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/55d8399a-943b-4e13-b9d2-3d06bba8eb99-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-q7z6b\" (UID: \"55d8399a-943b-4e13-b9d2-3d06bba8eb99\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-q7z6b"
Sep 11 21:12:35.546938 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.546766    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42ppx\" (UniqueName: \"kubernetes.io/projected/9c8a9e63-523e-49ec-9f0d-d8e2e737c745-kube-api-access-42ppx\") pod \"kuadrant-operator-controller-manager-5769f99d9f-tsv5x\" (UID: \"9c8a9e63-523e-49ec-9f0d-d8e2e737c745\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-tsv5x"
Sep 11 21:12:35.547006 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.546971    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c8a9e63-523e-49ec-9f0d-d8e2e737c745-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-tsv5x\" (UID: \"9c8a9e63-523e-49ec-9f0d-d8e2e737c745\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-tsv5x"
Sep 11 21:12:35.547193 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.547169    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/55d8399a-943b-4e13-b9d2-3d06bba8eb99-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-q7z6b\" (UID: \"55d8399a-943b-4e13-b9d2-3d06bba8eb99\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-q7z6b"
Sep 11 21:12:35.555813 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.555789    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4tzd\" (UniqueName: \"kubernetes.io/projected/55d8399a-943b-4e13-b9d2-3d06bba8eb99-kube-api-access-c4tzd\") pod \"kuadrant-operator-controller-manager-76f8f686bf-q7z6b\" (UID: \"55d8399a-943b-4e13-b9d2-3d06bba8eb99\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-q7z6b"
Sep 11 21:12:35.556021 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.556001    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42ppx\" (UniqueName: \"kubernetes.io/projected/9c8a9e63-523e-49ec-9f0d-d8e2e737c745-kube-api-access-42ppx\") pod \"kuadrant-operator-controller-manager-5769f99d9f-tsv5x\" (UID: \"9c8a9e63-523e-49ec-9f0d-d8e2e737c745\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-tsv5x"
Sep 11 21:12:35.633194 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.633169    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8shw6"
Sep 11 21:12:35.635652 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:12:35.635623    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-hdcdf\" is forbidden: User \"system:node:ip-10-0-137-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-163.ec2.internal' and this object" podUID="21f8dc9c-6a38-4c56-aa80-3e38c7cb1b6a" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hdcdf"
Sep 11 21:12:35.638057 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:12:35.638030    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-8shw6\" is forbidden: User \"system:node:ip-10-0-137-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-163.ec2.internal' and this object" podUID="ad68f914-e2c0-408a-abcc-da4bc6f489be" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8shw6"
Sep 11 21:12:35.639754 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.639737    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hdcdf"
Sep 11 21:12:35.642814 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:12:35.642790    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-hdcdf\" is forbidden: User \"system:node:ip-10-0-137-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-163.ec2.internal' and this object" podUID="21f8dc9c-6a38-4c56-aa80-3e38c7cb1b6a" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hdcdf"
Sep 11 21:12:35.644728 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:12:35.644708    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-8shw6\" is forbidden: User \"system:node:ip-10-0-137-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-163.ec2.internal' and this object" podUID="ad68f914-e2c0-408a-abcc-da4bc6f489be" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8shw6"
Sep 11 21:12:35.648255 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.648229    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jc298\" (UniqueName: \"kubernetes.io/projected/16f08edd-7ea0-424d-90f4-b42a402ae84d-kube-api-access-jc298\") pod \"limitador-operator-controller-manager-74495c69f8-jvr59\" (UID: \"16f08edd-7ea0-424d-90f4-b42a402ae84d\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-jvr59"
Sep 11 21:12:35.657453 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.657430    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jc298\" (UniqueName: \"kubernetes.io/projected/16f08edd-7ea0-424d-90f4-b42a402ae84d-kube-api-access-jc298\") pod \"limitador-operator-controller-manager-74495c69f8-jvr59\" (UID: \"16f08edd-7ea0-424d-90f4-b42a402ae84d\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-jvr59"
Sep 11 21:12:35.749369 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.749286    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ad68f914-e2c0-408a-abcc-da4bc6f489be-extensions-socket-volume\") pod \"ad68f914-e2c0-408a-abcc-da4bc6f489be\" (UID: \"ad68f914-e2c0-408a-abcc-da4bc6f489be\") "
Sep 11 21:12:35.749531 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.749426    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m8mzq\" (UniqueName: \"kubernetes.io/projected/ad68f914-e2c0-408a-abcc-da4bc6f489be-kube-api-access-m8mzq\") pod \"ad68f914-e2c0-408a-abcc-da4bc6f489be\" (UID: \"ad68f914-e2c0-408a-abcc-da4bc6f489be\") "
Sep 11 21:12:35.749531 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.749448    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zfwl2\" (UniqueName: \"kubernetes.io/projected/21f8dc9c-6a38-4c56-aa80-3e38c7cb1b6a-kube-api-access-zfwl2\") pod \"21f8dc9c-6a38-4c56-aa80-3e38c7cb1b6a\" (UID: \"21f8dc9c-6a38-4c56-aa80-3e38c7cb1b6a\") "
Sep 11 21:12:35.749817 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.749794    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad68f914-e2c0-408a-abcc-da4bc6f489be-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ad68f914-e2c0-408a-abcc-da4bc6f489be" (UID: "ad68f914-e2c0-408a-abcc-da4bc6f489be"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:12:35.751656 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.751632    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad68f914-e2c0-408a-abcc-da4bc6f489be-kube-api-access-m8mzq" (OuterVolumeSpecName: "kube-api-access-m8mzq") pod "ad68f914-e2c0-408a-abcc-da4bc6f489be" (UID: "ad68f914-e2c0-408a-abcc-da4bc6f489be"). InnerVolumeSpecName "kube-api-access-m8mzq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:12:35.751738 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.751722    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21f8dc9c-6a38-4c56-aa80-3e38c7cb1b6a-kube-api-access-zfwl2" (OuterVolumeSpecName: "kube-api-access-zfwl2") pod "21f8dc9c-6a38-4c56-aa80-3e38c7cb1b6a" (UID: "21f8dc9c-6a38-4c56-aa80-3e38c7cb1b6a"). InnerVolumeSpecName "kube-api-access-zfwl2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:12:35.773914 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.773887    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-tsv5x"
Sep 11 21:12:35.781056 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.781027    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-q7z6b"
Sep 11 21:12:35.787002 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.786982    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-jvr59"
Sep 11 21:12:35.851576 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.851544    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8mzq\" (UniqueName: \"kubernetes.io/projected/ad68f914-e2c0-408a-abcc-da4bc6f489be-kube-api-access-m8mzq\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:12:35.851700 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.851580    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zfwl2\" (UniqueName: \"kubernetes.io/projected/21f8dc9c-6a38-4c56-aa80-3e38c7cb1b6a-kube-api-access-zfwl2\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:12:35.851700 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:35.851600    2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ad68f914-e2c0-408a-abcc-da4bc6f489be-extensions-socket-volume\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:12:36.059018 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:36.058989    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-tsv5x"]
Sep 11 21:12:36.060715 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:12:36.060688    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55d8399a_943b_4e13_b9d2_3d06bba8eb99.slice/crio-bbf1757791304becd84e48cf1f29031e23ac93ebe2c9a0c755b9da73230ce062 WatchSource:0}: Error finding container bbf1757791304becd84e48cf1f29031e23ac93ebe2c9a0c755b9da73230ce062: Status 404 returned error can't find the container with id bbf1757791304becd84e48cf1f29031e23ac93ebe2c9a0c755b9da73230ce062
Sep 11 21:12:36.061050 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:36.061028    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-q7z6b"]
Sep 11 21:12:36.061554 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:12:36.061531    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c8a9e63_523e_49ec_9f0d_d8e2e737c745.slice/crio-e19853389ec4bc783a91e37ec00399201bbab77b35bfad3fdaa319680a0a0a89 WatchSource:0}: Error finding container e19853389ec4bc783a91e37ec00399201bbab77b35bfad3fdaa319680a0a0a89: Status 404 returned error can't find the container with id e19853389ec4bc783a91e37ec00399201bbab77b35bfad3fdaa319680a0a0a89
Sep 11 21:12:36.064549 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:36.064499    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-jvr59"]
Sep 11 21:12:36.067225 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:12:36.067199    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16f08edd_7ea0_424d_90f4_b42a402ae84d.slice/crio-1e623ed6e4ce2205cf9d383cff971a8852330b629c27d8e24c58970b20df588d WatchSource:0}: Error finding container 1e623ed6e4ce2205cf9d383cff971a8852330b629c27d8e24c58970b20df588d: Status 404 returned error can't find the container with id 1e623ed6e4ce2205cf9d383cff971a8852330b629c27d8e24c58970b20df588d
Sep 11 21:12:36.167868 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:36.167826    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-q7z6b" event={"ID":"55d8399a-943b-4e13-b9d2-3d06bba8eb99","Type":"ContainerStarted","Data":"696c3226b8fc0eb7ebbb7b4ad0652912431476a2bd68c7ad05e2d4fa9b2ea8e7"}
Sep 11 21:12:36.168319 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:36.167894    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-q7z6b" event={"ID":"55d8399a-943b-4e13-b9d2-3d06bba8eb99","Type":"ContainerStarted","Data":"bbf1757791304becd84e48cf1f29031e23ac93ebe2c9a0c755b9da73230ce062"}
Sep 11 21:12:36.168319 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:36.167938    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-q7z6b"
Sep 11 21:12:36.169825 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:36.169790    2560 generic.go:356] "Generic (PLEG): container finished" podID="ad68f914-e2c0-408a-abcc-da4bc6f489be" containerID="1b70897a6af5b1b74c41f7e33616ef3f48d15feac952953e11823c26c2825354" exitCode=0
Sep 11 21:12:36.170123 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:36.169850    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8shw6"
Sep 11 21:12:36.170123 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:36.169955    2560 scope.go:117] "RemoveContainer" containerID="1b70897a6af5b1b74c41f7e33616ef3f48d15feac952953e11823c26c2825354"
Sep 11 21:12:36.170232 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:12:36.170168    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-hdcdf\" is forbidden: User \"system:node:ip-10-0-137-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-163.ec2.internal' and this object" podUID="21f8dc9c-6a38-4c56-aa80-3e38c7cb1b6a" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hdcdf"
Sep 11 21:12:36.173580 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:36.173494    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-jvr59" event={"ID":"16f08edd-7ea0-424d-90f4-b42a402ae84d","Type":"ContainerStarted","Data":"f209032922a214914e54575fced8024097fb3c8e7e374f95f624c547763dbf4a"}
Sep 11 21:12:36.173580 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:36.173547    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-jvr59" event={"ID":"16f08edd-7ea0-424d-90f4-b42a402ae84d","Type":"ContainerStarted","Data":"1e623ed6e4ce2205cf9d383cff971a8852330b629c27d8e24c58970b20df588d"}
Sep 11 21:12:36.173753 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:36.173595    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-jvr59"
Sep 11 21:12:36.175551 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:36.175502    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-tsv5x" event={"ID":"9c8a9e63-523e-49ec-9f0d-d8e2e737c745","Type":"ContainerStarted","Data":"ca7c723b7fc4c44456171cf3b6031477f4f23f331786a7cba389317f54b7fabc"}
Sep 11 21:12:36.175659 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:36.175569    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-tsv5x"
Sep 11 21:12:36.175659 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:36.175598    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-tsv5x" event={"ID":"9c8a9e63-523e-49ec-9f0d-d8e2e737c745","Type":"ContainerStarted","Data":"e19853389ec4bc783a91e37ec00399201bbab77b35bfad3fdaa319680a0a0a89"}
Sep 11 21:12:36.177148 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:36.177125    2560 generic.go:356] "Generic (PLEG): container finished" podID="21f8dc9c-6a38-4c56-aa80-3e38c7cb1b6a" containerID="c6491aede6ebfabda903f00a9f3c1bb4a1c98592131cbeee502422a40210a87f" exitCode=0
Sep 11 21:12:36.177231 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:36.177185    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-pfksh"
Sep 11 21:12:36.177586 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:36.177523    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hdcdf"
Sep 11 21:12:36.182368 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:36.182242    2560 scope.go:117] "RemoveContainer" containerID="1b70897a6af5b1b74c41f7e33616ef3f48d15feac952953e11823c26c2825354"
Sep 11 21:12:36.182578 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:12:36.182561    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b70897a6af5b1b74c41f7e33616ef3f48d15feac952953e11823c26c2825354\": container with ID starting with 1b70897a6af5b1b74c41f7e33616ef3f48d15feac952953e11823c26c2825354 not found: ID does not exist" containerID="1b70897a6af5b1b74c41f7e33616ef3f48d15feac952953e11823c26c2825354"
Sep 11 21:12:36.182632 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:36.182588    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b70897a6af5b1b74c41f7e33616ef3f48d15feac952953e11823c26c2825354"} err="failed to get container status \"1b70897a6af5b1b74c41f7e33616ef3f48d15feac952953e11823c26c2825354\": rpc error: code = NotFound desc = could not find container \"1b70897a6af5b1b74c41f7e33616ef3f48d15feac952953e11823c26c2825354\": container with ID starting with 1b70897a6af5b1b74c41f7e33616ef3f48d15feac952953e11823c26c2825354 not found: ID does not exist"
Sep 11 21:12:36.182632 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:36.182605    2560 scope.go:117] "RemoveContainer" containerID="c6491aede6ebfabda903f00a9f3c1bb4a1c98592131cbeee502422a40210a87f"
Sep 11 21:12:36.187520 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:36.187430    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-pfksh"
Sep 11 21:12:36.191506 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:36.191476    2560 scope.go:117] "RemoveContainer" containerID="c6491aede6ebfabda903f00a9f3c1bb4a1c98592131cbeee502422a40210a87f"
Sep 11 21:12:36.191789 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:12:36.191773    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6491aede6ebfabda903f00a9f3c1bb4a1c98592131cbeee502422a40210a87f\": container with ID starting with c6491aede6ebfabda903f00a9f3c1bb4a1c98592131cbeee502422a40210a87f not found: ID does not exist" containerID="c6491aede6ebfabda903f00a9f3c1bb4a1c98592131cbeee502422a40210a87f"
Sep 11 21:12:36.191832 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:36.191797    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6491aede6ebfabda903f00a9f3c1bb4a1c98592131cbeee502422a40210a87f"} err="failed to get container status \"c6491aede6ebfabda903f00a9f3c1bb4a1c98592131cbeee502422a40210a87f\": rpc error: code = NotFound desc = could not find container \"c6491aede6ebfabda903f00a9f3c1bb4a1c98592131cbeee502422a40210a87f\": container with ID starting with c6491aede6ebfabda903f00a9f3c1bb4a1c98592131cbeee502422a40210a87f not found: ID does not exist"
Sep 11 21:12:36.196208 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:12:36.196177    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-8shw6\" is forbidden: User \"system:node:ip-10-0-137-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-163.ec2.internal' and this object" podUID="ad68f914-e2c0-408a-abcc-da4bc6f489be" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8shw6"
Sep 11 21:12:36.197022 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:36.196978    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-q7z6b" podStartSLOduration=1.19696302 podStartE2EDuration="1.19696302s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:12:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:12:36.194060935 +0000 UTC m=+401.672372779" watchObservedRunningTime="2026-09-11 21:12:36.19696302 +0000 UTC m=+401.675274863"
Sep 11 21:12:36.197993 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:12:36.197967    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-hdcdf\" is forbidden: User \"system:node:ip-10-0-137-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-163.ec2.internal' and this object" podUID="21f8dc9c-6a38-4c56-aa80-3e38c7cb1b6a" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hdcdf"
Sep 11 21:12:36.199678 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:12:36.199656    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-8shw6\" is forbidden: User \"system:node:ip-10-0-137-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-163.ec2.internal' and this object" podUID="ad68f914-e2c0-408a-abcc-da4bc6f489be" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8shw6"
Sep 11 21:12:36.201337 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:12:36.201316    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-pfksh\" is forbidden: User \"system:node:ip-10-0-137-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-163.ec2.internal' and this object" podUID="624bb14f-da75-4700-9c63-4306a49a808b" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-pfksh"
Sep 11 21:12:36.225377 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:36.225316    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-tsv5x" podStartSLOduration=1.225298555 podStartE2EDuration="1.225298555s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:12:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:12:36.223336697 +0000 UTC m=+401.701648541" watchObservedRunningTime="2026-09-11 21:12:36.225298555 +0000 UTC m=+401.703610390"
Sep 11 21:12:36.251847 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:36.251790    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-jvr59" podStartSLOduration=1.251773525 podStartE2EDuration="1.251773525s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:12:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:12:36.250042038 +0000 UTC m=+401.728353875" watchObservedRunningTime="2026-09-11 21:12:36.251773525 +0000 UTC m=+401.730085369"
Sep 11 21:12:36.253992 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:36.253972    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/624bb14f-da75-4700-9c63-4306a49a808b-extensions-socket-volume\") pod \"624bb14f-da75-4700-9c63-4306a49a808b\" (UID: \"624bb14f-da75-4700-9c63-4306a49a808b\") "
Sep 11 21:12:36.254064 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:36.254001    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qv6cv\" (UniqueName: \"kubernetes.io/projected/624bb14f-da75-4700-9c63-4306a49a808b-kube-api-access-qv6cv\") pod \"624bb14f-da75-4700-9c63-4306a49a808b\" (UID: \"624bb14f-da75-4700-9c63-4306a49a808b\") "
Sep 11 21:12:36.254302 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:36.254279    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/624bb14f-da75-4700-9c63-4306a49a808b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "624bb14f-da75-4700-9c63-4306a49a808b" (UID: "624bb14f-da75-4700-9c63-4306a49a808b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:12:36.254580 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:36.254564    2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/624bb14f-da75-4700-9c63-4306a49a808b-extensions-socket-volume\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:12:36.256584 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:36.256560    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/624bb14f-da75-4700-9c63-4306a49a808b-kube-api-access-qv6cv" (OuterVolumeSpecName: "kube-api-access-qv6cv") pod "624bb14f-da75-4700-9c63-4306a49a808b" (UID: "624bb14f-da75-4700-9c63-4306a49a808b"). InnerVolumeSpecName "kube-api-access-qv6cv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:12:36.355585 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:36.355553    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qv6cv\" (UniqueName: \"kubernetes.io/projected/624bb14f-da75-4700-9c63-4306a49a808b-kube-api-access-qv6cv\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:12:37.038538 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:37.038507    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21f8dc9c-6a38-4c56-aa80-3e38c7cb1b6a" path="/var/lib/kubelet/pods/21f8dc9c-6a38-4c56-aa80-3e38c7cb1b6a/volumes"
Sep 11 21:12:37.038899 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:37.038886    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="624bb14f-da75-4700-9c63-4306a49a808b" path="/var/lib/kubelet/pods/624bb14f-da75-4700-9c63-4306a49a808b/volumes"
Sep 11 21:12:37.039133 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:37.039122    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad68f914-e2c0-408a-abcc-da4bc6f489be" path="/var/lib/kubelet/pods/ad68f914-e2c0-408a-abcc-da4bc6f489be/volumes"
Sep 11 21:12:37.185332 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:37.185291    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-pfksh"
Sep 11 21:12:37.189540 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:12:37.189508    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-pfksh\" is forbidden: User \"system:node:ip-10-0-137-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-163.ec2.internal' and this object" podUID="624bb14f-da75-4700-9c63-4306a49a808b" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-pfksh"
Sep 11 21:12:47.187583 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:47.187544    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-tsv5x"
Sep 11 21:12:47.188079 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:47.187720    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-q7z6b"
Sep 11 21:12:47.188079 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:47.187779    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-jvr59"
Sep 11 21:12:47.258000 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:47.257968    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-q7z6b"]
Sep 11 21:12:47.258181 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:47.258162    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-q7z6b" podUID="55d8399a-943b-4e13-b9d2-3d06bba8eb99" containerName="manager" containerID="cri-o://696c3226b8fc0eb7ebbb7b4ad0652912431476a2bd68c7ad05e2d4fa9b2ea8e7" gracePeriod=10
Sep 11 21:12:47.525686 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:47.525658    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-q7z6b"
Sep 11 21:12:47.673707 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:47.673667    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c4tzd\" (UniqueName: \"kubernetes.io/projected/55d8399a-943b-4e13-b9d2-3d06bba8eb99-kube-api-access-c4tzd\") pod \"55d8399a-943b-4e13-b9d2-3d06bba8eb99\" (UID: \"55d8399a-943b-4e13-b9d2-3d06bba8eb99\") "
Sep 11 21:12:47.673885 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:47.673749    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/55d8399a-943b-4e13-b9d2-3d06bba8eb99-extensions-socket-volume\") pod \"55d8399a-943b-4e13-b9d2-3d06bba8eb99\" (UID: \"55d8399a-943b-4e13-b9d2-3d06bba8eb99\") "
Sep 11 21:12:47.674170 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:47.674145    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55d8399a-943b-4e13-b9d2-3d06bba8eb99-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "55d8399a-943b-4e13-b9d2-3d06bba8eb99" (UID: "55d8399a-943b-4e13-b9d2-3d06bba8eb99"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:12:47.675952 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:47.675929    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55d8399a-943b-4e13-b9d2-3d06bba8eb99-kube-api-access-c4tzd" (OuterVolumeSpecName: "kube-api-access-c4tzd") pod "55d8399a-943b-4e13-b9d2-3d06bba8eb99" (UID: "55d8399a-943b-4e13-b9d2-3d06bba8eb99"). InnerVolumeSpecName "kube-api-access-c4tzd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:12:47.775467 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:47.775346    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c4tzd\" (UniqueName: \"kubernetes.io/projected/55d8399a-943b-4e13-b9d2-3d06bba8eb99-kube-api-access-c4tzd\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:12:47.775467 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:47.775377    2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/55d8399a-943b-4e13-b9d2-3d06bba8eb99-extensions-socket-volume\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:12:48.244463 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:48.244422    2560 generic.go:356] "Generic (PLEG): container finished" podID="55d8399a-943b-4e13-b9d2-3d06bba8eb99" containerID="696c3226b8fc0eb7ebbb7b4ad0652912431476a2bd68c7ad05e2d4fa9b2ea8e7" exitCode=0
Sep 11 21:12:48.244904 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:48.244470    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-q7z6b"
Sep 11 21:12:48.244904 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:48.244497    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-q7z6b" event={"ID":"55d8399a-943b-4e13-b9d2-3d06bba8eb99","Type":"ContainerDied","Data":"696c3226b8fc0eb7ebbb7b4ad0652912431476a2bd68c7ad05e2d4fa9b2ea8e7"}
Sep 11 21:12:48.244904 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:48.244553    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-q7z6b" event={"ID":"55d8399a-943b-4e13-b9d2-3d06bba8eb99","Type":"ContainerDied","Data":"bbf1757791304becd84e48cf1f29031e23ac93ebe2c9a0c755b9da73230ce062"}
Sep 11 21:12:48.244904 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:48.244574    2560 scope.go:117] "RemoveContainer" containerID="696c3226b8fc0eb7ebbb7b4ad0652912431476a2bd68c7ad05e2d4fa9b2ea8e7"
Sep 11 21:12:48.253968 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:48.253945    2560 scope.go:117] "RemoveContainer" containerID="696c3226b8fc0eb7ebbb7b4ad0652912431476a2bd68c7ad05e2d4fa9b2ea8e7"
Sep 11 21:12:48.254296 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:12:48.254273    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"696c3226b8fc0eb7ebbb7b4ad0652912431476a2bd68c7ad05e2d4fa9b2ea8e7\": container with ID starting with 696c3226b8fc0eb7ebbb7b4ad0652912431476a2bd68c7ad05e2d4fa9b2ea8e7 not found: ID does not exist" containerID="696c3226b8fc0eb7ebbb7b4ad0652912431476a2bd68c7ad05e2d4fa9b2ea8e7"
Sep 11 21:12:48.254376 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:48.254304    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"696c3226b8fc0eb7ebbb7b4ad0652912431476a2bd68c7ad05e2d4fa9b2ea8e7"} err="failed to get container status \"696c3226b8fc0eb7ebbb7b4ad0652912431476a2bd68c7ad05e2d4fa9b2ea8e7\": rpc error: code = NotFound desc = could not find container \"696c3226b8fc0eb7ebbb7b4ad0652912431476a2bd68c7ad05e2d4fa9b2ea8e7\": container with ID starting with 696c3226b8fc0eb7ebbb7b4ad0652912431476a2bd68c7ad05e2d4fa9b2ea8e7 not found: ID does not exist"
Sep 11 21:12:48.267450 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:48.267418    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-q7z6b"]
Sep 11 21:12:48.275521 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:48.275484    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-q7z6b"]
Sep 11 21:12:49.038399 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:12:49.038350    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55d8399a-943b-4e13-b9d2-3d06bba8eb99" path="/var/lib/kubelet/pods/55d8399a-943b-4e13-b9d2-3d06bba8eb99/volumes"
Sep 11 21:14:23.902331 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:14:23.902292    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-57cp9"]
Sep 11 21:14:23.903624 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:14:23.903596    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55d8399a-943b-4e13-b9d2-3d06bba8eb99" containerName="manager"
Sep 11 21:14:23.903775 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:14:23.903764    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="55d8399a-943b-4e13-b9d2-3d06bba8eb99" containerName="manager"
Sep 11 21:14:23.903957 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:14:23.903946    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="55d8399a-943b-4e13-b9d2-3d06bba8eb99" containerName="manager"
Sep 11 21:14:23.906342 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:14:23.906321    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-57cp9"
Sep 11 21:14:23.909398 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:14:23.909361    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 11 21:14:23.916237 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:14:23.916206    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-57cp9"]
Sep 11 21:14:23.939592 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:14:23.939554    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-62vnh"]
Sep 11 21:14:23.942009 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:14:23.941990    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-62vnh"
Sep 11 21:14:23.948358 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:14:23.948327    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-b59qs\""
Sep 11 21:14:23.955741 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:14:23.955704    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-62vnh"]
Sep 11 21:14:24.008291 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:14:24.008252    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srfqc\" (UniqueName: \"kubernetes.io/projected/1e776d2f-909f-40ad-90ae-a496399241b1-kube-api-access-srfqc\") pod \"payload-pre-processing-59fbc47bf8-57cp9\" (UID: \"1e776d2f-909f-40ad-90ae-a496399241b1\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-57cp9"
Sep 11 21:14:24.008598 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:14:24.008311    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvwnc\" (UniqueName: \"kubernetes.io/projected/923b93fb-4af2-42e6-a2ef-eb36d7547f59-kube-api-access-pvwnc\") pod \"payload-processing-5b54b7fbb7-62vnh\" (UID: \"923b93fb-4af2-42e6-a2ef-eb36d7547f59\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-62vnh"
Sep 11 21:14:24.008598 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:14:24.008466    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/923b93fb-4af2-42e6-a2ef-eb36d7547f59-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-62vnh\" (UID: \"923b93fb-4af2-42e6-a2ef-eb36d7547f59\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-62vnh"
Sep 11 21:14:24.008598 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:14:24.008515    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e776d2f-909f-40ad-90ae-a496399241b1-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-57cp9\" (UID: \"1e776d2f-909f-40ad-90ae-a496399241b1\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-57cp9"
Sep 11 21:14:24.109881 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:14:24.109840    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/923b93fb-4af2-42e6-a2ef-eb36d7547f59-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-62vnh\" (UID: \"923b93fb-4af2-42e6-a2ef-eb36d7547f59\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-62vnh"
Sep 11 21:14:24.110083 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:14:24.109906    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e776d2f-909f-40ad-90ae-a496399241b1-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-57cp9\" (UID: \"1e776d2f-909f-40ad-90ae-a496399241b1\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-57cp9"
Sep 11 21:14:24.110083 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:14:24.109952    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srfqc\" (UniqueName: \"kubernetes.io/projected/1e776d2f-909f-40ad-90ae-a496399241b1-kube-api-access-srfqc\") pod \"payload-pre-processing-59fbc47bf8-57cp9\" (UID: \"1e776d2f-909f-40ad-90ae-a496399241b1\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-57cp9"
Sep 11 21:14:24.110083 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:14:24.110009    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvwnc\" (UniqueName: \"kubernetes.io/projected/923b93fb-4af2-42e6-a2ef-eb36d7547f59-kube-api-access-pvwnc\") pod \"payload-processing-5b54b7fbb7-62vnh\" (UID: \"923b93fb-4af2-42e6-a2ef-eb36d7547f59\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-62vnh"
Sep 11 21:14:24.110679 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:14:24.110656    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e776d2f-909f-40ad-90ae-a496399241b1-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-57cp9\" (UID: \"1e776d2f-909f-40ad-90ae-a496399241b1\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-57cp9"
Sep 11 21:14:24.110679 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:14:24.110670    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/923b93fb-4af2-42e6-a2ef-eb36d7547f59-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-62vnh\" (UID: \"923b93fb-4af2-42e6-a2ef-eb36d7547f59\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-62vnh"
Sep 11 21:14:24.121157 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:14:24.121119    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvwnc\" (UniqueName: \"kubernetes.io/projected/923b93fb-4af2-42e6-a2ef-eb36d7547f59-kube-api-access-pvwnc\") pod \"payload-processing-5b54b7fbb7-62vnh\" (UID: \"923b93fb-4af2-42e6-a2ef-eb36d7547f59\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-62vnh"
Sep 11 21:14:24.121157 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:14:24.121122    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srfqc\" (UniqueName: \"kubernetes.io/projected/1e776d2f-909f-40ad-90ae-a496399241b1-kube-api-access-srfqc\") pod \"payload-pre-processing-59fbc47bf8-57cp9\" (UID: \"1e776d2f-909f-40ad-90ae-a496399241b1\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-57cp9"
Sep 11 21:14:24.221345 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:14:24.221246    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-57cp9"
Sep 11 21:14:24.253857 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:14:24.253817    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-62vnh"
Sep 11 21:14:24.496970 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:14:24.496943    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-57cp9"]
Sep 11 21:14:24.499236 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:14:24.499207    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e776d2f_909f_40ad_90ae_a496399241b1.slice/crio-4bed79dd8178190559f7b7457ea05b9843d82441ad42c40f935db4234a573f9e WatchSource:0}: Error finding container 4bed79dd8178190559f7b7457ea05b9843d82441ad42c40f935db4234a573f9e: Status 404 returned error can't find the container with id 4bed79dd8178190559f7b7457ea05b9843d82441ad42c40f935db4234a573f9e
Sep 11 21:14:24.536757 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:14:24.536729    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-62vnh"]
Sep 11 21:14:24.539276 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:14:24.539244    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod923b93fb_4af2_42e6_a2ef_eb36d7547f59.slice/crio-2c58e137c0155d639298ba1952b1a8633f36a7da0d7e6b123894b6b20d01279d WatchSource:0}: Error finding container 2c58e137c0155d639298ba1952b1a8633f36a7da0d7e6b123894b6b20d01279d: Status 404 returned error can't find the container with id 2c58e137c0155d639298ba1952b1a8633f36a7da0d7e6b123894b6b20d01279d
Sep 11 21:14:24.732260 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:14:24.732218    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-57cp9" event={"ID":"1e776d2f-909f-40ad-90ae-a496399241b1","Type":"ContainerStarted","Data":"4bed79dd8178190559f7b7457ea05b9843d82441ad42c40f935db4234a573f9e"}
Sep 11 21:14:24.733448 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:14:24.733420    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-62vnh" event={"ID":"923b93fb-4af2-42e6-a2ef-eb36d7547f59","Type":"ContainerStarted","Data":"2c58e137c0155d639298ba1952b1a8633f36a7da0d7e6b123894b6b20d01279d"}
Sep 11 21:14:26.745941 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:14:26.745898    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-57cp9" event={"ID":"1e776d2f-909f-40ad-90ae-a496399241b1","Type":"ContainerStarted","Data":"73c6af8a4bbeeb48b88a2cd96dbf13f09ae9110e6d03e08c02ef0623af67bb35"}
Sep 11 21:14:26.746409 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:14:26.746078    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-57cp9"
Sep 11 21:14:26.747587 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:14:26.747560    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-62vnh" event={"ID":"923b93fb-4af2-42e6-a2ef-eb36d7547f59","Type":"ContainerStarted","Data":"755592050dbbde6410719eb55fb0b3d1f86da232d4a7ea3eb11ae7239bc0cdc0"}
Sep 11 21:14:26.747697 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:14:26.747634    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-62vnh"
Sep 11 21:14:26.764474 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:14:26.764411    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-57cp9" podStartSLOduration=2.470598368 podStartE2EDuration="3.764373813s" totalImagesPullingTime="1.293775445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:14:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:14:26.762856756 +0000 UTC m=+512.241168601" watchObservedRunningTime="2026-09-11 21:14:26.764373813 +0000 UTC m=+512.242685659"
Sep 11 21:14:26.781014 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:14:26.780954    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-62vnh" podStartSLOduration=2.530036405 podStartE2EDuration="3.780933935s" totalImagesPullingTime="1.25089753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:14:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:14:26.779331299 +0000 UTC m=+512.257643143" watchObservedRunningTime="2026-09-11 21:14:26.780933935 +0000 UTC m=+512.259245807"
Sep 11 21:14:37.754725 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:14:37.754669    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-62vnh"
Sep 11 21:14:37.755470 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:14:37.754905    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-57cp9"
Sep 11 21:15:00.154737 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:00.154652    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29819355-wr9h6"]
Sep 11 21:15:00.158718 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:00.158696    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819355-wr9h6"
Sep 11 21:15:00.161542 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:00.161517    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bfm9g\""
Sep 11 21:15:00.168633 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:00.168614    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819355-wr9h6"
Sep 11 21:15:00.175837 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:00.175810    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29819355-wr9h6"]
Sep 11 21:15:00.448990 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:00.448964    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29819355-wr9h6"]
Sep 11 21:15:00.451431 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:15:00.451402    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b08603f_13e0_4456_bb5c_baf370799573.slice/crio-e75b6aceac290e32ee0e9099162c111af6c6e08ed5c8a2efc4e17c203530fd00 WatchSource:0}: Error finding container e75b6aceac290e32ee0e9099162c111af6c6e08ed5c8a2efc4e17c203530fd00: Status 404 returned error can't find the container with id e75b6aceac290e32ee0e9099162c111af6c6e08ed5c8a2efc4e17c203530fd00
Sep 11 21:15:00.920607 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:00.920572    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819355-wr9h6" event={"ID":"1b08603f-13e0-4456-bb5c-baf370799573","Type":"ContainerStarted","Data":"e75b6aceac290e32ee0e9099162c111af6c6e08ed5c8a2efc4e17c203530fd00"}
Sep 11 21:15:03.940367 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:03.940276    2560 generic.go:356] "Generic (PLEG): container finished" podID="1b08603f-13e0-4456-bb5c-baf370799573" containerID="68e4790b38b8a9710ae81d69327f5f59974c10a82309abdd1d485bda3d1617ba" exitCode=0
Sep 11 21:15:03.940761 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:03.940370    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819355-wr9h6" event={"ID":"1b08603f-13e0-4456-bb5c-baf370799573","Type":"ContainerDied","Data":"68e4790b38b8a9710ae81d69327f5f59974c10a82309abdd1d485bda3d1617ba"}
Sep 11 21:15:04.201239 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:04.201151    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6bbbc"]
Sep 11 21:15:04.205087 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:04.205051    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6bbbc"
Sep 11 21:15:04.207478 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:04.207445    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 11 21:15:04.207672 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:04.207514    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 11 21:15:04.207746 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:04.207733    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-m6p5f\""
Sep 11 21:15:04.208352 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:04.208334    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 11 21:15:04.219316 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:04.219276    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6bbbc"]
Sep 11 21:15:04.283797 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:04.283762    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22ffb45d-7e38-43ef-9c1d-775a96b0f13d-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6bbbc\" (UID: \"22ffb45d-7e38-43ef-9c1d-775a96b0f13d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6bbbc"
Sep 11 21:15:04.283797 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:04.283797    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/22ffb45d-7e38-43ef-9c1d-775a96b0f13d-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6bbbc\" (UID: \"22ffb45d-7e38-43ef-9c1d-775a96b0f13d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6bbbc"
Sep 11 21:15:04.284016 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:04.283822    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/22ffb45d-7e38-43ef-9c1d-775a96b0f13d-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6bbbc\" (UID: \"22ffb45d-7e38-43ef-9c1d-775a96b0f13d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6bbbc"
Sep 11 21:15:04.284016 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:04.283838    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/22ffb45d-7e38-43ef-9c1d-775a96b0f13d-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6bbbc\" (UID: \"22ffb45d-7e38-43ef-9c1d-775a96b0f13d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6bbbc"
Sep 11 21:15:04.284016 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:04.283996    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/22ffb45d-7e38-43ef-9c1d-775a96b0f13d-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6bbbc\" (UID: \"22ffb45d-7e38-43ef-9c1d-775a96b0f13d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6bbbc"
Sep 11 21:15:04.284115 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:04.284098    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pw7tv\" (UniqueName: \"kubernetes.io/projected/22ffb45d-7e38-43ef-9c1d-775a96b0f13d-kube-api-access-pw7tv\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6bbbc\" (UID: \"22ffb45d-7e38-43ef-9c1d-775a96b0f13d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6bbbc"
Sep 11 21:15:04.385201 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:04.385159    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/22ffb45d-7e38-43ef-9c1d-775a96b0f13d-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6bbbc\" (UID: \"22ffb45d-7e38-43ef-9c1d-775a96b0f13d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6bbbc"
Sep 11 21:15:04.385430 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:04.385235    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/22ffb45d-7e38-43ef-9c1d-775a96b0f13d-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6bbbc\" (UID: \"22ffb45d-7e38-43ef-9c1d-775a96b0f13d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6bbbc"
Sep 11 21:15:04.385430 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:04.385276    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pw7tv\" (UniqueName: \"kubernetes.io/projected/22ffb45d-7e38-43ef-9c1d-775a96b0f13d-kube-api-access-pw7tv\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6bbbc\" (UID: \"22ffb45d-7e38-43ef-9c1d-775a96b0f13d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6bbbc"
Sep 11 21:15:04.385430 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:04.385317    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22ffb45d-7e38-43ef-9c1d-775a96b0f13d-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6bbbc\" (UID: \"22ffb45d-7e38-43ef-9c1d-775a96b0f13d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6bbbc"
Sep 11 21:15:04.385430 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:04.385339    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/22ffb45d-7e38-43ef-9c1d-775a96b0f13d-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6bbbc\" (UID: \"22ffb45d-7e38-43ef-9c1d-775a96b0f13d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6bbbc"
Sep 11 21:15:04.385430 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:04.385375    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/22ffb45d-7e38-43ef-9c1d-775a96b0f13d-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6bbbc\" (UID: \"22ffb45d-7e38-43ef-9c1d-775a96b0f13d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6bbbc"
Sep 11 21:15:04.385702 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:04.385659    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/22ffb45d-7e38-43ef-9c1d-775a96b0f13d-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6bbbc\" (UID: \"22ffb45d-7e38-43ef-9c1d-775a96b0f13d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6bbbc"
Sep 11 21:15:04.385751 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:04.385667    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/22ffb45d-7e38-43ef-9c1d-775a96b0f13d-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6bbbc\" (UID: \"22ffb45d-7e38-43ef-9c1d-775a96b0f13d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6bbbc"
Sep 11 21:15:04.385790 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:04.385756    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22ffb45d-7e38-43ef-9c1d-775a96b0f13d-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6bbbc\" (UID: \"22ffb45d-7e38-43ef-9c1d-775a96b0f13d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6bbbc"
Sep 11 21:15:04.387876 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:04.387841    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/22ffb45d-7e38-43ef-9c1d-775a96b0f13d-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6bbbc\" (UID: \"22ffb45d-7e38-43ef-9c1d-775a96b0f13d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6bbbc"
Sep 11 21:15:04.387876 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:04.387868    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/22ffb45d-7e38-43ef-9c1d-775a96b0f13d-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6bbbc\" (UID: \"22ffb45d-7e38-43ef-9c1d-775a96b0f13d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6bbbc"
Sep 11 21:15:04.393245 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:04.393216    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pw7tv\" (UniqueName: \"kubernetes.io/projected/22ffb45d-7e38-43ef-9c1d-775a96b0f13d-kube-api-access-pw7tv\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6bbbc\" (UID: \"22ffb45d-7e38-43ef-9c1d-775a96b0f13d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6bbbc"
Sep 11 21:15:04.517165 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:04.517065    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6bbbc"
Sep 11 21:15:04.792873 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:04.792843    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6bbbc"]
Sep 11 21:15:04.795018 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:15:04.794984    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22ffb45d_7e38_43ef_9c1d_775a96b0f13d.slice/crio-f1e2c832142ade8a02c767994de426c0b5d7217db1ee226a2a0e68a7786126e5 WatchSource:0}: Error finding container f1e2c832142ade8a02c767994de426c0b5d7217db1ee226a2a0e68a7786126e5: Status 404 returned error can't find the container with id f1e2c832142ade8a02c767994de426c0b5d7217db1ee226a2a0e68a7786126e5
Sep 11 21:15:04.945931 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:04.945897    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6bbbc" event={"ID":"22ffb45d-7e38-43ef-9c1d-775a96b0f13d","Type":"ContainerStarted","Data":"f1e2c832142ade8a02c767994de426c0b5d7217db1ee226a2a0e68a7786126e5"}
Sep 11 21:15:05.080310 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:05.080271    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819355-wr9h6"
Sep 11 21:15:05.952117 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:05.952089    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819355-wr9h6"
Sep 11 21:15:05.952657 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:05.952084    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819355-wr9h6" event={"ID":"1b08603f-13e0-4456-bb5c-baf370799573","Type":"ContainerDied","Data":"e75b6aceac290e32ee0e9099162c111af6c6e08ed5c8a2efc4e17c203530fd00"}
Sep 11 21:15:05.952657 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:05.952227    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e75b6aceac290e32ee0e9099162c111af6c6e08ed5c8a2efc4e17c203530fd00"
Sep 11 21:15:06.960486 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:06.960453    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6bbbc" event={"ID":"22ffb45d-7e38-43ef-9c1d-775a96b0f13d","Type":"ContainerStarted","Data":"1eb3f82a369501e88d94840baab0552825569fed9c449f6cdcf8148c558f3978"}
Sep 11 21:15:06.982918 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:06.982862    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6bbbc" podStartSLOduration=1.811416825 podStartE2EDuration="2.98284139s" totalImagesPullingTime="1.171424565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:15:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:15:06.980314771 +0000 UTC m=+552.458626617" watchObservedRunningTime="2026-09-11 21:15:06.98284139 +0000 UTC m=+552.461153228"
Sep 11 21:15:11.327666 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:11.327631    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-9bgjp"]
Sep 11 21:15:11.328107 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:11.328090    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b08603f-13e0-4456-bb5c-baf370799573" containerName="cleanup"
Sep 11 21:15:11.328150 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:11.328110    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b08603f-13e0-4456-bb5c-baf370799573" containerName="cleanup"
Sep 11 21:15:11.328232 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:11.328222    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b08603f-13e0-4456-bb5c-baf370799573" containerName="cleanup"
Sep 11 21:15:11.331722 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:11.331701    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9bgjp"
Sep 11 21:15:11.334757 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:11.334732    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 11 21:15:11.342182 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:11.342150    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-9bgjp"]
Sep 11 21:15:11.455670 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:11.455624    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/659fac49-bf98-4112-b32d-c674fae31b84-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9bgjp\" (UID: \"659fac49-bf98-4112-b32d-c674fae31b84\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9bgjp"
Sep 11 21:15:11.455859 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:11.455682    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/659fac49-bf98-4112-b32d-c674fae31b84-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9bgjp\" (UID: \"659fac49-bf98-4112-b32d-c674fae31b84\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9bgjp"
Sep 11 21:15:11.455859 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:11.455728    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/659fac49-bf98-4112-b32d-c674fae31b84-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9bgjp\" (UID: \"659fac49-bf98-4112-b32d-c674fae31b84\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9bgjp"
Sep 11 21:15:11.455859 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:11.455766    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/659fac49-bf98-4112-b32d-c674fae31b84-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9bgjp\" (UID: \"659fac49-bf98-4112-b32d-c674fae31b84\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9bgjp"
Sep 11 21:15:11.455859 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:11.455793    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/659fac49-bf98-4112-b32d-c674fae31b84-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9bgjp\" (UID: \"659fac49-bf98-4112-b32d-c674fae31b84\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9bgjp"
Sep 11 21:15:11.455859 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:11.455815    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h59tj\" (UniqueName: \"kubernetes.io/projected/659fac49-bf98-4112-b32d-c674fae31b84-kube-api-access-h59tj\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9bgjp\" (UID: \"659fac49-bf98-4112-b32d-c674fae31b84\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9bgjp"
Sep 11 21:15:11.556955 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:11.556914    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/659fac49-bf98-4112-b32d-c674fae31b84-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9bgjp\" (UID: \"659fac49-bf98-4112-b32d-c674fae31b84\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9bgjp"
Sep 11 21:15:11.556955 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:11.556965    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/659fac49-bf98-4112-b32d-c674fae31b84-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9bgjp\" (UID: \"659fac49-bf98-4112-b32d-c674fae31b84\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9bgjp"
Sep 11 21:15:11.557218 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:11.556982    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/659fac49-bf98-4112-b32d-c674fae31b84-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9bgjp\" (UID: \"659fac49-bf98-4112-b32d-c674fae31b84\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9bgjp"
Sep 11 21:15:11.557218 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:11.557014    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/659fac49-bf98-4112-b32d-c674fae31b84-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9bgjp\" (UID: \"659fac49-bf98-4112-b32d-c674fae31b84\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9bgjp"
Sep 11 21:15:11.557218 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:11.557047    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/659fac49-bf98-4112-b32d-c674fae31b84-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9bgjp\" (UID: \"659fac49-bf98-4112-b32d-c674fae31b84\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9bgjp"
Sep 11 21:15:11.557218 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:11.557076    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h59tj\" (UniqueName: \"kubernetes.io/projected/659fac49-bf98-4112-b32d-c674fae31b84-kube-api-access-h59tj\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9bgjp\" (UID: \"659fac49-bf98-4112-b32d-c674fae31b84\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9bgjp"
Sep 11 21:15:11.557578 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:11.557541    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/659fac49-bf98-4112-b32d-c674fae31b84-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9bgjp\" (UID: \"659fac49-bf98-4112-b32d-c674fae31b84\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9bgjp"
Sep 11 21:15:11.557716 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:11.557542    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/659fac49-bf98-4112-b32d-c674fae31b84-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9bgjp\" (UID: \"659fac49-bf98-4112-b32d-c674fae31b84\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9bgjp"
Sep 11 21:15:11.557716 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:11.557694    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/659fac49-bf98-4112-b32d-c674fae31b84-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9bgjp\" (UID: \"659fac49-bf98-4112-b32d-c674fae31b84\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9bgjp"
Sep 11 21:15:11.559744 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:11.559705    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/659fac49-bf98-4112-b32d-c674fae31b84-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9bgjp\" (UID: \"659fac49-bf98-4112-b32d-c674fae31b84\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9bgjp"
Sep 11 21:15:11.560182 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:11.560160    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/659fac49-bf98-4112-b32d-c674fae31b84-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9bgjp\" (UID: \"659fac49-bf98-4112-b32d-c674fae31b84\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9bgjp"
Sep 11 21:15:11.568973 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:11.568943    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h59tj\" (UniqueName: \"kubernetes.io/projected/659fac49-bf98-4112-b32d-c674fae31b84-kube-api-access-h59tj\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9bgjp\" (UID: \"659fac49-bf98-4112-b32d-c674fae31b84\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9bgjp"
Sep 11 21:15:11.643374 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:11.643346    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9bgjp"
Sep 11 21:15:11.921192 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:11.921159    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-9bgjp"]
Sep 11 21:15:11.923677 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:15:11.923645    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod659fac49_bf98_4112_b32d_c674fae31b84.slice/crio-ba2a27f5b8be5c18e35cc8551ec690a324631af4c049d0c6154d7aa8d321c47a WatchSource:0}: Error finding container ba2a27f5b8be5c18e35cc8551ec690a324631af4c049d0c6154d7aa8d321c47a: Status 404 returned error can't find the container with id ba2a27f5b8be5c18e35cc8551ec690a324631af4c049d0c6154d7aa8d321c47a
Sep 11 21:15:11.992268 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:11.992236    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9bgjp" event={"ID":"659fac49-bf98-4112-b32d-c674fae31b84","Type":"ContainerStarted","Data":"ba2a27f5b8be5c18e35cc8551ec690a324631af4c049d0c6154d7aa8d321c47a"}
Sep 11 21:15:12.999332 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:12.999292    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9bgjp" event={"ID":"659fac49-bf98-4112-b32d-c674fae31b84","Type":"ContainerStarted","Data":"5256be0c5f7880943443c7148173849714ec5552824fac9cb273f5c780a0c13f"}
Sep 11 21:15:13.025210 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:13.025149    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9bgjp" podStartSLOduration=1.841251118 podStartE2EDuration="2.025126734s" totalImagesPullingTime="183.875616ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:15:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:15:13.023081792 +0000 UTC m=+558.501393637" watchObservedRunningTime="2026-09-11 21:15:13.025126734 +0000 UTC m=+558.503438611"
Sep 11 21:15:14.517881 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:14.517837    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6bbbc"
Sep 11 21:15:14.518271 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:14.517917    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6bbbc"
Sep 11 21:15:14.530914 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:14.530883    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6bbbc"
Sep 11 21:15:15.021996 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:15.021964    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6bbbc"
Sep 11 21:15:21.643859 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:21.643810    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9bgjp"
Sep 11 21:15:21.644314 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:21.643890    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9bgjp"
Sep 11 21:15:21.657072 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:21.657036    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9bgjp"
Sep 11 21:15:22.056575 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:15:22.056490    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9bgjp"
Sep 11 21:16:48.284013 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.283973    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc"]
Sep 11 21:16:48.287861 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.287836    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc"
Sep 11 21:16:48.299986 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.299958    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-ea5e33-openshift-default-dockercfg-v7qgv\""
Sep 11 21:16:48.308362 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.308330    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc"]
Sep 11 21:16:48.408714 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.408682    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw"]
Sep 11 21:16:48.409706 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.409674    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35aef6e0-32e3-4520-9b42-b094fa4f3f53-istio-data\") pod \"e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc\" (UID: \"35aef6e0-32e3-4520-9b42-b094fa4f3f53\") " pod="openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc"
Sep 11 21:16:48.409840 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.409718    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35aef6e0-32e3-4520-9b42-b094fa4f3f53-istiod-ca-cert\") pod \"e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc\" (UID: \"35aef6e0-32e3-4520-9b42-b094fa4f3f53\") " pod="openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc"
Sep 11 21:16:48.409840 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.409745    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35aef6e0-32e3-4520-9b42-b094fa4f3f53-workload-certs\") pod \"e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc\" (UID: \"35aef6e0-32e3-4520-9b42-b094fa4f3f53\") " pod="openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc"
Sep 11 21:16:48.409840 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.409766    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6f84\" (UniqueName: \"kubernetes.io/projected/35aef6e0-32e3-4520-9b42-b094fa4f3f53-kube-api-access-x6f84\") pod \"e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc\" (UID: \"35aef6e0-32e3-4520-9b42-b094fa4f3f53\") " pod="openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc"
Sep 11 21:16:48.409954 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.409869    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35aef6e0-32e3-4520-9b42-b094fa4f3f53-credential-socket\") pod \"e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc\" (UID: \"35aef6e0-32e3-4520-9b42-b094fa4f3f53\") " pod="openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc"
Sep 11 21:16:48.409954 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.409944    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35aef6e0-32e3-4520-9b42-b094fa4f3f53-istio-podinfo\") pod \"e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc\" (UID: \"35aef6e0-32e3-4520-9b42-b094fa4f3f53\") " pod="openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc"
Sep 11 21:16:48.410021 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.409976    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35aef6e0-32e3-4520-9b42-b094fa4f3f53-istio-envoy\") pod \"e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc\" (UID: \"35aef6e0-32e3-4520-9b42-b094fa4f3f53\") " pod="openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc"
Sep 11 21:16:48.410063 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.410045    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35aef6e0-32e3-4520-9b42-b094fa4f3f53-workload-socket\") pod \"e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc\" (UID: \"35aef6e0-32e3-4520-9b42-b094fa4f3f53\") " pod="openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc"
Sep 11 21:16:48.410098 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.410069    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35aef6e0-32e3-4520-9b42-b094fa4f3f53-istio-token\") pod \"e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc\" (UID: \"35aef6e0-32e3-4520-9b42-b094fa4f3f53\") " pod="openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc"
Sep 11 21:16:48.412554 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.412535    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw"
Sep 11 21:16:48.415093 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.415065    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-26462a-openshift-default-dockercfg-47ndx\""
Sep 11 21:16:48.438273 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.438236    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw"]
Sep 11 21:16:48.510914 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.510868    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35aef6e0-32e3-4520-9b42-b094fa4f3f53-workload-socket\") pod \"e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc\" (UID: \"35aef6e0-32e3-4520-9b42-b094fa4f3f53\") " pod="openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc"
Sep 11 21:16:48.510914 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.510915    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35aef6e0-32e3-4520-9b42-b094fa4f3f53-istio-token\") pod \"e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc\" (UID: \"35aef6e0-32e3-4520-9b42-b094fa4f3f53\") " pod="openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc"
Sep 11 21:16:48.511172 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.510956    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e45340b-c693-4168-951b-a3df79f884f6-istio-token\") pod \"e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw\" (UID: \"2e45340b-c693-4168-951b-a3df79f884f6\") " pod="openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw"
Sep 11 21:16:48.511172 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.510975    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e45340b-c693-4168-951b-a3df79f884f6-credential-socket\") pod \"e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw\" (UID: \"2e45340b-c693-4168-951b-a3df79f884f6\") " pod="openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw"
Sep 11 21:16:48.511172 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.510995    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e45340b-c693-4168-951b-a3df79f884f6-istio-data\") pod \"e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw\" (UID: \"2e45340b-c693-4168-951b-a3df79f884f6\") " pod="openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw"
Sep 11 21:16:48.511172 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.511027    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35aef6e0-32e3-4520-9b42-b094fa4f3f53-istio-data\") pod \"e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc\" (UID: \"35aef6e0-32e3-4520-9b42-b094fa4f3f53\") " pod="openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc"
Sep 11 21:16:48.511172 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.511059    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35aef6e0-32e3-4520-9b42-b094fa4f3f53-istiod-ca-cert\") pod \"e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc\" (UID: \"35aef6e0-32e3-4520-9b42-b094fa4f3f53\") " pod="openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc"
Sep 11 21:16:48.511172 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.511097    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35aef6e0-32e3-4520-9b42-b094fa4f3f53-workload-certs\") pod \"e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc\" (UID: \"35aef6e0-32e3-4520-9b42-b094fa4f3f53\") " pod="openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc"
Sep 11 21:16:48.511172 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.511123    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6f84\" (UniqueName: \"kubernetes.io/projected/35aef6e0-32e3-4520-9b42-b094fa4f3f53-kube-api-access-x6f84\") pod \"e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc\" (UID: \"35aef6e0-32e3-4520-9b42-b094fa4f3f53\") " pod="openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc"
Sep 11 21:16:48.511172 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.511158    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e45340b-c693-4168-951b-a3df79f884f6-workload-socket\") pod \"e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw\" (UID: \"2e45340b-c693-4168-951b-a3df79f884f6\") " pod="openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw"
Sep 11 21:16:48.511624 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.511187    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e45340b-c693-4168-951b-a3df79f884f6-workload-certs\") pod \"e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw\" (UID: \"2e45340b-c693-4168-951b-a3df79f884f6\") " pod="openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw"
Sep 11 21:16:48.511624 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.511232    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35aef6e0-32e3-4520-9b42-b094fa4f3f53-credential-socket\") pod \"e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc\" (UID: \"35aef6e0-32e3-4520-9b42-b094fa4f3f53\") " pod="openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc"
Sep 11 21:16:48.511624 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.511254    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e45340b-c693-4168-951b-a3df79f884f6-istiod-ca-cert\") pod \"e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw\" (UID: \"2e45340b-c693-4168-951b-a3df79f884f6\") " pod="openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw"
Sep 11 21:16:48.511624 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.511278    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e45340b-c693-4168-951b-a3df79f884f6-istio-podinfo\") pod \"e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw\" (UID: \"2e45340b-c693-4168-951b-a3df79f884f6\") " pod="openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw"
Sep 11 21:16:48.511624 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.511335    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35aef6e0-32e3-4520-9b42-b094fa4f3f53-istio-podinfo\") pod \"e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc\" (UID: \"35aef6e0-32e3-4520-9b42-b094fa4f3f53\") " pod="openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc"
Sep 11 21:16:48.511624 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.511412    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35aef6e0-32e3-4520-9b42-b094fa4f3f53-workload-socket\") pod \"e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc\" (UID: \"35aef6e0-32e3-4520-9b42-b094fa4f3f53\") " pod="openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc"
Sep 11 21:16:48.511624 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.511427    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35aef6e0-32e3-4520-9b42-b094fa4f3f53-istio-envoy\") pod \"e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc\" (UID: \"35aef6e0-32e3-4520-9b42-b094fa4f3f53\") " pod="openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc"
Sep 11 21:16:48.511624 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.511488    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stfzt\" (UniqueName: \"kubernetes.io/projected/2e45340b-c693-4168-951b-a3df79f884f6-kube-api-access-stfzt\") pod \"e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw\" (UID: \"2e45340b-c693-4168-951b-a3df79f884f6\") " pod="openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw"
Sep 11 21:16:48.511624 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.511574    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e45340b-c693-4168-951b-a3df79f884f6-istio-envoy\") pod \"e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw\" (UID: \"2e45340b-c693-4168-951b-a3df79f884f6\") " pod="openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw"
Sep 11 21:16:48.512088 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.511640    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35aef6e0-32e3-4520-9b42-b094fa4f3f53-workload-certs\") pod \"e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc\" (UID: \"35aef6e0-32e3-4520-9b42-b094fa4f3f53\") " pod="openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc"
Sep 11 21:16:48.512088 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.511862    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35aef6e0-32e3-4520-9b42-b094fa4f3f53-istio-data\") pod \"e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc\" (UID: \"35aef6e0-32e3-4520-9b42-b094fa4f3f53\") " pod="openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc"
Sep 11 21:16:48.512088 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.511880    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35aef6e0-32e3-4520-9b42-b094fa4f3f53-credential-socket\") pod \"e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc\" (UID: \"35aef6e0-32e3-4520-9b42-b094fa4f3f53\") " pod="openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc"
Sep 11 21:16:48.512244 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.512159    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35aef6e0-32e3-4520-9b42-b094fa4f3f53-istiod-ca-cert\") pod \"e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc\" (UID: \"35aef6e0-32e3-4520-9b42-b094fa4f3f53\") " pod="openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc"
Sep 11 21:16:48.513971 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.513944    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35aef6e0-32e3-4520-9b42-b094fa4f3f53-istio-envoy\") pod \"e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc\" (UID: \"35aef6e0-32e3-4520-9b42-b094fa4f3f53\") " pod="openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc"
Sep 11 21:16:48.514519 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.514491    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35aef6e0-32e3-4520-9b42-b094fa4f3f53-istio-podinfo\") pod \"e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc\" (UID: \"35aef6e0-32e3-4520-9b42-b094fa4f3f53\") " pod="openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc"
Sep 11 21:16:48.524565 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.524532    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn"]
Sep 11 21:16:48.528548 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.528521    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn"
Sep 11 21:16:48.533812 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.533786    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-962a7d-openshift-default-dockercfg-n6zkn\""
Sep 11 21:16:48.537047 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.536978    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6f84\" (UniqueName: \"kubernetes.io/projected/35aef6e0-32e3-4520-9b42-b094fa4f3f53-kube-api-access-x6f84\") pod \"e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc\" (UID: \"35aef6e0-32e3-4520-9b42-b094fa4f3f53\") " pod="openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc"
Sep 11 21:16:48.541934 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.541904    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35aef6e0-32e3-4520-9b42-b094fa4f3f53-istio-token\") pod \"e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc\" (UID: \"35aef6e0-32e3-4520-9b42-b094fa4f3f53\") " pod="openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc"
Sep 11 21:16:48.553617 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.553578    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn"]
Sep 11 21:16:48.598344 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.598308    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc"
Sep 11 21:16:48.612943 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.612906    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e45340b-c693-4168-951b-a3df79f884f6-istio-token\") pod \"e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw\" (UID: \"2e45340b-c693-4168-951b-a3df79f884f6\") " pod="openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw"
Sep 11 21:16:48.613077 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.612948    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e45340b-c693-4168-951b-a3df79f884f6-credential-socket\") pod \"e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw\" (UID: \"2e45340b-c693-4168-951b-a3df79f884f6\") " pod="openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw"
Sep 11 21:16:48.613077 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.612972    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb31366e-1024-4d0b-8152-e966df8c777d-istio-envoy\") pod \"e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn\" (UID: \"eb31366e-1024-4d0b-8152-e966df8c777d\") " pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn"
Sep 11 21:16:48.613077 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.612995    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e45340b-c693-4168-951b-a3df79f884f6-istio-data\") pod \"e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw\" (UID: \"2e45340b-c693-4168-951b-a3df79f884f6\") " pod="openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw"
Sep 11 21:16:48.613077 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.613023    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb31366e-1024-4d0b-8152-e966df8c777d-istio-data\") pod \"e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn\" (UID: \"eb31366e-1024-4d0b-8152-e966df8c777d\") " pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn"
Sep 11 21:16:48.613077 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.613048    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb31366e-1024-4d0b-8152-e966df8c777d-credential-socket\") pod \"e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn\" (UID: \"eb31366e-1024-4d0b-8152-e966df8c777d\") " pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn"
Sep 11 21:16:48.613341 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.613114    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb31366e-1024-4d0b-8152-e966df8c777d-istio-podinfo\") pod \"e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn\" (UID: \"eb31366e-1024-4d0b-8152-e966df8c777d\") " pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn"
Sep 11 21:16:48.613341 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.613178    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e45340b-c693-4168-951b-a3df79f884f6-workload-socket\") pod \"e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw\" (UID: \"2e45340b-c693-4168-951b-a3df79f884f6\") " pod="openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw"
Sep 11 21:16:48.613341 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.613201    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e45340b-c693-4168-951b-a3df79f884f6-workload-certs\") pod \"e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw\" (UID: \"2e45340b-c693-4168-951b-a3df79f884f6\") " pod="openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw"
Sep 11 21:16:48.613341 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.613257    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e45340b-c693-4168-951b-a3df79f884f6-istiod-ca-cert\") pod \"e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw\" (UID: \"2e45340b-c693-4168-951b-a3df79f884f6\") " pod="openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw"
Sep 11 21:16:48.613341 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.613326    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e45340b-c693-4168-951b-a3df79f884f6-istio-podinfo\") pod \"e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw\" (UID: \"2e45340b-c693-4168-951b-a3df79f884f6\") " pod="openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw"
Sep 11 21:16:48.613593 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.613349    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e45340b-c693-4168-951b-a3df79f884f6-istio-data\") pod \"e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw\" (UID: \"2e45340b-c693-4168-951b-a3df79f884f6\") " pod="openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw"
Sep 11 21:16:48.613593 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.613366    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb31366e-1024-4d0b-8152-e966df8c777d-istiod-ca-cert\") pod \"e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn\" (UID: \"eb31366e-1024-4d0b-8152-e966df8c777d\") " pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn"
Sep 11 21:16:48.613733 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.613452    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e45340b-c693-4168-951b-a3df79f884f6-credential-socket\") pod \"e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw\" (UID: \"2e45340b-c693-4168-951b-a3df79f884f6\") " pod="openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw"
Sep 11 21:16:48.613805 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.613621    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e45340b-c693-4168-951b-a3df79f884f6-workload-socket\") pod \"e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw\" (UID: \"2e45340b-c693-4168-951b-a3df79f884f6\") " pod="openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw"
Sep 11 21:16:48.613805 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.613620    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e45340b-c693-4168-951b-a3df79f884f6-workload-certs\") pod \"e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw\" (UID: \"2e45340b-c693-4168-951b-a3df79f884f6\") " pod="openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw"
Sep 11 21:16:48.613805 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.613716    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkxsm\" (UniqueName: \"kubernetes.io/projected/eb31366e-1024-4d0b-8152-e966df8c777d-kube-api-access-fkxsm\") pod \"e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn\" (UID: \"eb31366e-1024-4d0b-8152-e966df8c777d\") " pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn"
Sep 11 21:16:48.613960 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.613824    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stfzt\" (UniqueName: \"kubernetes.io/projected/2e45340b-c693-4168-951b-a3df79f884f6-kube-api-access-stfzt\") pod \"e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw\" (UID: \"2e45340b-c693-4168-951b-a3df79f884f6\") " pod="openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw"
Sep 11 21:16:48.613960 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.613868    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e45340b-c693-4168-951b-a3df79f884f6-istio-envoy\") pod \"e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw\" (UID: \"2e45340b-c693-4168-951b-a3df79f884f6\") " pod="openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw"
Sep 11 21:16:48.613960 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.613903    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb31366e-1024-4d0b-8152-e966df8c777d-workload-socket\") pod \"e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn\" (UID: \"eb31366e-1024-4d0b-8152-e966df8c777d\") " pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn"
Sep 11 21:16:48.613960 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.613956    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb31366e-1024-4d0b-8152-e966df8c777d-workload-certs\") pod \"e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn\" (UID: \"eb31366e-1024-4d0b-8152-e966df8c777d\") " pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn"
Sep 11 21:16:48.614160 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.613983    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb31366e-1024-4d0b-8152-e966df8c777d-istio-token\") pod \"e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn\" (UID: \"eb31366e-1024-4d0b-8152-e966df8c777d\") " pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn"
Sep 11 21:16:48.614160 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.614114    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e45340b-c693-4168-951b-a3df79f884f6-istiod-ca-cert\") pod \"e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw\" (UID: \"2e45340b-c693-4168-951b-a3df79f884f6\") " pod="openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw"
Sep 11 21:16:48.616048 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.615978    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e45340b-c693-4168-951b-a3df79f884f6-istio-podinfo\") pod \"e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw\" (UID: \"2e45340b-c693-4168-951b-a3df79f884f6\") " pod="openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw"
Sep 11 21:16:48.616298 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.616227    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e45340b-c693-4168-951b-a3df79f884f6-istio-envoy\") pod \"e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw\" (UID: \"2e45340b-c693-4168-951b-a3df79f884f6\") " pod="openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw"
Sep 11 21:16:48.623276 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.623249    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e45340b-c693-4168-951b-a3df79f884f6-istio-token\") pod \"e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw\" (UID: \"2e45340b-c693-4168-951b-a3df79f884f6\") " pod="openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw"
Sep 11 21:16:48.623585 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.623563    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stfzt\" (UniqueName: \"kubernetes.io/projected/2e45340b-c693-4168-951b-a3df79f884f6-kube-api-access-stfzt\") pod \"e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw\" (UID: \"2e45340b-c693-4168-951b-a3df79f884f6\") " pod="openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw"
Sep 11 21:16:48.714967 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.714922    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb31366e-1024-4d0b-8152-e966df8c777d-workload-socket\") pod \"e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn\" (UID: \"eb31366e-1024-4d0b-8152-e966df8c777d\") " pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn"
Sep 11 21:16:48.715167 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.714983    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb31366e-1024-4d0b-8152-e966df8c777d-workload-certs\") pod \"e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn\" (UID: \"eb31366e-1024-4d0b-8152-e966df8c777d\") " pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn"
Sep 11 21:16:48.715167 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.715005    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb31366e-1024-4d0b-8152-e966df8c777d-istio-token\") pod \"e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn\" (UID: \"eb31366e-1024-4d0b-8152-e966df8c777d\") " pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn"
Sep 11 21:16:48.715167 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.715034    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb31366e-1024-4d0b-8152-e966df8c777d-istio-envoy\") pod \"e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn\" (UID: \"eb31366e-1024-4d0b-8152-e966df8c777d\") " pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn"
Sep 11 21:16:48.715167 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.715055    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb31366e-1024-4d0b-8152-e966df8c777d-istio-data\") pod \"e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn\" (UID: \"eb31366e-1024-4d0b-8152-e966df8c777d\") " pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn"
Sep 11 21:16:48.715167 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.715084    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb31366e-1024-4d0b-8152-e966df8c777d-credential-socket\") pod \"e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn\" (UID: \"eb31366e-1024-4d0b-8152-e966df8c777d\") " pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn"
Sep 11 21:16:48.715413 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.715173    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb31366e-1024-4d0b-8152-e966df8c777d-istio-podinfo\") pod \"e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn\" (UID: \"eb31366e-1024-4d0b-8152-e966df8c777d\") " pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn"
Sep 11 21:16:48.715413 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.715273    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb31366e-1024-4d0b-8152-e966df8c777d-istiod-ca-cert\") pod \"e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn\" (UID: \"eb31366e-1024-4d0b-8152-e966df8c777d\") " pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn"
Sep 11 21:16:48.715413 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.715325    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkxsm\" (UniqueName: \"kubernetes.io/projected/eb31366e-1024-4d0b-8152-e966df8c777d-kube-api-access-fkxsm\") pod \"e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn\" (UID: \"eb31366e-1024-4d0b-8152-e966df8c777d\") " pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn"
Sep 11 21:16:48.715413 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.715346    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb31366e-1024-4d0b-8152-e966df8c777d-workload-socket\") pod \"e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn\" (UID: \"eb31366e-1024-4d0b-8152-e966df8c777d\") " pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn"
Sep 11 21:16:48.715645 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.715623    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb31366e-1024-4d0b-8152-e966df8c777d-workload-certs\") pod \"e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn\" (UID: \"eb31366e-1024-4d0b-8152-e966df8c777d\") " pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn"
Sep 11 21:16:48.715738 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.715716    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb31366e-1024-4d0b-8152-e966df8c777d-istio-data\") pod \"e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn\" (UID: \"eb31366e-1024-4d0b-8152-e966df8c777d\") " pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn"
Sep 11 21:16:48.715977 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.715956    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb31366e-1024-4d0b-8152-e966df8c777d-credential-socket\") pod \"e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn\" (UID: \"eb31366e-1024-4d0b-8152-e966df8c777d\") " pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn"
Sep 11 21:16:48.716080 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.716064    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb31366e-1024-4d0b-8152-e966df8c777d-istiod-ca-cert\") pod \"e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn\" (UID: \"eb31366e-1024-4d0b-8152-e966df8c777d\") " pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn"
Sep 11 21:16:48.718237 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.718211    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb31366e-1024-4d0b-8152-e966df8c777d-istio-envoy\") pod \"e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn\" (UID: \"eb31366e-1024-4d0b-8152-e966df8c777d\") " pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn"
Sep 11 21:16:48.718561 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.718541    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb31366e-1024-4d0b-8152-e966df8c777d-istio-podinfo\") pod \"e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn\" (UID: \"eb31366e-1024-4d0b-8152-e966df8c777d\") " pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn"
Sep 11 21:16:48.723186 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.723154    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw"
Sep 11 21:16:48.724154 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.724130    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkxsm\" (UniqueName: \"kubernetes.io/projected/eb31366e-1024-4d0b-8152-e966df8c777d-kube-api-access-fkxsm\") pod \"e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn\" (UID: \"eb31366e-1024-4d0b-8152-e966df8c777d\") " pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn"
Sep 11 21:16:48.724299 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.724174    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb31366e-1024-4d0b-8152-e966df8c777d-istio-token\") pod \"e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn\" (UID: \"eb31366e-1024-4d0b-8152-e966df8c777d\") " pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn"
Sep 11 21:16:48.862471 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.862336    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn"
Sep 11 21:16:48.882446 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.882412    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc"]
Sep 11 21:16:48.883710 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:16:48.883680    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35aef6e0_32e3_4520_9b42_b094fa4f3f53.slice/crio-7d08b79262c7180eb79bbc99efaeea65e5d982426519808f36d0831867d5f74b WatchSource:0}: Error finding container 7d08b79262c7180eb79bbc99efaeea65e5d982426519808f36d0831867d5f74b: Status 404 returned error can't find the container with id 7d08b79262c7180eb79bbc99efaeea65e5d982426519808f36d0831867d5f74b
Sep 11 21:16:48.886080 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.886039    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:16:48.886172 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.886115    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:16:48.886172 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:48.886144    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:16:49.006530 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:49.006498    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw"]
Sep 11 21:16:49.007455 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:16:49.007425    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e45340b_c693_4168_951b_a3df79f884f6.slice/crio-08554efb61dc48305e9b52a9a94e43ce9b881b716a77cc20c65817f4a385440f WatchSource:0}: Error finding container 08554efb61dc48305e9b52a9a94e43ce9b881b716a77cc20c65817f4a385440f: Status 404 returned error can't find the container with id 08554efb61dc48305e9b52a9a94e43ce9b881b716a77cc20c65817f4a385440f
Sep 11 21:16:49.010745 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:49.010710    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:16:49.010868 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:49.010800    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:16:49.010868 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:49.010846    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:16:49.147455 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:49.147375    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn"]
Sep 11 21:16:49.149937 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:16:49.149906    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb31366e_1024_4d0b_8152_e966df8c777d.slice/crio-dc5cf5a3a22ff0c3477893fbdce832b4bf6ae9c4fc2ce8c1ed941650c13886d2 WatchSource:0}: Error finding container dc5cf5a3a22ff0c3477893fbdce832b4bf6ae9c4fc2ce8c1ed941650c13886d2: Status 404 returned error can't find the container with id dc5cf5a3a22ff0c3477893fbdce832b4bf6ae9c4fc2ce8c1ed941650c13886d2
Sep 11 21:16:49.152515 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:49.152482    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:16:49.152694 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:49.152670    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:16:49.152775 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:49.152726    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:16:49.498743 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:49.498637    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn" event={"ID":"eb31366e-1024-4d0b-8152-e966df8c777d","Type":"ContainerStarted","Data":"622ae7791766ec12ac497a332486afb487144baad5e7276a3cebd357a4c80cea"}
Sep 11 21:16:49.498743 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:49.498693    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn" event={"ID":"eb31366e-1024-4d0b-8152-e966df8c777d","Type":"ContainerStarted","Data":"dc5cf5a3a22ff0c3477893fbdce832b4bf6ae9c4fc2ce8c1ed941650c13886d2"}
Sep 11 21:16:49.500710 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:49.500678    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw" event={"ID":"2e45340b-c693-4168-951b-a3df79f884f6","Type":"ContainerStarted","Data":"e9a8d290056831174e6b6c3920d73892d2dd3026c8dd86985a4c1e53ca95d7a1"}
Sep 11 21:16:49.500865 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:49.500741    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw" event={"ID":"2e45340b-c693-4168-951b-a3df79f884f6","Type":"ContainerStarted","Data":"08554efb61dc48305e9b52a9a94e43ce9b881b716a77cc20c65817f4a385440f"}
Sep 11 21:16:49.502603 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:49.502575    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc" event={"ID":"35aef6e0-32e3-4520-9b42-b094fa4f3f53","Type":"ContainerStarted","Data":"185e1eee74e2ffb3db69c21c2ba115663d590a1b133aa59f5d0e952a2a872230"}
Sep 11 21:16:49.502740 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:49.502618    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc" event={"ID":"35aef6e0-32e3-4520-9b42-b094fa4f3f53","Type":"ContainerStarted","Data":"7d08b79262c7180eb79bbc99efaeea65e5d982426519808f36d0831867d5f74b"}
Sep 11 21:16:49.531264 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:49.531201    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn" podStartSLOduration=1.5311802079999999 podStartE2EDuration="1.531180208s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:16:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:16:49.529861958 +0000 UTC m=+655.008173804" watchObservedRunningTime="2026-09-11 21:16:49.531180208 +0000 UTC m=+655.009492199"
Sep 11 21:16:49.561725 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:49.561656    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw" podStartSLOduration=1.5616323300000001 podStartE2EDuration="1.56163233s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:16:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:16:49.558160352 +0000 UTC m=+655.036472221" watchObservedRunningTime="2026-09-11 21:16:49.56163233 +0000 UTC m=+655.039944177"
Sep 11 21:16:49.578429 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:49.578334    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc" podStartSLOduration=1.578313965 podStartE2EDuration="1.578313965s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:16:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:16:49.577285364 +0000 UTC m=+655.055597209" watchObservedRunningTime="2026-09-11 21:16:49.578313965 +0000 UTC m=+655.056625809"
Sep 11 21:16:49.599597 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:49.599547    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc"
Sep 11 21:16:49.605522 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:49.605491    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc"
Sep 11 21:16:49.723930 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:49.723891    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw"
Sep 11 21:16:49.862714 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:49.862611    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn"
Sep 11 21:16:50.509577 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:50.509538    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc"
Sep 11 21:16:50.510361 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:50.510334    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc"
Sep 11 21:16:50.729729 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:50.729696    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw"
Sep 11 21:16:50.868701 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:50.868673    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn"
Sep 11 21:16:51.514639 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:51.514605    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn"
Sep 11 21:16:51.515098 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:51.514653    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw"
Sep 11 21:16:51.515188 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:51.515173    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn"
Sep 11 21:16:51.515240 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:51.515221    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw"
Sep 11 21:16:53.917318 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:53.917274    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-962a7d-54fcd4b8db-h7sk5"]
Sep 11 21:16:53.921103 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:53.921083    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-962a7d-54fcd4b8db-h7sk5"
Sep 11 21:16:53.923595 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:53.923565    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-962a7d\""
Sep 11 21:16:53.923751 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:53.923719    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-962a7d-dockercfg-6t7lv\""
Sep 11 21:16:53.931835 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:53.931801    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-962a7d-54fcd4b8db-h7sk5"]
Sep 11 21:16:53.982875 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:53.982834    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd129171-9973-4067-a3d5-4c2faa3f7322-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-962a7d-54fcd4b8db-h7sk5\" (UID: \"bd129171-9973-4067-a3d5-4c2faa3f7322\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-962a7d-54fcd4b8db-h7sk5"
Sep 11 21:16:53.983023 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:53.982933    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpmj8\" (UniqueName: \"kubernetes.io/projected/bd129171-9973-4067-a3d5-4c2faa3f7322-kube-api-access-lpmj8\") pod \"payload-pre-processing-e2e-worker-w4-962a7d-54fcd4b8db-h7sk5\" (UID: \"bd129171-9973-4067-a3d5-4c2faa3f7322\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-962a7d-54fcd4b8db-h7sk5"
Sep 11 21:16:54.083703 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:54.083660    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpmj8\" (UniqueName: \"kubernetes.io/projected/bd129171-9973-4067-a3d5-4c2faa3f7322-kube-api-access-lpmj8\") pod \"payload-pre-processing-e2e-worker-w4-962a7d-54fcd4b8db-h7sk5\" (UID: \"bd129171-9973-4067-a3d5-4c2faa3f7322\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-962a7d-54fcd4b8db-h7sk5"
Sep 11 21:16:54.083883 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:54.083759    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd129171-9973-4067-a3d5-4c2faa3f7322-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-962a7d-54fcd4b8db-h7sk5\" (UID: \"bd129171-9973-4067-a3d5-4c2faa3f7322\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-962a7d-54fcd4b8db-h7sk5"
Sep 11 21:16:54.084488 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:54.084468    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd129171-9973-4067-a3d5-4c2faa3f7322-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-962a7d-54fcd4b8db-h7sk5\" (UID: \"bd129171-9973-4067-a3d5-4c2faa3f7322\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-962a7d-54fcd4b8db-h7sk5"
Sep 11 21:16:54.098470 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:54.098439    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpmj8\" (UniqueName: \"kubernetes.io/projected/bd129171-9973-4067-a3d5-4c2faa3f7322-kube-api-access-lpmj8\") pod \"payload-pre-processing-e2e-worker-w4-962a7d-54fcd4b8db-h7sk5\" (UID: \"bd129171-9973-4067-a3d5-4c2faa3f7322\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-962a7d-54fcd4b8db-h7sk5"
Sep 11 21:16:54.234250 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:54.234139    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-962a7d-54fcd4b8db-h7sk5"
Sep 11 21:16:54.518892 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:54.518867    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-962a7d-54fcd4b8db-h7sk5"]
Sep 11 21:16:54.521370 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:16:54.521318    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd129171_9973_4067_a3d5_4c2faa3f7322.slice/crio-cb678079b2f7d3574c2b355dad87a3043b7e868721ea36803d958309ba265c6a WatchSource:0}: Error finding container cb678079b2f7d3574c2b355dad87a3043b7e868721ea36803d958309ba265c6a: Status 404 returned error can't find the container with id cb678079b2f7d3574c2b355dad87a3043b7e868721ea36803d958309ba265c6a
Sep 11 21:16:54.533893 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:54.533864    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-962a7d-54fcd4b8db-h7sk5" event={"ID":"bd129171-9973-4067-a3d5-4c2faa3f7322","Type":"ContainerStarted","Data":"cb678079b2f7d3574c2b355dad87a3043b7e868721ea36803d958309ba265c6a"}
Sep 11 21:16:55.069870 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:55.069839    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-26462a-854bf7ff54-2zldl"]
Sep 11 21:16:55.075233 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:55.075202    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-26462a-75c6958dff-gnp6v"]
Sep 11 21:16:55.075478 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:55.075300    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-26462a-854bf7ff54-2zldl"
Sep 11 21:16:55.078041 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:55.077993    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-26462a\""
Sep 11 21:16:55.078185 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:55.078094    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-26462a-dockercfg-6m94v\""
Sep 11 21:16:55.080704 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:55.080544    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-26462a-75c6958dff-gnp6v"
Sep 11 21:16:55.083643 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:55.083614    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-26462a-854bf7ff54-2zldl"]
Sep 11 21:16:55.090479 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:55.090447    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-26462a-75c6958dff-gnp6v"]
Sep 11 21:16:55.092803 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:55.092772    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6nst\" (UniqueName: \"kubernetes.io/projected/d1178699-07be-4028-8579-394c3aabb22c-kube-api-access-x6nst\") pod \"payload-pre-processing-e2e-inf-a-26462a-854bf7ff54-2zldl\" (UID: \"d1178699-07be-4028-8579-394c3aabb22c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-26462a-854bf7ff54-2zldl"
Sep 11 21:16:55.092938 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:55.092892    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1178699-07be-4028-8579-394c3aabb22c-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-26462a-854bf7ff54-2zldl\" (UID: \"d1178699-07be-4028-8579-394c3aabb22c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-26462a-854bf7ff54-2zldl"
Sep 11 21:16:55.093331 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:55.093000    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zs4jp\" (UniqueName: \"kubernetes.io/projected/d778faff-d07b-40e4-a46a-e103ed4485fb-kube-api-access-zs4jp\") pod \"payload-processing-e2e-inf-a-26462a-75c6958dff-gnp6v\" (UID: \"d778faff-d07b-40e4-a46a-e103ed4485fb\") " pod="openshift-ingress/payload-processing-e2e-inf-a-26462a-75c6958dff-gnp6v"
Sep 11 21:16:55.093331 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:55.093054    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d778faff-d07b-40e4-a46a-e103ed4485fb-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-26462a-75c6958dff-gnp6v\" (UID: \"d778faff-d07b-40e4-a46a-e103ed4485fb\") " pod="openshift-ingress/payload-processing-e2e-inf-a-26462a-75c6958dff-gnp6v"
Sep 11 21:16:55.194215 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:55.194173    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d778faff-d07b-40e4-a46a-e103ed4485fb-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-26462a-75c6958dff-gnp6v\" (UID: \"d778faff-d07b-40e4-a46a-e103ed4485fb\") " pod="openshift-ingress/payload-processing-e2e-inf-a-26462a-75c6958dff-gnp6v"
Sep 11 21:16:55.194460 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:55.194264    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6nst\" (UniqueName: \"kubernetes.io/projected/d1178699-07be-4028-8579-394c3aabb22c-kube-api-access-x6nst\") pod \"payload-pre-processing-e2e-inf-a-26462a-854bf7ff54-2zldl\" (UID: \"d1178699-07be-4028-8579-394c3aabb22c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-26462a-854bf7ff54-2zldl"
Sep 11 21:16:55.194460 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:55.194325    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1178699-07be-4028-8579-394c3aabb22c-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-26462a-854bf7ff54-2zldl\" (UID: \"d1178699-07be-4028-8579-394c3aabb22c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-26462a-854bf7ff54-2zldl"
Sep 11 21:16:55.194460 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:55.194435    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zs4jp\" (UniqueName: \"kubernetes.io/projected/d778faff-d07b-40e4-a46a-e103ed4485fb-kube-api-access-zs4jp\") pod \"payload-processing-e2e-inf-a-26462a-75c6958dff-gnp6v\" (UID: \"d778faff-d07b-40e4-a46a-e103ed4485fb\") " pod="openshift-ingress/payload-processing-e2e-inf-a-26462a-75c6958dff-gnp6v"
Sep 11 21:16:55.195812 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:55.195780    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1178699-07be-4028-8579-394c3aabb22c-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-26462a-854bf7ff54-2zldl\" (UID: \"d1178699-07be-4028-8579-394c3aabb22c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-26462a-854bf7ff54-2zldl"
Sep 11 21:16:55.196029 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:55.195813    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d778faff-d07b-40e4-a46a-e103ed4485fb-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-26462a-75c6958dff-gnp6v\" (UID: \"d778faff-d07b-40e4-a46a-e103ed4485fb\") " pod="openshift-ingress/payload-processing-e2e-inf-a-26462a-75c6958dff-gnp6v"
Sep 11 21:16:55.204376 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:55.204346    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6nst\" (UniqueName: \"kubernetes.io/projected/d1178699-07be-4028-8579-394c3aabb22c-kube-api-access-x6nst\") pod \"payload-pre-processing-e2e-inf-a-26462a-854bf7ff54-2zldl\" (UID: \"d1178699-07be-4028-8579-394c3aabb22c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-26462a-854bf7ff54-2zldl"
Sep 11 21:16:55.204578 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:55.204399    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zs4jp\" (UniqueName: \"kubernetes.io/projected/d778faff-d07b-40e4-a46a-e103ed4485fb-kube-api-access-zs4jp\") pod \"payload-processing-e2e-inf-a-26462a-75c6958dff-gnp6v\" (UID: \"d778faff-d07b-40e4-a46a-e103ed4485fb\") " pod="openshift-ingress/payload-processing-e2e-inf-a-26462a-75c6958dff-gnp6v"
Sep 11 21:16:55.390610 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:55.390569    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-26462a-854bf7ff54-2zldl"
Sep 11 21:16:55.400322 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:55.400286    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-26462a-75c6958dff-gnp6v"
Sep 11 21:16:55.541817 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:55.541779    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-962a7d-54fcd4b8db-h7sk5" event={"ID":"bd129171-9973-4067-a3d5-4c2faa3f7322","Type":"ContainerStarted","Data":"4214b1510f8d319902a3bc46e01f189f4c03c83a43412613a1b1148a4013779e"}
Sep 11 21:16:55.542022 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:55.541929    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-962a7d-54fcd4b8db-h7sk5"
Sep 11 21:16:55.570134 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:55.570077    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-962a7d-54fcd4b8db-h7sk5" podStartSLOduration=2.570059066 podStartE2EDuration="2.570059066s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:16:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:16:55.567930525 +0000 UTC m=+661.046242368" watchObservedRunningTime="2026-09-11 21:16:55.570059066 +0000 UTC m=+661.048370910"
Sep 11 21:16:55.669152 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:55.669120    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-26462a-854bf7ff54-2zldl"]
Sep 11 21:16:55.671280 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:16:55.671253    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1178699_07be_4028_8579_394c3aabb22c.slice/crio-c21f8c109ee600eb53b0d2dddd399d26a5e5214bb8afe84052e6a2c9b9086727 WatchSource:0}: Error finding container c21f8c109ee600eb53b0d2dddd399d26a5e5214bb8afe84052e6a2c9b9086727: Status 404 returned error can't find the container with id c21f8c109ee600eb53b0d2dddd399d26a5e5214bb8afe84052e6a2c9b9086727
Sep 11 21:16:55.689416 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:55.689371    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-26462a-75c6958dff-gnp6v"]
Sep 11 21:16:55.690992 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:16:55.690966    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd778faff_d07b_40e4_a46a_e103ed4485fb.slice/crio-057facc723fb20c0fdf5740a7ee05bcb62a4cc75fdd06bc3d088b42e506612d9 WatchSource:0}: Error finding container 057facc723fb20c0fdf5740a7ee05bcb62a4cc75fdd06bc3d088b42e506612d9: Status 404 returned error can't find the container with id 057facc723fb20c0fdf5740a7ee05bcb62a4cc75fdd06bc3d088b42e506612d9
Sep 11 21:16:56.549091 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:56.549058    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-26462a-75c6958dff-gnp6v" event={"ID":"d778faff-d07b-40e4-a46a-e103ed4485fb","Type":"ContainerStarted","Data":"f056c915aa8d5d89f0ea28569f0915d8cfe9a6c1c8091126eaabe9407b632d24"}
Sep 11 21:16:56.549601 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:56.549114    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-26462a-75c6958dff-gnp6v" event={"ID":"d778faff-d07b-40e4-a46a-e103ed4485fb","Type":"ContainerStarted","Data":"057facc723fb20c0fdf5740a7ee05bcb62a4cc75fdd06bc3d088b42e506612d9"}
Sep 11 21:16:56.549601 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:56.549197    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-26462a-75c6958dff-gnp6v"
Sep 11 21:16:56.550919 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:56.550885    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-26462a-854bf7ff54-2zldl" event={"ID":"d1178699-07be-4028-8579-394c3aabb22c","Type":"ContainerStarted","Data":"bb980bc6060a4e571bcfcb8d90c4c74a8a8f1b7645f204aca7a8969b9e1b462f"}
Sep 11 21:16:56.551025 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:56.550943    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-26462a-854bf7ff54-2zldl" event={"ID":"d1178699-07be-4028-8579-394c3aabb22c","Type":"ContainerStarted","Data":"c21f8c109ee600eb53b0d2dddd399d26a5e5214bb8afe84052e6a2c9b9086727"}
Sep 11 21:16:56.551082 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:56.551070    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-26462a-854bf7ff54-2zldl"
Sep 11 21:16:56.572019 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:56.571953    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-26462a-75c6958dff-gnp6v" podStartSLOduration=1.571929231 podStartE2EDuration="1.571929231s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:16:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:16:56.568751148 +0000 UTC m=+662.047062993" watchObservedRunningTime="2026-09-11 21:16:56.571929231 +0000 UTC m=+662.050241078"
Sep 11 21:16:56.589251 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:56.589184    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-26462a-854bf7ff54-2zldl" podStartSLOduration=1.589160387 podStartE2EDuration="1.589160387s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:16:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:16:56.586317846 +0000 UTC m=+662.064629690" watchObservedRunningTime="2026-09-11 21:16:56.589160387 +0000 UTC m=+662.067472236"
Sep 11 21:16:57.039572 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:57.039538    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8"]
Sep 11 21:16:57.043632 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:57.043607    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8"
Sep 11 21:16:57.046189 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:57.046167    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-765a18-openshift-default-dockercfg-76v2d\""
Sep 11 21:16:57.050951 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:57.050925    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8"]
Sep 11 21:16:57.111881 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:57.111843    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d939ae9d-6c4e-4184-9300-e7a83a4671df-workload-certs\") pod \"e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8\" (UID: \"d939ae9d-6c4e-4184-9300-e7a83a4671df\") " pod="openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8"
Sep 11 21:16:57.112132 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:57.111905    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d939ae9d-6c4e-4184-9300-e7a83a4671df-istio-podinfo\") pod \"e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8\" (UID: \"d939ae9d-6c4e-4184-9300-e7a83a4671df\") " pod="openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8"
Sep 11 21:16:57.112132 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:57.111938    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d939ae9d-6c4e-4184-9300-e7a83a4671df-istio-envoy\") pod \"e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8\" (UID: \"d939ae9d-6c4e-4184-9300-e7a83a4671df\") " pod="openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8"
Sep 11 21:16:57.112132 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:57.111957    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jm8j\" (UniqueName: \"kubernetes.io/projected/d939ae9d-6c4e-4184-9300-e7a83a4671df-kube-api-access-4jm8j\") pod \"e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8\" (UID: \"d939ae9d-6c4e-4184-9300-e7a83a4671df\") " pod="openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8"
Sep 11 21:16:57.112132 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:57.112035    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d939ae9d-6c4e-4184-9300-e7a83a4671df-workload-socket\") pod \"e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8\" (UID: \"d939ae9d-6c4e-4184-9300-e7a83a4671df\") " pod="openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8"
Sep 11 21:16:57.112132 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:57.112084    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d939ae9d-6c4e-4184-9300-e7a83a4671df-istiod-ca-cert\") pod \"e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8\" (UID: \"d939ae9d-6c4e-4184-9300-e7a83a4671df\") " pod="openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8"
Sep 11 21:16:57.112132 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:57.112101    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d939ae9d-6c4e-4184-9300-e7a83a4671df-istio-token\") pod \"e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8\" (UID: \"d939ae9d-6c4e-4184-9300-e7a83a4671df\") " pod="openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8"
Sep 11 21:16:57.112132 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:57.112119    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d939ae9d-6c4e-4184-9300-e7a83a4671df-credential-socket\") pod \"e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8\" (UID: \"d939ae9d-6c4e-4184-9300-e7a83a4671df\") " pod="openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8"
Sep 11 21:16:57.112497 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:57.112188    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d939ae9d-6c4e-4184-9300-e7a83a4671df-istio-data\") pod \"e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8\" (UID: \"d939ae9d-6c4e-4184-9300-e7a83a4671df\") " pod="openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8"
Sep 11 21:16:57.212878 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:57.212826    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d939ae9d-6c4e-4184-9300-e7a83a4671df-istio-data\") pod \"e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8\" (UID: \"d939ae9d-6c4e-4184-9300-e7a83a4671df\") " pod="openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8"
Sep 11 21:16:57.213088 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:57.212899    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d939ae9d-6c4e-4184-9300-e7a83a4671df-workload-certs\") pod \"e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8\" (UID: \"d939ae9d-6c4e-4184-9300-e7a83a4671df\") " pod="openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8"
Sep 11 21:16:57.213088 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:57.212964    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d939ae9d-6c4e-4184-9300-e7a83a4671df-istio-podinfo\") pod \"e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8\" (UID: \"d939ae9d-6c4e-4184-9300-e7a83a4671df\") " pod="openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8"
Sep 11 21:16:57.213088 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:57.212997    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d939ae9d-6c4e-4184-9300-e7a83a4671df-istio-envoy\") pod \"e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8\" (UID: \"d939ae9d-6c4e-4184-9300-e7a83a4671df\") " pod="openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8"
Sep 11 21:16:57.213088 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:57.213021    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jm8j\" (UniqueName: \"kubernetes.io/projected/d939ae9d-6c4e-4184-9300-e7a83a4671df-kube-api-access-4jm8j\") pod \"e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8\" (UID: \"d939ae9d-6c4e-4184-9300-e7a83a4671df\") " pod="openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8"
Sep 11 21:16:57.213088 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:57.213083    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d939ae9d-6c4e-4184-9300-e7a83a4671df-workload-socket\") pod \"e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8\" (UID: \"d939ae9d-6c4e-4184-9300-e7a83a4671df\") " pod="openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8"
Sep 11 21:16:57.213337 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:57.213125    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d939ae9d-6c4e-4184-9300-e7a83a4671df-istiod-ca-cert\") pod \"e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8\" (UID: \"d939ae9d-6c4e-4184-9300-e7a83a4671df\") " pod="openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8"
Sep 11 21:16:57.213337 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:57.213152    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d939ae9d-6c4e-4184-9300-e7a83a4671df-istio-token\") pod \"e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8\" (UID: \"d939ae9d-6c4e-4184-9300-e7a83a4671df\") " pod="openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8"
Sep 11 21:16:57.213337 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:57.213179    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d939ae9d-6c4e-4184-9300-e7a83a4671df-credential-socket\") pod \"e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8\" (UID: \"d939ae9d-6c4e-4184-9300-e7a83a4671df\") " pod="openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8"
Sep 11 21:16:57.213337 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:57.213296    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d939ae9d-6c4e-4184-9300-e7a83a4671df-workload-certs\") pod \"e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8\" (UID: \"d939ae9d-6c4e-4184-9300-e7a83a4671df\") " pod="openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8"
Sep 11 21:16:57.213559 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:57.213362    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d939ae9d-6c4e-4184-9300-e7a83a4671df-istio-data\") pod \"e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8\" (UID: \"d939ae9d-6c4e-4184-9300-e7a83a4671df\") " pod="openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8"
Sep 11 21:16:57.213636 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:57.213599    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d939ae9d-6c4e-4184-9300-e7a83a4671df-workload-socket\") pod \"e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8\" (UID: \"d939ae9d-6c4e-4184-9300-e7a83a4671df\") " pod="openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8"
Sep 11 21:16:57.213689 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:57.213657    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d939ae9d-6c4e-4184-9300-e7a83a4671df-credential-socket\") pod \"e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8\" (UID: \"d939ae9d-6c4e-4184-9300-e7a83a4671df\") " pod="openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8"
Sep 11 21:16:57.213988 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:57.213966    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d939ae9d-6c4e-4184-9300-e7a83a4671df-istiod-ca-cert\") pod \"e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8\" (UID: \"d939ae9d-6c4e-4184-9300-e7a83a4671df\") " pod="openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8"
Sep 11 21:16:57.215527 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:57.215488    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d939ae9d-6c4e-4184-9300-e7a83a4671df-istio-podinfo\") pod \"e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8\" (UID: \"d939ae9d-6c4e-4184-9300-e7a83a4671df\") " pod="openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8"
Sep 11 21:16:57.215671 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:57.215618    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d939ae9d-6c4e-4184-9300-e7a83a4671df-istio-envoy\") pod \"e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8\" (UID: \"d939ae9d-6c4e-4184-9300-e7a83a4671df\") " pod="openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8"
Sep 11 21:16:57.221523 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:57.221493    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d939ae9d-6c4e-4184-9300-e7a83a4671df-istio-token\") pod \"e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8\" (UID: \"d939ae9d-6c4e-4184-9300-e7a83a4671df\") " pod="openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8"
Sep 11 21:16:57.221716 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:57.221696    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jm8j\" (UniqueName: \"kubernetes.io/projected/d939ae9d-6c4e-4184-9300-e7a83a4671df-kube-api-access-4jm8j\") pod \"e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8\" (UID: \"d939ae9d-6c4e-4184-9300-e7a83a4671df\") " pod="openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8"
Sep 11 21:16:57.358846 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:57.358749    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8"
Sep 11 21:16:57.650395 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:57.650353    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8"]
Sep 11 21:16:57.652581 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:16:57.652548    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd939ae9d_6c4e_4184_9300_e7a83a4671df.slice/crio-eada3c04cd8760a3b59a70d3534999ef1101a9b0d400c71ee25eeda0ba192d37 WatchSource:0}: Error finding container eada3c04cd8760a3b59a70d3534999ef1101a9b0d400c71ee25eeda0ba192d37: Status 404 returned error can't find the container with id eada3c04cd8760a3b59a70d3534999ef1101a9b0d400c71ee25eeda0ba192d37
Sep 11 21:16:57.658715 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:57.658633    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:16:57.658847 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:57.658756    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:16:57.658847 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:57.658830    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:16:58.564723 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:58.564686    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8" event={"ID":"d939ae9d-6c4e-4184-9300-e7a83a4671df","Type":"ContainerStarted","Data":"29686c223cc9afa2307fc520f3a8a3ee780b4648182e2f82c6ab07ad0bf746e1"}
Sep 11 21:16:58.564875 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:58.564743    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8" event={"ID":"d939ae9d-6c4e-4184-9300-e7a83a4671df","Type":"ContainerStarted","Data":"eada3c04cd8760a3b59a70d3534999ef1101a9b0d400c71ee25eeda0ba192d37"}
Sep 11 21:16:58.588394 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:58.588322    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8" podStartSLOduration=1.5883038219999999 podStartE2EDuration="1.588303822s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:16:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:16:58.58589571 +0000 UTC m=+664.064207556" watchObservedRunningTime="2026-09-11 21:16:58.588303822 +0000 UTC m=+664.066615666"
Sep 11 21:16:59.359449 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:59.359407    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8"
Sep 11 21:16:59.366627 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:59.366595    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8"
Sep 11 21:16:59.570836 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:59.570800    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8"
Sep 11 21:16:59.571963 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:16:59.571941    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8"
Sep 11 21:17:05.917754 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:05.917715    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-765a18-676c6c664b-7pxdk"]
Sep 11 21:17:05.954351 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:05.954314    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-765a18-676c6c664b-7pxdk"]
Sep 11 21:17:05.954784 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:05.954765    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-765a18-676c6c664b-7pxdk"
Sep 11 21:17:05.968168 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:05.967168    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-765a18-dockercfg-s9pkp\""
Sep 11 21:17:05.972247 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:05.967366    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-765a18\""
Sep 11 21:17:06.047412 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:06.044245    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d42lt\" (UniqueName: \"kubernetes.io/projected/0ca4d43f-b16a-4c3b-a6ca-e29f9751e326-kube-api-access-d42lt\") pod \"payload-pre-processing-e2e-autores-765a18-676c6c664b-7pxdk\" (UID: \"0ca4d43f-b16a-4c3b-a6ca-e29f9751e326\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-765a18-676c6c664b-7pxdk"
Sep 11 21:17:06.047412 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:06.044314    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ca4d43f-b16a-4c3b-a6ca-e29f9751e326-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-765a18-676c6c664b-7pxdk\" (UID: \"0ca4d43f-b16a-4c3b-a6ca-e29f9751e326\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-765a18-676c6c664b-7pxdk"
Sep 11 21:17:06.146842 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:06.146801    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d42lt\" (UniqueName: \"kubernetes.io/projected/0ca4d43f-b16a-4c3b-a6ca-e29f9751e326-kube-api-access-d42lt\") pod \"payload-pre-processing-e2e-autores-765a18-676c6c664b-7pxdk\" (UID: \"0ca4d43f-b16a-4c3b-a6ca-e29f9751e326\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-765a18-676c6c664b-7pxdk"
Sep 11 21:17:06.146842 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:06.146848    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ca4d43f-b16a-4c3b-a6ca-e29f9751e326-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-765a18-676c6c664b-7pxdk\" (UID: \"0ca4d43f-b16a-4c3b-a6ca-e29f9751e326\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-765a18-676c6c664b-7pxdk"
Sep 11 21:17:06.147893 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:06.147872    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ca4d43f-b16a-4c3b-a6ca-e29f9751e326-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-765a18-676c6c664b-7pxdk\" (UID: \"0ca4d43f-b16a-4c3b-a6ca-e29f9751e326\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-765a18-676c6c664b-7pxdk"
Sep 11 21:17:06.175432 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:06.175307    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d42lt\" (UniqueName: \"kubernetes.io/projected/0ca4d43f-b16a-4c3b-a6ca-e29f9751e326-kube-api-access-d42lt\") pod \"payload-pre-processing-e2e-autores-765a18-676c6c664b-7pxdk\" (UID: \"0ca4d43f-b16a-4c3b-a6ca-e29f9751e326\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-765a18-676c6c664b-7pxdk"
Sep 11 21:17:06.330346 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:06.330290    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-765a18-676c6c664b-7pxdk"
Sep 11 21:17:06.588436 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:06.578562    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-962a7d-54fcd4b8db-h7sk5"
Sep 11 21:17:06.741987 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:06.741947    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-765a18-676c6c664b-7pxdk"]
Sep 11 21:17:06.893956 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:06.893921    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh"]
Sep 11 21:17:06.904098 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:06.904068    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh"
Sep 11 21:17:06.914870 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:06.914829    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-2b95f8-openshift-default-dockercfg-brj6w\""
Sep 11 21:17:06.924179 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:06.924138    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh"]
Sep 11 21:17:06.991482 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:06.980522    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d07f0c6e-53ed-4177-ae62-a74a27279132-istio-data\") pod \"e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh\" (UID: \"d07f0c6e-53ed-4177-ae62-a74a27279132\") " pod="openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh"
Sep 11 21:17:06.991482 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:06.980625    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2d7s\" (UniqueName: \"kubernetes.io/projected/d07f0c6e-53ed-4177-ae62-a74a27279132-kube-api-access-q2d7s\") pod \"e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh\" (UID: \"d07f0c6e-53ed-4177-ae62-a74a27279132\") " pod="openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh"
Sep 11 21:17:06.991482 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:06.980712    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d07f0c6e-53ed-4177-ae62-a74a27279132-credential-socket\") pod \"e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh\" (UID: \"d07f0c6e-53ed-4177-ae62-a74a27279132\") " pod="openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh"
Sep 11 21:17:06.991482 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:06.980740    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d07f0c6e-53ed-4177-ae62-a74a27279132-workload-certs\") pod \"e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh\" (UID: \"d07f0c6e-53ed-4177-ae62-a74a27279132\") " pod="openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh"
Sep 11 21:17:06.991482 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:06.980766    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d07f0c6e-53ed-4177-ae62-a74a27279132-istio-token\") pod \"e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh\" (UID: \"d07f0c6e-53ed-4177-ae62-a74a27279132\") " pod="openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh"
Sep 11 21:17:06.991482 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:06.980825    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d07f0c6e-53ed-4177-ae62-a74a27279132-istio-envoy\") pod \"e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh\" (UID: \"d07f0c6e-53ed-4177-ae62-a74a27279132\") " pod="openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh"
Sep 11 21:17:06.991482 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:06.980897    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d07f0c6e-53ed-4177-ae62-a74a27279132-istio-podinfo\") pod \"e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh\" (UID: \"d07f0c6e-53ed-4177-ae62-a74a27279132\") " pod="openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh"
Sep 11 21:17:06.991482 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:06.980944    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d07f0c6e-53ed-4177-ae62-a74a27279132-workload-socket\") pod \"e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh\" (UID: \"d07f0c6e-53ed-4177-ae62-a74a27279132\") " pod="openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh"
Sep 11 21:17:06.991482 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:06.981030    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d07f0c6e-53ed-4177-ae62-a74a27279132-istiod-ca-cert\") pod \"e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh\" (UID: \"d07f0c6e-53ed-4177-ae62-a74a27279132\") " pod="openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh"
Sep 11 21:17:07.082122 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:07.082081    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d07f0c6e-53ed-4177-ae62-a74a27279132-credential-socket\") pod \"e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh\" (UID: \"d07f0c6e-53ed-4177-ae62-a74a27279132\") " pod="openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh"
Sep 11 21:17:07.082919 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:07.082893    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d07f0c6e-53ed-4177-ae62-a74a27279132-workload-certs\") pod \"e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh\" (UID: \"d07f0c6e-53ed-4177-ae62-a74a27279132\") " pod="openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh"
Sep 11 21:17:07.083420 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:07.083399    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d07f0c6e-53ed-4177-ae62-a74a27279132-istio-token\") pod \"e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh\" (UID: \"d07f0c6e-53ed-4177-ae62-a74a27279132\") " pod="openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh"
Sep 11 21:17:07.083617 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:07.083599    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d07f0c6e-53ed-4177-ae62-a74a27279132-istio-envoy\") pod \"e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh\" (UID: \"d07f0c6e-53ed-4177-ae62-a74a27279132\") " pod="openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh"
Sep 11 21:17:07.083771 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:07.083755    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d07f0c6e-53ed-4177-ae62-a74a27279132-istio-podinfo\") pod \"e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh\" (UID: \"d07f0c6e-53ed-4177-ae62-a74a27279132\") " pod="openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh"
Sep 11 21:17:07.083890 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:07.083875    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d07f0c6e-53ed-4177-ae62-a74a27279132-workload-socket\") pod \"e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh\" (UID: \"d07f0c6e-53ed-4177-ae62-a74a27279132\") " pod="openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh"
Sep 11 21:17:07.084040 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:07.084028    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d07f0c6e-53ed-4177-ae62-a74a27279132-istiod-ca-cert\") pod \"e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh\" (UID: \"d07f0c6e-53ed-4177-ae62-a74a27279132\") " pod="openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh"
Sep 11 21:17:07.084199 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:07.084186    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d07f0c6e-53ed-4177-ae62-a74a27279132-istio-data\") pod \"e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh\" (UID: \"d07f0c6e-53ed-4177-ae62-a74a27279132\") " pod="openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh"
Sep 11 21:17:07.084326 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:07.084310    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2d7s\" (UniqueName: \"kubernetes.io/projected/d07f0c6e-53ed-4177-ae62-a74a27279132-kube-api-access-q2d7s\") pod \"e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh\" (UID: \"d07f0c6e-53ed-4177-ae62-a74a27279132\") " pod="openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh"
Sep 11 21:17:07.084823 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:07.082819    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d07f0c6e-53ed-4177-ae62-a74a27279132-credential-socket\") pod \"e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh\" (UID: \"d07f0c6e-53ed-4177-ae62-a74a27279132\") " pod="openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh"
Sep 11 21:17:07.085190 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:07.083336    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d07f0c6e-53ed-4177-ae62-a74a27279132-workload-certs\") pod \"e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh\" (UID: \"d07f0c6e-53ed-4177-ae62-a74a27279132\") " pod="openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh"
Sep 11 21:17:07.085915 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:07.085893    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d07f0c6e-53ed-4177-ae62-a74a27279132-workload-socket\") pod \"e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh\" (UID: \"d07f0c6e-53ed-4177-ae62-a74a27279132\") " pod="openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh"
Sep 11 21:17:07.095410 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:07.089251    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d07f0c6e-53ed-4177-ae62-a74a27279132-istio-podinfo\") pod \"e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh\" (UID: \"d07f0c6e-53ed-4177-ae62-a74a27279132\") " pod="openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh"
Sep 11 21:17:07.098039 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:07.097266    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d07f0c6e-53ed-4177-ae62-a74a27279132-istiod-ca-cert\") pod \"e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh\" (UID: \"d07f0c6e-53ed-4177-ae62-a74a27279132\") " pod="openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh"
Sep 11 21:17:07.098039 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:07.097583    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d07f0c6e-53ed-4177-ae62-a74a27279132-istio-data\") pod \"e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh\" (UID: \"d07f0c6e-53ed-4177-ae62-a74a27279132\") " pod="openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh"
Sep 11 21:17:07.107104 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:07.107013    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d07f0c6e-53ed-4177-ae62-a74a27279132-istio-envoy\") pod \"e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh\" (UID: \"d07f0c6e-53ed-4177-ae62-a74a27279132\") " pod="openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh"
Sep 11 21:17:07.108070 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:07.108015    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2d7s\" (UniqueName: \"kubernetes.io/projected/d07f0c6e-53ed-4177-ae62-a74a27279132-kube-api-access-q2d7s\") pod \"e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh\" (UID: \"d07f0c6e-53ed-4177-ae62-a74a27279132\") " pod="openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh"
Sep 11 21:17:07.109621 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:07.109561    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d07f0c6e-53ed-4177-ae62-a74a27279132-istio-token\") pod \"e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh\" (UID: \"d07f0c6e-53ed-4177-ae62-a74a27279132\") " pod="openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh"
Sep 11 21:17:07.325014 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:07.324906    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh"
Sep 11 21:17:07.577476 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:07.573554    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-26462a-854bf7ff54-2zldl"
Sep 11 21:17:07.577476 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:07.575113    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-26462a-75c6958dff-gnp6v"
Sep 11 21:17:07.712409 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:07.710237    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-765a18-676c6c664b-7pxdk" event={"ID":"0ca4d43f-b16a-4c3b-a6ca-e29f9751e326","Type":"ContainerStarted","Data":"9e1a95456190e251fcfe4431c217fe61bb9550c7728dda871cd4d1552653ab91"}
Sep 11 21:17:07.712409 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:07.710314    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-765a18-676c6c664b-7pxdk" event={"ID":"0ca4d43f-b16a-4c3b-a6ca-e29f9751e326","Type":"ContainerStarted","Data":"ad73e763ae6889b0c76401a5cdcbbc95ac488d27ef578261b9080aeb8ea830c1"}
Sep 11 21:17:07.712409 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:07.711175    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-765a18-676c6c664b-7pxdk"
Sep 11 21:17:07.914603 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:07.914538    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-autores-765a18-676c6c664b-7pxdk" podStartSLOduration=2.914511924 podStartE2EDuration="2.914511924s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:17:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:17:07.781727462 +0000 UTC m=+673.260039309" watchObservedRunningTime="2026-09-11 21:17:07.914511924 +0000 UTC m=+673.392823769"
Sep 11 21:17:07.935660 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:17:07.935624    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd07f0c6e_53ed_4177_ae62_a74a27279132.slice/crio-d9b6bdf821db4ed3219530cc818211428b3b329eaad5cae987032d06c491a47b WatchSource:0}: Error finding container d9b6bdf821db4ed3219530cc818211428b3b329eaad5cae987032d06c491a47b: Status 404 returned error can't find the container with id d9b6bdf821db4ed3219530cc818211428b3b329eaad5cae987032d06c491a47b
Sep 11 21:17:07.939578 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:07.939540    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:17:07.940072 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:07.940045    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:17:07.940247 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:07.940227    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:17:07.942972 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:07.942950    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh"]
Sep 11 21:17:08.722944 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:08.722631    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh" event={"ID":"d07f0c6e-53ed-4177-ae62-a74a27279132","Type":"ContainerStarted","Data":"3d27750afacb5c9dae46baf31476d57ec4b2f9ce2085caac5d0b0b0297cef42e"}
Sep 11 21:17:08.722944 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:08.722689    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh" event={"ID":"d07f0c6e-53ed-4177-ae62-a74a27279132","Type":"ContainerStarted","Data":"d9b6bdf821db4ed3219530cc818211428b3b329eaad5cae987032d06c491a47b"}
Sep 11 21:17:08.748920 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:08.748858    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh" podStartSLOduration=2.748839793 podStartE2EDuration="2.748839793s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:17:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:17:08.746641635 +0000 UTC m=+674.224953502" watchObservedRunningTime="2026-09-11 21:17:08.748839793 +0000 UTC m=+674.227151636"
Sep 11 21:17:08.854435 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:08.854312    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8dbad4ec-58b76df45c-9tvw8"]
Sep 11 21:17:08.859758 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:08.859728    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-8dbad4ec-58b76df45c-9tvw8"
Sep 11 21:17:08.868747 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:08.867677    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-8dbad4ec\""
Sep 11 21:17:08.868747 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:08.868442    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-8dbad4ec-dockercfg-67chp\""
Sep 11 21:17:08.871193 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:08.871167    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8dbad4ec-58b76df45c-9tvw8"]
Sep 11 21:17:08.928673 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:08.928628    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8nnz\" (UniqueName: \"kubernetes.io/projected/5daf03f1-1ec2-4665-a399-eae596b85541-kube-api-access-s8nnz\") pod \"payload-processing-e2e-ait-8dbad4ec-58b76df45c-9tvw8\" (UID: \"5daf03f1-1ec2-4665-a399-eae596b85541\") " pod="openshift-ingress/payload-processing-e2e-ait-8dbad4ec-58b76df45c-9tvw8"
Sep 11 21:17:08.928837 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:08.928764    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5daf03f1-1ec2-4665-a399-eae596b85541-plugins-config-volume\") pod \"payload-processing-e2e-ait-8dbad4ec-58b76df45c-9tvw8\" (UID: \"5daf03f1-1ec2-4665-a399-eae596b85541\") " pod="openshift-ingress/payload-processing-e2e-ait-8dbad4ec-58b76df45c-9tvw8"
Sep 11 21:17:09.030042 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:09.029992    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8nnz\" (UniqueName: \"kubernetes.io/projected/5daf03f1-1ec2-4665-a399-eae596b85541-kube-api-access-s8nnz\") pod \"payload-processing-e2e-ait-8dbad4ec-58b76df45c-9tvw8\" (UID: \"5daf03f1-1ec2-4665-a399-eae596b85541\") " pod="openshift-ingress/payload-processing-e2e-ait-8dbad4ec-58b76df45c-9tvw8"
Sep 11 21:17:09.030512 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:09.030110    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5daf03f1-1ec2-4665-a399-eae596b85541-plugins-config-volume\") pod \"payload-processing-e2e-ait-8dbad4ec-58b76df45c-9tvw8\" (UID: \"5daf03f1-1ec2-4665-a399-eae596b85541\") " pod="openshift-ingress/payload-processing-e2e-ait-8dbad4ec-58b76df45c-9tvw8"
Sep 11 21:17:09.030887 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:09.030864    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5daf03f1-1ec2-4665-a399-eae596b85541-plugins-config-volume\") pod \"payload-processing-e2e-ait-8dbad4ec-58b76df45c-9tvw8\" (UID: \"5daf03f1-1ec2-4665-a399-eae596b85541\") " pod="openshift-ingress/payload-processing-e2e-ait-8dbad4ec-58b76df45c-9tvw8"
Sep 11 21:17:09.040211 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:09.040176    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8nnz\" (UniqueName: \"kubernetes.io/projected/5daf03f1-1ec2-4665-a399-eae596b85541-kube-api-access-s8nnz\") pod \"payload-processing-e2e-ait-8dbad4ec-58b76df45c-9tvw8\" (UID: \"5daf03f1-1ec2-4665-a399-eae596b85541\") " pod="openshift-ingress/payload-processing-e2e-ait-8dbad4ec-58b76df45c-9tvw8"
Sep 11 21:17:09.190198 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:09.190145    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-8dbad4ec-58b76df45c-9tvw8"
Sep 11 21:17:09.326517 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:09.326476    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh"
Sep 11 21:17:09.333756 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:09.333726    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh"
Sep 11 21:17:09.480553 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:09.480448    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8dbad4ec-58b76df45c-9tvw8"]
Sep 11 21:17:09.492316 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:17:09.492282    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5daf03f1_1ec2_4665_a399_eae596b85541.slice/crio-476c8172ea3dac3e338c5fc15f7a543544b55e40c6e9d652d8528bef7657e913 WatchSource:0}: Error finding container 476c8172ea3dac3e338c5fc15f7a543544b55e40c6e9d652d8528bef7657e913: Status 404 returned error can't find the container with id 476c8172ea3dac3e338c5fc15f7a543544b55e40c6e9d652d8528bef7657e913
Sep 11 21:17:09.732844 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:09.732552    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-8dbad4ec-58b76df45c-9tvw8" event={"ID":"5daf03f1-1ec2-4665-a399-eae596b85541","Type":"ContainerStarted","Data":"fa28d223bfc080242851909b321786d247cbfe047901ca6b7eb9fdd2008d4d12"}
Sep 11 21:17:09.732844 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:09.732667    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-8dbad4ec-58b76df45c-9tvw8" event={"ID":"5daf03f1-1ec2-4665-a399-eae596b85541","Type":"ContainerStarted","Data":"476c8172ea3dac3e338c5fc15f7a543544b55e40c6e9d652d8528bef7657e913"}
Sep 11 21:17:09.732844 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:09.732738    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-8dbad4ec-58b76df45c-9tvw8"
Sep 11 21:17:09.734543 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:09.733712    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh"
Sep 11 21:17:09.734825 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:09.734783    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh"
Sep 11 21:17:09.753213 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:09.753157    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-8dbad4ec-58b76df45c-9tvw8" podStartSLOduration=1.753141327 podStartE2EDuration="1.753141327s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:17:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:17:09.752726037 +0000 UTC m=+675.231037881" watchObservedRunningTime="2026-09-11 21:17:09.753141327 +0000 UTC m=+675.231453213"
Sep 11 21:17:13.768443 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:13.768314    2560 generic.go:356] "Generic (PLEG): container finished" podID="eb31366e-1024-4d0b-8152-e966df8c777d" containerID="622ae7791766ec12ac497a332486afb487144baad5e7276a3cebd357a4c80cea" exitCode=0
Sep 11 21:17:13.768443 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:13.768415    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn" event={"ID":"eb31366e-1024-4d0b-8152-e966df8c777d","Type":"ContainerDied","Data":"622ae7791766ec12ac497a332486afb487144baad5e7276a3cebd357a4c80cea"}
Sep 11 21:17:13.769025 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:13.769005    2560 scope.go:117] "RemoveContainer" containerID="622ae7791766ec12ac497a332486afb487144baad5e7276a3cebd357a4c80cea"
Sep 11 21:17:13.770229 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:13.770199    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:17:13.770229 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:13.770223    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw" event={"ID":"2e45340b-c693-4168-951b-a3df79f884f6","Type":"ContainerDied","Data":"e9a8d290056831174e6b6c3920d73892d2dd3026c8dd86985a4c1e53ca95d7a1"}
Sep 11 21:17:13.770394 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:13.770270    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:17:13.770394 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:13.770310    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:17:13.770394 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:13.770207    2560 generic.go:356] "Generic (PLEG): container finished" podID="2e45340b-c693-4168-951b-a3df79f884f6" containerID="e9a8d290056831174e6b6c3920d73892d2dd3026c8dd86985a4c1e53ca95d7a1" exitCode=0
Sep 11 21:17:13.770697 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:13.770600    2560 scope.go:117] "RemoveContainer" containerID="e9a8d290056831174e6b6c3920d73892d2dd3026c8dd86985a4c1e53ca95d7a1"
Sep 11 21:17:13.779433 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:13.772374    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:17:13.779433 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:13.772803    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:17:13.779433 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:13.773001    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:17:13.780216 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:13.780186    2560 generic.go:356] "Generic (PLEG): container finished" podID="35aef6e0-32e3-4520-9b42-b094fa4f3f53" containerID="185e1eee74e2ffb3db69c21c2ba115663d590a1b133aa59f5d0e952a2a872230" exitCode=0
Sep 11 21:17:13.780277 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:13.780244    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc" event={"ID":"35aef6e0-32e3-4520-9b42-b094fa4f3f53","Type":"ContainerDied","Data":"185e1eee74e2ffb3db69c21c2ba115663d590a1b133aa59f5d0e952a2a872230"}
Sep 11 21:17:13.780705 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:13.780690    2560 scope.go:117] "RemoveContainer" containerID="185e1eee74e2ffb3db69c21c2ba115663d590a1b133aa59f5d0e952a2a872230"
Sep 11 21:17:13.785317 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:13.785292    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:17:13.785369 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:13.785359    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:17:13.785444 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:13.785419    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:17:14.788416 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:14.788349    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn" event={"ID":"eb31366e-1024-4d0b-8152-e966df8c777d","Type":"ContainerStarted","Data":"5ee01ab9e85b17a00775fdc27b7f148f22ce647cfa01daed3633e5ef3b23f576"}
Sep 11 21:17:14.790409 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:14.790359    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw" event={"ID":"2e45340b-c693-4168-951b-a3df79f884f6","Type":"ContainerStarted","Data":"0a900e73e0817d72db09943409ae82fc8653d7d63a4a62429da664806acd2084"}
Sep 11 21:17:14.792277 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:14.792252    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc" event={"ID":"35aef6e0-32e3-4520-9b42-b094fa4f3f53","Type":"ContainerStarted","Data":"399812c17434e42fbc4ce1f5cb4b4f3e761540ee7c5016efb1d5fced70712284"}
Sep 11 21:17:14.863296 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:14.863254    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn"
Sep 11 21:17:14.863547 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:14.863508    2560 patch_prober.go:28] interesting pod/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 11 21:17:14.863680 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:14.863568    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn" podUID="eb31366e-1024-4d0b-8152-e966df8c777d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 11 21:17:15.599771 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:15.599728    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc"
Sep 11 21:17:15.599996 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:15.599870    2560 patch_prober.go:28] interesting pod/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 11 21:17:15.599996 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:15.599920    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc" podUID="35aef6e0-32e3-4520-9b42-b094fa4f3f53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 11 21:17:15.724408 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:15.723898    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw"
Sep 11 21:17:15.724408 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:15.724265    2560 patch_prober.go:28] interesting pod/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 11 21:17:15.724408 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:15.724345    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw" podUID="2e45340b-c693-4168-951b-a3df79f884f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 11 21:17:15.863259 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:15.863146    2560 patch_prober.go:28] interesting pod/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 11 21:17:15.863259 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:15.863215    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn" podUID="eb31366e-1024-4d0b-8152-e966df8c777d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 11 21:17:16.599258 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:16.599222    2560 patch_prober.go:28] interesting pod/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 11 21:17:16.599605 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:16.599572    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc" podUID="35aef6e0-32e3-4520-9b42-b094fa4f3f53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 11 21:17:16.724314 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:16.724277    2560 patch_prober.go:28] interesting pod/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 11 21:17:16.724627 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:16.724598    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw" podUID="2e45340b-c693-4168-951b-a3df79f884f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 11 21:17:16.863950 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:16.863850    2560 patch_prober.go:28] interesting pod/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 11 21:17:16.864553 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:16.864517    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn" podUID="eb31366e-1024-4d0b-8152-e966df8c777d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 11 21:17:17.599148 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:17.599100    2560 patch_prober.go:28] interesting pod/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 11 21:17:17.599522 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:17.599476    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc" podUID="35aef6e0-32e3-4520-9b42-b094fa4f3f53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 11 21:17:17.724298 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:17.724242    2560 patch_prober.go:28] interesting pod/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 11 21:17:17.724673 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:17.724638    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw" podUID="2e45340b-c693-4168-951b-a3df79f884f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 11 21:17:17.863545 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:17.863435    2560 patch_prober.go:28] interesting pod/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 11 21:17:17.863802 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:17.863771    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn" podUID="eb31366e-1024-4d0b-8152-e966df8c777d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 11 21:17:18.599056 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:18.599014    2560 patch_prober.go:28] interesting pod/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 11 21:17:18.600206 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:18.599742    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc" podUID="35aef6e0-32e3-4520-9b42-b094fa4f3f53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 11 21:17:18.724078 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:18.724025    2560 patch_prober.go:28] interesting pod/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 11 21:17:18.724639 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:18.724126    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw" podUID="2e45340b-c693-4168-951b-a3df79f884f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 11 21:17:18.863026 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:18.862927    2560 patch_prober.go:28] interesting pod/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 11 21:17:18.863297 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:18.863268    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn" podUID="eb31366e-1024-4d0b-8152-e966df8c777d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 11 21:17:19.599040 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:19.598997    2560 patch_prober.go:28] interesting pod/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 11 21:17:19.599343 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:19.599311    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc" podUID="35aef6e0-32e3-4520-9b42-b094fa4f3f53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 11 21:17:19.724654 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:19.724589    2560 patch_prober.go:28] interesting pod/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 11 21:17:19.724972 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:19.724923    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw" podUID="2e45340b-c693-4168-951b-a3df79f884f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 11 21:17:19.737647 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:19.737606    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-765a18-676c6c664b-7pxdk"
Sep 11 21:17:19.869505 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:19.869470    2560 patch_prober.go:28] interesting pod/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 11 21:17:19.869773 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:19.869746    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn" podUID="eb31366e-1024-4d0b-8152-e966df8c777d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 11 21:17:20.509705 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:20.509647    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc"
Sep 11 21:17:20.599185 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:20.599133    2560 patch_prober.go:28] interesting pod/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 11 21:17:20.599423 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:20.599213    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc" podUID="35aef6e0-32e3-4520-9b42-b094fa4f3f53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 11 21:17:20.730422 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:20.730355    2560 patch_prober.go:28] interesting pod/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 11 21:17:20.730643 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:20.730451    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw" podUID="2e45340b-c693-4168-951b-a3df79f884f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 11 21:17:20.757410 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:20.753604    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-8dbad4ec-58b76df45c-9tvw8"
Sep 11 21:17:20.864990 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:20.864878    2560 patch_prober.go:28] interesting pod/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 11 21:17:20.865278 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:20.865230    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn" podUID="eb31366e-1024-4d0b-8152-e966df8c777d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 11 21:17:21.514457 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:21.514407    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn"
Sep 11 21:17:21.515444 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:21.515413    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw"
Sep 11 21:17:21.724103 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:21.724071    2560 patch_prober.go:28] interesting pod/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 11 21:17:21.724626 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:21.724591    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw" podUID="2e45340b-c693-4168-951b-a3df79f884f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 11 21:17:21.745158 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:21.743755    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc"
Sep 11 21:17:21.746681 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:21.746650    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc"
Sep 11 21:17:21.887373 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:21.885803    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn"
Sep 11 21:17:21.913959 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:21.913933    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn"
Sep 11 21:17:22.728894 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:22.728861    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw"
Sep 11 21:17:22.730453 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:22.730424    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw"
Sep 11 21:17:27.951749 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:27.951711    2560 generic.go:356] "Generic (PLEG): container finished" podID="d939ae9d-6c4e-4184-9300-e7a83a4671df" containerID="29686c223cc9afa2307fc520f3a8a3ee780b4648182e2f82c6ab07ad0bf746e1" exitCode=0
Sep 11 21:17:27.952199 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:27.951782    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8" event={"ID":"d939ae9d-6c4e-4184-9300-e7a83a4671df","Type":"ContainerDied","Data":"29686c223cc9afa2307fc520f3a8a3ee780b4648182e2f82c6ab07ad0bf746e1"}
Sep 11 21:17:27.952294 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:27.952280    2560 scope.go:117] "RemoveContainer" containerID="29686c223cc9afa2307fc520f3a8a3ee780b4648182e2f82c6ab07ad0bf746e1"
Sep 11 21:17:27.953593 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:27.953566    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:17:27.953664 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:27.953638    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:17:27.953702 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:27.953674    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:17:28.963246 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:28.963199    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8" event={"ID":"d939ae9d-6c4e-4184-9300-e7a83a4671df","Type":"ContainerStarted","Data":"6aea93ed669813074e4e25a88f030884c7b7fc173b26288086bb270e26da66ae"}
Sep 11 21:17:29.361492 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:29.360345    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8"
Sep 11 21:17:29.362227 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:29.361879    2560 patch_prober.go:28] interesting pod/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 11 21:17:29.362227 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:29.361942    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8" podUID="d939ae9d-6c4e-4184-9300-e7a83a4671df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 11 21:17:29.571583 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:29.571485    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8"
Sep 11 21:17:30.359723 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:30.359685    2560 patch_prober.go:28] interesting pod/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 11 21:17:30.360311 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:30.360280    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8" podUID="d939ae9d-6c4e-4184-9300-e7a83a4671df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 11 21:17:31.365828 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:31.365783    2560 patch_prober.go:28] interesting pod/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 11 21:17:31.366370 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:31.365853    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8" podUID="d939ae9d-6c4e-4184-9300-e7a83a4671df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 11 21:17:32.365410 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:32.362001    2560 patch_prober.go:28] interesting pod/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 11 21:17:32.365410 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:32.362113    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8" podUID="d939ae9d-6c4e-4184-9300-e7a83a4671df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 11 21:17:33.359664 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:33.359615    2560 patch_prober.go:28] interesting pod/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 11 21:17:33.360195 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:33.359710    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8" podUID="d939ae9d-6c4e-4184-9300-e7a83a4671df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 11 21:17:34.425320 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:34.425282    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8"
Sep 11 21:17:34.427883 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:34.427852    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8"
Sep 11 21:17:40.688214 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:40.687538    2560 patch_prober.go:28] interesting pod/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": read tcp 10.134.0.2:48584->10.134.0.47:15021: read: connection reset by peer" start-of-body=
Sep 11 21:17:40.688214 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:40.687607    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh" podUID="d07f0c6e-53ed-4177-ae62-a74a27279132" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": read tcp 10.134.0.2:48584->10.134.0.47:15021: read: connection reset by peer"
Sep 11 21:17:41.055754 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:41.055662    2560 generic.go:356] "Generic (PLEG): container finished" podID="d07f0c6e-53ed-4177-ae62-a74a27279132" containerID="3d27750afacb5c9dae46baf31476d57ec4b2f9ce2085caac5d0b0b0297cef42e" exitCode=0
Sep 11 21:17:41.055754 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:41.055731    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh" event={"ID":"d07f0c6e-53ed-4177-ae62-a74a27279132","Type":"ContainerDied","Data":"3d27750afacb5c9dae46baf31476d57ec4b2f9ce2085caac5d0b0b0297cef42e"}
Sep 11 21:17:41.056177 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:41.056163    2560 scope.go:117] "RemoveContainer" containerID="3d27750afacb5c9dae46baf31476d57ec4b2f9ce2085caac5d0b0b0297cef42e"
Sep 11 21:17:41.057557 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:41.057527    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:17:41.057683 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:41.057596    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:17:41.057683 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:41.057628    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:17:42.074192 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:42.074142    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh" event={"ID":"d07f0c6e-53ed-4177-ae62-a74a27279132","Type":"ContainerStarted","Data":"5ee2aa95d935a25666f2ec80d20bbe1d583b3e281ad041e59e8e1972d4ecd8ef"}
Sep 11 21:17:42.325708 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:42.325608    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh"
Sep 11 21:17:42.325988 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:42.325953    2560 patch_prober.go:28] interesting pod/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 11 21:17:42.326069 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:42.326016    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh" podUID="d07f0c6e-53ed-4177-ae62-a74a27279132" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 11 21:17:43.326071 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:43.326032    2560 patch_prober.go:28] interesting pod/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 11 21:17:43.326518 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:43.326106    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh" podUID="d07f0c6e-53ed-4177-ae62-a74a27279132" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 11 21:17:44.326096 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:44.325718    2560 patch_prober.go:28] interesting pod/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 11 21:17:44.326096 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:44.325786    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh" podUID="d07f0c6e-53ed-4177-ae62-a74a27279132" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 11 21:17:45.326311 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:45.326269    2560 patch_prober.go:28] interesting pod/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 11 21:17:45.326855 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:45.326818    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh" podUID="d07f0c6e-53ed-4177-ae62-a74a27279132" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 11 21:17:46.050312 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:46.050276    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8dbad4ec-58b76df45c-9tvw8"]
Sep 11 21:17:46.050892 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:46.050860    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-8dbad4ec-58b76df45c-9tvw8" podUID="5daf03f1-1ec2-4665-a399-eae596b85541" containerName="payload-processing" containerID="cri-o://fa28d223bfc080242851909b321786d247cbfe047901ca6b7eb9fdd2008d4d12" gracePeriod=30
Sep 11 21:17:46.325941 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:46.325555    2560 patch_prober.go:28] interesting pod/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 11 21:17:46.325941 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:46.325612    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh" podUID="d07f0c6e-53ed-4177-ae62-a74a27279132" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 11 21:17:46.401076 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:46.401042    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-8dbad4ec-58b76df45c-9tvw8"
Sep 11 21:17:46.419678 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:46.419645    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s8nnz\" (UniqueName: \"kubernetes.io/projected/5daf03f1-1ec2-4665-a399-eae596b85541-kube-api-access-s8nnz\") pod \"5daf03f1-1ec2-4665-a399-eae596b85541\" (UID: \"5daf03f1-1ec2-4665-a399-eae596b85541\") "
Sep 11 21:17:46.419883 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:46.419831    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5daf03f1-1ec2-4665-a399-eae596b85541-plugins-config-volume\") pod \"5daf03f1-1ec2-4665-a399-eae596b85541\" (UID: \"5daf03f1-1ec2-4665-a399-eae596b85541\") "
Sep 11 21:17:46.420314 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:46.420287    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5daf03f1-1ec2-4665-a399-eae596b85541-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5daf03f1-1ec2-4665-a399-eae596b85541" (UID: "5daf03f1-1ec2-4665-a399-eae596b85541"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:17:46.422661 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:46.422631    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5daf03f1-1ec2-4665-a399-eae596b85541-kube-api-access-s8nnz" (OuterVolumeSpecName: "kube-api-access-s8nnz") pod "5daf03f1-1ec2-4665-a399-eae596b85541" (UID: "5daf03f1-1ec2-4665-a399-eae596b85541"). InnerVolumeSpecName "kube-api-access-s8nnz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:17:46.521593 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:46.521553    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5daf03f1-1ec2-4665-a399-eae596b85541-plugins-config-volume\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:17:46.521593 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:46.521585    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s8nnz\" (UniqueName: \"kubernetes.io/projected/5daf03f1-1ec2-4665-a399-eae596b85541-kube-api-access-s8nnz\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:17:47.115294 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:47.115255    2560 generic.go:356] "Generic (PLEG): container finished" podID="5daf03f1-1ec2-4665-a399-eae596b85541" containerID="fa28d223bfc080242851909b321786d247cbfe047901ca6b7eb9fdd2008d4d12" exitCode=0
Sep 11 21:17:47.115294 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:47.115297    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-8dbad4ec-58b76df45c-9tvw8"
Sep 11 21:17:47.115600 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:47.115298    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-8dbad4ec-58b76df45c-9tvw8" event={"ID":"5daf03f1-1ec2-4665-a399-eae596b85541","Type":"ContainerDied","Data":"fa28d223bfc080242851909b321786d247cbfe047901ca6b7eb9fdd2008d4d12"}
Sep 11 21:17:47.115600 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:47.115441    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-8dbad4ec-58b76df45c-9tvw8" event={"ID":"5daf03f1-1ec2-4665-a399-eae596b85541","Type":"ContainerDied","Data":"476c8172ea3dac3e338c5fc15f7a543544b55e40c6e9d652d8528bef7657e913"}
Sep 11 21:17:47.115600 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:47.115469    2560 scope.go:117] "RemoveContainer" containerID="fa28d223bfc080242851909b321786d247cbfe047901ca6b7eb9fdd2008d4d12"
Sep 11 21:17:47.125793 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:47.125762    2560 scope.go:117] "RemoveContainer" containerID="fa28d223bfc080242851909b321786d247cbfe047901ca6b7eb9fdd2008d4d12"
Sep 11 21:17:47.126156 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:17:47.126131    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa28d223bfc080242851909b321786d247cbfe047901ca6b7eb9fdd2008d4d12\": container with ID starting with fa28d223bfc080242851909b321786d247cbfe047901ca6b7eb9fdd2008d4d12 not found: ID does not exist" containerID="fa28d223bfc080242851909b321786d247cbfe047901ca6b7eb9fdd2008d4d12"
Sep 11 21:17:47.126240 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:47.126164    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa28d223bfc080242851909b321786d247cbfe047901ca6b7eb9fdd2008d4d12"} err="failed to get container status \"fa28d223bfc080242851909b321786d247cbfe047901ca6b7eb9fdd2008d4d12\": rpc error: code = NotFound desc = could not find container \"fa28d223bfc080242851909b321786d247cbfe047901ca6b7eb9fdd2008d4d12\": container with ID starting with fa28d223bfc080242851909b321786d247cbfe047901ca6b7eb9fdd2008d4d12 not found: ID does not exist"
Sep 11 21:17:47.151147 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:47.151110    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8dbad4ec-58b76df45c-9tvw8"]
Sep 11 21:17:47.153709 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:47.153683    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8dbad4ec-58b76df45c-9tvw8"]
Sep 11 21:17:47.330952 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:47.330861    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh"
Sep 11 21:17:47.331287 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:47.331268    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh"
Sep 11 21:17:47.332180 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:47.332158    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh"
Sep 11 21:17:49.038582 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:49.038548    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5daf03f1-1ec2-4665-a399-eae596b85541" path="/var/lib/kubelet/pods/5daf03f1-1ec2-4665-a399-eae596b85541/volumes"
Sep 11 21:17:53.506095 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:53.506054    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-2d3d3219-664b44b54-m6hln"]
Sep 11 21:17:53.506598 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:53.506584    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5daf03f1-1ec2-4665-a399-eae596b85541" containerName="payload-processing"
Sep 11 21:17:53.506598 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:53.506599    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5daf03f1-1ec2-4665-a399-eae596b85541" containerName="payload-processing"
Sep 11 21:17:53.506682 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:53.506670    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5daf03f1-1ec2-4665-a399-eae596b85541" containerName="payload-processing"
Sep 11 21:17:53.508906 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:53.508890    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2d3d3219-664b44b54-m6hln"
Sep 11 21:17:53.511353 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:53.511330    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-2d3d3219-dockercfg-dmbcj\""
Sep 11 21:17:53.511571 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:53.511525    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-2d3d3219\""
Sep 11 21:17:53.520432 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:53.520364    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-2d3d3219-664b44b54-m6hln"]
Sep 11 21:17:53.598657 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:53.598623    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8lr7\" (UniqueName: \"kubernetes.io/projected/29c747df-256e-4741-b682-bceaa732f19b-kube-api-access-r8lr7\") pod \"payload-pre-processing-e2e-migrate-2d3d3219-664b44b54-m6hln\" (UID: \"29c747df-256e-4741-b682-bceaa732f19b\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-2d3d3219-664b44b54-m6hln"
Sep 11 21:17:53.598846 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:53.598720    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29c747df-256e-4741-b682-bceaa732f19b-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-2d3d3219-664b44b54-m6hln\" (UID: \"29c747df-256e-4741-b682-bceaa732f19b\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-2d3d3219-664b44b54-m6hln"
Sep 11 21:17:53.700343 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:53.700311    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8lr7\" (UniqueName: \"kubernetes.io/projected/29c747df-256e-4741-b682-bceaa732f19b-kube-api-access-r8lr7\") pod \"payload-pre-processing-e2e-migrate-2d3d3219-664b44b54-m6hln\" (UID: \"29c747df-256e-4741-b682-bceaa732f19b\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-2d3d3219-664b44b54-m6hln"
Sep 11 21:17:53.700530 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:53.700351    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29c747df-256e-4741-b682-bceaa732f19b-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-2d3d3219-664b44b54-m6hln\" (UID: \"29c747df-256e-4741-b682-bceaa732f19b\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-2d3d3219-664b44b54-m6hln"
Sep 11 21:17:53.701114 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:53.701087    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29c747df-256e-4741-b682-bceaa732f19b-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-2d3d3219-664b44b54-m6hln\" (UID: \"29c747df-256e-4741-b682-bceaa732f19b\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-2d3d3219-664b44b54-m6hln"
Sep 11 21:17:53.709243 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:53.709217    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8lr7\" (UniqueName: \"kubernetes.io/projected/29c747df-256e-4741-b682-bceaa732f19b-kube-api-access-r8lr7\") pod \"payload-pre-processing-e2e-migrate-2d3d3219-664b44b54-m6hln\" (UID: \"29c747df-256e-4741-b682-bceaa732f19b\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-2d3d3219-664b44b54-m6hln"
Sep 11 21:17:53.819877 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:53.819799    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2d3d3219-664b44b54-m6hln"
Sep 11 21:17:54.103455 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:54.103431    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-2d3d3219-664b44b54-m6hln"]
Sep 11 21:17:54.105472 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:17:54.105444    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29c747df_256e_4741_b682_bceaa732f19b.slice/crio-cf8011aa6fb0de2d697bcd53ca018ea800c6213460fc65743096d5b987bd0e00 WatchSource:0}: Error finding container cf8011aa6fb0de2d697bcd53ca018ea800c6213460fc65743096d5b987bd0e00: Status 404 returned error can't find the container with id cf8011aa6fb0de2d697bcd53ca018ea800c6213460fc65743096d5b987bd0e00
Sep 11 21:17:54.171012 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:54.170974    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2d3d3219-664b44b54-m6hln" event={"ID":"29c747df-256e-4741-b682-bceaa732f19b","Type":"ContainerStarted","Data":"cf8011aa6fb0de2d697bcd53ca018ea800c6213460fc65743096d5b987bd0e00"}
Sep 11 21:17:55.177909 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:55.177873    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2d3d3219-664b44b54-m6hln" event={"ID":"29c747df-256e-4741-b682-bceaa732f19b","Type":"ContainerStarted","Data":"5b6009832c21e46731392d0f8bc23ccdf4f5011fcad1c83d40b7411096f84abc"}
Sep 11 21:17:55.178366 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:55.178016    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2d3d3219-664b44b54-m6hln"
Sep 11 21:17:55.196455 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:17:55.196403    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2d3d3219-664b44b54-m6hln" podStartSLOduration=2.196374356 podStartE2EDuration="2.196374356s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:17:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:17:55.194562399 +0000 UTC m=+720.672874256" watchObservedRunningTime="2026-09-11 21:17:55.196374356 +0000 UTC m=+720.674686199"
Sep 11 21:18:06.186450 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:06.186411    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2d3d3219-664b44b54-m6hln"
Sep 11 21:18:21.303501 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:21.303438    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-2d3d3219-664b44b54-m6hln"]
Sep 11 21:18:21.304124 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:21.303708    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2d3d3219-664b44b54-m6hln" podUID="29c747df-256e-4741-b682-bceaa732f19b" containerName="payload-pre-processing" containerID="cri-o://5b6009832c21e46731392d0f8bc23ccdf4f5011fcad1c83d40b7411096f84abc" gracePeriod=30
Sep 11 21:18:21.565318 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:21.565250    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2d3d3219-664b44b54-m6hln"
Sep 11 21:18:21.608654 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:21.608619    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8lr7\" (UniqueName: \"kubernetes.io/projected/29c747df-256e-4741-b682-bceaa732f19b-kube-api-access-r8lr7\") pod \"29c747df-256e-4741-b682-bceaa732f19b\" (UID: \"29c747df-256e-4741-b682-bceaa732f19b\") "
Sep 11 21:18:21.608853 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:21.608691    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29c747df-256e-4741-b682-bceaa732f19b-plugins-config-volume\") pod \"29c747df-256e-4741-b682-bceaa732f19b\" (UID: \"29c747df-256e-4741-b682-bceaa732f19b\") "
Sep 11 21:18:21.609485 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:21.609436    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29c747df-256e-4741-b682-bceaa732f19b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "29c747df-256e-4741-b682-bceaa732f19b" (UID: "29c747df-256e-4741-b682-bceaa732f19b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:18:21.612939 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:21.612883    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29c747df-256e-4741-b682-bceaa732f19b-kube-api-access-r8lr7" (OuterVolumeSpecName: "kube-api-access-r8lr7") pod "29c747df-256e-4741-b682-bceaa732f19b" (UID: "29c747df-256e-4741-b682-bceaa732f19b"). InnerVolumeSpecName "kube-api-access-r8lr7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:18:21.710692 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:21.710656    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8lr7\" (UniqueName: \"kubernetes.io/projected/29c747df-256e-4741-b682-bceaa732f19b-kube-api-access-r8lr7\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:18:21.710692 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:21.710687    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29c747df-256e-4741-b682-bceaa732f19b-plugins-config-volume\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:18:22.336957 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:22.336917    2560 generic.go:356] "Generic (PLEG): container finished" podID="29c747df-256e-4741-b682-bceaa732f19b" containerID="5b6009832c21e46731392d0f8bc23ccdf4f5011fcad1c83d40b7411096f84abc" exitCode=0
Sep 11 21:18:22.336957 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:22.336954    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2d3d3219-664b44b54-m6hln" event={"ID":"29c747df-256e-4741-b682-bceaa732f19b","Type":"ContainerDied","Data":"5b6009832c21e46731392d0f8bc23ccdf4f5011fcad1c83d40b7411096f84abc"}
Sep 11 21:18:22.337514 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:22.337012    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2d3d3219-664b44b54-m6hln"
Sep 11 21:18:22.337514 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:22.337020    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2d3d3219-664b44b54-m6hln" event={"ID":"29c747df-256e-4741-b682-bceaa732f19b","Type":"ContainerDied","Data":"cf8011aa6fb0de2d697bcd53ca018ea800c6213460fc65743096d5b987bd0e00"}
Sep 11 21:18:22.337514 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:22.337050    2560 scope.go:117] "RemoveContainer" containerID="5b6009832c21e46731392d0f8bc23ccdf4f5011fcad1c83d40b7411096f84abc"
Sep 11 21:18:22.357296 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:22.357277    2560 scope.go:117] "RemoveContainer" containerID="5b6009832c21e46731392d0f8bc23ccdf4f5011fcad1c83d40b7411096f84abc"
Sep 11 21:18:22.358265 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:18:22.358237    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b6009832c21e46731392d0f8bc23ccdf4f5011fcad1c83d40b7411096f84abc\": container with ID starting with 5b6009832c21e46731392d0f8bc23ccdf4f5011fcad1c83d40b7411096f84abc not found: ID does not exist" containerID="5b6009832c21e46731392d0f8bc23ccdf4f5011fcad1c83d40b7411096f84abc"
Sep 11 21:18:22.358470 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:22.358445    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b6009832c21e46731392d0f8bc23ccdf4f5011fcad1c83d40b7411096f84abc"} err="failed to get container status \"5b6009832c21e46731392d0f8bc23ccdf4f5011fcad1c83d40b7411096f84abc\": rpc error: code = NotFound desc = could not find container \"5b6009832c21e46731392d0f8bc23ccdf4f5011fcad1c83d40b7411096f84abc\": container with ID starting with 5b6009832c21e46731392d0f8bc23ccdf4f5011fcad1c83d40b7411096f84abc not found: ID does not exist"
Sep 11 21:18:22.376378 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:22.376349    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-2d3d3219-664b44b54-m6hln"]
Sep 11 21:18:22.409815 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:22.409788    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-2d3d3219-664b44b54-m6hln"]
Sep 11 21:18:23.039090 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:23.039052    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29c747df-256e-4741-b682-bceaa732f19b" path="/var/lib/kubelet/pods/29c747df-256e-4741-b682-bceaa732f19b/volumes"
Sep 11 21:18:27.813885 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:27.813845    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-257d9182-6fff4bbc5-xp2xw"]
Sep 11 21:18:27.814415 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:27.814401    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29c747df-256e-4741-b682-bceaa732f19b" containerName="payload-pre-processing"
Sep 11 21:18:27.814415 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:27.814416    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="29c747df-256e-4741-b682-bceaa732f19b" containerName="payload-pre-processing"
Sep 11 21:18:27.814504 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:27.814485    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="29c747df-256e-4741-b682-bceaa732f19b" containerName="payload-pre-processing"
Sep 11 21:18:27.817302 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:27.817283    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-257d9182-6fff4bbc5-xp2xw"
Sep 11 21:18:27.820156 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:27.820127    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-257d9182\""
Sep 11 21:18:27.820281 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:27.820166    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-257d9182-dockercfg-zxdcz\""
Sep 11 21:18:27.827164 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:27.827143    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-257d9182-6fff4bbc5-xp2xw"]
Sep 11 21:18:27.881010 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:27.880978    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/228631b2-d51f-4127-8806-8efd7ec0d28f-plugins-config-volume\") pod \"payload-processing-e2e-ait-257d9182-6fff4bbc5-xp2xw\" (UID: \"228631b2-d51f-4127-8806-8efd7ec0d28f\") " pod="openshift-ingress/payload-processing-e2e-ait-257d9182-6fff4bbc5-xp2xw"
Sep 11 21:18:27.881193 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:27.881139    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7zwh\" (UniqueName: \"kubernetes.io/projected/228631b2-d51f-4127-8806-8efd7ec0d28f-kube-api-access-q7zwh\") pod \"payload-processing-e2e-ait-257d9182-6fff4bbc5-xp2xw\" (UID: \"228631b2-d51f-4127-8806-8efd7ec0d28f\") " pod="openshift-ingress/payload-processing-e2e-ait-257d9182-6fff4bbc5-xp2xw"
Sep 11 21:18:27.982411 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:27.982346    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/228631b2-d51f-4127-8806-8efd7ec0d28f-plugins-config-volume\") pod \"payload-processing-e2e-ait-257d9182-6fff4bbc5-xp2xw\" (UID: \"228631b2-d51f-4127-8806-8efd7ec0d28f\") " pod="openshift-ingress/payload-processing-e2e-ait-257d9182-6fff4bbc5-xp2xw"
Sep 11 21:18:27.982618 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:27.982467    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7zwh\" (UniqueName: \"kubernetes.io/projected/228631b2-d51f-4127-8806-8efd7ec0d28f-kube-api-access-q7zwh\") pod \"payload-processing-e2e-ait-257d9182-6fff4bbc5-xp2xw\" (UID: \"228631b2-d51f-4127-8806-8efd7ec0d28f\") " pod="openshift-ingress/payload-processing-e2e-ait-257d9182-6fff4bbc5-xp2xw"
Sep 11 21:18:27.983121 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:27.983095    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/228631b2-d51f-4127-8806-8efd7ec0d28f-plugins-config-volume\") pod \"payload-processing-e2e-ait-257d9182-6fff4bbc5-xp2xw\" (UID: \"228631b2-d51f-4127-8806-8efd7ec0d28f\") " pod="openshift-ingress/payload-processing-e2e-ait-257d9182-6fff4bbc5-xp2xw"
Sep 11 21:18:27.990773 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:27.990750    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7zwh\" (UniqueName: \"kubernetes.io/projected/228631b2-d51f-4127-8806-8efd7ec0d28f-kube-api-access-q7zwh\") pod \"payload-processing-e2e-ait-257d9182-6fff4bbc5-xp2xw\" (UID: \"228631b2-d51f-4127-8806-8efd7ec0d28f\") " pod="openshift-ingress/payload-processing-e2e-ait-257d9182-6fff4bbc5-xp2xw"
Sep 11 21:18:28.129532 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:28.129495    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-257d9182-6fff4bbc5-xp2xw"
Sep 11 21:18:28.402863 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:28.402828    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-257d9182-6fff4bbc5-xp2xw"]
Sep 11 21:18:28.405102 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:18:28.405073    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod228631b2_d51f_4127_8806_8efd7ec0d28f.slice/crio-f6aad39ba20e4efe0b9b020f2c404637ba64b2d9ca97ad08d6f4c05f2bbd5ed4 WatchSource:0}: Error finding container f6aad39ba20e4efe0b9b020f2c404637ba64b2d9ca97ad08d6f4c05f2bbd5ed4: Status 404 returned error can't find the container with id f6aad39ba20e4efe0b9b020f2c404637ba64b2d9ca97ad08d6f4c05f2bbd5ed4
Sep 11 21:18:29.380674 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:29.380642    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-257d9182-6fff4bbc5-xp2xw" event={"ID":"228631b2-d51f-4127-8806-8efd7ec0d28f","Type":"ContainerStarted","Data":"efbfcef7c552b1be2ec11aff48e1c567d5e6ad1f7b723f284ae2398344d2b58d"}
Sep 11 21:18:29.381067 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:29.380699    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-257d9182-6fff4bbc5-xp2xw" event={"ID":"228631b2-d51f-4127-8806-8efd7ec0d28f","Type":"ContainerStarted","Data":"f6aad39ba20e4efe0b9b020f2c404637ba64b2d9ca97ad08d6f4c05f2bbd5ed4"}
Sep 11 21:18:29.381067 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:29.380728    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-257d9182-6fff4bbc5-xp2xw"
Sep 11 21:18:29.402752 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:29.402693    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-257d9182-6fff4bbc5-xp2xw" podStartSLOduration=2.402675993 podStartE2EDuration="2.402675993s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:18:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:18:29.400600018 +0000 UTC m=+754.878911862" watchObservedRunningTime="2026-09-11 21:18:29.402675993 +0000 UTC m=+754.880987859"
Sep 11 21:18:40.390690 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:40.390632    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-257d9182-6fff4bbc5-xp2xw"
Sep 11 21:18:50.286332 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:50.286290    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-257d9182-67k42"]
Sep 11 21:18:50.289681 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:50.289660    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-257d9182-67k42"
Sep 11 21:18:50.292455 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:50.292436    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 21:18:50.292576 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:50.292498    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bfm9g\""
Sep 11 21:18:50.306299 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:50.306261    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-257d9182-67k42"]
Sep 11 21:18:50.335949 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:50.335906    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/25ff89b3-79b5-446c-b93f-8c51f37fafd7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-257d9182-67k42\" (UID: \"25ff89b3-79b5-446c-b93f-8c51f37fafd7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-257d9182-67k42"
Sep 11 21:18:50.436983 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:50.436939    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/25ff89b3-79b5-446c-b93f-8c51f37fafd7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-257d9182-67k42\" (UID: \"25ff89b3-79b5-446c-b93f-8c51f37fafd7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-257d9182-67k42"
Sep 11 21:18:50.437629 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:50.437610    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/25ff89b3-79b5-446c-b93f-8c51f37fafd7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-257d9182-67k42\" (UID: \"25ff89b3-79b5-446c-b93f-8c51f37fafd7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-257d9182-67k42"
Sep 11 21:18:50.600495 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:50.600374    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-257d9182-67k42"
Sep 11 21:18:50.882961 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:50.882930    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-257d9182-67k42"]
Sep 11 21:18:50.884869 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:18:50.884840    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25ff89b3_79b5_446c_b93f_8c51f37fafd7.slice/crio-b558f51cc765ba6aeedf66207d2936b6844f5ed6fb4f8676f061f09de08cd88b WatchSource:0}: Error finding container b558f51cc765ba6aeedf66207d2936b6844f5ed6fb4f8676f061f09de08cd88b: Status 404 returned error can't find the container with id b558f51cc765ba6aeedf66207d2936b6844f5ed6fb4f8676f061f09de08cd88b
Sep 11 21:18:51.525114 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:51.525005    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-257d9182-67k42" event={"ID":"25ff89b3-79b5-446c-b93f-8c51f37fafd7","Type":"ContainerStarted","Data":"43628ff6ddbb1324b100b80ca966dace7d875127bd9a9c94fa35770766008e9d"}
Sep 11 21:18:51.525114 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:51.525100    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-257d9182-67k42" event={"ID":"25ff89b3-79b5-446c-b93f-8c51f37fafd7","Type":"ContainerStarted","Data":"b558f51cc765ba6aeedf66207d2936b6844f5ed6fb4f8676f061f09de08cd88b"}
Sep 11 21:18:51.559589 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:51.559517    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-257d9182-67k42" podStartSLOduration=1.559494767 podStartE2EDuration="1.559494767s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:18:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:18:51.556066807 +0000 UTC m=+777.034378652" watchObservedRunningTime="2026-09-11 21:18:51.559494767 +0000 UTC m=+777.037806613"
Sep 11 21:18:52.533895 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:52.533859    2560 generic.go:356] "Generic (PLEG): container finished" podID="25ff89b3-79b5-446c-b93f-8c51f37fafd7" containerID="43628ff6ddbb1324b100b80ca966dace7d875127bd9a9c94fa35770766008e9d" exitCode=0
Sep 11 21:18:52.534449 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:52.533901    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-257d9182-67k42" event={"ID":"25ff89b3-79b5-446c-b93f-8c51f37fafd7","Type":"ContainerDied","Data":"43628ff6ddbb1324b100b80ca966dace7d875127bd9a9c94fa35770766008e9d"}
Sep 11 21:18:53.684932 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:53.684899    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-257d9182-67k42"
Sep 11 21:18:53.775884 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:53.775843    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/25ff89b3-79b5-446c-b93f-8c51f37fafd7-maas-api-service-ca\") pod \"25ff89b3-79b5-446c-b93f-8c51f37fafd7\" (UID: \"25ff89b3-79b5-446c-b93f-8c51f37fafd7\") "
Sep 11 21:18:53.776227 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:53.776200    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25ff89b3-79b5-446c-b93f-8c51f37fafd7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "25ff89b3-79b5-446c-b93f-8c51f37fafd7" (UID: "25ff89b3-79b5-446c-b93f-8c51f37fafd7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:18:53.776339 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:53.776321    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/25ff89b3-79b5-446c-b93f-8c51f37fafd7-maas-api-service-ca\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:18:54.547397 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:54.547354    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-257d9182-67k42"
Sep 11 21:18:54.547603 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:54.547378    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-257d9182-67k42" event={"ID":"25ff89b3-79b5-446c-b93f-8c51f37fafd7","Type":"ContainerDied","Data":"b558f51cc765ba6aeedf66207d2936b6844f5ed6fb4f8676f061f09de08cd88b"}
Sep 11 21:18:54.547603 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:54.547454    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b558f51cc765ba6aeedf66207d2936b6844f5ed6fb4f8676f061f09de08cd88b"
Sep 11 21:18:57.270289 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:57.270251    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-257d9182-6fff4bbc5-xp2xw"]
Sep 11 21:18:57.270816 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:57.270763    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-257d9182-6fff4bbc5-xp2xw" podUID="228631b2-d51f-4127-8806-8efd7ec0d28f" containerName="payload-processing" containerID="cri-o://efbfcef7c552b1be2ec11aff48e1c567d5e6ad1f7b723f284ae2398344d2b58d" gracePeriod=30
Sep 11 21:18:57.460167 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:57.460124    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-257d9182-67k42"]
Sep 11 21:18:57.468738 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:57.468665    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-257d9182-67k42"]
Sep 11 21:18:57.547030 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:57.547002    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-257d9182-6fff4bbc5-xp2xw"
Sep 11 21:18:57.574632 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:57.574584    2560 generic.go:356] "Generic (PLEG): container finished" podID="228631b2-d51f-4127-8806-8efd7ec0d28f" containerID="efbfcef7c552b1be2ec11aff48e1c567d5e6ad1f7b723f284ae2398344d2b58d" exitCode=0
Sep 11 21:18:57.574821 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:57.574690    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-257d9182-6fff4bbc5-xp2xw"
Sep 11 21:18:57.574895 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:57.574706    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-257d9182-6fff4bbc5-xp2xw" event={"ID":"228631b2-d51f-4127-8806-8efd7ec0d28f","Type":"ContainerDied","Data":"efbfcef7c552b1be2ec11aff48e1c567d5e6ad1f7b723f284ae2398344d2b58d"}
Sep 11 21:18:57.574951 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:57.574917    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-257d9182-6fff4bbc5-xp2xw" event={"ID":"228631b2-d51f-4127-8806-8efd7ec0d28f","Type":"ContainerDied","Data":"f6aad39ba20e4efe0b9b020f2c404637ba64b2d9ca97ad08d6f4c05f2bbd5ed4"}
Sep 11 21:18:57.574951 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:57.574944    2560 scope.go:117] "RemoveContainer" containerID="efbfcef7c552b1be2ec11aff48e1c567d5e6ad1f7b723f284ae2398344d2b58d"
Sep 11 21:18:57.585778 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:57.585756    2560 scope.go:117] "RemoveContainer" containerID="efbfcef7c552b1be2ec11aff48e1c567d5e6ad1f7b723f284ae2398344d2b58d"
Sep 11 21:18:57.586144 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:18:57.586121    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efbfcef7c552b1be2ec11aff48e1c567d5e6ad1f7b723f284ae2398344d2b58d\": container with ID starting with efbfcef7c552b1be2ec11aff48e1c567d5e6ad1f7b723f284ae2398344d2b58d not found: ID does not exist" containerID="efbfcef7c552b1be2ec11aff48e1c567d5e6ad1f7b723f284ae2398344d2b58d"
Sep 11 21:18:57.586250 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:57.586157    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efbfcef7c552b1be2ec11aff48e1c567d5e6ad1f7b723f284ae2398344d2b58d"} err="failed to get container status \"efbfcef7c552b1be2ec11aff48e1c567d5e6ad1f7b723f284ae2398344d2b58d\": rpc error: code = NotFound desc = could not find container \"efbfcef7c552b1be2ec11aff48e1c567d5e6ad1f7b723f284ae2398344d2b58d\": container with ID starting with efbfcef7c552b1be2ec11aff48e1c567d5e6ad1f7b723f284ae2398344d2b58d not found: ID does not exist"
Sep 11 21:18:57.618478 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:57.618445    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/228631b2-d51f-4127-8806-8efd7ec0d28f-plugins-config-volume\") pod \"228631b2-d51f-4127-8806-8efd7ec0d28f\" (UID: \"228631b2-d51f-4127-8806-8efd7ec0d28f\") "
Sep 11 21:18:57.618685 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:57.618485    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7zwh\" (UniqueName: \"kubernetes.io/projected/228631b2-d51f-4127-8806-8efd7ec0d28f-kube-api-access-q7zwh\") pod \"228631b2-d51f-4127-8806-8efd7ec0d28f\" (UID: \"228631b2-d51f-4127-8806-8efd7ec0d28f\") "
Sep 11 21:18:57.618917 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:57.618890    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/228631b2-d51f-4127-8806-8efd7ec0d28f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "228631b2-d51f-4127-8806-8efd7ec0d28f" (UID: "228631b2-d51f-4127-8806-8efd7ec0d28f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:18:57.618995 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:57.618979    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/228631b2-d51f-4127-8806-8efd7ec0d28f-plugins-config-volume\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:18:57.620675 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:57.620646    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/228631b2-d51f-4127-8806-8efd7ec0d28f-kube-api-access-q7zwh" (OuterVolumeSpecName: "kube-api-access-q7zwh") pod "228631b2-d51f-4127-8806-8efd7ec0d28f" (UID: "228631b2-d51f-4127-8806-8efd7ec0d28f"). InnerVolumeSpecName "kube-api-access-q7zwh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:18:57.720259 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:57.720211    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7zwh\" (UniqueName: \"kubernetes.io/projected/228631b2-d51f-4127-8806-8efd7ec0d28f-kube-api-access-q7zwh\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:18:57.898055 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:57.898015    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-257d9182-6fff4bbc5-xp2xw"]
Sep 11 21:18:57.908706 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:57.908670    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-257d9182-6fff4bbc5-xp2xw"]
Sep 11 21:18:59.038999 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:59.038961    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="228631b2-d51f-4127-8806-8efd7ec0d28f" path="/var/lib/kubelet/pods/228631b2-d51f-4127-8806-8efd7ec0d28f/volumes"
Sep 11 21:18:59.039405 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:18:59.039327    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25ff89b3-79b5-446c-b93f-8c51f37fafd7" path="/var/lib/kubelet/pods/25ff89b3-79b5-446c-b93f-8c51f37fafd7/volumes"
Sep 11 21:19:04.605187 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:04.605119    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-5fdb611f-569b6dffc-9scrl"]
Sep 11 21:19:04.605732 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:04.605716    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25ff89b3-79b5-446c-b93f-8c51f37fafd7" containerName="revoke-keys"
Sep 11 21:19:04.605781 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:04.605735    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="25ff89b3-79b5-446c-b93f-8c51f37fafd7" containerName="revoke-keys"
Sep 11 21:19:04.605781 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:04.605758    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="228631b2-d51f-4127-8806-8efd7ec0d28f" containerName="payload-processing"
Sep 11 21:19:04.605781 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:04.605764    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="228631b2-d51f-4127-8806-8efd7ec0d28f" containerName="payload-processing"
Sep 11 21:19:04.605873 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:04.605834    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="25ff89b3-79b5-446c-b93f-8c51f37fafd7" containerName="revoke-keys"
Sep 11 21:19:04.605873 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:04.605844    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="228631b2-d51f-4127-8806-8efd7ec0d28f" containerName="payload-processing"
Sep 11 21:19:04.609039 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:04.609019    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-5fdb611f-569b6dffc-9scrl"
Sep 11 21:19:04.611916 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:04.611886    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-5fdb611f\""
Sep 11 21:19:04.612064 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:04.611965    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-5fdb611f-dockercfg-lct28\""
Sep 11 21:19:04.619402 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:04.619356    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-5fdb611f-569b6dffc-9scrl"]
Sep 11 21:19:04.698406 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:04.698115    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a35c53d-bb29-499b-99d5-e90d5c3e589a-plugins-config-volume\") pod \"payload-processing-e2e-derive-5fdb611f-569b6dffc-9scrl\" (UID: \"8a35c53d-bb29-499b-99d5-e90d5c3e589a\") " pod="openshift-ingress/payload-processing-e2e-derive-5fdb611f-569b6dffc-9scrl"
Sep 11 21:19:04.698406 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:04.698286    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp8c6\" (UniqueName: \"kubernetes.io/projected/8a35c53d-bb29-499b-99d5-e90d5c3e589a-kube-api-access-vp8c6\") pod \"payload-processing-e2e-derive-5fdb611f-569b6dffc-9scrl\" (UID: \"8a35c53d-bb29-499b-99d5-e90d5c3e589a\") " pod="openshift-ingress/payload-processing-e2e-derive-5fdb611f-569b6dffc-9scrl"
Sep 11 21:19:04.799565 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:04.799514    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp8c6\" (UniqueName: \"kubernetes.io/projected/8a35c53d-bb29-499b-99d5-e90d5c3e589a-kube-api-access-vp8c6\") pod \"payload-processing-e2e-derive-5fdb611f-569b6dffc-9scrl\" (UID: \"8a35c53d-bb29-499b-99d5-e90d5c3e589a\") " pod="openshift-ingress/payload-processing-e2e-derive-5fdb611f-569b6dffc-9scrl"
Sep 11 21:19:04.799747 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:04.799631    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a35c53d-bb29-499b-99d5-e90d5c3e589a-plugins-config-volume\") pod \"payload-processing-e2e-derive-5fdb611f-569b6dffc-9scrl\" (UID: \"8a35c53d-bb29-499b-99d5-e90d5c3e589a\") " pod="openshift-ingress/payload-processing-e2e-derive-5fdb611f-569b6dffc-9scrl"
Sep 11 21:19:04.800424 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:04.800361    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a35c53d-bb29-499b-99d5-e90d5c3e589a-plugins-config-volume\") pod \"payload-processing-e2e-derive-5fdb611f-569b6dffc-9scrl\" (UID: \"8a35c53d-bb29-499b-99d5-e90d5c3e589a\") " pod="openshift-ingress/payload-processing-e2e-derive-5fdb611f-569b6dffc-9scrl"
Sep 11 21:19:04.808350 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:04.808324    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp8c6\" (UniqueName: \"kubernetes.io/projected/8a35c53d-bb29-499b-99d5-e90d5c3e589a-kube-api-access-vp8c6\") pod \"payload-processing-e2e-derive-5fdb611f-569b6dffc-9scrl\" (UID: \"8a35c53d-bb29-499b-99d5-e90d5c3e589a\") " pod="openshift-ingress/payload-processing-e2e-derive-5fdb611f-569b6dffc-9scrl"
Sep 11 21:19:04.922304 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:04.922268    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-5fdb611f-569b6dffc-9scrl"
Sep 11 21:19:05.206870 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:05.206844    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-5fdb611f-569b6dffc-9scrl"]
Sep 11 21:19:05.209112 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:19:05.209075    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a35c53d_bb29_499b_99d5_e90d5c3e589a.slice/crio-563f5f6bdc78a1952af90d8f97035f6330ae29897b0001bb53b109db1022e59c WatchSource:0}: Error finding container 563f5f6bdc78a1952af90d8f97035f6330ae29897b0001bb53b109db1022e59c: Status 404 returned error can't find the container with id 563f5f6bdc78a1952af90d8f97035f6330ae29897b0001bb53b109db1022e59c
Sep 11 21:19:05.629997 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:05.629950    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-5fdb611f-569b6dffc-9scrl" event={"ID":"8a35c53d-bb29-499b-99d5-e90d5c3e589a","Type":"ContainerStarted","Data":"50af0e6a43afb96a429e07788622c911593cab9e6e86a7c5d5f88d878dbe6acc"}
Sep 11 21:19:05.630424 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:05.630013    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-5fdb611f-569b6dffc-9scrl" event={"ID":"8a35c53d-bb29-499b-99d5-e90d5c3e589a","Type":"ContainerStarted","Data":"563f5f6bdc78a1952af90d8f97035f6330ae29897b0001bb53b109db1022e59c"}
Sep 11 21:19:05.630424 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:05.630142    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-5fdb611f-569b6dffc-9scrl"
Sep 11 21:19:05.650571 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:05.650503    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-5fdb611f-569b6dffc-9scrl" podStartSLOduration=1.650484292 podStartE2EDuration="1.650484292s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:19:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:19:05.648252977 +0000 UTC m=+791.126564823" watchObservedRunningTime="2026-09-11 21:19:05.650484292 +0000 UTC m=+791.128796187"
Sep 11 21:19:16.637855 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:16.637819    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-5fdb611f-569b6dffc-9scrl"
Sep 11 21:19:26.485211 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:26.485169    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5fdb611f-q4b87"]
Sep 11 21:19:26.488901 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:26.488881    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5fdb611f-q4b87"
Sep 11 21:19:26.491327 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:26.491303    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bfm9g\""
Sep 11 21:19:26.491502 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:26.491483    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 21:19:26.499038 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:26.499011    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5fdb611f-q4b87"]
Sep 11 21:19:26.546964 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:26.546927    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3af74147-efd7-4d89-8a27-94e770745376-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5fdb611f-q4b87\" (UID: \"3af74147-efd7-4d89-8a27-94e770745376\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5fdb611f-q4b87"
Sep 11 21:19:26.648536 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:26.648490    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3af74147-efd7-4d89-8a27-94e770745376-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5fdb611f-q4b87\" (UID: \"3af74147-efd7-4d89-8a27-94e770745376\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5fdb611f-q4b87"
Sep 11 21:19:26.649164 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:26.649142    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3af74147-efd7-4d89-8a27-94e770745376-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5fdb611f-q4b87\" (UID: \"3af74147-efd7-4d89-8a27-94e770745376\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5fdb611f-q4b87"
Sep 11 21:19:26.801420 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:26.801307    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5fdb611f-q4b87"
Sep 11 21:19:27.074953 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:27.074925    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5fdb611f-q4b87"]
Sep 11 21:19:27.076572 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:19:27.076542    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3af74147_efd7_4d89_8a27_94e770745376.slice/crio-32cdfb336be187ddcc616a7e4282d6a38b849baf2d3a312082d171d6f8f78b8d WatchSource:0}: Error finding container 32cdfb336be187ddcc616a7e4282d6a38b849baf2d3a312082d171d6f8f78b8d: Status 404 returned error can't find the container with id 32cdfb336be187ddcc616a7e4282d6a38b849baf2d3a312082d171d6f8f78b8d
Sep 11 21:19:27.764567 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:27.764529    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5fdb611f-q4b87" event={"ID":"3af74147-efd7-4d89-8a27-94e770745376","Type":"ContainerStarted","Data":"ee02ebce362436d3478f01f3322b2ff21288224840e26fa46d70e0e931d9369a"}
Sep 11 21:19:27.764986 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:27.764593    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5fdb611f-q4b87" event={"ID":"3af74147-efd7-4d89-8a27-94e770745376","Type":"ContainerStarted","Data":"32cdfb336be187ddcc616a7e4282d6a38b849baf2d3a312082d171d6f8f78b8d"}
Sep 11 21:19:27.782804 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:27.782737    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5fdb611f-q4b87" podStartSLOduration=1.782715958 podStartE2EDuration="1.782715958s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:19:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:19:27.779829904 +0000 UTC m=+813.258141748" watchObservedRunningTime="2026-09-11 21:19:27.782715958 +0000 UTC m=+813.261027801"
Sep 11 21:19:28.772505 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:28.772468    2560 generic.go:356] "Generic (PLEG): container finished" podID="3af74147-efd7-4d89-8a27-94e770745376" containerID="ee02ebce362436d3478f01f3322b2ff21288224840e26fa46d70e0e931d9369a" exitCode=0
Sep 11 21:19:28.772918 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:28.772544    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5fdb611f-q4b87" event={"ID":"3af74147-efd7-4d89-8a27-94e770745376","Type":"ContainerDied","Data":"ee02ebce362436d3478f01f3322b2ff21288224840e26fa46d70e0e931d9369a"}
Sep 11 21:19:29.931456 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:29.931426    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5fdb611f-q4b87"
Sep 11 21:19:29.986511 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:29.986476    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3af74147-efd7-4d89-8a27-94e770745376-maas-api-service-ca\") pod \"3af74147-efd7-4d89-8a27-94e770745376\" (UID: \"3af74147-efd7-4d89-8a27-94e770745376\") "
Sep 11 21:19:29.986916 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:29.986889    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3af74147-efd7-4d89-8a27-94e770745376-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3af74147-efd7-4d89-8a27-94e770745376" (UID: "3af74147-efd7-4d89-8a27-94e770745376"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:19:30.088536 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:30.088442    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3af74147-efd7-4d89-8a27-94e770745376-maas-api-service-ca\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:19:30.786518 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:30.786489    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5fdb611f-q4b87"
Sep 11 21:19:30.786702 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:30.786491    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5fdb611f-q4b87" event={"ID":"3af74147-efd7-4d89-8a27-94e770745376","Type":"ContainerDied","Data":"32cdfb336be187ddcc616a7e4282d6a38b849baf2d3a312082d171d6f8f78b8d"}
Sep 11 21:19:30.786702 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:30.786624    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="32cdfb336be187ddcc616a7e4282d6a38b849baf2d3a312082d171d6f8f78b8d"
Sep 11 21:19:33.723375 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:33.723338    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-5fdb611f-569b6dffc-9scrl"]
Sep 11 21:19:33.723877 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:33.723627    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-5fdb611f-569b6dffc-9scrl" podUID="8a35c53d-bb29-499b-99d5-e90d5c3e589a" containerName="payload-processing" containerID="cri-o://50af0e6a43afb96a429e07788622c911593cab9e6e86a7c5d5f88d878dbe6acc" gracePeriod=30
Sep 11 21:19:33.882022 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:33.881989    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5fdb611f-q4b87"]
Sep 11 21:19:33.884427 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:33.884372    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5fdb611f-q4b87"]
Sep 11 21:19:34.037323 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:34.037294    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-5fdb611f-569b6dffc-9scrl"
Sep 11 21:19:34.134233 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:34.134184    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a35c53d-bb29-499b-99d5-e90d5c3e589a-plugins-config-volume\") pod \"8a35c53d-bb29-499b-99d5-e90d5c3e589a\" (UID: \"8a35c53d-bb29-499b-99d5-e90d5c3e589a\") "
Sep 11 21:19:34.134650 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:34.134629    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vp8c6\" (UniqueName: \"kubernetes.io/projected/8a35c53d-bb29-499b-99d5-e90d5c3e589a-kube-api-access-vp8c6\") pod \"8a35c53d-bb29-499b-99d5-e90d5c3e589a\" (UID: \"8a35c53d-bb29-499b-99d5-e90d5c3e589a\") "
Sep 11 21:19:34.135017 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:34.134643    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a35c53d-bb29-499b-99d5-e90d5c3e589a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8a35c53d-bb29-499b-99d5-e90d5c3e589a" (UID: "8a35c53d-bb29-499b-99d5-e90d5c3e589a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:19:34.136402 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:34.136369    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a35c53d-bb29-499b-99d5-e90d5c3e589a-plugins-config-volume\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:19:34.143618 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:34.143504    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a35c53d-bb29-499b-99d5-e90d5c3e589a-kube-api-access-vp8c6" (OuterVolumeSpecName: "kube-api-access-vp8c6") pod "8a35c53d-bb29-499b-99d5-e90d5c3e589a" (UID: "8a35c53d-bb29-499b-99d5-e90d5c3e589a"). InnerVolumeSpecName "kube-api-access-vp8c6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:19:34.238076 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:34.238042    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vp8c6\" (UniqueName: \"kubernetes.io/projected/8a35c53d-bb29-499b-99d5-e90d5c3e589a-kube-api-access-vp8c6\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:19:34.817233 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:34.817195    2560 generic.go:356] "Generic (PLEG): container finished" podID="8a35c53d-bb29-499b-99d5-e90d5c3e589a" containerID="50af0e6a43afb96a429e07788622c911593cab9e6e86a7c5d5f88d878dbe6acc" exitCode=0
Sep 11 21:19:34.817670 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:34.817255    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-5fdb611f-569b6dffc-9scrl"
Sep 11 21:19:34.817670 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:34.817259    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-5fdb611f-569b6dffc-9scrl" event={"ID":"8a35c53d-bb29-499b-99d5-e90d5c3e589a","Type":"ContainerDied","Data":"50af0e6a43afb96a429e07788622c911593cab9e6e86a7c5d5f88d878dbe6acc"}
Sep 11 21:19:34.817670 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:34.817337    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-5fdb611f-569b6dffc-9scrl" event={"ID":"8a35c53d-bb29-499b-99d5-e90d5c3e589a","Type":"ContainerDied","Data":"563f5f6bdc78a1952af90d8f97035f6330ae29897b0001bb53b109db1022e59c"}
Sep 11 21:19:34.817670 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:34.817362    2560 scope.go:117] "RemoveContainer" containerID="50af0e6a43afb96a429e07788622c911593cab9e6e86a7c5d5f88d878dbe6acc"
Sep 11 21:19:34.827140 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:34.827118    2560 scope.go:117] "RemoveContainer" containerID="50af0e6a43afb96a429e07788622c911593cab9e6e86a7c5d5f88d878dbe6acc"
Sep 11 21:19:34.827505 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:19:34.827458    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50af0e6a43afb96a429e07788622c911593cab9e6e86a7c5d5f88d878dbe6acc\": container with ID starting with 50af0e6a43afb96a429e07788622c911593cab9e6e86a7c5d5f88d878dbe6acc not found: ID does not exist" containerID="50af0e6a43afb96a429e07788622c911593cab9e6e86a7c5d5f88d878dbe6acc"
Sep 11 21:19:34.827597 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:34.827514    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50af0e6a43afb96a429e07788622c911593cab9e6e86a7c5d5f88d878dbe6acc"} err="failed to get container status \"50af0e6a43afb96a429e07788622c911593cab9e6e86a7c5d5f88d878dbe6acc\": rpc error: code = NotFound desc = could not find container \"50af0e6a43afb96a429e07788622c911593cab9e6e86a7c5d5f88d878dbe6acc\": container with ID starting with 50af0e6a43afb96a429e07788622c911593cab9e6e86a7c5d5f88d878dbe6acc not found: ID does not exist"
Sep 11 21:19:34.870021 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:34.869983    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-5fdb611f-569b6dffc-9scrl"]
Sep 11 21:19:34.874181 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:34.874147    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-5fdb611f-569b6dffc-9scrl"]
Sep 11 21:19:35.038630 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:35.038600    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3af74147-efd7-4d89-8a27-94e770745376" path="/var/lib/kubelet/pods/3af74147-efd7-4d89-8a27-94e770745376/volumes"
Sep 11 21:19:35.039002 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:19:35.038989    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a35c53d-bb29-499b-99d5-e90d5c3e589a" path="/var/lib/kubelet/pods/8a35c53d-bb29-499b-99d5-e90d5c3e589a/volumes"
Sep 11 21:20:00.017693 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:00.017660    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-765a18-6pcgv"]
Sep 11 21:20:00.018149 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:00.018137    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3af74147-efd7-4d89-8a27-94e770745376" containerName="revoke-keys"
Sep 11 21:20:00.018149 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:00.018150    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3af74147-efd7-4d89-8a27-94e770745376" containerName="revoke-keys"
Sep 11 21:20:00.018233 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:00.018164    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a35c53d-bb29-499b-99d5-e90d5c3e589a" containerName="payload-processing"
Sep 11 21:20:00.018233 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:00.018170    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a35c53d-bb29-499b-99d5-e90d5c3e589a" containerName="payload-processing"
Sep 11 21:20:00.018315 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:00.018240    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3af74147-efd7-4d89-8a27-94e770745376" containerName="revoke-keys"
Sep 11 21:20:00.018315 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:00.018252    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a35c53d-bb29-499b-99d5-e90d5c3e589a" containerName="payload-processing"
Sep 11 21:20:00.023367 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:00.023349    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-765a18-6pcgv"
Sep 11 21:20:00.026405 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:00.026260    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 21:20:00.026405 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:00.026260    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bfm9g\""
Sep 11 21:20:00.029146 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:00.029117    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-765a18-6pcgv"]
Sep 11 21:20:00.121329 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:00.121291    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/97d0d856-7cb0-4694-bf58-c1b10c4b34c9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-765a18-6pcgv\" (UID: \"97d0d856-7cb0-4694-bf58-c1b10c4b34c9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-765a18-6pcgv"
Sep 11 21:20:00.222693 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:00.222654    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/97d0d856-7cb0-4694-bf58-c1b10c4b34c9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-765a18-6pcgv\" (UID: \"97d0d856-7cb0-4694-bf58-c1b10c4b34c9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-765a18-6pcgv"
Sep 11 21:20:00.223368 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:00.223339    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/97d0d856-7cb0-4694-bf58-c1b10c4b34c9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-765a18-6pcgv\" (UID: \"97d0d856-7cb0-4694-bf58-c1b10c4b34c9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-765a18-6pcgv"
Sep 11 21:20:00.337258 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:00.337190    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-765a18-6pcgv"
Sep 11 21:20:00.614708 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:00.614686    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-765a18-6pcgv"]
Sep 11 21:20:00.616586 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:20:00.616561    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97d0d856_7cb0_4694_bf58_c1b10c4b34c9.slice/crio-dca9d8754ebed6ce38d9001c9a61f1fdfbfef12c171f34088180d95c34d9ab55 WatchSource:0}: Error finding container dca9d8754ebed6ce38d9001c9a61f1fdfbfef12c171f34088180d95c34d9ab55: Status 404 returned error can't find the container with id dca9d8754ebed6ce38d9001c9a61f1fdfbfef12c171f34088180d95c34d9ab55
Sep 11 21:20:00.977851 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:00.977822    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-765a18-6pcgv" event={"ID":"97d0d856-7cb0-4694-bf58-c1b10c4b34c9","Type":"ContainerStarted","Data":"036cfa205b7ff310a66699bb9a59dc3f28ff8f673c3edb17ccdda597a800231a"}
Sep 11 21:20:00.977977 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:00.977885    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-765a18-6pcgv" event={"ID":"97d0d856-7cb0-4694-bf58-c1b10c4b34c9","Type":"ContainerStarted","Data":"dca9d8754ebed6ce38d9001c9a61f1fdfbfef12c171f34088180d95c34d9ab55"}
Sep 11 21:20:00.993843 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:00.993795    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-765a18-6pcgv" podStartSLOduration=0.993777163 podStartE2EDuration="993.777163ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:20:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:20:00.993077885 +0000 UTC m=+846.471389730" watchObservedRunningTime="2026-09-11 21:20:00.993777163 +0000 UTC m=+846.472089007"
Sep 11 21:20:01.984674 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:01.984635    2560 generic.go:356] "Generic (PLEG): container finished" podID="97d0d856-7cb0-4694-bf58-c1b10c4b34c9" containerID="036cfa205b7ff310a66699bb9a59dc3f28ff8f673c3edb17ccdda597a800231a" exitCode=0
Sep 11 21:20:01.985020 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:01.984678    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-765a18-6pcgv" event={"ID":"97d0d856-7cb0-4694-bf58-c1b10c4b34c9","Type":"ContainerDied","Data":"036cfa205b7ff310a66699bb9a59dc3f28ff8f673c3edb17ccdda597a800231a"}
Sep 11 21:20:03.137078 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:03.137052    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-765a18-6pcgv"
Sep 11 21:20:03.257374 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:03.257270    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/97d0d856-7cb0-4694-bf58-c1b10c4b34c9-maas-api-service-ca\") pod \"97d0d856-7cb0-4694-bf58-c1b10c4b34c9\" (UID: \"97d0d856-7cb0-4694-bf58-c1b10c4b34c9\") "
Sep 11 21:20:03.257698 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:03.257676    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97d0d856-7cb0-4694-bf58-c1b10c4b34c9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "97d0d856-7cb0-4694-bf58-c1b10c4b34c9" (UID: "97d0d856-7cb0-4694-bf58-c1b10c4b34c9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:20:03.358968 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:03.358937    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/97d0d856-7cb0-4694-bf58-c1b10c4b34c9-maas-api-service-ca\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:20:03.998112 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:03.998081    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-765a18-6pcgv" event={"ID":"97d0d856-7cb0-4694-bf58-c1b10c4b34c9","Type":"ContainerDied","Data":"dca9d8754ebed6ce38d9001c9a61f1fdfbfef12c171f34088180d95c34d9ab55"}
Sep 11 21:20:03.998112 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:03.998097    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-765a18-6pcgv"
Sep 11 21:20:03.998326 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:03.998151    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dca9d8754ebed6ce38d9001c9a61f1fdfbfef12c171f34088180d95c34d9ab55"
Sep 11 21:20:10.683204 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:10.683169    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-765a18-676c6c664b-7pxdk"]
Sep 11 21:20:10.683619 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:10.683474    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-autores-765a18-676c6c664b-7pxdk" podUID="0ca4d43f-b16a-4c3b-a6ca-e29f9751e326" containerName="payload-pre-processing" containerID="cri-o://9e1a95456190e251fcfe4431c217fe61bb9550c7728dda871cd4d1552653ab91" gracePeriod=30
Sep 11 21:20:10.840117 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:10.840080    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-765a18-6pcgv"]
Sep 11 21:20:10.842408 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:10.842370    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-765a18-6pcgv"]
Sep 11 21:20:10.972912 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:10.972869    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-765a18-676c6c664b-7pxdk"
Sep 11 21:20:11.038180 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:11.038144    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97d0d856-7cb0-4694-bf58-c1b10c4b34c9" path="/var/lib/kubelet/pods/97d0d856-7cb0-4694-bf58-c1b10c4b34c9/volumes"
Sep 11 21:20:11.039824 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:11.039796    2560 generic.go:356] "Generic (PLEG): container finished" podID="0ca4d43f-b16a-4c3b-a6ca-e29f9751e326" containerID="9e1a95456190e251fcfe4431c217fe61bb9550c7728dda871cd4d1552653ab91" exitCode=0
Sep 11 21:20:11.039952 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:11.039889    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-765a18-676c6c664b-7pxdk"
Sep 11 21:20:11.040396 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:11.040361    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-765a18-676c6c664b-7pxdk" event={"ID":"0ca4d43f-b16a-4c3b-a6ca-e29f9751e326","Type":"ContainerDied","Data":"9e1a95456190e251fcfe4431c217fe61bb9550c7728dda871cd4d1552653ab91"}
Sep 11 21:20:11.040442 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:11.040424    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-765a18-676c6c664b-7pxdk" event={"ID":"0ca4d43f-b16a-4c3b-a6ca-e29f9751e326","Type":"ContainerDied","Data":"ad73e763ae6889b0c76401a5cdcbbc95ac488d27ef578261b9080aeb8ea830c1"}
Sep 11 21:20:11.040482 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:11.040450    2560 scope.go:117] "RemoveContainer" containerID="9e1a95456190e251fcfe4431c217fe61bb9550c7728dda871cd4d1552653ab91"
Sep 11 21:20:11.044198 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:11.044170    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ca4d43f-b16a-4c3b-a6ca-e29f9751e326-plugins-config-volume\") pod \"0ca4d43f-b16a-4c3b-a6ca-e29f9751e326\" (UID: \"0ca4d43f-b16a-4c3b-a6ca-e29f9751e326\") "
Sep 11 21:20:11.044302 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:11.044286    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d42lt\" (UniqueName: \"kubernetes.io/projected/0ca4d43f-b16a-4c3b-a6ca-e29f9751e326-kube-api-access-d42lt\") pod \"0ca4d43f-b16a-4c3b-a6ca-e29f9751e326\" (UID: \"0ca4d43f-b16a-4c3b-a6ca-e29f9751e326\") "
Sep 11 21:20:11.044514 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:11.044493    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ca4d43f-b16a-4c3b-a6ca-e29f9751e326-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0ca4d43f-b16a-4c3b-a6ca-e29f9751e326" (UID: "0ca4d43f-b16a-4c3b-a6ca-e29f9751e326"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:20:11.044711 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:11.044691    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ca4d43f-b16a-4c3b-a6ca-e29f9751e326-plugins-config-volume\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:20:11.046355 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:11.046333    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ca4d43f-b16a-4c3b-a6ca-e29f9751e326-kube-api-access-d42lt" (OuterVolumeSpecName: "kube-api-access-d42lt") pod "0ca4d43f-b16a-4c3b-a6ca-e29f9751e326" (UID: "0ca4d43f-b16a-4c3b-a6ca-e29f9751e326"). InnerVolumeSpecName "kube-api-access-d42lt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:20:11.049959 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:11.049936    2560 scope.go:117] "RemoveContainer" containerID="9e1a95456190e251fcfe4431c217fe61bb9550c7728dda871cd4d1552653ab91"
Sep 11 21:20:11.050244 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:20:11.050216    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e1a95456190e251fcfe4431c217fe61bb9550c7728dda871cd4d1552653ab91\": container with ID starting with 9e1a95456190e251fcfe4431c217fe61bb9550c7728dda871cd4d1552653ab91 not found: ID does not exist" containerID="9e1a95456190e251fcfe4431c217fe61bb9550c7728dda871cd4d1552653ab91"
Sep 11 21:20:11.050300 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:11.050258    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e1a95456190e251fcfe4431c217fe61bb9550c7728dda871cd4d1552653ab91"} err="failed to get container status \"9e1a95456190e251fcfe4431c217fe61bb9550c7728dda871cd4d1552653ab91\": rpc error: code = NotFound desc = could not find container \"9e1a95456190e251fcfe4431c217fe61bb9550c7728dda871cd4d1552653ab91\": container with ID starting with 9e1a95456190e251fcfe4431c217fe61bb9550c7728dda871cd4d1552653ab91 not found: ID does not exist"
Sep 11 21:20:11.146004 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:11.145969    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d42lt\" (UniqueName: \"kubernetes.io/projected/0ca4d43f-b16a-4c3b-a6ca-e29f9751e326-kube-api-access-d42lt\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:20:11.369356 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:11.369314    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-765a18-676c6c664b-7pxdk"]
Sep 11 21:20:11.380027 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:11.379995    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-765a18-676c6c664b-7pxdk"]
Sep 11 21:20:13.041558 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:13.039543    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ca4d43f-b16a-4c3b-a6ca-e29f9751e326" path="/var/lib/kubelet/pods/0ca4d43f-b16a-4c3b-a6ca-e29f9751e326/volumes"
Sep 11 21:20:18.160793 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:18.160753    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-962a7d-hm9zl"]
Sep 11 21:20:18.161592 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:18.161569    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ca4d43f-b16a-4c3b-a6ca-e29f9751e326" containerName="payload-pre-processing"
Sep 11 21:20:18.161592 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:18.161594    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ca4d43f-b16a-4c3b-a6ca-e29f9751e326" containerName="payload-pre-processing"
Sep 11 21:20:18.161781 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:18.161643    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97d0d856-7cb0-4694-bf58-c1b10c4b34c9" containerName="revoke-keys"
Sep 11 21:20:18.161781 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:18.161653    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="97d0d856-7cb0-4694-bf58-c1b10c4b34c9" containerName="revoke-keys"
Sep 11 21:20:18.161781 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:18.161743    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="97d0d856-7cb0-4694-bf58-c1b10c4b34c9" containerName="revoke-keys"
Sep 11 21:20:18.161781 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:18.161757    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ca4d43f-b16a-4c3b-a6ca-e29f9751e326" containerName="payload-pre-processing"
Sep 11 21:20:18.166915 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:18.166888    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-962a7d-hm9zl"
Sep 11 21:20:18.169784 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:18.169761    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 21:20:18.170015 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:18.169964    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bfm9g\""
Sep 11 21:20:18.175220 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:18.175185    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-962a7d-hm9zl"]
Sep 11 21:20:18.218504 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:18.218472    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/145f6e17-7fe9-4081-aaa0-1de80f783b87-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-962a7d-hm9zl\" (UID: \"145f6e17-7fe9-4081-aaa0-1de80f783b87\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-962a7d-hm9zl"
Sep 11 21:20:18.319613 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:18.319577    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/145f6e17-7fe9-4081-aaa0-1de80f783b87-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-962a7d-hm9zl\" (UID: \"145f6e17-7fe9-4081-aaa0-1de80f783b87\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-962a7d-hm9zl"
Sep 11 21:20:18.320191 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:18.320170    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/145f6e17-7fe9-4081-aaa0-1de80f783b87-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-962a7d-hm9zl\" (UID: \"145f6e17-7fe9-4081-aaa0-1de80f783b87\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-962a7d-hm9zl"
Sep 11 21:20:18.480311 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:18.480214    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-962a7d-hm9zl"
Sep 11 21:20:18.769343 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:18.769310    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-962a7d-hm9zl"]
Sep 11 21:20:18.771437 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:20:18.771371    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod145f6e17_7fe9_4081_aaa0_1de80f783b87.slice/crio-37ede09a7d828355af674f041d329ee315c16020b4eca4f57ab60961616869aa WatchSource:0}: Error finding container 37ede09a7d828355af674f041d329ee315c16020b4eca4f57ab60961616869aa: Status 404 returned error can't find the container with id 37ede09a7d828355af674f041d329ee315c16020b4eca4f57ab60961616869aa
Sep 11 21:20:19.088676 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:19.088643    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-962a7d-hm9zl" event={"ID":"145f6e17-7fe9-4081-aaa0-1de80f783b87","Type":"ContainerStarted","Data":"476346dff178283d6feaeea5f978d34390569601d15b013828723f118f303deb"}
Sep 11 21:20:19.088832 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:19.088712    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-962a7d-hm9zl" event={"ID":"145f6e17-7fe9-4081-aaa0-1de80f783b87","Type":"ContainerStarted","Data":"37ede09a7d828355af674f041d329ee315c16020b4eca4f57ab60961616869aa"}
Sep 11 21:20:19.105905 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:19.105856    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-962a7d-hm9zl" podStartSLOduration=1.105840635 podStartE2EDuration="1.105840635s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:20:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:20:19.10444184 +0000 UTC m=+864.582753687" watchObservedRunningTime="2026-09-11 21:20:19.105840635 +0000 UTC m=+864.584152479"
Sep 11 21:20:20.096186 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:20.096155    2560 generic.go:356] "Generic (PLEG): container finished" podID="145f6e17-7fe9-4081-aaa0-1de80f783b87" containerID="476346dff178283d6feaeea5f978d34390569601d15b013828723f118f303deb" exitCode=0
Sep 11 21:20:20.096585 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:20.096244    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-962a7d-hm9zl" event={"ID":"145f6e17-7fe9-4081-aaa0-1de80f783b87","Type":"ContainerDied","Data":"476346dff178283d6feaeea5f978d34390569601d15b013828723f118f303deb"}
Sep 11 21:20:21.241793 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:21.241770    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-962a7d-hm9zl"
Sep 11 21:20:21.352749 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:21.352663    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/145f6e17-7fe9-4081-aaa0-1de80f783b87-maas-api-service-ca\") pod \"145f6e17-7fe9-4081-aaa0-1de80f783b87\" (UID: \"145f6e17-7fe9-4081-aaa0-1de80f783b87\") "
Sep 11 21:20:21.353017 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:21.352994    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/145f6e17-7fe9-4081-aaa0-1de80f783b87-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "145f6e17-7fe9-4081-aaa0-1de80f783b87" (UID: "145f6e17-7fe9-4081-aaa0-1de80f783b87"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:20:21.353127 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:21.353113    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/145f6e17-7fe9-4081-aaa0-1de80f783b87-maas-api-service-ca\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:20:22.109446 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:22.109410    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-962a7d-hm9zl" event={"ID":"145f6e17-7fe9-4081-aaa0-1de80f783b87","Type":"ContainerDied","Data":"37ede09a7d828355af674f041d329ee315c16020b4eca4f57ab60961616869aa"}
Sep 11 21:20:22.109446 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:22.109438    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-962a7d-hm9zl"
Sep 11 21:20:22.109651 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:22.109459    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="37ede09a7d828355af674f041d329ee315c16020b4eca4f57ab60961616869aa"
Sep 11 21:20:28.430882 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:28.430847    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-962a7d-54fcd4b8db-h7sk5"]
Sep 11 21:20:28.431424 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:28.431098    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-962a7d-54fcd4b8db-h7sk5" podUID="bd129171-9973-4067-a3d5-4c2faa3f7322" containerName="payload-pre-processing" containerID="cri-o://4214b1510f8d319902a3bc46e01f189f4c03c83a43412613a1b1148a4013779e" gracePeriod=30
Sep 11 21:20:28.654263 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:28.654207    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-962a7d-hm9zl"]
Sep 11 21:20:28.658169 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:28.658143    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-962a7d-hm9zl"]
Sep 11 21:20:28.737851 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:28.737823    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-962a7d-54fcd4b8db-h7sk5"
Sep 11 21:20:28.851729 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:28.851691    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd129171-9973-4067-a3d5-4c2faa3f7322-plugins-config-volume\") pod \"bd129171-9973-4067-a3d5-4c2faa3f7322\" (UID: \"bd129171-9973-4067-a3d5-4c2faa3f7322\") "
Sep 11 21:20:28.851908 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:28.851777    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lpmj8\" (UniqueName: \"kubernetes.io/projected/bd129171-9973-4067-a3d5-4c2faa3f7322-kube-api-access-lpmj8\") pod \"bd129171-9973-4067-a3d5-4c2faa3f7322\" (UID: \"bd129171-9973-4067-a3d5-4c2faa3f7322\") "
Sep 11 21:20:28.852084 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:28.852061    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd129171-9973-4067-a3d5-4c2faa3f7322-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bd129171-9973-4067-a3d5-4c2faa3f7322" (UID: "bd129171-9973-4067-a3d5-4c2faa3f7322"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:20:28.853898 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:28.853874    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd129171-9973-4067-a3d5-4c2faa3f7322-kube-api-access-lpmj8" (OuterVolumeSpecName: "kube-api-access-lpmj8") pod "bd129171-9973-4067-a3d5-4c2faa3f7322" (UID: "bd129171-9973-4067-a3d5-4c2faa3f7322"). InnerVolumeSpecName "kube-api-access-lpmj8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:20:28.952711 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:28.952675    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd129171-9973-4067-a3d5-4c2faa3f7322-plugins-config-volume\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:20:28.952711 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:28.952702    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lpmj8\" (UniqueName: \"kubernetes.io/projected/bd129171-9973-4067-a3d5-4c2faa3f7322-kube-api-access-lpmj8\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:20:29.043457 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:29.042832    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="145f6e17-7fe9-4081-aaa0-1de80f783b87" path="/var/lib/kubelet/pods/145f6e17-7fe9-4081-aaa0-1de80f783b87/volumes"
Sep 11 21:20:29.150583 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:29.150553    2560 generic.go:356] "Generic (PLEG): container finished" podID="bd129171-9973-4067-a3d5-4c2faa3f7322" containerID="4214b1510f8d319902a3bc46e01f189f4c03c83a43412613a1b1148a4013779e" exitCode=0
Sep 11 21:20:29.150762 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:29.150601    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-962a7d-54fcd4b8db-h7sk5"
Sep 11 21:20:29.150762 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:29.150625    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-962a7d-54fcd4b8db-h7sk5" event={"ID":"bd129171-9973-4067-a3d5-4c2faa3f7322","Type":"ContainerDied","Data":"4214b1510f8d319902a3bc46e01f189f4c03c83a43412613a1b1148a4013779e"}
Sep 11 21:20:29.150762 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:29.150670    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-962a7d-54fcd4b8db-h7sk5" event={"ID":"bd129171-9973-4067-a3d5-4c2faa3f7322","Type":"ContainerDied","Data":"cb678079b2f7d3574c2b355dad87a3043b7e868721ea36803d958309ba265c6a"}
Sep 11 21:20:29.150762 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:29.150692    2560 scope.go:117] "RemoveContainer" containerID="4214b1510f8d319902a3bc46e01f189f4c03c83a43412613a1b1148a4013779e"
Sep 11 21:20:29.160563 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:29.160539    2560 scope.go:117] "RemoveContainer" containerID="4214b1510f8d319902a3bc46e01f189f4c03c83a43412613a1b1148a4013779e"
Sep 11 21:20:29.160870 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:20:29.160839    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4214b1510f8d319902a3bc46e01f189f4c03c83a43412613a1b1148a4013779e\": container with ID starting with 4214b1510f8d319902a3bc46e01f189f4c03c83a43412613a1b1148a4013779e not found: ID does not exist" containerID="4214b1510f8d319902a3bc46e01f189f4c03c83a43412613a1b1148a4013779e"
Sep 11 21:20:29.160950 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:29.160878    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4214b1510f8d319902a3bc46e01f189f4c03c83a43412613a1b1148a4013779e"} err="failed to get container status \"4214b1510f8d319902a3bc46e01f189f4c03c83a43412613a1b1148a4013779e\": rpc error: code = NotFound desc = could not find container \"4214b1510f8d319902a3bc46e01f189f4c03c83a43412613a1b1148a4013779e\": container with ID starting with 4214b1510f8d319902a3bc46e01f189f4c03c83a43412613a1b1148a4013779e not found: ID does not exist"
Sep 11 21:20:29.169266 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:29.169244    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-962a7d-54fcd4b8db-h7sk5"]
Sep 11 21:20:29.174823 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:29.174803    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-962a7d-54fcd4b8db-h7sk5"]
Sep 11 21:20:31.039054 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:31.039016    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd129171-9973-4067-a3d5-4c2faa3f7322" path="/var/lib/kubelet/pods/bd129171-9973-4067-a3d5-4c2faa3f7322/volumes"
Sep 11 21:20:35.154242 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:35.154209    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn"]
Sep 11 21:20:35.154725 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:35.154507    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn" podUID="eb31366e-1024-4d0b-8152-e966df8c777d" containerName="istio-proxy" containerID="cri-o://5ee01ab9e85b17a00775fdc27b7f148f22ce647cfa01daed3633e5ef3b23f576" gracePeriod=30
Sep 11 21:20:35.808355 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:35.808323    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc"]
Sep 11 21:20:35.808642 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:35.808611    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc" podUID="35aef6e0-32e3-4520-9b42-b094fa4f3f53" containerName="istio-proxy" containerID="cri-o://399812c17434e42fbc4ce1f5cb4b4f3e761540ee7c5016efb1d5fced70712284" gracePeriod=30
Sep 11 21:20:36.747095 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:36.747052    2560 patch_prober.go:28] interesting pod/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 21:20:36.747457 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:36.747124    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc" podUID="35aef6e0-32e3-4520-9b42-b094fa4f3f53" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 21:20:36.915074 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:36.915032    2560 patch_prober.go:28] interesting pod/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 21:20:36.915236 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:36.915097    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn" podUID="eb31366e-1024-4d0b-8152-e966df8c777d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 21:20:40.420623 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:40.420563    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn"
Sep 11 21:20:40.470531 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:40.470489    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fkxsm\" (UniqueName: \"kubernetes.io/projected/eb31366e-1024-4d0b-8152-e966df8c777d-kube-api-access-fkxsm\") pod \"eb31366e-1024-4d0b-8152-e966df8c777d\" (UID: \"eb31366e-1024-4d0b-8152-e966df8c777d\") "
Sep 11 21:20:40.470707 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:40.470591    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb31366e-1024-4d0b-8152-e966df8c777d-istio-data\") pod \"eb31366e-1024-4d0b-8152-e966df8c777d\" (UID: \"eb31366e-1024-4d0b-8152-e966df8c777d\") "
Sep 11 21:20:40.470707 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:40.470625    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb31366e-1024-4d0b-8152-e966df8c777d-workload-socket\") pod \"eb31366e-1024-4d0b-8152-e966df8c777d\" (UID: \"eb31366e-1024-4d0b-8152-e966df8c777d\") "
Sep 11 21:20:40.470707 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:40.470666    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb31366e-1024-4d0b-8152-e966df8c777d-istio-envoy\") pod \"eb31366e-1024-4d0b-8152-e966df8c777d\" (UID: \"eb31366e-1024-4d0b-8152-e966df8c777d\") "
Sep 11 21:20:40.470707 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:40.470694    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb31366e-1024-4d0b-8152-e966df8c777d-istio-podinfo\") pod \"eb31366e-1024-4d0b-8152-e966df8c777d\" (UID: \"eb31366e-1024-4d0b-8152-e966df8c777d\") "
Sep 11 21:20:40.470955 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:40.470733    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb31366e-1024-4d0b-8152-e966df8c777d-istio-token\") pod \"eb31366e-1024-4d0b-8152-e966df8c777d\" (UID: \"eb31366e-1024-4d0b-8152-e966df8c777d\") "
Sep 11 21:20:40.470955 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:40.470780    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb31366e-1024-4d0b-8152-e966df8c777d-credential-socket\") pod \"eb31366e-1024-4d0b-8152-e966df8c777d\" (UID: \"eb31366e-1024-4d0b-8152-e966df8c777d\") "
Sep 11 21:20:40.470955 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:40.470815    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb31366e-1024-4d0b-8152-e966df8c777d-istiod-ca-cert\") pod \"eb31366e-1024-4d0b-8152-e966df8c777d\" (UID: \"eb31366e-1024-4d0b-8152-e966df8c777d\") "
Sep 11 21:20:40.470955 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:40.470851    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb31366e-1024-4d0b-8152-e966df8c777d-workload-certs\") pod \"eb31366e-1024-4d0b-8152-e966df8c777d\" (UID: \"eb31366e-1024-4d0b-8152-e966df8c777d\") "
Sep 11 21:20:40.470955 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:40.470888    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb31366e-1024-4d0b-8152-e966df8c777d-istio-data" (OuterVolumeSpecName: "istio-data") pod "eb31366e-1024-4d0b-8152-e966df8c777d" (UID: "eb31366e-1024-4d0b-8152-e966df8c777d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:20:40.470955 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:40.470913    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb31366e-1024-4d0b-8152-e966df8c777d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "eb31366e-1024-4d0b-8152-e966df8c777d" (UID: "eb31366e-1024-4d0b-8152-e966df8c777d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:20:40.471336 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:40.471208    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb31366e-1024-4d0b-8152-e966df8c777d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "eb31366e-1024-4d0b-8152-e966df8c777d" (UID: "eb31366e-1024-4d0b-8152-e966df8c777d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:20:40.471513 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:40.471461    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb31366e-1024-4d0b-8152-e966df8c777d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "eb31366e-1024-4d0b-8152-e966df8c777d" (UID: "eb31366e-1024-4d0b-8152-e966df8c777d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:20:40.471638 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:40.471539    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb31366e-1024-4d0b-8152-e966df8c777d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "eb31366e-1024-4d0b-8152-e966df8c777d" (UID: "eb31366e-1024-4d0b-8152-e966df8c777d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:20:40.471824 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:40.471804    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb31366e-1024-4d0b-8152-e966df8c777d-istio-data\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:20:40.471889 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:40.471830    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb31366e-1024-4d0b-8152-e966df8c777d-workload-socket\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:20:40.473223 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:40.473175    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/eb31366e-1024-4d0b-8152-e966df8c777d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "eb31366e-1024-4d0b-8152-e966df8c777d" (UID: "eb31366e-1024-4d0b-8152-e966df8c777d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 21:20:40.473316 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:40.473292    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb31366e-1024-4d0b-8152-e966df8c777d-kube-api-access-fkxsm" (OuterVolumeSpecName: "kube-api-access-fkxsm") pod "eb31366e-1024-4d0b-8152-e966df8c777d" (UID: "eb31366e-1024-4d0b-8152-e966df8c777d"). InnerVolumeSpecName "kube-api-access-fkxsm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:20:40.473463 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:40.473438    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb31366e-1024-4d0b-8152-e966df8c777d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "eb31366e-1024-4d0b-8152-e966df8c777d" (UID: "eb31366e-1024-4d0b-8152-e966df8c777d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:20:40.473805 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:40.473788    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb31366e-1024-4d0b-8152-e966df8c777d-istio-token" (OuterVolumeSpecName: "istio-token") pod "eb31366e-1024-4d0b-8152-e966df8c777d" (UID: "eb31366e-1024-4d0b-8152-e966df8c777d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:20:40.573315 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:40.573273    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb31366e-1024-4d0b-8152-e966df8c777d-istio-envoy\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:20:40.573315 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:40.573306    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb31366e-1024-4d0b-8152-e966df8c777d-istio-podinfo\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:20:40.573315 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:40.573315    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb31366e-1024-4d0b-8152-e966df8c777d-istio-token\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:20:40.573315 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:40.573326    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb31366e-1024-4d0b-8152-e966df8c777d-credential-socket\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:20:40.573623 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:40.573335    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb31366e-1024-4d0b-8152-e966df8c777d-istiod-ca-cert\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:20:40.573623 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:40.573344    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb31366e-1024-4d0b-8152-e966df8c777d-workload-certs\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:20:40.573623 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:40.573352    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fkxsm\" (UniqueName: \"kubernetes.io/projected/eb31366e-1024-4d0b-8152-e966df8c777d-kube-api-access-fkxsm\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:20:41.065273 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:41.065248    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc"
Sep 11 21:20:41.078157 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:41.078075    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6f84\" (UniqueName: \"kubernetes.io/projected/35aef6e0-32e3-4520-9b42-b094fa4f3f53-kube-api-access-x6f84\") pod \"35aef6e0-32e3-4520-9b42-b094fa4f3f53\" (UID: \"35aef6e0-32e3-4520-9b42-b094fa4f3f53\") "
Sep 11 21:20:41.078157 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:41.078127    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35aef6e0-32e3-4520-9b42-b094fa4f3f53-istio-podinfo\") pod \"35aef6e0-32e3-4520-9b42-b094fa4f3f53\" (UID: \"35aef6e0-32e3-4520-9b42-b094fa4f3f53\") "
Sep 11 21:20:41.078157 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:41.078160    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35aef6e0-32e3-4520-9b42-b094fa4f3f53-workload-socket\") pod \"35aef6e0-32e3-4520-9b42-b094fa4f3f53\" (UID: \"35aef6e0-32e3-4520-9b42-b094fa4f3f53\") "
Sep 11 21:20:41.078441 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:41.078174    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35aef6e0-32e3-4520-9b42-b094fa4f3f53-istio-envoy\") pod \"35aef6e0-32e3-4520-9b42-b094fa4f3f53\" (UID: \"35aef6e0-32e3-4520-9b42-b094fa4f3f53\") "
Sep 11 21:20:41.078441 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:41.078213    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35aef6e0-32e3-4520-9b42-b094fa4f3f53-credential-socket\") pod \"35aef6e0-32e3-4520-9b42-b094fa4f3f53\" (UID: \"35aef6e0-32e3-4520-9b42-b094fa4f3f53\") "
Sep 11 21:20:41.078441 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:41.078238    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35aef6e0-32e3-4520-9b42-b094fa4f3f53-istio-token\") pod \"35aef6e0-32e3-4520-9b42-b094fa4f3f53\" (UID: \"35aef6e0-32e3-4520-9b42-b094fa4f3f53\") "
Sep 11 21:20:41.078441 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:41.078261    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35aef6e0-32e3-4520-9b42-b094fa4f3f53-workload-certs\") pod \"35aef6e0-32e3-4520-9b42-b094fa4f3f53\" (UID: \"35aef6e0-32e3-4520-9b42-b094fa4f3f53\") "
Sep 11 21:20:41.078441 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:41.078320    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35aef6e0-32e3-4520-9b42-b094fa4f3f53-istio-data\") pod \"35aef6e0-32e3-4520-9b42-b094fa4f3f53\" (UID: \"35aef6e0-32e3-4520-9b42-b094fa4f3f53\") "
Sep 11 21:20:41.078441 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:41.078353    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35aef6e0-32e3-4520-9b42-b094fa4f3f53-istiod-ca-cert\") pod \"35aef6e0-32e3-4520-9b42-b094fa4f3f53\" (UID: \"35aef6e0-32e3-4520-9b42-b094fa4f3f53\") "
Sep 11 21:20:41.078698 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:41.078672    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35aef6e0-32e3-4520-9b42-b094fa4f3f53-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "35aef6e0-32e3-4520-9b42-b094fa4f3f53" (UID: "35aef6e0-32e3-4520-9b42-b094fa4f3f53"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:20:41.078698 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:41.078679    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35aef6e0-32e3-4520-9b42-b094fa4f3f53-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "35aef6e0-32e3-4520-9b42-b094fa4f3f53" (UID: "35aef6e0-32e3-4520-9b42-b094fa4f3f53"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:20:41.078812 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:41.078712    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35aef6e0-32e3-4520-9b42-b094fa4f3f53-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "35aef6e0-32e3-4520-9b42-b094fa4f3f53" (UID: "35aef6e0-32e3-4520-9b42-b094fa4f3f53"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:20:41.078908 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:41.078867    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35aef6e0-32e3-4520-9b42-b094fa4f3f53-istio-data" (OuterVolumeSpecName: "istio-data") pod "35aef6e0-32e3-4520-9b42-b094fa4f3f53" (UID: "35aef6e0-32e3-4520-9b42-b094fa4f3f53"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:20:41.078962 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:41.078928    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35aef6e0-32e3-4520-9b42-b094fa4f3f53-credential-socket\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:20:41.078962 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:41.078947    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35aef6e0-32e3-4520-9b42-b094fa4f3f53-workload-certs\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:20:41.079062 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:41.078962    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35aef6e0-32e3-4520-9b42-b094fa4f3f53-workload-socket\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:20:41.079062 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:41.079043    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35aef6e0-32e3-4520-9b42-b094fa4f3f53-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "35aef6e0-32e3-4520-9b42-b094fa4f3f53" (UID: "35aef6e0-32e3-4520-9b42-b094fa4f3f53"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:20:41.080564 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:41.080534    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35aef6e0-32e3-4520-9b42-b094fa4f3f53-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "35aef6e0-32e3-4520-9b42-b094fa4f3f53" (UID: "35aef6e0-32e3-4520-9b42-b094fa4f3f53"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:20:41.080672 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:41.080563    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35aef6e0-32e3-4520-9b42-b094fa4f3f53-kube-api-access-x6f84" (OuterVolumeSpecName: "kube-api-access-x6f84") pod "35aef6e0-32e3-4520-9b42-b094fa4f3f53" (UID: "35aef6e0-32e3-4520-9b42-b094fa4f3f53"). InnerVolumeSpecName "kube-api-access-x6f84". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:20:41.080672 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:41.080593    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35aef6e0-32e3-4520-9b42-b094fa4f3f53-istio-token" (OuterVolumeSpecName: "istio-token") pod "35aef6e0-32e3-4520-9b42-b094fa4f3f53" (UID: "35aef6e0-32e3-4520-9b42-b094fa4f3f53"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:20:41.080672 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:41.080607    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/35aef6e0-32e3-4520-9b42-b094fa4f3f53-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "35aef6e0-32e3-4520-9b42-b094fa4f3f53" (UID: "35aef6e0-32e3-4520-9b42-b094fa4f3f53"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 21:20:41.180101 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:41.180070    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6f84\" (UniqueName: \"kubernetes.io/projected/35aef6e0-32e3-4520-9b42-b094fa4f3f53-kube-api-access-x6f84\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:20:41.180101 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:41.180100    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35aef6e0-32e3-4520-9b42-b094fa4f3f53-istio-podinfo\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:20:41.180252 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:41.180111    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35aef6e0-32e3-4520-9b42-b094fa4f3f53-istio-envoy\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:20:41.180252 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:41.180121    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35aef6e0-32e3-4520-9b42-b094fa4f3f53-istio-token\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:20:41.180252 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:41.180129    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35aef6e0-32e3-4520-9b42-b094fa4f3f53-istio-data\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:20:41.180252 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:41.180136    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35aef6e0-32e3-4520-9b42-b094fa4f3f53-istiod-ca-cert\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:20:41.229352 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:41.229321    2560 generic.go:356] "Generic (PLEG): container finished" podID="35aef6e0-32e3-4520-9b42-b094fa4f3f53" containerID="399812c17434e42fbc4ce1f5cb4b4f3e761540ee7c5016efb1d5fced70712284" exitCode=0
Sep 11 21:20:41.229537 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:41.229372    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc"
Sep 11 21:20:41.229537 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:41.229410    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc" event={"ID":"35aef6e0-32e3-4520-9b42-b094fa4f3f53","Type":"ContainerDied","Data":"399812c17434e42fbc4ce1f5cb4b4f3e761540ee7c5016efb1d5fced70712284"}
Sep 11 21:20:41.229537 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:41.229474    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc" event={"ID":"35aef6e0-32e3-4520-9b42-b094fa4f3f53","Type":"ContainerDied","Data":"7d08b79262c7180eb79bbc99efaeea65e5d982426519808f36d0831867d5f74b"}
Sep 11 21:20:41.229537 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:41.229504    2560 scope.go:117] "RemoveContainer" containerID="399812c17434e42fbc4ce1f5cb4b4f3e761540ee7c5016efb1d5fced70712284"
Sep 11 21:20:41.231552 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:41.231522    2560 generic.go:356] "Generic (PLEG): container finished" podID="eb31366e-1024-4d0b-8152-e966df8c777d" containerID="5ee01ab9e85b17a00775fdc27b7f148f22ce647cfa01daed3633e5ef3b23f576" exitCode=0
Sep 11 21:20:41.231686 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:41.231575    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn"
Sep 11 21:20:41.231686 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:41.231574    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn" event={"ID":"eb31366e-1024-4d0b-8152-e966df8c777d","Type":"ContainerDied","Data":"5ee01ab9e85b17a00775fdc27b7f148f22ce647cfa01daed3633e5ef3b23f576"}
Sep 11 21:20:41.231809 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:41.231689    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn" event={"ID":"eb31366e-1024-4d0b-8152-e966df8c777d","Type":"ContainerDied","Data":"dc5cf5a3a22ff0c3477893fbdce832b4bf6ae9c4fc2ce8c1ed941650c13886d2"}
Sep 11 21:20:41.239727 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:41.239714    2560 scope.go:117] "RemoveContainer" containerID="185e1eee74e2ffb3db69c21c2ba115663d590a1b133aa59f5d0e952a2a872230"
Sep 11 21:20:41.248113 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:41.248097    2560 scope.go:117] "RemoveContainer" containerID="399812c17434e42fbc4ce1f5cb4b4f3e761540ee7c5016efb1d5fced70712284"
Sep 11 21:20:41.248368 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:20:41.248347    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"399812c17434e42fbc4ce1f5cb4b4f3e761540ee7c5016efb1d5fced70712284\": container with ID starting with 399812c17434e42fbc4ce1f5cb4b4f3e761540ee7c5016efb1d5fced70712284 not found: ID does not exist" containerID="399812c17434e42fbc4ce1f5cb4b4f3e761540ee7c5016efb1d5fced70712284"
Sep 11 21:20:41.248477 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:41.248373    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"399812c17434e42fbc4ce1f5cb4b4f3e761540ee7c5016efb1d5fced70712284"} err="failed to get container status \"399812c17434e42fbc4ce1f5cb4b4f3e761540ee7c5016efb1d5fced70712284\": rpc error: code = NotFound desc = could not find container \"399812c17434e42fbc4ce1f5cb4b4f3e761540ee7c5016efb1d5fced70712284\": container with ID starting with 399812c17434e42fbc4ce1f5cb4b4f3e761540ee7c5016efb1d5fced70712284 not found: ID does not exist"
Sep 11 21:20:41.248477 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:41.248407    2560 scope.go:117] "RemoveContainer" containerID="185e1eee74e2ffb3db69c21c2ba115663d590a1b133aa59f5d0e952a2a872230"
Sep 11 21:20:41.248659 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:20:41.248643    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"185e1eee74e2ffb3db69c21c2ba115663d590a1b133aa59f5d0e952a2a872230\": container with ID starting with 185e1eee74e2ffb3db69c21c2ba115663d590a1b133aa59f5d0e952a2a872230 not found: ID does not exist" containerID="185e1eee74e2ffb3db69c21c2ba115663d590a1b133aa59f5d0e952a2a872230"
Sep 11 21:20:41.248716 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:41.248663    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"185e1eee74e2ffb3db69c21c2ba115663d590a1b133aa59f5d0e952a2a872230"} err="failed to get container status \"185e1eee74e2ffb3db69c21c2ba115663d590a1b133aa59f5d0e952a2a872230\": rpc error: code = NotFound desc = could not find container \"185e1eee74e2ffb3db69c21c2ba115663d590a1b133aa59f5d0e952a2a872230\": container with ID starting with 185e1eee74e2ffb3db69c21c2ba115663d590a1b133aa59f5d0e952a2a872230 not found: ID does not exist"
Sep 11 21:20:41.248716 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:41.248675    2560 scope.go:117] "RemoveContainer" containerID="5ee01ab9e85b17a00775fdc27b7f148f22ce647cfa01daed3633e5ef3b23f576"
Sep 11 21:20:41.249768 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:41.249748    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn"]
Sep 11 21:20:41.253024 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:41.253004    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn"]
Sep 11 21:20:41.258597 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:41.258577    2560 scope.go:117] "RemoveContainer" containerID="622ae7791766ec12ac497a332486afb487144baad5e7276a3cebd357a4c80cea"
Sep 11 21:20:41.264192 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:41.264172    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc"]
Sep 11 21:20:41.268238 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:41.268216    2560 scope.go:117] "RemoveContainer" containerID="5ee01ab9e85b17a00775fdc27b7f148f22ce647cfa01daed3633e5ef3b23f576"
Sep 11 21:20:41.268540 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:20:41.268516    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ee01ab9e85b17a00775fdc27b7f148f22ce647cfa01daed3633e5ef3b23f576\": container with ID starting with 5ee01ab9e85b17a00775fdc27b7f148f22ce647cfa01daed3633e5ef3b23f576 not found: ID does not exist" containerID="5ee01ab9e85b17a00775fdc27b7f148f22ce647cfa01daed3633e5ef3b23f576"
Sep 11 21:20:41.268637 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:41.268549    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ee01ab9e85b17a00775fdc27b7f148f22ce647cfa01daed3633e5ef3b23f576"} err="failed to get container status \"5ee01ab9e85b17a00775fdc27b7f148f22ce647cfa01daed3633e5ef3b23f576\": rpc error: code = NotFound desc = could not find container \"5ee01ab9e85b17a00775fdc27b7f148f22ce647cfa01daed3633e5ef3b23f576\": container with ID starting with 5ee01ab9e85b17a00775fdc27b7f148f22ce647cfa01daed3633e5ef3b23f576 not found: ID does not exist"
Sep 11 21:20:41.268637 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:41.268572    2560 scope.go:117] "RemoveContainer" containerID="622ae7791766ec12ac497a332486afb487144baad5e7276a3cebd357a4c80cea"
Sep 11 21:20:41.268825 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:20:41.268803    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"622ae7791766ec12ac497a332486afb487144baad5e7276a3cebd357a4c80cea\": container with ID starting with 622ae7791766ec12ac497a332486afb487144baad5e7276a3cebd357a4c80cea not found: ID does not exist" containerID="622ae7791766ec12ac497a332486afb487144baad5e7276a3cebd357a4c80cea"
Sep 11 21:20:41.268890 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:41.268830    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"622ae7791766ec12ac497a332486afb487144baad5e7276a3cebd357a4c80cea"} err="failed to get container status \"622ae7791766ec12ac497a332486afb487144baad5e7276a3cebd357a4c80cea\": rpc error: code = NotFound desc = could not find container \"622ae7791766ec12ac497a332486afb487144baad5e7276a3cebd357a4c80cea\": container with ID starting with 622ae7791766ec12ac497a332486afb487144baad5e7276a3cebd357a4c80cea not found: ID does not exist"
Sep 11 21:20:41.269223 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:41.269206    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc"]
Sep 11 21:20:43.038403 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:43.038352    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35aef6e0-32e3-4520-9b42-b094fa4f3f53" path="/var/lib/kubelet/pods/35aef6e0-32e3-4520-9b42-b094fa4f3f53/volumes"
Sep 11 21:20:43.038878 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:43.038863    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb31366e-1024-4d0b-8152-e966df8c777d" path="/var/lib/kubelet/pods/eb31366e-1024-4d0b-8152-e966df8c777d/volumes"
Sep 11 21:20:53.300114 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:53.300030    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8"]
Sep 11 21:20:53.300597 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:53.300278    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8" podUID="d939ae9d-6c4e-4184-9300-e7a83a4671df" containerName="istio-proxy" containerID="cri-o://6aea93ed669813074e4e25a88f030884c7b7fc173b26288086bb270e26da66ae" gracePeriod=30
Sep 11 21:20:58.556795 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:58.556759    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8"
Sep 11 21:20:58.662927 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:58.662897    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d939ae9d-6c4e-4184-9300-e7a83a4671df-workload-certs\") pod \"d939ae9d-6c4e-4184-9300-e7a83a4671df\" (UID: \"d939ae9d-6c4e-4184-9300-e7a83a4671df\") "
Sep 11 21:20:58.663129 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:58.662956    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d939ae9d-6c4e-4184-9300-e7a83a4671df-istio-token\") pod \"d939ae9d-6c4e-4184-9300-e7a83a4671df\" (UID: \"d939ae9d-6c4e-4184-9300-e7a83a4671df\") "
Sep 11 21:20:58.663129 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:58.662991    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d939ae9d-6c4e-4184-9300-e7a83a4671df-istiod-ca-cert\") pod \"d939ae9d-6c4e-4184-9300-e7a83a4671df\" (UID: \"d939ae9d-6c4e-4184-9300-e7a83a4671df\") "
Sep 11 21:20:58.663129 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:58.663008    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d939ae9d-6c4e-4184-9300-e7a83a4671df-credential-socket\") pod \"d939ae9d-6c4e-4184-9300-e7a83a4671df\" (UID: \"d939ae9d-6c4e-4184-9300-e7a83a4671df\") "
Sep 11 21:20:58.663129 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:58.663035    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d939ae9d-6c4e-4184-9300-e7a83a4671df-istio-data\") pod \"d939ae9d-6c4e-4184-9300-e7a83a4671df\" (UID: \"d939ae9d-6c4e-4184-9300-e7a83a4671df\") "
Sep 11 21:20:58.663129 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:58.663053    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4jm8j\" (UniqueName: \"kubernetes.io/projected/d939ae9d-6c4e-4184-9300-e7a83a4671df-kube-api-access-4jm8j\") pod \"d939ae9d-6c4e-4184-9300-e7a83a4671df\" (UID: \"d939ae9d-6c4e-4184-9300-e7a83a4671df\") "
Sep 11 21:20:58.663129 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:58.663114    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d939ae9d-6c4e-4184-9300-e7a83a4671df-istio-envoy\") pod \"d939ae9d-6c4e-4184-9300-e7a83a4671df\" (UID: \"d939ae9d-6c4e-4184-9300-e7a83a4671df\") "
Sep 11 21:20:58.663479 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:58.663147    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d939ae9d-6c4e-4184-9300-e7a83a4671df-workload-socket\") pod \"d939ae9d-6c4e-4184-9300-e7a83a4671df\" (UID: \"d939ae9d-6c4e-4184-9300-e7a83a4671df\") "
Sep 11 21:20:58.663479 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:58.663196    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d939ae9d-6c4e-4184-9300-e7a83a4671df-istio-podinfo\") pod \"d939ae9d-6c4e-4184-9300-e7a83a4671df\" (UID: \"d939ae9d-6c4e-4184-9300-e7a83a4671df\") "
Sep 11 21:20:58.664049 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:58.663990    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d939ae9d-6c4e-4184-9300-e7a83a4671df-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d939ae9d-6c4e-4184-9300-e7a83a4671df" (UID: "d939ae9d-6c4e-4184-9300-e7a83a4671df"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:20:58.664357 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:58.664278    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d939ae9d-6c4e-4184-9300-e7a83a4671df-istio-data" (OuterVolumeSpecName: "istio-data") pod "d939ae9d-6c4e-4184-9300-e7a83a4671df" (UID: "d939ae9d-6c4e-4184-9300-e7a83a4671df"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:20:58.664357 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:58.664301    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d939ae9d-6c4e-4184-9300-e7a83a4671df-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d939ae9d-6c4e-4184-9300-e7a83a4671df" (UID: "d939ae9d-6c4e-4184-9300-e7a83a4671df"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:20:58.664529 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:58.664484    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d939ae9d-6c4e-4184-9300-e7a83a4671df-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d939ae9d-6c4e-4184-9300-e7a83a4671df" (UID: "d939ae9d-6c4e-4184-9300-e7a83a4671df"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:20:58.664689 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:58.664670    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d939ae9d-6c4e-4184-9300-e7a83a4671df-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d939ae9d-6c4e-4184-9300-e7a83a4671df" (UID: "d939ae9d-6c4e-4184-9300-e7a83a4671df"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:20:58.666965 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:58.666935    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d939ae9d-6c4e-4184-9300-e7a83a4671df-kube-api-access-4jm8j" (OuterVolumeSpecName: "kube-api-access-4jm8j") pod "d939ae9d-6c4e-4184-9300-e7a83a4671df" (UID: "d939ae9d-6c4e-4184-9300-e7a83a4671df"). InnerVolumeSpecName "kube-api-access-4jm8j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:20:58.667078 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:58.667016    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d939ae9d-6c4e-4184-9300-e7a83a4671df-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d939ae9d-6c4e-4184-9300-e7a83a4671df" (UID: "d939ae9d-6c4e-4184-9300-e7a83a4671df"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 21:20:58.667866 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:58.667844    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d939ae9d-6c4e-4184-9300-e7a83a4671df-istio-token" (OuterVolumeSpecName: "istio-token") pod "d939ae9d-6c4e-4184-9300-e7a83a4671df" (UID: "d939ae9d-6c4e-4184-9300-e7a83a4671df"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:20:58.668540 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:58.668511    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d939ae9d-6c4e-4184-9300-e7a83a4671df-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d939ae9d-6c4e-4184-9300-e7a83a4671df" (UID: "d939ae9d-6c4e-4184-9300-e7a83a4671df"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:20:58.764441 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:58.764367    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d939ae9d-6c4e-4184-9300-e7a83a4671df-istiod-ca-cert\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:20:58.764441 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:58.764440    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d939ae9d-6c4e-4184-9300-e7a83a4671df-credential-socket\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:20:58.764659 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:58.764457    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d939ae9d-6c4e-4184-9300-e7a83a4671df-istio-data\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:20:58.764659 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:58.764473    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4jm8j\" (UniqueName: \"kubernetes.io/projected/d939ae9d-6c4e-4184-9300-e7a83a4671df-kube-api-access-4jm8j\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:20:58.764659 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:58.764488    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d939ae9d-6c4e-4184-9300-e7a83a4671df-istio-envoy\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:20:58.764659 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:58.764500    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d939ae9d-6c4e-4184-9300-e7a83a4671df-workload-socket\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:20:58.764659 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:58.764511    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d939ae9d-6c4e-4184-9300-e7a83a4671df-istio-podinfo\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:20:58.764659 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:58.764523    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d939ae9d-6c4e-4184-9300-e7a83a4671df-workload-certs\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:20:58.764659 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:58.764537    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d939ae9d-6c4e-4184-9300-e7a83a4671df-istio-token\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:20:59.352315 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.352221    2560 generic.go:356] "Generic (PLEG): container finished" podID="d939ae9d-6c4e-4184-9300-e7a83a4671df" containerID="6aea93ed669813074e4e25a88f030884c7b7fc173b26288086bb270e26da66ae" exitCode=0
Sep 11 21:20:59.352315 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.352297    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8"
Sep 11 21:20:59.352315 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.352298    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8" event={"ID":"d939ae9d-6c4e-4184-9300-e7a83a4671df","Type":"ContainerDied","Data":"6aea93ed669813074e4e25a88f030884c7b7fc173b26288086bb270e26da66ae"}
Sep 11 21:20:59.352604 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.352395    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8" event={"ID":"d939ae9d-6c4e-4184-9300-e7a83a4671df","Type":"ContainerDied","Data":"eada3c04cd8760a3b59a70d3534999ef1101a9b0d400c71ee25eeda0ba192d37"}
Sep 11 21:20:59.352604 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.352428    2560 scope.go:117] "RemoveContainer" containerID="6aea93ed669813074e4e25a88f030884c7b7fc173b26288086bb270e26da66ae"
Sep 11 21:20:59.363317 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.363288    2560 scope.go:117] "RemoveContainer" containerID="29686c223cc9afa2307fc520f3a8a3ee780b4648182e2f82c6ab07ad0bf746e1"
Sep 11 21:20:59.372866 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.372846    2560 scope.go:117] "RemoveContainer" containerID="6aea93ed669813074e4e25a88f030884c7b7fc173b26288086bb270e26da66ae"
Sep 11 21:20:59.374159 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:20:59.374133    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6aea93ed669813074e4e25a88f030884c7b7fc173b26288086bb270e26da66ae\": container with ID starting with 6aea93ed669813074e4e25a88f030884c7b7fc173b26288086bb270e26da66ae not found: ID does not exist" containerID="6aea93ed669813074e4e25a88f030884c7b7fc173b26288086bb270e26da66ae"
Sep 11 21:20:59.374317 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.374284    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6aea93ed669813074e4e25a88f030884c7b7fc173b26288086bb270e26da66ae"} err="failed to get container status \"6aea93ed669813074e4e25a88f030884c7b7fc173b26288086bb270e26da66ae\": rpc error: code = NotFound desc = could not find container \"6aea93ed669813074e4e25a88f030884c7b7fc173b26288086bb270e26da66ae\": container with ID starting with 6aea93ed669813074e4e25a88f030884c7b7fc173b26288086bb270e26da66ae not found: ID does not exist"
Sep 11 21:20:59.374317 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.374317    2560 scope.go:117] "RemoveContainer" containerID="29686c223cc9afa2307fc520f3a8a3ee780b4648182e2f82c6ab07ad0bf746e1"
Sep 11 21:20:59.374801 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:20:59.374775    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29686c223cc9afa2307fc520f3a8a3ee780b4648182e2f82c6ab07ad0bf746e1\": container with ID starting with 29686c223cc9afa2307fc520f3a8a3ee780b4648182e2f82c6ab07ad0bf746e1 not found: ID does not exist" containerID="29686c223cc9afa2307fc520f3a8a3ee780b4648182e2f82c6ab07ad0bf746e1"
Sep 11 21:20:59.374893 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.374811    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29686c223cc9afa2307fc520f3a8a3ee780b4648182e2f82c6ab07ad0bf746e1"} err="failed to get container status \"29686c223cc9afa2307fc520f3a8a3ee780b4648182e2f82c6ab07ad0bf746e1\": rpc error: code = NotFound desc = could not find container \"29686c223cc9afa2307fc520f3a8a3ee780b4648182e2f82c6ab07ad0bf746e1\": container with ID starting with 29686c223cc9afa2307fc520f3a8a3ee780b4648182e2f82c6ab07ad0bf746e1 not found: ID does not exist"
Sep 11 21:20:59.375506 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.375477    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8"]
Sep 11 21:20:59.378643 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.378622    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8"]
Sep 11 21:20:59.444833 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.444794    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-7ae28e-ccbcc88f7-pkjzt"]
Sep 11 21:20:59.445344 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.445324    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb31366e-1024-4d0b-8152-e966df8c777d" containerName="istio-proxy"
Sep 11 21:20:59.445501 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.445347    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb31366e-1024-4d0b-8152-e966df8c777d" containerName="istio-proxy"
Sep 11 21:20:59.445501 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.445357    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d939ae9d-6c4e-4184-9300-e7a83a4671df" containerName="istio-proxy"
Sep 11 21:20:59.445501 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.445365    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d939ae9d-6c4e-4184-9300-e7a83a4671df" containerName="istio-proxy"
Sep 11 21:20:59.445501 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.445373    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="145f6e17-7fe9-4081-aaa0-1de80f783b87" containerName="revoke-keys"
Sep 11 21:20:59.445501 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.445395    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="145f6e17-7fe9-4081-aaa0-1de80f783b87" containerName="revoke-keys"
Sep 11 21:20:59.445501 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.445428    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35aef6e0-32e3-4520-9b42-b094fa4f3f53" containerName="istio-proxy"
Sep 11 21:20:59.445501 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.445436    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="35aef6e0-32e3-4520-9b42-b094fa4f3f53" containerName="istio-proxy"
Sep 11 21:20:59.445501 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.445448    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd129171-9973-4067-a3d5-4c2faa3f7322" containerName="payload-pre-processing"
Sep 11 21:20:59.445501 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.445456    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd129171-9973-4067-a3d5-4c2faa3f7322" containerName="payload-pre-processing"
Sep 11 21:20:59.445501 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.445468    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb31366e-1024-4d0b-8152-e966df8c777d" containerName="istio-proxy"
Sep 11 21:20:59.445501 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.445476    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb31366e-1024-4d0b-8152-e966df8c777d" containerName="istio-proxy"
Sep 11 21:20:59.445501 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.445487    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35aef6e0-32e3-4520-9b42-b094fa4f3f53" containerName="istio-proxy"
Sep 11 21:20:59.445501 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.445494    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="35aef6e0-32e3-4520-9b42-b094fa4f3f53" containerName="istio-proxy"
Sep 11 21:20:59.446122 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.445607    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="35aef6e0-32e3-4520-9b42-b094fa4f3f53" containerName="istio-proxy"
Sep 11 21:20:59.446122 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.445620    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb31366e-1024-4d0b-8152-e966df8c777d" containerName="istio-proxy"
Sep 11 21:20:59.446122 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.445631    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="145f6e17-7fe9-4081-aaa0-1de80f783b87" containerName="revoke-keys"
Sep 11 21:20:59.446122 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.445643    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d939ae9d-6c4e-4184-9300-e7a83a4671df" containerName="istio-proxy"
Sep 11 21:20:59.446122 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.445653    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb31366e-1024-4d0b-8152-e966df8c777d" containerName="istio-proxy"
Sep 11 21:20:59.446122 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.445663    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd129171-9973-4067-a3d5-4c2faa3f7322" containerName="payload-pre-processing"
Sep 11 21:20:59.451283 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.451259    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-7ae28e-ccbcc88f7-pkjzt"
Sep 11 21:20:59.453987 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.453962    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-7ae28e\""
Sep 11 21:20:59.454305 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.454290    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-7ae28e-dockercfg-d4cz9\""
Sep 11 21:20:59.461147 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.461123    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-7ae28e-ccbcc88f7-pkjzt"]
Sep 11 21:20:59.503578 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.503542    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-7ae28e-6c7b9cd94-m2psz"]
Sep 11 21:20:59.504040 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.504027    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d939ae9d-6c4e-4184-9300-e7a83a4671df" containerName="istio-proxy"
Sep 11 21:20:59.504085 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.504041    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d939ae9d-6c4e-4184-9300-e7a83a4671df" containerName="istio-proxy"
Sep 11 21:20:59.504127 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.504118    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="35aef6e0-32e3-4520-9b42-b094fa4f3f53" containerName="istio-proxy"
Sep 11 21:20:59.504162 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.504132    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d939ae9d-6c4e-4184-9300-e7a83a4671df" containerName="istio-proxy"
Sep 11 21:20:59.507302 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.507284    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-7ae28e-6c7b9cd94-m2psz"
Sep 11 21:20:59.517286 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.517257    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-7ae28e-6c7b9cd94-m2psz"]
Sep 11 21:20:59.574504 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.574473    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9cd910a-2e59-4a8c-8104-e8419d72049b-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-7ae28e-6c7b9cd94-m2psz\" (UID: \"f9cd910a-2e59-4a8c-8104-e8419d72049b\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-7ae28e-6c7b9cd94-m2psz"
Sep 11 21:20:59.574504 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.574505    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmhs2\" (UniqueName: \"kubernetes.io/projected/f9cd910a-2e59-4a8c-8104-e8419d72049b-kube-api-access-kmhs2\") pod \"payload-pre-processing-e2e-explicit-7ae28e-6c7b9cd94-m2psz\" (UID: \"f9cd910a-2e59-4a8c-8104-e8419d72049b\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-7ae28e-6c7b9cd94-m2psz"
Sep 11 21:20:59.575048 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.574559    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjs9r\" (UniqueName: \"kubernetes.io/projected/e36b8dab-4e90-4d60-b1c9-45b47bd4ed45-kube-api-access-vjs9r\") pod \"payload-processing-e2e-explicit-7ae28e-ccbcc88f7-pkjzt\" (UID: \"e36b8dab-4e90-4d60-b1c9-45b47bd4ed45\") " pod="openshift-ingress/payload-processing-e2e-explicit-7ae28e-ccbcc88f7-pkjzt"
Sep 11 21:20:59.575048 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.574587    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e36b8dab-4e90-4d60-b1c9-45b47bd4ed45-plugins-config-volume\") pod \"payload-processing-e2e-explicit-7ae28e-ccbcc88f7-pkjzt\" (UID: \"e36b8dab-4e90-4d60-b1c9-45b47bd4ed45\") " pod="openshift-ingress/payload-processing-e2e-explicit-7ae28e-ccbcc88f7-pkjzt"
Sep 11 21:20:59.676132 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.676094    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9cd910a-2e59-4a8c-8104-e8419d72049b-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-7ae28e-6c7b9cd94-m2psz\" (UID: \"f9cd910a-2e59-4a8c-8104-e8419d72049b\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-7ae28e-6c7b9cd94-m2psz"
Sep 11 21:20:59.676132 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.676132    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmhs2\" (UniqueName: \"kubernetes.io/projected/f9cd910a-2e59-4a8c-8104-e8419d72049b-kube-api-access-kmhs2\") pod \"payload-pre-processing-e2e-explicit-7ae28e-6c7b9cd94-m2psz\" (UID: \"f9cd910a-2e59-4a8c-8104-e8419d72049b\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-7ae28e-6c7b9cd94-m2psz"
Sep 11 21:20:59.676431 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.676178    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjs9r\" (UniqueName: \"kubernetes.io/projected/e36b8dab-4e90-4d60-b1c9-45b47bd4ed45-kube-api-access-vjs9r\") pod \"payload-processing-e2e-explicit-7ae28e-ccbcc88f7-pkjzt\" (UID: \"e36b8dab-4e90-4d60-b1c9-45b47bd4ed45\") " pod="openshift-ingress/payload-processing-e2e-explicit-7ae28e-ccbcc88f7-pkjzt"
Sep 11 21:20:59.676431 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.676212    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e36b8dab-4e90-4d60-b1c9-45b47bd4ed45-plugins-config-volume\") pod \"payload-processing-e2e-explicit-7ae28e-ccbcc88f7-pkjzt\" (UID: \"e36b8dab-4e90-4d60-b1c9-45b47bd4ed45\") " pod="openshift-ingress/payload-processing-e2e-explicit-7ae28e-ccbcc88f7-pkjzt"
Sep 11 21:20:59.676810 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.676792    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9cd910a-2e59-4a8c-8104-e8419d72049b-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-7ae28e-6c7b9cd94-m2psz\" (UID: \"f9cd910a-2e59-4a8c-8104-e8419d72049b\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-7ae28e-6c7b9cd94-m2psz"
Sep 11 21:20:59.676984 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.676965    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e36b8dab-4e90-4d60-b1c9-45b47bd4ed45-plugins-config-volume\") pod \"payload-processing-e2e-explicit-7ae28e-ccbcc88f7-pkjzt\" (UID: \"e36b8dab-4e90-4d60-b1c9-45b47bd4ed45\") " pod="openshift-ingress/payload-processing-e2e-explicit-7ae28e-ccbcc88f7-pkjzt"
Sep 11 21:20:59.685183 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.685160    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjs9r\" (UniqueName: \"kubernetes.io/projected/e36b8dab-4e90-4d60-b1c9-45b47bd4ed45-kube-api-access-vjs9r\") pod \"payload-processing-e2e-explicit-7ae28e-ccbcc88f7-pkjzt\" (UID: \"e36b8dab-4e90-4d60-b1c9-45b47bd4ed45\") " pod="openshift-ingress/payload-processing-e2e-explicit-7ae28e-ccbcc88f7-pkjzt"
Sep 11 21:20:59.685327 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.685231    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmhs2\" (UniqueName: \"kubernetes.io/projected/f9cd910a-2e59-4a8c-8104-e8419d72049b-kube-api-access-kmhs2\") pod \"payload-pre-processing-e2e-explicit-7ae28e-6c7b9cd94-m2psz\" (UID: \"f9cd910a-2e59-4a8c-8104-e8419d72049b\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-7ae28e-6c7b9cd94-m2psz"
Sep 11 21:20:59.764323 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.764286    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-7ae28e-ccbcc88f7-pkjzt"
Sep 11 21:20:59.818595 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:20:59.818560    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-7ae28e-6c7b9cd94-m2psz"
Sep 11 21:21:00.044078 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:00.044048    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-7ae28e-ccbcc88f7-pkjzt"]
Sep 11 21:21:00.115870 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:00.115841    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-7ae28e-6c7b9cd94-m2psz"]
Sep 11 21:21:00.117768 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:21:00.117742    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9cd910a_2e59_4a8c_8104_e8419d72049b.slice/crio-9aa21b310d16992171ceb88452780fb1b4e7760893d3396b828fb752ee706886 WatchSource:0}: Error finding container 9aa21b310d16992171ceb88452780fb1b4e7760893d3396b828fb752ee706886: Status 404 returned error can't find the container with id 9aa21b310d16992171ceb88452780fb1b4e7760893d3396b828fb752ee706886
Sep 11 21:21:00.362402 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:00.362286    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-7ae28e-6c7b9cd94-m2psz" event={"ID":"f9cd910a-2e59-4a8c-8104-e8419d72049b","Type":"ContainerStarted","Data":"e6adf6ce8a9a6958ed19b5c81779ec3747625528b81dc366c67285a8b7bde6a2"}
Sep 11 21:21:00.362402 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:00.362345    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-7ae28e-6c7b9cd94-m2psz" event={"ID":"f9cd910a-2e59-4a8c-8104-e8419d72049b","Type":"ContainerStarted","Data":"9aa21b310d16992171ceb88452780fb1b4e7760893d3396b828fb752ee706886"}
Sep 11 21:21:00.362646 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:00.362416    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-7ae28e-6c7b9cd94-m2psz"
Sep 11 21:21:00.364555 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:00.364528    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-7ae28e-ccbcc88f7-pkjzt" event={"ID":"e36b8dab-4e90-4d60-b1c9-45b47bd4ed45","Type":"ContainerStarted","Data":"19c06f0855ca729fe00b9f5eb4ccb8e1d12930e699b6a60dd4d13d3eab169df8"}
Sep 11 21:21:00.364705 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:00.364573    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-7ae28e-ccbcc88f7-pkjzt" event={"ID":"e36b8dab-4e90-4d60-b1c9-45b47bd4ed45","Type":"ContainerStarted","Data":"8fd5d094411602874c2d8d5ef6ac8c692dba043b1df1d3bebd3ea93d65cc4de1"}
Sep 11 21:21:00.364705 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:00.364643    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-7ae28e-ccbcc88f7-pkjzt"
Sep 11 21:21:00.382985 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:00.382927    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-7ae28e-6c7b9cd94-m2psz" podStartSLOduration=1.3829104349999999 podStartE2EDuration="1.382910435s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:20:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:21:00.381548908 +0000 UTC m=+905.859860765" watchObservedRunningTime="2026-09-11 21:21:00.382910435 +0000 UTC m=+905.861222272"
Sep 11 21:21:00.400485 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:00.400438    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-7ae28e-ccbcc88f7-pkjzt" podStartSLOduration=1.400422175 podStartE2EDuration="1.400422175s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:20:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:21:00.398672393 +0000 UTC m=+905.876984249" watchObservedRunningTime="2026-09-11 21:21:00.400422175 +0000 UTC m=+905.878734016"
Sep 11 21:21:01.039132 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:01.039098    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d939ae9d-6c4e-4184-9300-e7a83a4671df" path="/var/lib/kubelet/pods/d939ae9d-6c4e-4184-9300-e7a83a4671df/volumes"
Sep 11 21:21:11.373277 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:11.373244    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-7ae28e-ccbcc88f7-pkjzt"
Sep 11 21:21:11.373687 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:11.373318    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-7ae28e-6c7b9cd94-m2psz"
Sep 11 21:21:20.484896 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:20.484862    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e85410da-dcf5cb458-k44sh"]
Sep 11 21:21:20.489917 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:20.489893    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-e85410da-dcf5cb458-k44sh"
Sep 11 21:21:20.492809 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:20.492782    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-e85410da\""
Sep 11 21:21:20.492958 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:20.492826    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-e85410da-dockercfg-pw7lt\""
Sep 11 21:21:20.500440 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:20.500419    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e85410da-dcf5cb458-k44sh"]
Sep 11 21:21:20.611724 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:20.611686    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/005aa7f6-3a89-4674-8809-0b916f59db04-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-e85410da-dcf5cb458-k44sh\" (UID: \"005aa7f6-3a89-4674-8809-0b916f59db04\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e85410da-dcf5cb458-k44sh"
Sep 11 21:21:20.611897 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:20.611832    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5pj7\" (UniqueName: \"kubernetes.io/projected/005aa7f6-3a89-4674-8809-0b916f59db04-kube-api-access-k5pj7\") pod \"payload-pre-processing-e2e-mt-e85410da-dcf5cb458-k44sh\" (UID: \"005aa7f6-3a89-4674-8809-0b916f59db04\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e85410da-dcf5cb458-k44sh"
Sep 11 21:21:20.713376 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:20.713330    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5pj7\" (UniqueName: \"kubernetes.io/projected/005aa7f6-3a89-4674-8809-0b916f59db04-kube-api-access-k5pj7\") pod \"payload-pre-processing-e2e-mt-e85410da-dcf5cb458-k44sh\" (UID: \"005aa7f6-3a89-4674-8809-0b916f59db04\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e85410da-dcf5cb458-k44sh"
Sep 11 21:21:20.713591 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:20.713515    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/005aa7f6-3a89-4674-8809-0b916f59db04-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-e85410da-dcf5cb458-k44sh\" (UID: \"005aa7f6-3a89-4674-8809-0b916f59db04\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e85410da-dcf5cb458-k44sh"
Sep 11 21:21:20.714211 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:20.714192    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/005aa7f6-3a89-4674-8809-0b916f59db04-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-e85410da-dcf5cb458-k44sh\" (UID: \"005aa7f6-3a89-4674-8809-0b916f59db04\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e85410da-dcf5cb458-k44sh"
Sep 11 21:21:20.724494 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:20.724466    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5pj7\" (UniqueName: \"kubernetes.io/projected/005aa7f6-3a89-4674-8809-0b916f59db04-kube-api-access-k5pj7\") pod \"payload-pre-processing-e2e-mt-e85410da-dcf5cb458-k44sh\" (UID: \"005aa7f6-3a89-4674-8809-0b916f59db04\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e85410da-dcf5cb458-k44sh"
Sep 11 21:21:20.803634 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:20.803535    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-e85410da-dcf5cb458-k44sh"
Sep 11 21:21:21.086837 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:21.082089    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e85410da-dcf5cb458-k44sh"]
Sep 11 21:21:21.089463 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:21:21.089427    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod005aa7f6_3a89_4674_8809_0b916f59db04.slice/crio-15191b920711ddb1ca736890d7b0b4f69f762de5ded379aa619515918bfc8010 WatchSource:0}: Error finding container 15191b920711ddb1ca736890d7b0b4f69f762de5ded379aa619515918bfc8010: Status 404 returned error can't find the container with id 15191b920711ddb1ca736890d7b0b4f69f762de5ded379aa619515918bfc8010
Sep 11 21:21:21.498245 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:21.498210    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-e85410da-dcf5cb458-k44sh" event={"ID":"005aa7f6-3a89-4674-8809-0b916f59db04","Type":"ContainerStarted","Data":"341ecc5541cd8198b858be4c9e0cb360fe0165c7f32c718e8b25c7d97b394999"}
Sep 11 21:21:21.498673 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:21.498264    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-e85410da-dcf5cb458-k44sh" event={"ID":"005aa7f6-3a89-4674-8809-0b916f59db04","Type":"ContainerStarted","Data":"15191b920711ddb1ca736890d7b0b4f69f762de5ded379aa619515918bfc8010"}
Sep 11 21:21:21.498673 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:21.498359    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-e85410da-dcf5cb458-k44sh"
Sep 11 21:21:21.516925 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:21.516875    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-e85410da-dcf5cb458-k44sh" podStartSLOduration=1.516859003 podStartE2EDuration="1.516859003s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:21:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:21:21.515828204 +0000 UTC m=+926.994140074" watchObservedRunningTime="2026-09-11 21:21:21.516859003 +0000 UTC m=+926.995170847"
Sep 11 21:21:32.507585 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:32.507543    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-e85410da-dcf5cb458-k44sh"
Sep 11 21:21:48.948637 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:48.948597    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e85410da-tsdwq"]
Sep 11 21:21:48.953646 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:48.953623    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e85410da-tsdwq"
Sep 11 21:21:48.956581 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:48.956551    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bfm9g\""
Sep 11 21:21:48.956718 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:48.956564    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 21:21:48.969314 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:48.969285    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e85410da-tsdwq"]
Sep 11 21:21:49.023914 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:49.023883    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/024d638c-5a8f-48a8-a4d3-b579206ad807-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e85410da-tsdwq\" (UID: \"024d638c-5a8f-48a8-a4d3-b579206ad807\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e85410da-tsdwq"
Sep 11 21:21:49.125242 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:49.125203    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/024d638c-5a8f-48a8-a4d3-b579206ad807-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e85410da-tsdwq\" (UID: \"024d638c-5a8f-48a8-a4d3-b579206ad807\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e85410da-tsdwq"
Sep 11 21:21:49.125845 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:49.125824    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/024d638c-5a8f-48a8-a4d3-b579206ad807-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e85410da-tsdwq\" (UID: \"024d638c-5a8f-48a8-a4d3-b579206ad807\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e85410da-tsdwq"
Sep 11 21:21:49.266963 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:49.266874    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e85410da-tsdwq"
Sep 11 21:21:49.542368 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:49.542343    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e85410da-tsdwq"]
Sep 11 21:21:49.544207 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:21:49.544181    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod024d638c_5a8f_48a8_a4d3_b579206ad807.slice/crio-bae2997d5ffb704d9339025e32aca53334584274b2d6ec5b8182f97dd06376d2 WatchSource:0}: Error finding container bae2997d5ffb704d9339025e32aca53334584274b2d6ec5b8182f97dd06376d2: Status 404 returned error can't find the container with id bae2997d5ffb704d9339025e32aca53334584274b2d6ec5b8182f97dd06376d2
Sep 11 21:21:49.661976 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:49.661945    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e85410da-tsdwq" event={"ID":"024d638c-5a8f-48a8-a4d3-b579206ad807","Type":"ContainerStarted","Data":"bae2997d5ffb704d9339025e32aca53334584274b2d6ec5b8182f97dd06376d2"}
Sep 11 21:21:50.669852 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:50.669810    2560 generic.go:356] "Generic (PLEG): container finished" podID="024d638c-5a8f-48a8-a4d3-b579206ad807" containerID="c4cca0e4b9cdcbba034011ed3515b809adc7bf092ea90b63aec06bdfed3146d6" exitCode=0
Sep 11 21:21:50.670328 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:50.669862    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e85410da-tsdwq" event={"ID":"024d638c-5a8f-48a8-a4d3-b579206ad807","Type":"ContainerDied","Data":"c4cca0e4b9cdcbba034011ed3515b809adc7bf092ea90b63aec06bdfed3146d6"}
Sep 11 21:21:51.813431 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:51.813400    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e85410da-tsdwq"
Sep 11 21:21:51.955892 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:51.955801    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/024d638c-5a8f-48a8-a4d3-b579206ad807-maas-api-service-ca\") pod \"024d638c-5a8f-48a8-a4d3-b579206ad807\" (UID: \"024d638c-5a8f-48a8-a4d3-b579206ad807\") "
Sep 11 21:21:51.956233 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:51.956200    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/024d638c-5a8f-48a8-a4d3-b579206ad807-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "024d638c-5a8f-48a8-a4d3-b579206ad807" (UID: "024d638c-5a8f-48a8-a4d3-b579206ad807"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:21:52.057581 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:52.057552    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/024d638c-5a8f-48a8-a4d3-b579206ad807-maas-api-service-ca\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:21:52.682869 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:52.682838    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e85410da-tsdwq" event={"ID":"024d638c-5a8f-48a8-a4d3-b579206ad807","Type":"ContainerDied","Data":"bae2997d5ffb704d9339025e32aca53334584274b2d6ec5b8182f97dd06376d2"}
Sep 11 21:21:52.682869 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:52.682856    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e85410da-tsdwq"
Sep 11 21:21:52.683088 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:52.682893    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bae2997d5ffb704d9339025e32aca53334584274b2d6ec5b8182f97dd06376d2"
Sep 11 21:21:58.195007 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:58.194969    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7ae28e-8g54v"]
Sep 11 21:21:58.195467 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:58.195454    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="024d638c-5a8f-48a8-a4d3-b579206ad807" containerName="revoke-keys"
Sep 11 21:21:58.195467 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:58.195468    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="024d638c-5a8f-48a8-a4d3-b579206ad807" containerName="revoke-keys"
Sep 11 21:21:58.195571 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:58.195551    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="024d638c-5a8f-48a8-a4d3-b579206ad807" containerName="revoke-keys"
Sep 11 21:21:58.199920 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:58.199904    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7ae28e-8g54v"
Sep 11 21:21:58.202253 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:58.202226    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 21:21:58.202401 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:58.202258    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bfm9g\""
Sep 11 21:21:58.206989 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:58.206967    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7ae28e-8g54v"]
Sep 11 21:21:58.322627 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:58.322594    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7951d952-85fd-4a19-9321-f3aafeae30df-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-7ae28e-8g54v\" (UID: \"7951d952-85fd-4a19-9321-f3aafeae30df\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7ae28e-8g54v"
Sep 11 21:21:58.423345 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:58.423312    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7951d952-85fd-4a19-9321-f3aafeae30df-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-7ae28e-8g54v\" (UID: \"7951d952-85fd-4a19-9321-f3aafeae30df\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7ae28e-8g54v"
Sep 11 21:21:58.423975 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:58.423956    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7951d952-85fd-4a19-9321-f3aafeae30df-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-7ae28e-8g54v\" (UID: \"7951d952-85fd-4a19-9321-f3aafeae30df\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7ae28e-8g54v"
Sep 11 21:21:58.512574 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:58.512487    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7ae28e-8g54v"
Sep 11 21:21:58.791202 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:58.791179    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7ae28e-8g54v"]
Sep 11 21:21:58.793273 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:21:58.793248    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7951d952_85fd_4a19_9321_f3aafeae30df.slice/crio-58759147a6e2a4477331d576c7d2b9ee36e3a7cde88d76458db566ec4b2498a9 WatchSource:0}: Error finding container 58759147a6e2a4477331d576c7d2b9ee36e3a7cde88d76458db566ec4b2498a9: Status 404 returned error can't find the container with id 58759147a6e2a4477331d576c7d2b9ee36e3a7cde88d76458db566ec4b2498a9
Sep 11 21:21:59.725298 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:59.725263    2560 generic.go:356] "Generic (PLEG): container finished" podID="7951d952-85fd-4a19-9321-f3aafeae30df" containerID="d18a2c17c5c338ee34bb690ada04890324ef287c03f2f1efacab95aff9b59155" exitCode=0
Sep 11 21:21:59.725759 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:59.725350    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7ae28e-8g54v" event={"ID":"7951d952-85fd-4a19-9321-f3aafeae30df","Type":"ContainerDied","Data":"d18a2c17c5c338ee34bb690ada04890324ef287c03f2f1efacab95aff9b59155"}
Sep 11 21:21:59.725759 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:21:59.725421    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7ae28e-8g54v" event={"ID":"7951d952-85fd-4a19-9321-f3aafeae30df","Type":"ContainerStarted","Data":"58759147a6e2a4477331d576c7d2b9ee36e3a7cde88d76458db566ec4b2498a9"}
Sep 11 21:22:00.636062 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:00.636028    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e85410da-dcf5cb458-k44sh"]
Sep 11 21:22:00.636275 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:00.636248    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-e85410da-dcf5cb458-k44sh" podUID="005aa7f6-3a89-4674-8809-0b916f59db04" containerName="payload-pre-processing" containerID="cri-o://341ecc5541cd8198b858be4c9e0cb360fe0165c7f32c718e8b25c7d97b394999" gracePeriod=30
Sep 11 21:22:00.837556 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:00.837524    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e85410da-tsdwq"]
Sep 11 21:22:00.840642 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:00.840607    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e85410da-tsdwq"]
Sep 11 21:22:00.920512 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:00.920490    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7ae28e-8g54v"
Sep 11 21:22:00.923666 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:00.923649    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-e85410da-dcf5cb458-k44sh"
Sep 11 21:22:01.038409 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:01.038352    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="024d638c-5a8f-48a8-a4d3-b579206ad807" path="/var/lib/kubelet/pods/024d638c-5a8f-48a8-a4d3-b579206ad807/volumes"
Sep 11 21:22:01.049218 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:01.049182    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7951d952-85fd-4a19-9321-f3aafeae30df-maas-api-service-ca\") pod \"7951d952-85fd-4a19-9321-f3aafeae30df\" (UID: \"7951d952-85fd-4a19-9321-f3aafeae30df\") "
Sep 11 21:22:01.049414 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:01.049243    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/005aa7f6-3a89-4674-8809-0b916f59db04-plugins-config-volume\") pod \"005aa7f6-3a89-4674-8809-0b916f59db04\" (UID: \"005aa7f6-3a89-4674-8809-0b916f59db04\") "
Sep 11 21:22:01.049414 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:01.049332    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k5pj7\" (UniqueName: \"kubernetes.io/projected/005aa7f6-3a89-4674-8809-0b916f59db04-kube-api-access-k5pj7\") pod \"005aa7f6-3a89-4674-8809-0b916f59db04\" (UID: \"005aa7f6-3a89-4674-8809-0b916f59db04\") "
Sep 11 21:22:01.049634 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:01.049607    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7951d952-85fd-4a19-9321-f3aafeae30df-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7951d952-85fd-4a19-9321-f3aafeae30df" (UID: "7951d952-85fd-4a19-9321-f3aafeae30df"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:22:01.049634 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:01.049620    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/005aa7f6-3a89-4674-8809-0b916f59db04-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "005aa7f6-3a89-4674-8809-0b916f59db04" (UID: "005aa7f6-3a89-4674-8809-0b916f59db04"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:22:01.049788 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:01.049766    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7951d952-85fd-4a19-9321-f3aafeae30df-maas-api-service-ca\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:22:01.049788 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:01.049780    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/005aa7f6-3a89-4674-8809-0b916f59db04-plugins-config-volume\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:22:01.052191 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:01.052157    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/005aa7f6-3a89-4674-8809-0b916f59db04-kube-api-access-k5pj7" (OuterVolumeSpecName: "kube-api-access-k5pj7") pod "005aa7f6-3a89-4674-8809-0b916f59db04" (UID: "005aa7f6-3a89-4674-8809-0b916f59db04"). InnerVolumeSpecName "kube-api-access-k5pj7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:22:01.151050 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:01.150956    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k5pj7\" (UniqueName: \"kubernetes.io/projected/005aa7f6-3a89-4674-8809-0b916f59db04-kube-api-access-k5pj7\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:22:01.738442 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:01.738402    2560 generic.go:356] "Generic (PLEG): container finished" podID="005aa7f6-3a89-4674-8809-0b916f59db04" containerID="341ecc5541cd8198b858be4c9e0cb360fe0165c7f32c718e8b25c7d97b394999" exitCode=0
Sep 11 21:22:01.738622 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:01.738467    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-e85410da-dcf5cb458-k44sh"
Sep 11 21:22:01.738622 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:01.738483    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-e85410da-dcf5cb458-k44sh" event={"ID":"005aa7f6-3a89-4674-8809-0b916f59db04","Type":"ContainerDied","Data":"341ecc5541cd8198b858be4c9e0cb360fe0165c7f32c718e8b25c7d97b394999"}
Sep 11 21:22:01.738622 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:01.738541    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-e85410da-dcf5cb458-k44sh" event={"ID":"005aa7f6-3a89-4674-8809-0b916f59db04","Type":"ContainerDied","Data":"15191b920711ddb1ca736890d7b0b4f69f762de5ded379aa619515918bfc8010"}
Sep 11 21:22:01.738622 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:01.738568    2560 scope.go:117] "RemoveContainer" containerID="341ecc5541cd8198b858be4c9e0cb360fe0165c7f32c718e8b25c7d97b394999"
Sep 11 21:22:01.740171 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:01.740156    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7ae28e-8g54v"
Sep 11 21:22:01.740284 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:01.740173    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7ae28e-8g54v" event={"ID":"7951d952-85fd-4a19-9321-f3aafeae30df","Type":"ContainerDied","Data":"58759147a6e2a4477331d576c7d2b9ee36e3a7cde88d76458db566ec4b2498a9"}
Sep 11 21:22:01.740284 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:01.740223    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="58759147a6e2a4477331d576c7d2b9ee36e3a7cde88d76458db566ec4b2498a9"
Sep 11 21:22:01.748960 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:01.748942    2560 scope.go:117] "RemoveContainer" containerID="341ecc5541cd8198b858be4c9e0cb360fe0165c7f32c718e8b25c7d97b394999"
Sep 11 21:22:01.749284 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:22:01.749258    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"341ecc5541cd8198b858be4c9e0cb360fe0165c7f32c718e8b25c7d97b394999\": container with ID starting with 341ecc5541cd8198b858be4c9e0cb360fe0165c7f32c718e8b25c7d97b394999 not found: ID does not exist" containerID="341ecc5541cd8198b858be4c9e0cb360fe0165c7f32c718e8b25c7d97b394999"
Sep 11 21:22:01.749393 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:01.749292    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"341ecc5541cd8198b858be4c9e0cb360fe0165c7f32c718e8b25c7d97b394999"} err="failed to get container status \"341ecc5541cd8198b858be4c9e0cb360fe0165c7f32c718e8b25c7d97b394999\": rpc error: code = NotFound desc = could not find container \"341ecc5541cd8198b858be4c9e0cb360fe0165c7f32c718e8b25c7d97b394999\": container with ID starting with 341ecc5541cd8198b858be4c9e0cb360fe0165c7f32c718e8b25c7d97b394999 not found: ID does not exist"
Sep 11 21:22:01.764130 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:01.764104    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e85410da-dcf5cb458-k44sh"]
Sep 11 21:22:01.768988 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:01.768962    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e85410da-dcf5cb458-k44sh"]
Sep 11 21:22:03.038062 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:03.038026    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="005aa7f6-3a89-4674-8809-0b916f59db04" path="/var/lib/kubelet/pods/005aa7f6-3a89-4674-8809-0b916f59db04/volumes"
Sep 11 21:22:09.235685 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:09.235622    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-7ae28e-ccbcc88f7-pkjzt"]
Sep 11 21:22:09.236189 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:09.235881    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-7ae28e-ccbcc88f7-pkjzt" podUID="e36b8dab-4e90-4d60-b1c9-45b47bd4ed45" containerName="payload-processing" containerID="cri-o://19c06f0855ca729fe00b9f5eb4ccb8e1d12930e699b6a60dd4d13d3eab169df8" gracePeriod=30
Sep 11 21:22:09.241288 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:09.241260    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-7ae28e-6c7b9cd94-m2psz"]
Sep 11 21:22:09.241676 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:09.241641    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-7ae28e-6c7b9cd94-m2psz" podUID="f9cd910a-2e59-4a8c-8104-e8419d72049b" containerName="payload-pre-processing" containerID="cri-o://e6adf6ce8a9a6958ed19b5c81779ec3747625528b81dc366c67285a8b7bde6a2" gracePeriod=30
Sep 11 21:22:09.543732 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:09.543694    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-7ae28e-6c7b9cd94-m2psz"
Sep 11 21:22:09.543960 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:09.543939    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7ae28e-8g54v"]
Sep 11 21:22:09.550339 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:09.550314    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7ae28e-8g54v"]
Sep 11 21:22:09.556883 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:09.556856    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-7ae28e-ccbcc88f7-pkjzt"
Sep 11 21:22:09.738447 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:09.738369    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9cd910a-2e59-4a8c-8104-e8419d72049b-plugins-config-volume\") pod \"f9cd910a-2e59-4a8c-8104-e8419d72049b\" (UID: \"f9cd910a-2e59-4a8c-8104-e8419d72049b\") "
Sep 11 21:22:09.738602 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:09.738533    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e36b8dab-4e90-4d60-b1c9-45b47bd4ed45-plugins-config-volume\") pod \"e36b8dab-4e90-4d60-b1c9-45b47bd4ed45\" (UID: \"e36b8dab-4e90-4d60-b1c9-45b47bd4ed45\") "
Sep 11 21:22:09.738602 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:09.738564    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kmhs2\" (UniqueName: \"kubernetes.io/projected/f9cd910a-2e59-4a8c-8104-e8419d72049b-kube-api-access-kmhs2\") pod \"f9cd910a-2e59-4a8c-8104-e8419d72049b\" (UID: \"f9cd910a-2e59-4a8c-8104-e8419d72049b\") "
Sep 11 21:22:09.738602 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:09.738585    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vjs9r\" (UniqueName: \"kubernetes.io/projected/e36b8dab-4e90-4d60-b1c9-45b47bd4ed45-kube-api-access-vjs9r\") pod \"e36b8dab-4e90-4d60-b1c9-45b47bd4ed45\" (UID: \"e36b8dab-4e90-4d60-b1c9-45b47bd4ed45\") "
Sep 11 21:22:09.738791 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:09.738764    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9cd910a-2e59-4a8c-8104-e8419d72049b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f9cd910a-2e59-4a8c-8104-e8419d72049b" (UID: "f9cd910a-2e59-4a8c-8104-e8419d72049b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:22:09.738963 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:09.738936    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e36b8dab-4e90-4d60-b1c9-45b47bd4ed45-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e36b8dab-4e90-4d60-b1c9-45b47bd4ed45" (UID: "e36b8dab-4e90-4d60-b1c9-45b47bd4ed45"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:22:09.740760 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:09.740737    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9cd910a-2e59-4a8c-8104-e8419d72049b-kube-api-access-kmhs2" (OuterVolumeSpecName: "kube-api-access-kmhs2") pod "f9cd910a-2e59-4a8c-8104-e8419d72049b" (UID: "f9cd910a-2e59-4a8c-8104-e8419d72049b"). InnerVolumeSpecName "kube-api-access-kmhs2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:22:09.740856 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:09.740800    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e36b8dab-4e90-4d60-b1c9-45b47bd4ed45-kube-api-access-vjs9r" (OuterVolumeSpecName: "kube-api-access-vjs9r") pod "e36b8dab-4e90-4d60-b1c9-45b47bd4ed45" (UID: "e36b8dab-4e90-4d60-b1c9-45b47bd4ed45"). InnerVolumeSpecName "kube-api-access-vjs9r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:22:09.790865 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:09.790770    2560 generic.go:356] "Generic (PLEG): container finished" podID="f9cd910a-2e59-4a8c-8104-e8419d72049b" containerID="e6adf6ce8a9a6958ed19b5c81779ec3747625528b81dc366c67285a8b7bde6a2" exitCode=0
Sep 11 21:22:09.790865 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:09.790827    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-7ae28e-6c7b9cd94-m2psz"
Sep 11 21:22:09.790865 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:09.790854    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-7ae28e-6c7b9cd94-m2psz" event={"ID":"f9cd910a-2e59-4a8c-8104-e8419d72049b","Type":"ContainerDied","Data":"e6adf6ce8a9a6958ed19b5c81779ec3747625528b81dc366c67285a8b7bde6a2"}
Sep 11 21:22:09.791143 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:09.790930    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-7ae28e-6c7b9cd94-m2psz" event={"ID":"f9cd910a-2e59-4a8c-8104-e8419d72049b","Type":"ContainerDied","Data":"9aa21b310d16992171ceb88452780fb1b4e7760893d3396b828fb752ee706886"}
Sep 11 21:22:09.791143 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:09.790954    2560 scope.go:117] "RemoveContainer" containerID="e6adf6ce8a9a6958ed19b5c81779ec3747625528b81dc366c67285a8b7bde6a2"
Sep 11 21:22:09.792408 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:09.792361    2560 generic.go:356] "Generic (PLEG): container finished" podID="e36b8dab-4e90-4d60-b1c9-45b47bd4ed45" containerID="19c06f0855ca729fe00b9f5eb4ccb8e1d12930e699b6a60dd4d13d3eab169df8" exitCode=0
Sep 11 21:22:09.792534 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:09.792408    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-7ae28e-ccbcc88f7-pkjzt" event={"ID":"e36b8dab-4e90-4d60-b1c9-45b47bd4ed45","Type":"ContainerDied","Data":"19c06f0855ca729fe00b9f5eb4ccb8e1d12930e699b6a60dd4d13d3eab169df8"}
Sep 11 21:22:09.792534 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:09.792443    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-7ae28e-ccbcc88f7-pkjzt"
Sep 11 21:22:09.792534 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:09.792465    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-7ae28e-ccbcc88f7-pkjzt" event={"ID":"e36b8dab-4e90-4d60-b1c9-45b47bd4ed45","Type":"ContainerDied","Data":"8fd5d094411602874c2d8d5ef6ac8c692dba043b1df1d3bebd3ea93d65cc4de1"}
Sep 11 21:22:09.801138 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:09.801122    2560 scope.go:117] "RemoveContainer" containerID="e6adf6ce8a9a6958ed19b5c81779ec3747625528b81dc366c67285a8b7bde6a2"
Sep 11 21:22:09.801460 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:22:09.801442    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6adf6ce8a9a6958ed19b5c81779ec3747625528b81dc366c67285a8b7bde6a2\": container with ID starting with e6adf6ce8a9a6958ed19b5c81779ec3747625528b81dc366c67285a8b7bde6a2 not found: ID does not exist" containerID="e6adf6ce8a9a6958ed19b5c81779ec3747625528b81dc366c67285a8b7bde6a2"
Sep 11 21:22:09.801521 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:09.801469    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6adf6ce8a9a6958ed19b5c81779ec3747625528b81dc366c67285a8b7bde6a2"} err="failed to get container status \"e6adf6ce8a9a6958ed19b5c81779ec3747625528b81dc366c67285a8b7bde6a2\": rpc error: code = NotFound desc = could not find container \"e6adf6ce8a9a6958ed19b5c81779ec3747625528b81dc366c67285a8b7bde6a2\": container with ID starting with e6adf6ce8a9a6958ed19b5c81779ec3747625528b81dc366c67285a8b7bde6a2 not found: ID does not exist"
Sep 11 21:22:09.801521 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:09.801487    2560 scope.go:117] "RemoveContainer" containerID="19c06f0855ca729fe00b9f5eb4ccb8e1d12930e699b6a60dd4d13d3eab169df8"
Sep 11 21:22:09.809753 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:09.809735    2560 scope.go:117] "RemoveContainer" containerID="19c06f0855ca729fe00b9f5eb4ccb8e1d12930e699b6a60dd4d13d3eab169df8"
Sep 11 21:22:09.810005 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:22:09.809987    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19c06f0855ca729fe00b9f5eb4ccb8e1d12930e699b6a60dd4d13d3eab169df8\": container with ID starting with 19c06f0855ca729fe00b9f5eb4ccb8e1d12930e699b6a60dd4d13d3eab169df8 not found: ID does not exist" containerID="19c06f0855ca729fe00b9f5eb4ccb8e1d12930e699b6a60dd4d13d3eab169df8"
Sep 11 21:22:09.810055 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:09.810012    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19c06f0855ca729fe00b9f5eb4ccb8e1d12930e699b6a60dd4d13d3eab169df8"} err="failed to get container status \"19c06f0855ca729fe00b9f5eb4ccb8e1d12930e699b6a60dd4d13d3eab169df8\": rpc error: code = NotFound desc = could not find container \"19c06f0855ca729fe00b9f5eb4ccb8e1d12930e699b6a60dd4d13d3eab169df8\": container with ID starting with 19c06f0855ca729fe00b9f5eb4ccb8e1d12930e699b6a60dd4d13d3eab169df8 not found: ID does not exist"
Sep 11 21:22:09.813913 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:09.813889    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-7ae28e-6c7b9cd94-m2psz"]
Sep 11 21:22:09.817960 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:09.817937    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-7ae28e-6c7b9cd94-m2psz"]
Sep 11 21:22:09.828620 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:09.828597    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-7ae28e-ccbcc88f7-pkjzt"]
Sep 11 21:22:09.834329 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:09.834309    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-7ae28e-ccbcc88f7-pkjzt"]
Sep 11 21:22:09.839371 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:09.839351    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e36b8dab-4e90-4d60-b1c9-45b47bd4ed45-plugins-config-volume\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:22:09.839461 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:09.839374    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kmhs2\" (UniqueName: \"kubernetes.io/projected/f9cd910a-2e59-4a8c-8104-e8419d72049b-kube-api-access-kmhs2\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:22:09.839461 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:09.839400    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjs9r\" (UniqueName: \"kubernetes.io/projected/e36b8dab-4e90-4d60-b1c9-45b47bd4ed45-kube-api-access-vjs9r\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:22:09.839461 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:09.839414    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9cd910a-2e59-4a8c-8104-e8419d72049b-plugins-config-volume\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:22:11.039057 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:11.039022    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7951d952-85fd-4a19-9321-f3aafeae30df" path="/var/lib/kubelet/pods/7951d952-85fd-4a19-9321-f3aafeae30df/volumes"
Sep 11 21:22:11.039490 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:11.039473    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e36b8dab-4e90-4d60-b1c9-45b47bd4ed45" path="/var/lib/kubelet/pods/e36b8dab-4e90-4d60-b1c9-45b47bd4ed45/volumes"
Sep 11 21:22:11.039862 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:11.039849    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9cd910a-2e59-4a8c-8104-e8419d72049b" path="/var/lib/kubelet/pods/f9cd910a-2e59-4a8c-8104-e8419d72049b/volumes"
Sep 11 21:22:16.775999 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:16.775365    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd"]
Sep 11 21:22:16.776544 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:16.776393    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="005aa7f6-3a89-4674-8809-0b916f59db04" containerName="payload-pre-processing"
Sep 11 21:22:16.776544 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:16.776419    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="005aa7f6-3a89-4674-8809-0b916f59db04" containerName="payload-pre-processing"
Sep 11 21:22:16.776544 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:16.776436    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e36b8dab-4e90-4d60-b1c9-45b47bd4ed45" containerName="payload-processing"
Sep 11 21:22:16.776544 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:16.776447    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e36b8dab-4e90-4d60-b1c9-45b47bd4ed45" containerName="payload-processing"
Sep 11 21:22:16.776544 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:16.776464    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9cd910a-2e59-4a8c-8104-e8419d72049b" containerName="payload-pre-processing"
Sep 11 21:22:16.776544 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:16.776474    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9cd910a-2e59-4a8c-8104-e8419d72049b" containerName="payload-pre-processing"
Sep 11 21:22:16.776544 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:16.776490    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7951d952-85fd-4a19-9321-f3aafeae30df" containerName="revoke-keys"
Sep 11 21:22:16.776544 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:16.776499    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7951d952-85fd-4a19-9321-f3aafeae30df" containerName="revoke-keys"
Sep 11 21:22:16.776926 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:16.776656    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7951d952-85fd-4a19-9321-f3aafeae30df" containerName="revoke-keys"
Sep 11 21:22:16.776926 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:16.776671    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="005aa7f6-3a89-4674-8809-0b916f59db04" containerName="payload-pre-processing"
Sep 11 21:22:16.776926 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:16.776687    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e36b8dab-4e90-4d60-b1c9-45b47bd4ed45" containerName="payload-processing"
Sep 11 21:22:16.776926 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:16.776697    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9cd910a-2e59-4a8c-8104-e8419d72049b" containerName="payload-pre-processing"
Sep 11 21:22:16.780371 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:16.780352    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd"
Sep 11 21:22:16.783193 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:16.783169    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-ae7b6a-openshift-default-dockercfg-j7wh6\""
Sep 11 21:22:16.796825 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:16.796797    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd"]
Sep 11 21:22:16.804599 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:16.804572    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dee333c4-368c-4f23-a086-e62bdbc58ca0-credential-socket\") pod \"e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd\" (UID: \"dee333c4-368c-4f23-a086-e62bdbc58ca0\") " pod="openshift-ingress/e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd"
Sep 11 21:22:16.804741 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:16.804616    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dee333c4-368c-4f23-a086-e62bdbc58ca0-workload-certs\") pod \"e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd\" (UID: \"dee333c4-368c-4f23-a086-e62bdbc58ca0\") " pod="openshift-ingress/e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd"
Sep 11 21:22:16.804741 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:16.804657    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dee333c4-368c-4f23-a086-e62bdbc58ca0-istio-podinfo\") pod \"e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd\" (UID: \"dee333c4-368c-4f23-a086-e62bdbc58ca0\") " pod="openshift-ingress/e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd"
Sep 11 21:22:16.804741 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:16.804689    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dee333c4-368c-4f23-a086-e62bdbc58ca0-istiod-ca-cert\") pod \"e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd\" (UID: \"dee333c4-368c-4f23-a086-e62bdbc58ca0\") " pod="openshift-ingress/e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd"
Sep 11 21:22:16.804741 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:16.804716    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dee333c4-368c-4f23-a086-e62bdbc58ca0-workload-socket\") pod \"e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd\" (UID: \"dee333c4-368c-4f23-a086-e62bdbc58ca0\") " pod="openshift-ingress/e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd"
Sep 11 21:22:16.804901 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:16.804802    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dee333c4-368c-4f23-a086-e62bdbc58ca0-istio-token\") pod \"e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd\" (UID: \"dee333c4-368c-4f23-a086-e62bdbc58ca0\") " pod="openshift-ingress/e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd"
Sep 11 21:22:16.804901 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:16.804861    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x69kc\" (UniqueName: \"kubernetes.io/projected/dee333c4-368c-4f23-a086-e62bdbc58ca0-kube-api-access-x69kc\") pod \"e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd\" (UID: \"dee333c4-368c-4f23-a086-e62bdbc58ca0\") " pod="openshift-ingress/e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd"
Sep 11 21:22:16.804992 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:16.804975    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dee333c4-368c-4f23-a086-e62bdbc58ca0-istio-envoy\") pod \"e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd\" (UID: \"dee333c4-368c-4f23-a086-e62bdbc58ca0\") " pod="openshift-ingress/e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd"
Sep 11 21:22:16.805034 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:16.805014    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dee333c4-368c-4f23-a086-e62bdbc58ca0-istio-data\") pod \"e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd\" (UID: \"dee333c4-368c-4f23-a086-e62bdbc58ca0\") " pod="openshift-ingress/e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd"
Sep 11 21:22:16.906197 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:16.906158    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dee333c4-368c-4f23-a086-e62bdbc58ca0-istio-envoy\") pod \"e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd\" (UID: \"dee333c4-368c-4f23-a086-e62bdbc58ca0\") " pod="openshift-ingress/e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd"
Sep 11 21:22:16.906197 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:16.906198    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dee333c4-368c-4f23-a086-e62bdbc58ca0-istio-data\") pod \"e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd\" (UID: \"dee333c4-368c-4f23-a086-e62bdbc58ca0\") " pod="openshift-ingress/e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd"
Sep 11 21:22:16.906487 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:16.906224    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dee333c4-368c-4f23-a086-e62bdbc58ca0-credential-socket\") pod \"e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd\" (UID: \"dee333c4-368c-4f23-a086-e62bdbc58ca0\") " pod="openshift-ingress/e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd"
Sep 11 21:22:16.906487 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:16.906250    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dee333c4-368c-4f23-a086-e62bdbc58ca0-workload-certs\") pod \"e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd\" (UID: \"dee333c4-368c-4f23-a086-e62bdbc58ca0\") " pod="openshift-ingress/e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd"
Sep 11 21:22:16.906487 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:16.906345    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dee333c4-368c-4f23-a086-e62bdbc58ca0-istio-podinfo\") pod \"e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd\" (UID: \"dee333c4-368c-4f23-a086-e62bdbc58ca0\") " pod="openshift-ingress/e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd"
Sep 11 21:22:16.906487 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:16.906415    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dee333c4-368c-4f23-a086-e62bdbc58ca0-istiod-ca-cert\") pod \"e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd\" (UID: \"dee333c4-368c-4f23-a086-e62bdbc58ca0\") " pod="openshift-ingress/e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd"
Sep 11 21:22:16.906487 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:16.906443    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dee333c4-368c-4f23-a086-e62bdbc58ca0-workload-socket\") pod \"e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd\" (UID: \"dee333c4-368c-4f23-a086-e62bdbc58ca0\") " pod="openshift-ingress/e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd"
Sep 11 21:22:16.906812 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:16.906489    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dee333c4-368c-4f23-a086-e62bdbc58ca0-istio-token\") pod \"e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd\" (UID: \"dee333c4-368c-4f23-a086-e62bdbc58ca0\") " pod="openshift-ingress/e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd"
Sep 11 21:22:16.906812 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:16.906534    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x69kc\" (UniqueName: \"kubernetes.io/projected/dee333c4-368c-4f23-a086-e62bdbc58ca0-kube-api-access-x69kc\") pod \"e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd\" (UID: \"dee333c4-368c-4f23-a086-e62bdbc58ca0\") " pod="openshift-ingress/e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd"
Sep 11 21:22:16.906812 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:16.906735    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dee333c4-368c-4f23-a086-e62bdbc58ca0-credential-socket\") pod \"e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd\" (UID: \"dee333c4-368c-4f23-a086-e62bdbc58ca0\") " pod="openshift-ingress/e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd"
Sep 11 21:22:16.906812 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:16.906744    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dee333c4-368c-4f23-a086-e62bdbc58ca0-workload-certs\") pod \"e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd\" (UID: \"dee333c4-368c-4f23-a086-e62bdbc58ca0\") " pod="openshift-ingress/e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd"
Sep 11 21:22:16.907007 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:16.906845    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dee333c4-368c-4f23-a086-e62bdbc58ca0-workload-socket\") pod \"e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd\" (UID: \"dee333c4-368c-4f23-a086-e62bdbc58ca0\") " pod="openshift-ingress/e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd"
Sep 11 21:22:16.907007 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:16.906895    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dee333c4-368c-4f23-a086-e62bdbc58ca0-istio-data\") pod \"e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd\" (UID: \"dee333c4-368c-4f23-a086-e62bdbc58ca0\") " pod="openshift-ingress/e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd"
Sep 11 21:22:16.907174 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:16.907153    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dee333c4-368c-4f23-a086-e62bdbc58ca0-istiod-ca-cert\") pod \"e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd\" (UID: \"dee333c4-368c-4f23-a086-e62bdbc58ca0\") " pod="openshift-ingress/e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd"
Sep 11 21:22:16.908637 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:16.908616    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dee333c4-368c-4f23-a086-e62bdbc58ca0-istio-envoy\") pod \"e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd\" (UID: \"dee333c4-368c-4f23-a086-e62bdbc58ca0\") " pod="openshift-ingress/e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd"
Sep 11 21:22:16.908987 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:16.908965    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dee333c4-368c-4f23-a086-e62bdbc58ca0-istio-podinfo\") pod \"e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd\" (UID: \"dee333c4-368c-4f23-a086-e62bdbc58ca0\") " pod="openshift-ingress/e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd"
Sep 11 21:22:16.914761 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:16.914744    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dee333c4-368c-4f23-a086-e62bdbc58ca0-istio-token\") pod \"e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd\" (UID: \"dee333c4-368c-4f23-a086-e62bdbc58ca0\") " pod="openshift-ingress/e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd"
Sep 11 21:22:16.915143 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:16.915122    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x69kc\" (UniqueName: \"kubernetes.io/projected/dee333c4-368c-4f23-a086-e62bdbc58ca0-kube-api-access-x69kc\") pod \"e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd\" (UID: \"dee333c4-368c-4f23-a086-e62bdbc58ca0\") " pod="openshift-ingress/e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd"
Sep 11 21:22:17.090682 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:17.090561    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd"
Sep 11 21:22:17.376718 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:17.376694    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd"]
Sep 11 21:22:17.378626 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:22:17.378595    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddee333c4_368c_4f23_a086_e62bdbc58ca0.slice/crio-067e6fdacfb0e3e85b340a19ed209998cb458fa8d4a432bbfb6ac57f1c944e4e WatchSource:0}: Error finding container 067e6fdacfb0e3e85b340a19ed209998cb458fa8d4a432bbfb6ac57f1c944e4e: Status 404 returned error can't find the container with id 067e6fdacfb0e3e85b340a19ed209998cb458fa8d4a432bbfb6ac57f1c944e4e
Sep 11 21:22:17.381154 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:17.381114    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:22:17.381253 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:17.381234    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:22:17.381298 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:17.381286    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:22:17.846086 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:17.846002    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd" event={"ID":"dee333c4-368c-4f23-a086-e62bdbc58ca0","Type":"ContainerStarted","Data":"c7bf00ca7266d22205b3130eacc6485387e380a0722edaee3ebec63ecb14805a"}
Sep 11 21:22:17.846086 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:17.846053    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd" event={"ID":"dee333c4-368c-4f23-a086-e62bdbc58ca0","Type":"ContainerStarted","Data":"067e6fdacfb0e3e85b340a19ed209998cb458fa8d4a432bbfb6ac57f1c944e4e"}
Sep 11 21:22:17.870815 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:17.870764    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd" podStartSLOduration=1.870747283 podStartE2EDuration="1.870747283s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:22:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:22:17.868742643 +0000 UTC m=+983.347054488" watchObservedRunningTime="2026-09-11 21:22:17.870747283 +0000 UTC m=+983.349059198"
Sep 11 21:22:18.091719 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:18.091687    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd"
Sep 11 21:22:18.096965 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:18.096901    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd"
Sep 11 21:22:18.852715 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:18.852681    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd"
Sep 11 21:22:18.853737 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:18.853716    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd"
Sep 11 21:22:21.566921 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:21.566886    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9"]
Sep 11 21:22:21.570820 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:21.570797    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9"
Sep 11 21:22:21.573200 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:21.573176    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-1117b2-openshift-default-dockercfg-srlfj\""
Sep 11 21:22:21.587626 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:21.587600    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9"]
Sep 11 21:22:21.657771 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:21.657733    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e59f7272-4d6a-4c9e-ae1f-998f38f473a8-credential-socket\") pod \"e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9\" (UID: \"e59f7272-4d6a-4c9e-ae1f-998f38f473a8\") " pod="openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9"
Sep 11 21:22:21.657977 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:21.657787    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e59f7272-4d6a-4c9e-ae1f-998f38f473a8-istio-podinfo\") pod \"e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9\" (UID: \"e59f7272-4d6a-4c9e-ae1f-998f38f473a8\") " pod="openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9"
Sep 11 21:22:21.657977 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:21.657955    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e59f7272-4d6a-4c9e-ae1f-998f38f473a8-istio-data\") pod \"e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9\" (UID: \"e59f7272-4d6a-4c9e-ae1f-998f38f473a8\") " pod="openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9"
Sep 11 21:22:21.658082 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:21.658018    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e59f7272-4d6a-4c9e-ae1f-998f38f473a8-istio-token\") pod \"e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9\" (UID: \"e59f7272-4d6a-4c9e-ae1f-998f38f473a8\") " pod="openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9"
Sep 11 21:22:21.658082 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:21.658048    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e59f7272-4d6a-4c9e-ae1f-998f38f473a8-istiod-ca-cert\") pod \"e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9\" (UID: \"e59f7272-4d6a-4c9e-ae1f-998f38f473a8\") " pod="openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9"
Sep 11 21:22:21.658174 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:21.658089    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bjsb\" (UniqueName: \"kubernetes.io/projected/e59f7272-4d6a-4c9e-ae1f-998f38f473a8-kube-api-access-6bjsb\") pod \"e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9\" (UID: \"e59f7272-4d6a-4c9e-ae1f-998f38f473a8\") " pod="openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9"
Sep 11 21:22:21.658174 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:21.658134    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e59f7272-4d6a-4c9e-ae1f-998f38f473a8-workload-certs\") pod \"e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9\" (UID: \"e59f7272-4d6a-4c9e-ae1f-998f38f473a8\") " pod="openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9"
Sep 11 21:22:21.658275 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:21.658245    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e59f7272-4d6a-4c9e-ae1f-998f38f473a8-workload-socket\") pod \"e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9\" (UID: \"e59f7272-4d6a-4c9e-ae1f-998f38f473a8\") " pod="openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9"
Sep 11 21:22:21.658331 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:21.658284    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e59f7272-4d6a-4c9e-ae1f-998f38f473a8-istio-envoy\") pod \"e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9\" (UID: \"e59f7272-4d6a-4c9e-ae1f-998f38f473a8\") " pod="openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9"
Sep 11 21:22:21.759241 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:21.759202    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e59f7272-4d6a-4c9e-ae1f-998f38f473a8-istio-envoy\") pod \"e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9\" (UID: \"e59f7272-4d6a-4c9e-ae1f-998f38f473a8\") " pod="openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9"
Sep 11 21:22:21.759475 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:21.759269    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e59f7272-4d6a-4c9e-ae1f-998f38f473a8-credential-socket\") pod \"e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9\" (UID: \"e59f7272-4d6a-4c9e-ae1f-998f38f473a8\") " pod="openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9"
Sep 11 21:22:21.759475 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:21.759303    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e59f7272-4d6a-4c9e-ae1f-998f38f473a8-istio-podinfo\") pod \"e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9\" (UID: \"e59f7272-4d6a-4c9e-ae1f-998f38f473a8\") " pod="openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9"
Sep 11 21:22:21.759475 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:21.759415    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e59f7272-4d6a-4c9e-ae1f-998f38f473a8-istio-data\") pod \"e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9\" (UID: \"e59f7272-4d6a-4c9e-ae1f-998f38f473a8\") " pod="openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9"
Sep 11 21:22:21.759681 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:21.759480    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e59f7272-4d6a-4c9e-ae1f-998f38f473a8-istio-token\") pod \"e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9\" (UID: \"e59f7272-4d6a-4c9e-ae1f-998f38f473a8\") " pod="openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9"
Sep 11 21:22:21.759681 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:21.759520    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e59f7272-4d6a-4c9e-ae1f-998f38f473a8-istiod-ca-cert\") pod \"e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9\" (UID: \"e59f7272-4d6a-4c9e-ae1f-998f38f473a8\") " pod="openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9"
Sep 11 21:22:21.759681 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:21.759556    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bjsb\" (UniqueName: \"kubernetes.io/projected/e59f7272-4d6a-4c9e-ae1f-998f38f473a8-kube-api-access-6bjsb\") pod \"e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9\" (UID: \"e59f7272-4d6a-4c9e-ae1f-998f38f473a8\") " pod="openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9"
Sep 11 21:22:21.759681 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:21.759597    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e59f7272-4d6a-4c9e-ae1f-998f38f473a8-workload-certs\") pod \"e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9\" (UID: \"e59f7272-4d6a-4c9e-ae1f-998f38f473a8\") " pod="openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9"
Sep 11 21:22:21.759886 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:21.759683    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e59f7272-4d6a-4c9e-ae1f-998f38f473a8-workload-socket\") pod \"e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9\" (UID: \"e59f7272-4d6a-4c9e-ae1f-998f38f473a8\") " pod="openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9"
Sep 11 21:22:21.759886 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:21.759771    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e59f7272-4d6a-4c9e-ae1f-998f38f473a8-credential-socket\") pod \"e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9\" (UID: \"e59f7272-4d6a-4c9e-ae1f-998f38f473a8\") " pod="openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9"
Sep 11 21:22:21.760048 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:21.760027    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e59f7272-4d6a-4c9e-ae1f-998f38f473a8-workload-socket\") pod \"e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9\" (UID: \"e59f7272-4d6a-4c9e-ae1f-998f38f473a8\") " pod="openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9"
Sep 11 21:22:21.760471 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:21.760440    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e59f7272-4d6a-4c9e-ae1f-998f38f473a8-workload-certs\") pod \"e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9\" (UID: \"e59f7272-4d6a-4c9e-ae1f-998f38f473a8\") " pod="openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9"
Sep 11 21:22:21.760606 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:21.760522    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e59f7272-4d6a-4c9e-ae1f-998f38f473a8-istiod-ca-cert\") pod \"e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9\" (UID: \"e59f7272-4d6a-4c9e-ae1f-998f38f473a8\") " pod="openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9"
Sep 11 21:22:21.760674 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:21.760597    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e59f7272-4d6a-4c9e-ae1f-998f38f473a8-istio-data\") pod \"e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9\" (UID: \"e59f7272-4d6a-4c9e-ae1f-998f38f473a8\") " pod="openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9"
Sep 11 21:22:21.761886 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:21.761865    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e59f7272-4d6a-4c9e-ae1f-998f38f473a8-istio-envoy\") pod \"e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9\" (UID: \"e59f7272-4d6a-4c9e-ae1f-998f38f473a8\") " pod="openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9"
Sep 11 21:22:21.762909 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:21.762890    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e59f7272-4d6a-4c9e-ae1f-998f38f473a8-istio-podinfo\") pod \"e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9\" (UID: \"e59f7272-4d6a-4c9e-ae1f-998f38f473a8\") " pod="openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9"
Sep 11 21:22:21.767835 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:21.767811    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e59f7272-4d6a-4c9e-ae1f-998f38f473a8-istio-token\") pod \"e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9\" (UID: \"e59f7272-4d6a-4c9e-ae1f-998f38f473a8\") " pod="openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9"
Sep 11 21:22:21.767835 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:21.767828    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bjsb\" (UniqueName: \"kubernetes.io/projected/e59f7272-4d6a-4c9e-ae1f-998f38f473a8-kube-api-access-6bjsb\") pod \"e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9\" (UID: \"e59f7272-4d6a-4c9e-ae1f-998f38f473a8\") " pod="openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9"
Sep 11 21:22:21.881811 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:21.881784    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9"
Sep 11 21:22:22.162755 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:22.162729    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9"]
Sep 11 21:22:22.165364 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:22:22.165328    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode59f7272_4d6a_4c9e_ae1f_998f38f473a8.slice/crio-a080f868ef3b8172d4a0b1e090d094de38fdcac48c2bb3c675b36a616ee2d455 WatchSource:0}: Error finding container a080f868ef3b8172d4a0b1e090d094de38fdcac48c2bb3c675b36a616ee2d455: Status 404 returned error can't find the container with id a080f868ef3b8172d4a0b1e090d094de38fdcac48c2bb3c675b36a616ee2d455
Sep 11 21:22:22.167977 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:22.167934    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:22:22.168091 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:22.168030    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:22:22.168091 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:22.168076    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:22:22.878576 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:22.878541    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9" event={"ID":"e59f7272-4d6a-4c9e-ae1f-998f38f473a8","Type":"ContainerStarted","Data":"7db1c7037f1da292f6a331b9e9586e91f04f5d839d687babb39f898513e2a880"}
Sep 11 21:22:22.879050 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:22.878600    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9" event={"ID":"e59f7272-4d6a-4c9e-ae1f-998f38f473a8","Type":"ContainerStarted","Data":"a080f868ef3b8172d4a0b1e090d094de38fdcac48c2bb3c675b36a616ee2d455"}
Sep 11 21:22:22.882226 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:22.882202    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9"
Sep 11 21:22:22.899542 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:22.899486    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9" podStartSLOduration=1.8994695400000001 podStartE2EDuration="1.89946954s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:22:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:22:22.898172045 +0000 UTC m=+988.376483894" watchObservedRunningTime="2026-09-11 21:22:22.89946954 +0000 UTC m=+988.377781384"
Sep 11 21:22:23.887806 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:23.887775    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9"
Sep 11 21:22:24.891149 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:24.891116    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9"
Sep 11 21:22:24.892223 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:24.892198    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9"
Sep 11 21:22:40.933577 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:40.933532    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 21:22:40.935837 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:40.933599    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9" podUID="e59f7272-4d6a-4c9e-ae1f-998f38f473a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 21:22:42.002326 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:42.002245    2560 generic.go:356] "Generic (PLEG): container finished" podID="e59f7272-4d6a-4c9e-ae1f-998f38f473a8" containerID="7db1c7037f1da292f6a331b9e9586e91f04f5d839d687babb39f898513e2a880" exitCode=0
Sep 11 21:22:42.002947 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:42.002318    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9" event={"ID":"e59f7272-4d6a-4c9e-ae1f-998f38f473a8","Type":"ContainerDied","Data":"7db1c7037f1da292f6a331b9e9586e91f04f5d839d687babb39f898513e2a880"}
Sep 11 21:22:42.002947 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:42.002890    2560 scope.go:117] "RemoveContainer" containerID="7db1c7037f1da292f6a331b9e9586e91f04f5d839d687babb39f898513e2a880"
Sep 11 21:22:42.004095 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:42.004056    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:22:42.004186 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:42.004123    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:22:42.004186 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:42.004173    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:22:43.010601 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:43.010561    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9" event={"ID":"e59f7272-4d6a-4c9e-ae1f-998f38f473a8","Type":"ContainerStarted","Data":"91fd58518ddf68d69392f95e6cc845d3f1a9adf26bc3134e303d38c6e7f6226e"}
Sep 11 21:22:43.883320 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:43.883281    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9"
Sep 11 21:22:43.883804 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:43.883693    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 11 21:22:43.884031 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:43.884001    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9" podUID="e59f7272-4d6a-4c9e-ae1f-998f38f473a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 11 21:22:44.883396 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:44.883333    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 11 21:22:44.883889 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:44.883446    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9" podUID="e59f7272-4d6a-4c9e-ae1f-998f38f473a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 11 21:22:45.882822 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:45.882783    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 11 21:22:45.883008 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:45.882843    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9" podUID="e59f7272-4d6a-4c9e-ae1f-998f38f473a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 11 21:22:46.882857 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:46.882813    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 11 21:22:46.883375 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:46.882887    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9" podUID="e59f7272-4d6a-4c9e-ae1f-998f38f473a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 11 21:22:47.882626 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:47.882577    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 11 21:22:47.882840 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:47.882695    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9" podUID="e59f7272-4d6a-4c9e-ae1f-998f38f473a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 11 21:22:48.886117 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:48.886080    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9"
Sep 11 21:22:48.886546 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:48.886358    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9"
Sep 11 21:22:48.887136 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:48.887115    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9"
Sep 11 21:22:50.357637 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:50.357604    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh"]
Sep 11 21:22:50.362230 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:50.362201    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh"
Sep 11 21:22:50.364826 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:50.364801    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-55fb09-openshift-default-dockercfg-z9mhl\""
Sep 11 21:22:50.376851 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:50.376822    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh"]
Sep 11 21:22:50.477294 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:50.477258    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8835434a-feed-4a67-bbfa-7899cc5938aa-istio-envoy\") pod \"e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh\" (UID: \"8835434a-feed-4a67-bbfa-7899cc5938aa\") " pod="openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh"
Sep 11 21:22:50.477484 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:50.477364    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sbf5\" (UniqueName: \"kubernetes.io/projected/8835434a-feed-4a67-bbfa-7899cc5938aa-kube-api-access-5sbf5\") pod \"e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh\" (UID: \"8835434a-feed-4a67-bbfa-7899cc5938aa\") " pod="openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh"
Sep 11 21:22:50.477484 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:50.477438    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8835434a-feed-4a67-bbfa-7899cc5938aa-istio-podinfo\") pod \"e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh\" (UID: \"8835434a-feed-4a67-bbfa-7899cc5938aa\") " pod="openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh"
Sep 11 21:22:50.477484 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:50.477462    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8835434a-feed-4a67-bbfa-7899cc5938aa-workload-socket\") pod \"e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh\" (UID: \"8835434a-feed-4a67-bbfa-7899cc5938aa\") " pod="openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh"
Sep 11 21:22:50.477607 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:50.477513    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8835434a-feed-4a67-bbfa-7899cc5938aa-istio-token\") pod \"e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh\" (UID: \"8835434a-feed-4a67-bbfa-7899cc5938aa\") " pod="openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh"
Sep 11 21:22:50.477607 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:50.477547    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8835434a-feed-4a67-bbfa-7899cc5938aa-istiod-ca-cert\") pod \"e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh\" (UID: \"8835434a-feed-4a67-bbfa-7899cc5938aa\") " pod="openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh"
Sep 11 21:22:50.477607 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:50.477591    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8835434a-feed-4a67-bbfa-7899cc5938aa-istio-data\") pod \"e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh\" (UID: \"8835434a-feed-4a67-bbfa-7899cc5938aa\") " pod="openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh"
Sep 11 21:22:50.477708 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:50.477610    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8835434a-feed-4a67-bbfa-7899cc5938aa-credential-socket\") pod \"e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh\" (UID: \"8835434a-feed-4a67-bbfa-7899cc5938aa\") " pod="openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh"
Sep 11 21:22:50.477708 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:50.477654    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8835434a-feed-4a67-bbfa-7899cc5938aa-workload-certs\") pod \"e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh\" (UID: \"8835434a-feed-4a67-bbfa-7899cc5938aa\") " pod="openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh"
Sep 11 21:22:50.578529 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:50.578487    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8835434a-feed-4a67-bbfa-7899cc5938aa-workload-certs\") pod \"e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh\" (UID: \"8835434a-feed-4a67-bbfa-7899cc5938aa\") " pod="openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh"
Sep 11 21:22:50.578719 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:50.578567    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8835434a-feed-4a67-bbfa-7899cc5938aa-istio-envoy\") pod \"e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh\" (UID: \"8835434a-feed-4a67-bbfa-7899cc5938aa\") " pod="openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh"
Sep 11 21:22:50.578719 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:50.578660    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sbf5\" (UniqueName: \"kubernetes.io/projected/8835434a-feed-4a67-bbfa-7899cc5938aa-kube-api-access-5sbf5\") pod \"e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh\" (UID: \"8835434a-feed-4a67-bbfa-7899cc5938aa\") " pod="openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh"
Sep 11 21:22:50.578821 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:50.578716    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8835434a-feed-4a67-bbfa-7899cc5938aa-istio-podinfo\") pod \"e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh\" (UID: \"8835434a-feed-4a67-bbfa-7899cc5938aa\") " pod="openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh"
Sep 11 21:22:50.578821 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:50.578750    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8835434a-feed-4a67-bbfa-7899cc5938aa-workload-socket\") pod \"e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh\" (UID: \"8835434a-feed-4a67-bbfa-7899cc5938aa\") " pod="openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh"
Sep 11 21:22:50.578821 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:50.578781    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8835434a-feed-4a67-bbfa-7899cc5938aa-istio-token\") pod \"e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh\" (UID: \"8835434a-feed-4a67-bbfa-7899cc5938aa\") " pod="openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh"
Sep 11 21:22:50.578821 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:50.578814    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8835434a-feed-4a67-bbfa-7899cc5938aa-istiod-ca-cert\") pod \"e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh\" (UID: \"8835434a-feed-4a67-bbfa-7899cc5938aa\") " pod="openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh"
Sep 11 21:22:50.579003 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:50.578863    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8835434a-feed-4a67-bbfa-7899cc5938aa-istio-data\") pod \"e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh\" (UID: \"8835434a-feed-4a67-bbfa-7899cc5938aa\") " pod="openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh"
Sep 11 21:22:50.579003 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:50.578903    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8835434a-feed-4a67-bbfa-7899cc5938aa-credential-socket\") pod \"e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh\" (UID: \"8835434a-feed-4a67-bbfa-7899cc5938aa\") " pod="openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh"
Sep 11 21:22:50.579343 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:50.579320    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8835434a-feed-4a67-bbfa-7899cc5938aa-credential-socket\") pod \"e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh\" (UID: \"8835434a-feed-4a67-bbfa-7899cc5938aa\") " pod="openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh"
Sep 11 21:22:50.579620 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:50.579601    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8835434a-feed-4a67-bbfa-7899cc5938aa-workload-certs\") pod \"e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh\" (UID: \"8835434a-feed-4a67-bbfa-7899cc5938aa\") " pod="openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh"
Sep 11 21:22:50.580164 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:50.580138    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8835434a-feed-4a67-bbfa-7899cc5938aa-workload-socket\") pod \"e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh\" (UID: \"8835434a-feed-4a67-bbfa-7899cc5938aa\") " pod="openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh"
Sep 11 21:22:50.580769 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:50.580719    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8835434a-feed-4a67-bbfa-7899cc5938aa-istiod-ca-cert\") pod \"e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh\" (UID: \"8835434a-feed-4a67-bbfa-7899cc5938aa\") " pod="openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh"
Sep 11 21:22:50.580961 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:50.580935    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8835434a-feed-4a67-bbfa-7899cc5938aa-istio-data\") pod \"e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh\" (UID: \"8835434a-feed-4a67-bbfa-7899cc5938aa\") " pod="openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh"
Sep 11 21:22:50.583891 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:50.583677    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8835434a-feed-4a67-bbfa-7899cc5938aa-istio-podinfo\") pod \"e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh\" (UID: \"8835434a-feed-4a67-bbfa-7899cc5938aa\") " pod="openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh"
Sep 11 21:22:50.583891 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:50.583849    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8835434a-feed-4a67-bbfa-7899cc5938aa-istio-envoy\") pod \"e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh\" (UID: \"8835434a-feed-4a67-bbfa-7899cc5938aa\") " pod="openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh"
Sep 11 21:22:50.592412 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:50.592112    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8835434a-feed-4a67-bbfa-7899cc5938aa-istio-token\") pod \"e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh\" (UID: \"8835434a-feed-4a67-bbfa-7899cc5938aa\") " pod="openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh"
Sep 11 21:22:50.592412 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:50.592352    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sbf5\" (UniqueName: \"kubernetes.io/projected/8835434a-feed-4a67-bbfa-7899cc5938aa-kube-api-access-5sbf5\") pod \"e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh\" (UID: \"8835434a-feed-4a67-bbfa-7899cc5938aa\") " pod="openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh"
Sep 11 21:22:50.673330 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:50.673288    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh"
Sep 11 21:22:50.950551 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:50.950520    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh"]
Sep 11 21:22:50.951969 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:22:50.951941    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8835434a_feed_4a67_bbfa_7899cc5938aa.slice/crio-ad6285266c98828c28f483123ba82a4a3e1d8c5ae1dc670baf7eb5ac0ef67cb6 WatchSource:0}: Error finding container ad6285266c98828c28f483123ba82a4a3e1d8c5ae1dc670baf7eb5ac0ef67cb6: Status 404 returned error can't find the container with id ad6285266c98828c28f483123ba82a4a3e1d8c5ae1dc670baf7eb5ac0ef67cb6
Sep 11 21:22:50.954307 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:50.954278    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:22:50.954417 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:50.954359    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:22:50.954496 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:50.954434    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:22:51.066459 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:51.066416    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh" event={"ID":"8835434a-feed-4a67-bbfa-7899cc5938aa","Type":"ContainerStarted","Data":"40dcfa803f4f75e2238494c402703aa68121fc90367eef928366c3074ce5d3c9"}
Sep 11 21:22:51.066618 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:51.066489    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh" event={"ID":"8835434a-feed-4a67-bbfa-7899cc5938aa","Type":"ContainerStarted","Data":"ad6285266c98828c28f483123ba82a4a3e1d8c5ae1dc670baf7eb5ac0ef67cb6"}
Sep 11 21:22:51.088736 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:51.088674    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh" podStartSLOduration=1.088656345 podStartE2EDuration="1.088656345s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:22:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:22:51.087571171 +0000 UTC m=+1016.565883015" watchObservedRunningTime="2026-09-11 21:22:51.088656345 +0000 UTC m=+1016.566968210"
Sep 11 21:22:51.673889 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:51.673824    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh"
Sep 11 21:22:52.679133 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:52.679107    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh"
Sep 11 21:22:53.079920 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:53.079831    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh"
Sep 11 21:22:53.081016 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:53.080992    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh"
Sep 11 21:22:53.242131 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:53.242098    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd"]
Sep 11 21:22:53.242369 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:53.242343    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd" podUID="dee333c4-368c-4f23-a086-e62bdbc58ca0" containerName="istio-proxy" containerID="cri-o://c7bf00ca7266d22205b3130eacc6485387e380a0722edaee3ebec63ecb14805a" gracePeriod=30
Sep 11 21:22:56.942350 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:56.942316    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-55fb09-74998c669-5g8x5"]
Sep 11 21:22:56.945971 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:56.945949    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-55fb09-74998c669-5g8x5"
Sep 11 21:22:56.952226 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:56.952197    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-55fb09-dockercfg-l85cm\""
Sep 11 21:22:56.952442 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:56.952242    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-55fb09\""
Sep 11 21:22:56.958736 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:56.958712    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-55fb09-74998c669-5g8x5"]
Sep 11 21:22:57.054473 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:57.051525    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96aa0df2-4abc-4697-bb36-2827069e2325-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-55fb09-74998c669-5g8x5\" (UID: \"96aa0df2-4abc-4697-bb36-2827069e2325\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-55fb09-74998c669-5g8x5"
Sep 11 21:22:57.054473 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:57.051795    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz4zw\" (UniqueName: \"kubernetes.io/projected/96aa0df2-4abc-4697-bb36-2827069e2325-kube-api-access-qz4zw\") pod \"payload-processing-e2e-shared-b-w2-55fb09-74998c669-5g8x5\" (UID: \"96aa0df2-4abc-4697-bb36-2827069e2325\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-55fb09-74998c669-5g8x5"
Sep 11 21:22:57.152461 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:57.152424    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz4zw\" (UniqueName: \"kubernetes.io/projected/96aa0df2-4abc-4697-bb36-2827069e2325-kube-api-access-qz4zw\") pod \"payload-processing-e2e-shared-b-w2-55fb09-74998c669-5g8x5\" (UID: \"96aa0df2-4abc-4697-bb36-2827069e2325\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-55fb09-74998c669-5g8x5"
Sep 11 21:22:57.152645 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:57.152476    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96aa0df2-4abc-4697-bb36-2827069e2325-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-55fb09-74998c669-5g8x5\" (UID: \"96aa0df2-4abc-4697-bb36-2827069e2325\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-55fb09-74998c669-5g8x5"
Sep 11 21:22:57.153170 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:57.153151    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96aa0df2-4abc-4697-bb36-2827069e2325-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-55fb09-74998c669-5g8x5\" (UID: \"96aa0df2-4abc-4697-bb36-2827069e2325\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-55fb09-74998c669-5g8x5"
Sep 11 21:22:57.161118 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:57.161084    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz4zw\" (UniqueName: \"kubernetes.io/projected/96aa0df2-4abc-4697-bb36-2827069e2325-kube-api-access-qz4zw\") pod \"payload-processing-e2e-shared-b-w2-55fb09-74998c669-5g8x5\" (UID: \"96aa0df2-4abc-4697-bb36-2827069e2325\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-55fb09-74998c669-5g8x5"
Sep 11 21:22:57.258233 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:57.258107    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-55fb09-74998c669-5g8x5"
Sep 11 21:22:57.536947 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:57.536911    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-55fb09-74998c669-5g8x5"]
Sep 11 21:22:57.538427 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:22:57.538399    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96aa0df2_4abc_4697_bb36_2827069e2325.slice/crio-bff6a2646bd2390e9ad588e9fc0c18b6f0c7d5b6a39a89d1d26b30547be4e334 WatchSource:0}: Error finding container bff6a2646bd2390e9ad588e9fc0c18b6f0c7d5b6a39a89d1d26b30547be4e334: Status 404 returned error can't find the container with id bff6a2646bd2390e9ad588e9fc0c18b6f0c7d5b6a39a89d1d26b30547be4e334
Sep 11 21:22:58.108448 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:58.108408    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-55fb09-74998c669-5g8x5" event={"ID":"96aa0df2-4abc-4697-bb36-2827069e2325","Type":"ContainerStarted","Data":"7ea9403c41701e6548ff53d3391340fe0ba5bcf66dfdcb75773473cf6e6b1a31"}
Sep 11 21:22:58.108841 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:58.108465    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-55fb09-74998c669-5g8x5" event={"ID":"96aa0df2-4abc-4697-bb36-2827069e2325","Type":"ContainerStarted","Data":"bff6a2646bd2390e9ad588e9fc0c18b6f0c7d5b6a39a89d1d26b30547be4e334"}
Sep 11 21:22:58.108841 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:58.108504    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-55fb09-74998c669-5g8x5"
Sep 11 21:22:58.127924 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:58.127876    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-55fb09-74998c669-5g8x5" podStartSLOduration=2.127860624 podStartE2EDuration="2.127860624s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:22:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:22:58.126014755 +0000 UTC m=+1023.604326600" watchObservedRunningTime="2026-09-11 21:22:58.127860624 +0000 UTC m=+1023.606172537"
Sep 11 21:22:58.497795 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:58.497770    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd"
Sep 11 21:22:58.568630 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:58.568594    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dee333c4-368c-4f23-a086-e62bdbc58ca0-istio-token\") pod \"dee333c4-368c-4f23-a086-e62bdbc58ca0\" (UID: \"dee333c4-368c-4f23-a086-e62bdbc58ca0\") "
Sep 11 21:22:58.568795 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:58.568697    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dee333c4-368c-4f23-a086-e62bdbc58ca0-credential-socket\") pod \"dee333c4-368c-4f23-a086-e62bdbc58ca0\" (UID: \"dee333c4-368c-4f23-a086-e62bdbc58ca0\") "
Sep 11 21:22:58.568795 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:58.568736    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dee333c4-368c-4f23-a086-e62bdbc58ca0-istiod-ca-cert\") pod \"dee333c4-368c-4f23-a086-e62bdbc58ca0\" (UID: \"dee333c4-368c-4f23-a086-e62bdbc58ca0\") "
Sep 11 21:22:58.568795 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:58.568777    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x69kc\" (UniqueName: \"kubernetes.io/projected/dee333c4-368c-4f23-a086-e62bdbc58ca0-kube-api-access-x69kc\") pod \"dee333c4-368c-4f23-a086-e62bdbc58ca0\" (UID: \"dee333c4-368c-4f23-a086-e62bdbc58ca0\") "
Sep 11 21:22:58.568959 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:58.568819    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dee333c4-368c-4f23-a086-e62bdbc58ca0-workload-certs\") pod \"dee333c4-368c-4f23-a086-e62bdbc58ca0\" (UID: \"dee333c4-368c-4f23-a086-e62bdbc58ca0\") "
Sep 11 21:22:58.568959 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:58.568883    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dee333c4-368c-4f23-a086-e62bdbc58ca0-istio-podinfo\") pod \"dee333c4-368c-4f23-a086-e62bdbc58ca0\" (UID: \"dee333c4-368c-4f23-a086-e62bdbc58ca0\") "
Sep 11 21:22:58.568959 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:58.568911    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dee333c4-368c-4f23-a086-e62bdbc58ca0-istio-envoy\") pod \"dee333c4-368c-4f23-a086-e62bdbc58ca0\" (UID: \"dee333c4-368c-4f23-a086-e62bdbc58ca0\") "
Sep 11 21:22:58.569110 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:58.568962    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dee333c4-368c-4f23-a086-e62bdbc58ca0-workload-socket\") pod \"dee333c4-368c-4f23-a086-e62bdbc58ca0\" (UID: \"dee333c4-368c-4f23-a086-e62bdbc58ca0\") "
Sep 11 21:22:58.569110 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:58.569037    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dee333c4-368c-4f23-a086-e62bdbc58ca0-istio-data\") pod \"dee333c4-368c-4f23-a086-e62bdbc58ca0\" (UID: \"dee333c4-368c-4f23-a086-e62bdbc58ca0\") "
Sep 11 21:22:58.569110 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:58.569049    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dee333c4-368c-4f23-a086-e62bdbc58ca0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dee333c4-368c-4f23-a086-e62bdbc58ca0" (UID: "dee333c4-368c-4f23-a086-e62bdbc58ca0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:22:58.569243 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:58.569220    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dee333c4-368c-4f23-a086-e62bdbc58ca0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dee333c4-368c-4f23-a086-e62bdbc58ca0" (UID: "dee333c4-368c-4f23-a086-e62bdbc58ca0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:22:58.569514 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:58.569449    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dee333c4-368c-4f23-a086-e62bdbc58ca0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dee333c4-368c-4f23-a086-e62bdbc58ca0" (UID: "dee333c4-368c-4f23-a086-e62bdbc58ca0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:22:58.569514 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:58.569461    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dee333c4-368c-4f23-a086-e62bdbc58ca0-istio-data" (OuterVolumeSpecName: "istio-data") pod "dee333c4-368c-4f23-a086-e62bdbc58ca0" (UID: "dee333c4-368c-4f23-a086-e62bdbc58ca0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:22:58.569715 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:58.569533    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dee333c4-368c-4f23-a086-e62bdbc58ca0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dee333c4-368c-4f23-a086-e62bdbc58ca0" (UID: "dee333c4-368c-4f23-a086-e62bdbc58ca0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:22:58.569783 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:58.569744    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dee333c4-368c-4f23-a086-e62bdbc58ca0-workload-socket\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:22:58.569783 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:58.569765    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dee333c4-368c-4f23-a086-e62bdbc58ca0-istio-data\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:22:58.569783 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:58.569780    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dee333c4-368c-4f23-a086-e62bdbc58ca0-credential-socket\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:22:58.570007 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:58.569796    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dee333c4-368c-4f23-a086-e62bdbc58ca0-istiod-ca-cert\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:22:58.570007 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:58.569809    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dee333c4-368c-4f23-a086-e62bdbc58ca0-workload-certs\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:22:58.571041 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:58.571014    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dee333c4-368c-4f23-a086-e62bdbc58ca0-istio-token" (OuterVolumeSpecName: "istio-token") pod "dee333c4-368c-4f23-a086-e62bdbc58ca0" (UID: "dee333c4-368c-4f23-a086-e62bdbc58ca0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:22:58.571133 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:58.571066    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dee333c4-368c-4f23-a086-e62bdbc58ca0-kube-api-access-x69kc" (OuterVolumeSpecName: "kube-api-access-x69kc") pod "dee333c4-368c-4f23-a086-e62bdbc58ca0" (UID: "dee333c4-368c-4f23-a086-e62bdbc58ca0"). InnerVolumeSpecName "kube-api-access-x69kc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:22:58.571133 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:58.571085    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dee333c4-368c-4f23-a086-e62bdbc58ca0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dee333c4-368c-4f23-a086-e62bdbc58ca0" (UID: "dee333c4-368c-4f23-a086-e62bdbc58ca0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:22:58.571292 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:58.571272    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dee333c4-368c-4f23-a086-e62bdbc58ca0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dee333c4-368c-4f23-a086-e62bdbc58ca0" (UID: "dee333c4-368c-4f23-a086-e62bdbc58ca0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 21:22:58.671272 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:58.671187    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x69kc\" (UniqueName: \"kubernetes.io/projected/dee333c4-368c-4f23-a086-e62bdbc58ca0-kube-api-access-x69kc\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:22:58.671272 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:58.671215    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dee333c4-368c-4f23-a086-e62bdbc58ca0-istio-podinfo\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:22:58.671272 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:58.671224    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dee333c4-368c-4f23-a086-e62bdbc58ca0-istio-envoy\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:22:58.671272 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:58.671234    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dee333c4-368c-4f23-a086-e62bdbc58ca0-istio-token\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:22:59.115659 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:59.115608    2560 generic.go:356] "Generic (PLEG): container finished" podID="dee333c4-368c-4f23-a086-e62bdbc58ca0" containerID="c7bf00ca7266d22205b3130eacc6485387e380a0722edaee3ebec63ecb14805a" exitCode=0
Sep 11 21:22:59.115659 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:59.115660    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd"
Sep 11 21:22:59.116129 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:59.115689    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd" event={"ID":"dee333c4-368c-4f23-a086-e62bdbc58ca0","Type":"ContainerDied","Data":"c7bf00ca7266d22205b3130eacc6485387e380a0722edaee3ebec63ecb14805a"}
Sep 11 21:22:59.116129 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:59.115734    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd" event={"ID":"dee333c4-368c-4f23-a086-e62bdbc58ca0","Type":"ContainerDied","Data":"067e6fdacfb0e3e85b340a19ed209998cb458fa8d4a432bbfb6ac57f1c944e4e"}
Sep 11 21:22:59.116129 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:59.115756    2560 scope.go:117] "RemoveContainer" containerID="c7bf00ca7266d22205b3130eacc6485387e380a0722edaee3ebec63ecb14805a"
Sep 11 21:22:59.125147 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:59.125129    2560 scope.go:117] "RemoveContainer" containerID="c7bf00ca7266d22205b3130eacc6485387e380a0722edaee3ebec63ecb14805a"
Sep 11 21:22:59.125444 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:22:59.125423    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7bf00ca7266d22205b3130eacc6485387e380a0722edaee3ebec63ecb14805a\": container with ID starting with c7bf00ca7266d22205b3130eacc6485387e380a0722edaee3ebec63ecb14805a not found: ID does not exist" containerID="c7bf00ca7266d22205b3130eacc6485387e380a0722edaee3ebec63ecb14805a"
Sep 11 21:22:59.125547 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:59.125450    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7bf00ca7266d22205b3130eacc6485387e380a0722edaee3ebec63ecb14805a"} err="failed to get container status \"c7bf00ca7266d22205b3130eacc6485387e380a0722edaee3ebec63ecb14805a\": rpc error: code = NotFound desc = could not find container \"c7bf00ca7266d22205b3130eacc6485387e380a0722edaee3ebec63ecb14805a\": container with ID starting with c7bf00ca7266d22205b3130eacc6485387e380a0722edaee3ebec63ecb14805a not found: ID does not exist"
Sep 11 21:22:59.133991 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:59.133969    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd"]
Sep 11 21:22:59.142044 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:22:59.142025    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd"]
Sep 11 21:23:01.038395 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:01.038359    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dee333c4-368c-4f23-a086-e62bdbc58ca0" path="/var/lib/kubelet/pods/dee333c4-368c-4f23-a086-e62bdbc58ca0/volumes"
Sep 11 21:23:05.580480 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:05.580444    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-26462a-75c6958dff-gnp6v"]
Sep 11 21:23:05.580959 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:05.580741    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-26462a-75c6958dff-gnp6v" podUID="d778faff-d07b-40e4-a46a-e103ed4485fb" containerName="payload-processing" containerID="cri-o://f056c915aa8d5d89f0ea28569f0915d8cfe9a6c1c8091126eaabe9407b632d24" gracePeriod=30
Sep 11 21:23:05.588628 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:05.588592    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-26462a-854bf7ff54-2zldl"]
Sep 11 21:23:05.589345 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:05.588835    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-26462a-854bf7ff54-2zldl" podUID="d1178699-07be-4028-8579-394c3aabb22c" containerName="payload-pre-processing" containerID="cri-o://bb980bc6060a4e571bcfcb8d90c4c74a8a8f1b7645f204aca7a8969b9e1b462f" gracePeriod=30
Sep 11 21:23:05.899059 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:05.899034    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-26462a-75c6958dff-gnp6v"
Sep 11 21:23:05.901138 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:05.901117    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-26462a-854bf7ff54-2zldl"
Sep 11 21:23:06.055041 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:06.055005    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d778faff-d07b-40e4-a46a-e103ed4485fb-plugins-config-volume\") pod \"d778faff-d07b-40e4-a46a-e103ed4485fb\" (UID: \"d778faff-d07b-40e4-a46a-e103ed4485fb\") "
Sep 11 21:23:06.055212 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:06.055078    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6nst\" (UniqueName: \"kubernetes.io/projected/d1178699-07be-4028-8579-394c3aabb22c-kube-api-access-x6nst\") pod \"d1178699-07be-4028-8579-394c3aabb22c\" (UID: \"d1178699-07be-4028-8579-394c3aabb22c\") "
Sep 11 21:23:06.055212 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:06.055158    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1178699-07be-4028-8579-394c3aabb22c-plugins-config-volume\") pod \"d1178699-07be-4028-8579-394c3aabb22c\" (UID: \"d1178699-07be-4028-8579-394c3aabb22c\") "
Sep 11 21:23:06.055284 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:06.055225    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zs4jp\" (UniqueName: \"kubernetes.io/projected/d778faff-d07b-40e4-a46a-e103ed4485fb-kube-api-access-zs4jp\") pod \"d778faff-d07b-40e4-a46a-e103ed4485fb\" (UID: \"d778faff-d07b-40e4-a46a-e103ed4485fb\") "
Sep 11 21:23:06.055576 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:06.055546    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d778faff-d07b-40e4-a46a-e103ed4485fb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d778faff-d07b-40e4-a46a-e103ed4485fb" (UID: "d778faff-d07b-40e4-a46a-e103ed4485fb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:23:06.055676 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:06.055603    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1178699-07be-4028-8579-394c3aabb22c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d1178699-07be-4028-8579-394c3aabb22c" (UID: "d1178699-07be-4028-8579-394c3aabb22c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:23:06.055734 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:06.055720    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1178699-07be-4028-8579-394c3aabb22c-plugins-config-volume\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:23:06.055772 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:06.055758    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d778faff-d07b-40e4-a46a-e103ed4485fb-plugins-config-volume\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:23:06.057375 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:06.057336    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1178699-07be-4028-8579-394c3aabb22c-kube-api-access-x6nst" (OuterVolumeSpecName: "kube-api-access-x6nst") pod "d1178699-07be-4028-8579-394c3aabb22c" (UID: "d1178699-07be-4028-8579-394c3aabb22c"). InnerVolumeSpecName "kube-api-access-x6nst". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:23:06.057375 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:06.057373    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d778faff-d07b-40e4-a46a-e103ed4485fb-kube-api-access-zs4jp" (OuterVolumeSpecName: "kube-api-access-zs4jp") pod "d778faff-d07b-40e4-a46a-e103ed4485fb" (UID: "d778faff-d07b-40e4-a46a-e103ed4485fb"). InnerVolumeSpecName "kube-api-access-zs4jp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:23:06.156442 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:06.156341    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zs4jp\" (UniqueName: \"kubernetes.io/projected/d778faff-d07b-40e4-a46a-e103ed4485fb-kube-api-access-zs4jp\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:23:06.156442 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:06.156368    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6nst\" (UniqueName: \"kubernetes.io/projected/d1178699-07be-4028-8579-394c3aabb22c-kube-api-access-x6nst\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:23:06.166619 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:06.166591    2560 generic.go:356] "Generic (PLEG): container finished" podID="d1178699-07be-4028-8579-394c3aabb22c" containerID="bb980bc6060a4e571bcfcb8d90c4c74a8a8f1b7645f204aca7a8969b9e1b462f" exitCode=0
Sep 11 21:23:06.166810 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:06.166634    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-26462a-854bf7ff54-2zldl"
Sep 11 21:23:06.166810 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:06.166674    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-26462a-854bf7ff54-2zldl" event={"ID":"d1178699-07be-4028-8579-394c3aabb22c","Type":"ContainerDied","Data":"bb980bc6060a4e571bcfcb8d90c4c74a8a8f1b7645f204aca7a8969b9e1b462f"}
Sep 11 21:23:06.166810 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:06.166733    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-26462a-854bf7ff54-2zldl" event={"ID":"d1178699-07be-4028-8579-394c3aabb22c","Type":"ContainerDied","Data":"c21f8c109ee600eb53b0d2dddd399d26a5e5214bb8afe84052e6a2c9b9086727"}
Sep 11 21:23:06.166810 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:06.166767    2560 scope.go:117] "RemoveContainer" containerID="bb980bc6060a4e571bcfcb8d90c4c74a8a8f1b7645f204aca7a8969b9e1b462f"
Sep 11 21:23:06.168254 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:06.168227    2560 generic.go:356] "Generic (PLEG): container finished" podID="d778faff-d07b-40e4-a46a-e103ed4485fb" containerID="f056c915aa8d5d89f0ea28569f0915d8cfe9a6c1c8091126eaabe9407b632d24" exitCode=0
Sep 11 21:23:06.168416 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:06.168269    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-26462a-75c6958dff-gnp6v"
Sep 11 21:23:06.168416 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:06.168331    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-26462a-75c6958dff-gnp6v" event={"ID":"d778faff-d07b-40e4-a46a-e103ed4485fb","Type":"ContainerDied","Data":"f056c915aa8d5d89f0ea28569f0915d8cfe9a6c1c8091126eaabe9407b632d24"}
Sep 11 21:23:06.168416 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:06.168400    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-26462a-75c6958dff-gnp6v" event={"ID":"d778faff-d07b-40e4-a46a-e103ed4485fb","Type":"ContainerDied","Data":"057facc723fb20c0fdf5740a7ee05bcb62a4cc75fdd06bc3d088b42e506612d9"}
Sep 11 21:23:06.176654 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:06.176624    2560 scope.go:117] "RemoveContainer" containerID="bb980bc6060a4e571bcfcb8d90c4c74a8a8f1b7645f204aca7a8969b9e1b462f"
Sep 11 21:23:06.176919 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:23:06.176901    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb980bc6060a4e571bcfcb8d90c4c74a8a8f1b7645f204aca7a8969b9e1b462f\": container with ID starting with bb980bc6060a4e571bcfcb8d90c4c74a8a8f1b7645f204aca7a8969b9e1b462f not found: ID does not exist" containerID="bb980bc6060a4e571bcfcb8d90c4c74a8a8f1b7645f204aca7a8969b9e1b462f"
Sep 11 21:23:06.176980 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:06.176926    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb980bc6060a4e571bcfcb8d90c4c74a8a8f1b7645f204aca7a8969b9e1b462f"} err="failed to get container status \"bb980bc6060a4e571bcfcb8d90c4c74a8a8f1b7645f204aca7a8969b9e1b462f\": rpc error: code = NotFound desc = could not find container \"bb980bc6060a4e571bcfcb8d90c4c74a8a8f1b7645f204aca7a8969b9e1b462f\": container with ID starting with bb980bc6060a4e571bcfcb8d90c4c74a8a8f1b7645f204aca7a8969b9e1b462f not found: ID does not exist"
Sep 11 21:23:06.176980 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:06.176944    2560 scope.go:117] "RemoveContainer" containerID="f056c915aa8d5d89f0ea28569f0915d8cfe9a6c1c8091126eaabe9407b632d24"
Sep 11 21:23:06.185731 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:06.185717    2560 scope.go:117] "RemoveContainer" containerID="f056c915aa8d5d89f0ea28569f0915d8cfe9a6c1c8091126eaabe9407b632d24"
Sep 11 21:23:06.185982 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:23:06.185965    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f056c915aa8d5d89f0ea28569f0915d8cfe9a6c1c8091126eaabe9407b632d24\": container with ID starting with f056c915aa8d5d89f0ea28569f0915d8cfe9a6c1c8091126eaabe9407b632d24 not found: ID does not exist" containerID="f056c915aa8d5d89f0ea28569f0915d8cfe9a6c1c8091126eaabe9407b632d24"
Sep 11 21:23:06.186038 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:06.185987    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f056c915aa8d5d89f0ea28569f0915d8cfe9a6c1c8091126eaabe9407b632d24"} err="failed to get container status \"f056c915aa8d5d89f0ea28569f0915d8cfe9a6c1c8091126eaabe9407b632d24\": rpc error: code = NotFound desc = could not find container \"f056c915aa8d5d89f0ea28569f0915d8cfe9a6c1c8091126eaabe9407b632d24\": container with ID starting with f056c915aa8d5d89f0ea28569f0915d8cfe9a6c1c8091126eaabe9407b632d24 not found: ID does not exist"
Sep 11 21:23:06.196994 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:06.196966    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-26462a-854bf7ff54-2zldl"]
Sep 11 21:23:06.206081 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:06.206055    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-26462a-854bf7ff54-2zldl"]
Sep 11 21:23:06.217325 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:06.217291    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-26462a-75c6958dff-gnp6v"]
Sep 11 21:23:06.219707 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:06.219686    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-26462a-75c6958dff-gnp6v"]
Sep 11 21:23:07.038528 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:07.038493    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1178699-07be-4028-8579-394c3aabb22c" path="/var/lib/kubelet/pods/d1178699-07be-4028-8579-394c3aabb22c/volumes"
Sep 11 21:23:07.038911 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:07.038897    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d778faff-d07b-40e4-a46a-e103ed4485fb" path="/var/lib/kubelet/pods/d778faff-d07b-40e4-a46a-e103ed4485fb/volumes"
Sep 11 21:23:09.118351 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:09.118316    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-55fb09-74998c669-5g8x5"
Sep 11 21:23:12.145867 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:12.145827    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw"]
Sep 11 21:23:12.146315 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:12.146146    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw" podUID="2e45340b-c693-4168-951b-a3df79f884f6" containerName="istio-proxy" containerID="cri-o://0a900e73e0817d72db09943409ae82fc8653d7d63a4a62429da664806acd2084" gracePeriod=30
Sep 11 21:23:12.518265 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:12.518172    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2b95f8-mckr4"]
Sep 11 21:23:12.518737 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:12.518719    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1178699-07be-4028-8579-394c3aabb22c" containerName="payload-pre-processing"
Sep 11 21:23:12.518839 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:12.518739    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1178699-07be-4028-8579-394c3aabb22c" containerName="payload-pre-processing"
Sep 11 21:23:12.518839 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:12.518767    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d778faff-d07b-40e4-a46a-e103ed4485fb" containerName="payload-processing"
Sep 11 21:23:12.518839 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:12.518776    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d778faff-d07b-40e4-a46a-e103ed4485fb" containerName="payload-processing"
Sep 11 21:23:12.518839 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:12.518798    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dee333c4-368c-4f23-a086-e62bdbc58ca0" containerName="istio-proxy"
Sep 11 21:23:12.518839 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:12.518808    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="dee333c4-368c-4f23-a086-e62bdbc58ca0" containerName="istio-proxy"
Sep 11 21:23:12.519087 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:12.518910    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d778faff-d07b-40e4-a46a-e103ed4485fb" containerName="payload-processing"
Sep 11 21:23:12.519087 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:12.518926    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1178699-07be-4028-8579-394c3aabb22c" containerName="payload-pre-processing"
Sep 11 21:23:12.519087 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:12.518939    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="dee333c4-368c-4f23-a086-e62bdbc58ca0" containerName="istio-proxy"
Sep 11 21:23:12.523461 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:12.523440    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2b95f8-mckr4"
Sep 11 21:23:12.525745 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:12.525724    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 21:23:12.526017 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:12.525999    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bfm9g\""
Sep 11 21:23:12.530722 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:12.530701    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2b95f8-mckr4"]
Sep 11 21:23:12.632275 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:12.632241    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5c5e61a-c988-4f7c-9229-8abc689636b0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-2b95f8-mckr4\" (UID: \"a5c5e61a-c988-4f7c-9229-8abc689636b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2b95f8-mckr4"
Sep 11 21:23:12.733471 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:12.733430    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5c5e61a-c988-4f7c-9229-8abc689636b0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-2b95f8-mckr4\" (UID: \"a5c5e61a-c988-4f7c-9229-8abc689636b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2b95f8-mckr4"
Sep 11 21:23:12.734107 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:12.734083    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5c5e61a-c988-4f7c-9229-8abc689636b0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-2b95f8-mckr4\" (UID: \"a5c5e61a-c988-4f7c-9229-8abc689636b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2b95f8-mckr4"
Sep 11 21:23:12.836865 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:12.836765    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2b95f8-mckr4"
Sep 11 21:23:13.134286 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:13.134256    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2b95f8-mckr4"]
Sep 11 21:23:13.136871 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:23:13.136836    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5c5e61a_c988_4f7c_9229_8abc689636b0.slice/crio-9ced0d3dba6b0bea14c8951cab87198ef97101a080c5461b8ecfcba966037595 WatchSource:0}: Error finding container 9ced0d3dba6b0bea14c8951cab87198ef97101a080c5461b8ecfcba966037595: Status 404 returned error can't find the container with id 9ced0d3dba6b0bea14c8951cab87198ef97101a080c5461b8ecfcba966037595
Sep 11 21:23:13.225078 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:13.225043    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2b95f8-mckr4" event={"ID":"a5c5e61a-c988-4f7c-9229-8abc689636b0","Type":"ContainerStarted","Data":"9ced0d3dba6b0bea14c8951cab87198ef97101a080c5461b8ecfcba966037595"}
Sep 11 21:23:14.233436 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:14.233403    2560 generic.go:356] "Generic (PLEG): container finished" podID="a5c5e61a-c988-4f7c-9229-8abc689636b0" containerID="c0e69eaa9453ecec944422d5f391b85bfdcf3b7c9ef8d37664b1b16b305e3136" exitCode=0
Sep 11 21:23:14.233835 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:14.233508    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2b95f8-mckr4" event={"ID":"a5c5e61a-c988-4f7c-9229-8abc689636b0","Type":"ContainerDied","Data":"c0e69eaa9453ecec944422d5f391b85bfdcf3b7c9ef8d37664b1b16b305e3136"}
Sep 11 21:23:15.395418 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:15.395396    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2b95f8-mckr4"
Sep 11 21:23:15.462058 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:15.462015    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5c5e61a-c988-4f7c-9229-8abc689636b0-maas-api-service-ca\") pod \"a5c5e61a-c988-4f7c-9229-8abc689636b0\" (UID: \"a5c5e61a-c988-4f7c-9229-8abc689636b0\") "
Sep 11 21:23:15.462511 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:15.462485    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5c5e61a-c988-4f7c-9229-8abc689636b0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a5c5e61a-c988-4f7c-9229-8abc689636b0" (UID: "a5c5e61a-c988-4f7c-9229-8abc689636b0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:23:15.563684 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:15.563651    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5c5e61a-c988-4f7c-9229-8abc689636b0-maas-api-service-ca\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:23:16.246733 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:16.246698    2560 generic.go:356] "Generic (PLEG): container finished" podID="8835434a-feed-4a67-bbfa-7899cc5938aa" containerID="40dcfa803f4f75e2238494c402703aa68121fc90367eef928366c3074ce5d3c9" exitCode=0
Sep 11 21:23:16.246922 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:16.246770    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh" event={"ID":"8835434a-feed-4a67-bbfa-7899cc5938aa","Type":"ContainerDied","Data":"40dcfa803f4f75e2238494c402703aa68121fc90367eef928366c3074ce5d3c9"}
Sep 11 21:23:16.247360 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:16.247332    2560 scope.go:117] "RemoveContainer" containerID="40dcfa803f4f75e2238494c402703aa68121fc90367eef928366c3074ce5d3c9"
Sep 11 21:23:16.248288 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:16.248233    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2b95f8-mckr4"
Sep 11 21:23:16.248358 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:16.248235    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2b95f8-mckr4" event={"ID":"a5c5e61a-c988-4f7c-9229-8abc689636b0","Type":"ContainerDied","Data":"9ced0d3dba6b0bea14c8951cab87198ef97101a080c5461b8ecfcba966037595"}
Sep 11 21:23:16.248358 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:16.248335    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9ced0d3dba6b0bea14c8951cab87198ef97101a080c5461b8ecfcba966037595"
Sep 11 21:23:16.248674 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:16.248643    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:23:16.248766 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:16.248731    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:23:16.248836 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:16.248782    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:23:17.018291 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.018253    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k"]
Sep 11 21:23:17.019042 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.019021    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5c5e61a-c988-4f7c-9229-8abc689636b0" containerName="revoke-keys"
Sep 11 21:23:17.019092 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.019047    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5c5e61a-c988-4f7c-9229-8abc689636b0" containerName="revoke-keys"
Sep 11 21:23:17.019213 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.019201    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5c5e61a-c988-4f7c-9229-8abc689636b0" containerName="revoke-keys"
Sep 11 21:23:17.022889 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.022871    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k"
Sep 11 21:23:17.025322 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.025304    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-908a1435-openshift-default-dockercfg-5t87b\""
Sep 11 21:23:17.039522 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.039494    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k"]
Sep 11 21:23:17.089367 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.089318    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83caeb6f-14a3-45c4-bd3f-7c74a376e34e-workload-certs\") pod \"e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k\" (UID: \"83caeb6f-14a3-45c4-bd3f-7c74a376e34e\") " pod="openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k"
Sep 11 21:23:17.089583 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.089440    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83caeb6f-14a3-45c4-bd3f-7c74a376e34e-workload-socket\") pod \"e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k\" (UID: \"83caeb6f-14a3-45c4-bd3f-7c74a376e34e\") " pod="openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k"
Sep 11 21:23:17.089583 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.089479    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq6v2\" (UniqueName: \"kubernetes.io/projected/83caeb6f-14a3-45c4-bd3f-7c74a376e34e-kube-api-access-tq6v2\") pod \"e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k\" (UID: \"83caeb6f-14a3-45c4-bd3f-7c74a376e34e\") " pod="openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k"
Sep 11 21:23:17.089714 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.089578    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83caeb6f-14a3-45c4-bd3f-7c74a376e34e-istio-token\") pod \"e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k\" (UID: \"83caeb6f-14a3-45c4-bd3f-7c74a376e34e\") " pod="openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k"
Sep 11 21:23:17.089714 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.089624    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83caeb6f-14a3-45c4-bd3f-7c74a376e34e-istiod-ca-cert\") pod \"e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k\" (UID: \"83caeb6f-14a3-45c4-bd3f-7c74a376e34e\") " pod="openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k"
Sep 11 21:23:17.089714 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.089694    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83caeb6f-14a3-45c4-bd3f-7c74a376e34e-istio-envoy\") pod \"e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k\" (UID: \"83caeb6f-14a3-45c4-bd3f-7c74a376e34e\") " pod="openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k"
Sep 11 21:23:17.089875 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.089718    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83caeb6f-14a3-45c4-bd3f-7c74a376e34e-istio-data\") pod \"e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k\" (UID: \"83caeb6f-14a3-45c4-bd3f-7c74a376e34e\") " pod="openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k"
Sep 11 21:23:17.089875 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.089749    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83caeb6f-14a3-45c4-bd3f-7c74a376e34e-credential-socket\") pod \"e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k\" (UID: \"83caeb6f-14a3-45c4-bd3f-7c74a376e34e\") " pod="openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k"
Sep 11 21:23:17.089875 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.089792    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83caeb6f-14a3-45c4-bd3f-7c74a376e34e-istio-podinfo\") pod \"e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k\" (UID: \"83caeb6f-14a3-45c4-bd3f-7c74a376e34e\") " pod="openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k"
Sep 11 21:23:17.191583 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.191547    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83caeb6f-14a3-45c4-bd3f-7c74a376e34e-workload-certs\") pod \"e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k\" (UID: \"83caeb6f-14a3-45c4-bd3f-7c74a376e34e\") " pod="openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k"
Sep 11 21:23:17.191748 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.191639    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83caeb6f-14a3-45c4-bd3f-7c74a376e34e-workload-socket\") pod \"e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k\" (UID: \"83caeb6f-14a3-45c4-bd3f-7c74a376e34e\") " pod="openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k"
Sep 11 21:23:17.191748 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.191690    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tq6v2\" (UniqueName: \"kubernetes.io/projected/83caeb6f-14a3-45c4-bd3f-7c74a376e34e-kube-api-access-tq6v2\") pod \"e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k\" (UID: \"83caeb6f-14a3-45c4-bd3f-7c74a376e34e\") " pod="openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k"
Sep 11 21:23:17.191941 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.191770    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83caeb6f-14a3-45c4-bd3f-7c74a376e34e-istio-token\") pod \"e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k\" (UID: \"83caeb6f-14a3-45c4-bd3f-7c74a376e34e\") " pod="openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k"
Sep 11 21:23:17.191941 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.191803    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83caeb6f-14a3-45c4-bd3f-7c74a376e34e-istiod-ca-cert\") pod \"e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k\" (UID: \"83caeb6f-14a3-45c4-bd3f-7c74a376e34e\") " pod="openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k"
Sep 11 21:23:17.191941 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.191875    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83caeb6f-14a3-45c4-bd3f-7c74a376e34e-istio-envoy\") pod \"e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k\" (UID: \"83caeb6f-14a3-45c4-bd3f-7c74a376e34e\") " pod="openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k"
Sep 11 21:23:17.191941 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.191895    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83caeb6f-14a3-45c4-bd3f-7c74a376e34e-workload-certs\") pod \"e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k\" (UID: \"83caeb6f-14a3-45c4-bd3f-7c74a376e34e\") " pod="openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k"
Sep 11 21:23:17.191941 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.191916    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83caeb6f-14a3-45c4-bd3f-7c74a376e34e-istio-data\") pod \"e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k\" (UID: \"83caeb6f-14a3-45c4-bd3f-7c74a376e34e\") " pod="openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k"
Sep 11 21:23:17.192214 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.191948    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83caeb6f-14a3-45c4-bd3f-7c74a376e34e-credential-socket\") pod \"e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k\" (UID: \"83caeb6f-14a3-45c4-bd3f-7c74a376e34e\") " pod="openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k"
Sep 11 21:23:17.192214 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.192009    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83caeb6f-14a3-45c4-bd3f-7c74a376e34e-istio-podinfo\") pod \"e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k\" (UID: \"83caeb6f-14a3-45c4-bd3f-7c74a376e34e\") " pod="openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k"
Sep 11 21:23:17.192214 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.192131    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83caeb6f-14a3-45c4-bd3f-7c74a376e34e-workload-socket\") pod \"e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k\" (UID: \"83caeb6f-14a3-45c4-bd3f-7c74a376e34e\") " pod="openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k"
Sep 11 21:23:17.192426 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.192364    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83caeb6f-14a3-45c4-bd3f-7c74a376e34e-istio-data\") pod \"e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k\" (UID: \"83caeb6f-14a3-45c4-bd3f-7c74a376e34e\") " pod="openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k"
Sep 11 21:23:17.192781 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.192759    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83caeb6f-14a3-45c4-bd3f-7c74a376e34e-credential-socket\") pod \"e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k\" (UID: \"83caeb6f-14a3-45c4-bd3f-7c74a376e34e\") " pod="openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k"
Sep 11 21:23:17.192882 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.192864    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83caeb6f-14a3-45c4-bd3f-7c74a376e34e-istiod-ca-cert\") pod \"e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k\" (UID: \"83caeb6f-14a3-45c4-bd3f-7c74a376e34e\") " pod="openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k"
Sep 11 21:23:17.194532 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.194509    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83caeb6f-14a3-45c4-bd3f-7c74a376e34e-istio-envoy\") pod \"e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k\" (UID: \"83caeb6f-14a3-45c4-bd3f-7c74a376e34e\") " pod="openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k"
Sep 11 21:23:17.194688 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.194667    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83caeb6f-14a3-45c4-bd3f-7c74a376e34e-istio-podinfo\") pod \"e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k\" (UID: \"83caeb6f-14a3-45c4-bd3f-7c74a376e34e\") " pod="openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k"
Sep 11 21:23:17.200250 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.200230    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83caeb6f-14a3-45c4-bd3f-7c74a376e34e-istio-token\") pod \"e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k\" (UID: \"83caeb6f-14a3-45c4-bd3f-7c74a376e34e\") " pod="openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k"
Sep 11 21:23:17.200250 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.200239    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq6v2\" (UniqueName: \"kubernetes.io/projected/83caeb6f-14a3-45c4-bd3f-7c74a376e34e-kube-api-access-tq6v2\") pod \"e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k\" (UID: \"83caeb6f-14a3-45c4-bd3f-7c74a376e34e\") " pod="openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k"
Sep 11 21:23:17.287468 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.285514    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh" event={"ID":"8835434a-feed-4a67-bbfa-7899cc5938aa","Type":"ContainerStarted","Data":"5fa8f94cd9cdbe5cff8bc58a66a8ee8c0291614a3095e8ba8b8f02b6cdd755b0"}
Sep 11 21:23:17.333404 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.333360    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k"
Sep 11 21:23:17.512184 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.512157    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw"
Sep 11 21:23:17.599903 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.599613    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e45340b-c693-4168-951b-a3df79f884f6-istio-envoy\") pod \"2e45340b-c693-4168-951b-a3df79f884f6\" (UID: \"2e45340b-c693-4168-951b-a3df79f884f6\") "
Sep 11 21:23:17.599903 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.599693    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e45340b-c693-4168-951b-a3df79f884f6-workload-socket\") pod \"2e45340b-c693-4168-951b-a3df79f884f6\" (UID: \"2e45340b-c693-4168-951b-a3df79f884f6\") "
Sep 11 21:23:17.599903 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.599736    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e45340b-c693-4168-951b-a3df79f884f6-istio-data\") pod \"2e45340b-c693-4168-951b-a3df79f884f6\" (UID: \"2e45340b-c693-4168-951b-a3df79f884f6\") "
Sep 11 21:23:17.599903 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.599764    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e45340b-c693-4168-951b-a3df79f884f6-istio-podinfo\") pod \"2e45340b-c693-4168-951b-a3df79f884f6\" (UID: \"2e45340b-c693-4168-951b-a3df79f884f6\") "
Sep 11 21:23:17.599903 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.599819    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e45340b-c693-4168-951b-a3df79f884f6-istiod-ca-cert\") pod \"2e45340b-c693-4168-951b-a3df79f884f6\" (UID: \"2e45340b-c693-4168-951b-a3df79f884f6\") "
Sep 11 21:23:17.599903 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.599857    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-stfzt\" (UniqueName: \"kubernetes.io/projected/2e45340b-c693-4168-951b-a3df79f884f6-kube-api-access-stfzt\") pod \"2e45340b-c693-4168-951b-a3df79f884f6\" (UID: \"2e45340b-c693-4168-951b-a3df79f884f6\") "
Sep 11 21:23:17.600462 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.599942    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e45340b-c693-4168-951b-a3df79f884f6-workload-certs\") pod \"2e45340b-c693-4168-951b-a3df79f884f6\" (UID: \"2e45340b-c693-4168-951b-a3df79f884f6\") "
Sep 11 21:23:17.600462 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.599975    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e45340b-c693-4168-951b-a3df79f884f6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2e45340b-c693-4168-951b-a3df79f884f6" (UID: "2e45340b-c693-4168-951b-a3df79f884f6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:23:17.600462 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.600034    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e45340b-c693-4168-951b-a3df79f884f6-credential-socket\") pod \"2e45340b-c693-4168-951b-a3df79f884f6\" (UID: \"2e45340b-c693-4168-951b-a3df79f884f6\") "
Sep 11 21:23:17.600462 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.600063    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e45340b-c693-4168-951b-a3df79f884f6-istio-token\") pod \"2e45340b-c693-4168-951b-a3df79f884f6\" (UID: \"2e45340b-c693-4168-951b-a3df79f884f6\") "
Sep 11 21:23:17.600462 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.600251    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e45340b-c693-4168-951b-a3df79f884f6-istio-data" (OuterVolumeSpecName: "istio-data") pod "2e45340b-c693-4168-951b-a3df79f884f6" (UID: "2e45340b-c693-4168-951b-a3df79f884f6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:23:17.600780 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.600519    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e45340b-c693-4168-951b-a3df79f884f6-workload-socket\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:23:17.600780 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.600541    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e45340b-c693-4168-951b-a3df79f884f6-istio-data\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:23:17.601237 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.601097    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e45340b-c693-4168-951b-a3df79f884f6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2e45340b-c693-4168-951b-a3df79f884f6" (UID: "2e45340b-c693-4168-951b-a3df79f884f6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:23:17.601340 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.601252    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e45340b-c693-4168-951b-a3df79f884f6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2e45340b-c693-4168-951b-a3df79f884f6" (UID: "2e45340b-c693-4168-951b-a3df79f884f6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:23:17.601471 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.601422    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e45340b-c693-4168-951b-a3df79f884f6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2e45340b-c693-4168-951b-a3df79f884f6" (UID: "2e45340b-c693-4168-951b-a3df79f884f6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:23:17.602816 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.602794    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e45340b-c693-4168-951b-a3df79f884f6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2e45340b-c693-4168-951b-a3df79f884f6" (UID: "2e45340b-c693-4168-951b-a3df79f884f6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:23:17.603612 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.603543    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2e45340b-c693-4168-951b-a3df79f884f6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2e45340b-c693-4168-951b-a3df79f884f6" (UID: "2e45340b-c693-4168-951b-a3df79f884f6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 21:23:17.603612 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.603573    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e45340b-c693-4168-951b-a3df79f884f6-kube-api-access-stfzt" (OuterVolumeSpecName: "kube-api-access-stfzt") pod "2e45340b-c693-4168-951b-a3df79f884f6" (UID: "2e45340b-c693-4168-951b-a3df79f884f6"). InnerVolumeSpecName "kube-api-access-stfzt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:23:17.603612 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.603592    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e45340b-c693-4168-951b-a3df79f884f6-istio-token" (OuterVolumeSpecName: "istio-token") pod "2e45340b-c693-4168-951b-a3df79f884f6" (UID: "2e45340b-c693-4168-951b-a3df79f884f6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:23:17.672422 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.672040    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k"]
Sep 11 21:23:17.686935 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.685799    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh"
Sep 11 21:23:17.686935 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.685931    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 11 21:23:17.686935 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.685983    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh" podUID="8835434a-feed-4a67-bbfa-7899cc5938aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 11 21:23:17.691724 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:23:17.691668    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83caeb6f_14a3_45c4_bd3f_7c74a376e34e.slice/crio-17f574c580add66063ba490c6aa8bfb3eba7bd5003488296219855035e7e97bd WatchSource:0}: Error finding container 17f574c580add66063ba490c6aa8bfb3eba7bd5003488296219855035e7e97bd: Status 404 returned error can't find the container with id 17f574c580add66063ba490c6aa8bfb3eba7bd5003488296219855035e7e97bd
Sep 11 21:23:17.693982 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.693951    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:23:17.694070 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.694020    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:23:17.694070 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.694050    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:23:17.702198 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.702175    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e45340b-c693-4168-951b-a3df79f884f6-istio-token\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:23:17.702252 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.702206    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e45340b-c693-4168-951b-a3df79f884f6-istio-envoy\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:23:17.702252 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.702219    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e45340b-c693-4168-951b-a3df79f884f6-istio-podinfo\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:23:17.702252 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.702232    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e45340b-c693-4168-951b-a3df79f884f6-istiod-ca-cert\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:23:17.702252 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.702247    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-stfzt\" (UniqueName: \"kubernetes.io/projected/2e45340b-c693-4168-951b-a3df79f884f6-kube-api-access-stfzt\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:23:17.702412 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.702259    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e45340b-c693-4168-951b-a3df79f884f6-workload-certs\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:23:17.702412 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:17.702273    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e45340b-c693-4168-951b-a3df79f884f6-credential-socket\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:23:18.293832 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:18.293799    2560 generic.go:356] "Generic (PLEG): container finished" podID="2e45340b-c693-4168-951b-a3df79f884f6" containerID="0a900e73e0817d72db09943409ae82fc8653d7d63a4a62429da664806acd2084" exitCode=0
Sep 11 21:23:18.294262 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:18.293858    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw"
Sep 11 21:23:18.294262 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:18.293892    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw" event={"ID":"2e45340b-c693-4168-951b-a3df79f884f6","Type":"ContainerDied","Data":"0a900e73e0817d72db09943409ae82fc8653d7d63a4a62429da664806acd2084"}
Sep 11 21:23:18.294262 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:18.293951    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw" event={"ID":"2e45340b-c693-4168-951b-a3df79f884f6","Type":"ContainerDied","Data":"08554efb61dc48305e9b52a9a94e43ce9b881b716a77cc20c65817f4a385440f"}
Sep 11 21:23:18.294262 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:18.293975    2560 scope.go:117] "RemoveContainer" containerID="0a900e73e0817d72db09943409ae82fc8653d7d63a4a62429da664806acd2084"
Sep 11 21:23:18.296016 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:18.295982    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k" event={"ID":"83caeb6f-14a3-45c4-bd3f-7c74a376e34e","Type":"ContainerStarted","Data":"f4bf73ce221f2cc718316148a6c54926b0f6b15b2b8fd574a240f9e90aba49e5"}
Sep 11 21:23:18.296143 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:18.296044    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k" event={"ID":"83caeb6f-14a3-45c4-bd3f-7c74a376e34e","Type":"ContainerStarted","Data":"17f574c580add66063ba490c6aa8bfb3eba7bd5003488296219855035e7e97bd"}
Sep 11 21:23:18.304553 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:18.304407    2560 scope.go:117] "RemoveContainer" containerID="e9a8d290056831174e6b6c3920d73892d2dd3026c8dd86985a4c1e53ca95d7a1"
Sep 11 21:23:18.313480 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:18.313456    2560 scope.go:117] "RemoveContainer" containerID="0a900e73e0817d72db09943409ae82fc8653d7d63a4a62429da664806acd2084"
Sep 11 21:23:18.313815 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:23:18.313796    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a900e73e0817d72db09943409ae82fc8653d7d63a4a62429da664806acd2084\": container with ID starting with 0a900e73e0817d72db09943409ae82fc8653d7d63a4a62429da664806acd2084 not found: ID does not exist" containerID="0a900e73e0817d72db09943409ae82fc8653d7d63a4a62429da664806acd2084"
Sep 11 21:23:18.313866 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:18.313825    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a900e73e0817d72db09943409ae82fc8653d7d63a4a62429da664806acd2084"} err="failed to get container status \"0a900e73e0817d72db09943409ae82fc8653d7d63a4a62429da664806acd2084\": rpc error: code = NotFound desc = could not find container \"0a900e73e0817d72db09943409ae82fc8653d7d63a4a62429da664806acd2084\": container with ID starting with 0a900e73e0817d72db09943409ae82fc8653d7d63a4a62429da664806acd2084 not found: ID does not exist"
Sep 11 21:23:18.313866 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:18.313845    2560 scope.go:117] "RemoveContainer" containerID="e9a8d290056831174e6b6c3920d73892d2dd3026c8dd86985a4c1e53ca95d7a1"
Sep 11 21:23:18.314143 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:23:18.314122    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9a8d290056831174e6b6c3920d73892d2dd3026c8dd86985a4c1e53ca95d7a1\": container with ID starting with e9a8d290056831174e6b6c3920d73892d2dd3026c8dd86985a4c1e53ca95d7a1 not found: ID does not exist" containerID="e9a8d290056831174e6b6c3920d73892d2dd3026c8dd86985a4c1e53ca95d7a1"
Sep 11 21:23:18.314206 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:18.314148    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9a8d290056831174e6b6c3920d73892d2dd3026c8dd86985a4c1e53ca95d7a1"} err="failed to get container status \"e9a8d290056831174e6b6c3920d73892d2dd3026c8dd86985a4c1e53ca95d7a1\": rpc error: code = NotFound desc = could not find container \"e9a8d290056831174e6b6c3920d73892d2dd3026c8dd86985a4c1e53ca95d7a1\": container with ID starting with e9a8d290056831174e6b6c3920d73892d2dd3026c8dd86985a4c1e53ca95d7a1 not found: ID does not exist"
Sep 11 21:23:18.319284 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:18.319237    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k" podStartSLOduration=2.319221279 podStartE2EDuration="2.319221279s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:23:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:23:18.317837227 +0000 UTC m=+1043.796149075" watchObservedRunningTime="2026-09-11 21:23:18.319221279 +0000 UTC m=+1043.797533123"
Sep 11 21:23:18.333557 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:18.333524    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k"
Sep 11 21:23:18.333976 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:18.333955    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw"]
Sep 11 21:23:18.339347 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:18.339323    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k"
Sep 11 21:23:18.339501 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:18.339445    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw"]
Sep 11 21:23:18.673711 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:18.673669    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 11 21:23:18.673927 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:18.673738    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh" podUID="8835434a-feed-4a67-bbfa-7899cc5938aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 11 21:23:19.039082 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:19.039004    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e45340b-c693-4168-951b-a3df79f884f6" path="/var/lib/kubelet/pods/2e45340b-c693-4168-951b-a3df79f884f6/volumes"
Sep 11 21:23:19.302876 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:19.302801    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k"
Sep 11 21:23:19.303910 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:19.303892    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k"
Sep 11 21:23:19.674830 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:19.674332    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 11 21:23:19.674830 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:19.674422    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh" podUID="8835434a-feed-4a67-bbfa-7899cc5938aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 11 21:23:20.674750 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:20.674703    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 11 21:23:20.675266 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:20.674777    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh" podUID="8835434a-feed-4a67-bbfa-7899cc5938aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 11 21:23:21.674282 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:21.674241    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 11 21:23:21.674609 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:21.674580    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh" podUID="8835434a-feed-4a67-bbfa-7899cc5938aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 11 21:23:22.678642 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:22.678613    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh"
Sep 11 21:23:22.679103 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:22.678898    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh"
Sep 11 21:23:22.679531 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:22.679515    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh"
Sep 11 21:23:23.856156 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:23.856120    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-908a1435-76bdf8d7b5-lq7k6"]
Sep 11 21:23:23.856820 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:23.856791    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e45340b-c693-4168-951b-a3df79f884f6" containerName="istio-proxy"
Sep 11 21:23:23.856820 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:23.856818    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e45340b-c693-4168-951b-a3df79f884f6" containerName="istio-proxy"
Sep 11 21:23:23.856980 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:23.856830    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e45340b-c693-4168-951b-a3df79f884f6" containerName="istio-proxy"
Sep 11 21:23:23.856980 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:23.856841    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e45340b-c693-4168-951b-a3df79f884f6" containerName="istio-proxy"
Sep 11 21:23:23.856980 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:23.856955    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e45340b-c693-4168-951b-a3df79f884f6" containerName="istio-proxy"
Sep 11 21:23:23.856980 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:23.856970    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e45340b-c693-4168-951b-a3df79f884f6" containerName="istio-proxy"
Sep 11 21:23:23.860796 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:23.860768    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-908a1435-76bdf8d7b5-lq7k6"
Sep 11 21:23:23.863787 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:23.863759    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-908a1435-dockercfg-696pm\""
Sep 11 21:23:23.864015 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:23.863991    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-908a1435\""
Sep 11 21:23:23.873497 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:23.873471    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-908a1435-76bdf8d7b5-lq7k6"]
Sep 11 21:23:23.970594 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:23.970557    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea471c43-5b57-4d62-904b-688718d7a94d-plugins-config-volume\") pod \"payload-processing-e2e-mt-908a1435-76bdf8d7b5-lq7k6\" (UID: \"ea471c43-5b57-4d62-904b-688718d7a94d\") " pod="openshift-ingress/payload-processing-e2e-mt-908a1435-76bdf8d7b5-lq7k6"
Sep 11 21:23:23.970787 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:23.970688    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl2vk\" (UniqueName: \"kubernetes.io/projected/ea471c43-5b57-4d62-904b-688718d7a94d-kube-api-access-gl2vk\") pod \"payload-processing-e2e-mt-908a1435-76bdf8d7b5-lq7k6\" (UID: \"ea471c43-5b57-4d62-904b-688718d7a94d\") " pod="openshift-ingress/payload-processing-e2e-mt-908a1435-76bdf8d7b5-lq7k6"
Sep 11 21:23:24.071999 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:24.071969    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea471c43-5b57-4d62-904b-688718d7a94d-plugins-config-volume\") pod \"payload-processing-e2e-mt-908a1435-76bdf8d7b5-lq7k6\" (UID: \"ea471c43-5b57-4d62-904b-688718d7a94d\") " pod="openshift-ingress/payload-processing-e2e-mt-908a1435-76bdf8d7b5-lq7k6"
Sep 11 21:23:24.072208 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:24.072048    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gl2vk\" (UniqueName: \"kubernetes.io/projected/ea471c43-5b57-4d62-904b-688718d7a94d-kube-api-access-gl2vk\") pod \"payload-processing-e2e-mt-908a1435-76bdf8d7b5-lq7k6\" (UID: \"ea471c43-5b57-4d62-904b-688718d7a94d\") " pod="openshift-ingress/payload-processing-e2e-mt-908a1435-76bdf8d7b5-lq7k6"
Sep 11 21:23:24.072955 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:24.072926    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea471c43-5b57-4d62-904b-688718d7a94d-plugins-config-volume\") pod \"payload-processing-e2e-mt-908a1435-76bdf8d7b5-lq7k6\" (UID: \"ea471c43-5b57-4d62-904b-688718d7a94d\") " pod="openshift-ingress/payload-processing-e2e-mt-908a1435-76bdf8d7b5-lq7k6"
Sep 11 21:23:24.086112 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:24.086058    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl2vk\" (UniqueName: \"kubernetes.io/projected/ea471c43-5b57-4d62-904b-688718d7a94d-kube-api-access-gl2vk\") pod \"payload-processing-e2e-mt-908a1435-76bdf8d7b5-lq7k6\" (UID: \"ea471c43-5b57-4d62-904b-688718d7a94d\") " pod="openshift-ingress/payload-processing-e2e-mt-908a1435-76bdf8d7b5-lq7k6"
Sep 11 21:23:24.173597 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:24.173563    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-908a1435-76bdf8d7b5-lq7k6"
Sep 11 21:23:24.249413 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:24.248708    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2b95f8-mckr4"]
Sep 11 21:23:24.252849 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:24.252824    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2b95f8-mckr4"]
Sep 11 21:23:24.460271 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:24.460244    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-908a1435-76bdf8d7b5-lq7k6"]
Sep 11 21:23:24.463186 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:23:24.463155    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea471c43_5b57_4d62_904b_688718d7a94d.slice/crio-855e5dbd59d16bef1935ce9ee86a7ab84a8e12fd2af2e986c76d4981cf8fe2ee WatchSource:0}: Error finding container 855e5dbd59d16bef1935ce9ee86a7ab84a8e12fd2af2e986c76d4981cf8fe2ee: Status 404 returned error can't find the container with id 855e5dbd59d16bef1935ce9ee86a7ab84a8e12fd2af2e986c76d4981cf8fe2ee
Sep 11 21:23:25.039289 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:25.039252    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5c5e61a-c988-4f7c-9229-8abc689636b0" path="/var/lib/kubelet/pods/a5c5e61a-c988-4f7c-9229-8abc689636b0/volumes"
Sep 11 21:23:25.353133 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:25.353035    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-908a1435-76bdf8d7b5-lq7k6" event={"ID":"ea471c43-5b57-4d62-904b-688718d7a94d","Type":"ContainerStarted","Data":"296f185bb0fa29e54184bc9168f830d8a1c42d37ee59ae286f375fe5dacc48d8"}
Sep 11 21:23:25.353133 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:25.353096    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-908a1435-76bdf8d7b5-lq7k6" event={"ID":"ea471c43-5b57-4d62-904b-688718d7a94d","Type":"ContainerStarted","Data":"855e5dbd59d16bef1935ce9ee86a7ab84a8e12fd2af2e986c76d4981cf8fe2ee"}
Sep 11 21:23:25.353133 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:25.353124    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-908a1435-76bdf8d7b5-lq7k6"
Sep 11 21:23:25.372802 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:25.372752    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-908a1435-76bdf8d7b5-lq7k6" podStartSLOduration=2.372737318 podStartE2EDuration="2.372737318s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:23:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:23:25.369441253 +0000 UTC m=+1050.847753097" watchObservedRunningTime="2026-09-11 21:23:25.372737318 +0000 UTC m=+1050.851049162"
Sep 11 21:23:30.693038 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:30.692994    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh"]
Sep 11 21:23:30.693570 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:30.693314    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh" podUID="d07f0c6e-53ed-4177-ae62-a74a27279132" containerName="istio-proxy" containerID="cri-o://5ee2aa95d935a25666f2ec80d20bbe1d583b3e281ad041e59e8e1972d4ecd8ef" gracePeriod=30
Sep 11 21:23:32.333425 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:32.333374    2560 patch_prober.go:28] interesting pod/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 21:23:32.333803 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:32.333461    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh" podUID="d07f0c6e-53ed-4177-ae62-a74a27279132" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 21:23:35.994196 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:35.994163    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh"
Sep 11 21:23:36.118714 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:36.118682    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d07f0c6e-53ed-4177-ae62-a74a27279132-istiod-ca-cert\") pod \"d07f0c6e-53ed-4177-ae62-a74a27279132\" (UID: \"d07f0c6e-53ed-4177-ae62-a74a27279132\") "
Sep 11 21:23:36.118714 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:36.118721    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d07f0c6e-53ed-4177-ae62-a74a27279132-istio-envoy\") pod \"d07f0c6e-53ed-4177-ae62-a74a27279132\" (UID: \"d07f0c6e-53ed-4177-ae62-a74a27279132\") "
Sep 11 21:23:36.118989 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:36.118760    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d07f0c6e-53ed-4177-ae62-a74a27279132-istio-token\") pod \"d07f0c6e-53ed-4177-ae62-a74a27279132\" (UID: \"d07f0c6e-53ed-4177-ae62-a74a27279132\") "
Sep 11 21:23:36.118989 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:36.118815    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d07f0c6e-53ed-4177-ae62-a74a27279132-istio-podinfo\") pod \"d07f0c6e-53ed-4177-ae62-a74a27279132\" (UID: \"d07f0c6e-53ed-4177-ae62-a74a27279132\") "
Sep 11 21:23:36.118989 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:36.118865    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d07f0c6e-53ed-4177-ae62-a74a27279132-workload-socket\") pod \"d07f0c6e-53ed-4177-ae62-a74a27279132\" (UID: \"d07f0c6e-53ed-4177-ae62-a74a27279132\") "
Sep 11 21:23:36.118989 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:36.118958    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d07f0c6e-53ed-4177-ae62-a74a27279132-workload-certs\") pod \"d07f0c6e-53ed-4177-ae62-a74a27279132\" (UID: \"d07f0c6e-53ed-4177-ae62-a74a27279132\") "
Sep 11 21:23:36.119189 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:36.118997    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d07f0c6e-53ed-4177-ae62-a74a27279132-credential-socket\") pod \"d07f0c6e-53ed-4177-ae62-a74a27279132\" (UID: \"d07f0c6e-53ed-4177-ae62-a74a27279132\") "
Sep 11 21:23:36.119189 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:36.119035    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d07f0c6e-53ed-4177-ae62-a74a27279132-istio-data\") pod \"d07f0c6e-53ed-4177-ae62-a74a27279132\" (UID: \"d07f0c6e-53ed-4177-ae62-a74a27279132\") "
Sep 11 21:23:36.119189 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:36.119065    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q2d7s\" (UniqueName: \"kubernetes.io/projected/d07f0c6e-53ed-4177-ae62-a74a27279132-kube-api-access-q2d7s\") pod \"d07f0c6e-53ed-4177-ae62-a74a27279132\" (UID: \"d07f0c6e-53ed-4177-ae62-a74a27279132\") "
Sep 11 21:23:36.119332 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:36.119185    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d07f0c6e-53ed-4177-ae62-a74a27279132-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d07f0c6e-53ed-4177-ae62-a74a27279132" (UID: "d07f0c6e-53ed-4177-ae62-a74a27279132"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:23:36.119332 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:36.119214    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d07f0c6e-53ed-4177-ae62-a74a27279132-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d07f0c6e-53ed-4177-ae62-a74a27279132" (UID: "d07f0c6e-53ed-4177-ae62-a74a27279132"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:23:36.119332 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:36.119283    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d07f0c6e-53ed-4177-ae62-a74a27279132-istio-data" (OuterVolumeSpecName: "istio-data") pod "d07f0c6e-53ed-4177-ae62-a74a27279132" (UID: "d07f0c6e-53ed-4177-ae62-a74a27279132"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:23:36.119682 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:36.119659    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d07f0c6e-53ed-4177-ae62-a74a27279132-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d07f0c6e-53ed-4177-ae62-a74a27279132" (UID: "d07f0c6e-53ed-4177-ae62-a74a27279132"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:23:36.119799 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:36.119661    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d07f0c6e-53ed-4177-ae62-a74a27279132-workload-socket\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:23:36.119799 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:36.119738    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d07f0c6e-53ed-4177-ae62-a74a27279132-workload-certs\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:23:36.119799 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:36.119757    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d07f0c6e-53ed-4177-ae62-a74a27279132-istio-data\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:23:36.120068 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:36.120041    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d07f0c6e-53ed-4177-ae62-a74a27279132-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d07f0c6e-53ed-4177-ae62-a74a27279132" (UID: "d07f0c6e-53ed-4177-ae62-a74a27279132"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:23:36.121614 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:36.121581    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d07f0c6e-53ed-4177-ae62-a74a27279132-kube-api-access-q2d7s" (OuterVolumeSpecName: "kube-api-access-q2d7s") pod "d07f0c6e-53ed-4177-ae62-a74a27279132" (UID: "d07f0c6e-53ed-4177-ae62-a74a27279132"). InnerVolumeSpecName "kube-api-access-q2d7s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:23:36.121829 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:36.121803    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d07f0c6e-53ed-4177-ae62-a74a27279132-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d07f0c6e-53ed-4177-ae62-a74a27279132" (UID: "d07f0c6e-53ed-4177-ae62-a74a27279132"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 21:23:36.121829 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:36.121815    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d07f0c6e-53ed-4177-ae62-a74a27279132-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d07f0c6e-53ed-4177-ae62-a74a27279132" (UID: "d07f0c6e-53ed-4177-ae62-a74a27279132"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:23:36.122023 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:36.122010    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d07f0c6e-53ed-4177-ae62-a74a27279132-istio-token" (OuterVolumeSpecName: "istio-token") pod "d07f0c6e-53ed-4177-ae62-a74a27279132" (UID: "d07f0c6e-53ed-4177-ae62-a74a27279132"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:23:36.221316 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:36.221232    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d07f0c6e-53ed-4177-ae62-a74a27279132-credential-socket\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:23:36.221316 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:36.221265    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2d7s\" (UniqueName: \"kubernetes.io/projected/d07f0c6e-53ed-4177-ae62-a74a27279132-kube-api-access-q2d7s\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:23:36.221316 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:36.221280    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d07f0c6e-53ed-4177-ae62-a74a27279132-istiod-ca-cert\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:23:36.221316 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:36.221293    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d07f0c6e-53ed-4177-ae62-a74a27279132-istio-envoy\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:23:36.221316 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:36.221305    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d07f0c6e-53ed-4177-ae62-a74a27279132-istio-token\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:23:36.221316 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:36.221315    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d07f0c6e-53ed-4177-ae62-a74a27279132-istio-podinfo\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:23:36.364336 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:36.364306    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-908a1435-76bdf8d7b5-lq7k6"
Sep 11 21:23:36.429585 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:36.429553    2560 generic.go:356] "Generic (PLEG): container finished" podID="d07f0c6e-53ed-4177-ae62-a74a27279132" containerID="5ee2aa95d935a25666f2ec80d20bbe1d583b3e281ad041e59e8e1972d4ecd8ef" exitCode=0
Sep 11 21:23:36.429779 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:36.429604    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh"
Sep 11 21:23:36.429779 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:36.429632    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh" event={"ID":"d07f0c6e-53ed-4177-ae62-a74a27279132","Type":"ContainerDied","Data":"5ee2aa95d935a25666f2ec80d20bbe1d583b3e281ad041e59e8e1972d4ecd8ef"}
Sep 11 21:23:36.429779 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:36.429689    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh" event={"ID":"d07f0c6e-53ed-4177-ae62-a74a27279132","Type":"ContainerDied","Data":"d9b6bdf821db4ed3219530cc818211428b3b329eaad5cae987032d06c491a47b"}
Sep 11 21:23:36.429779 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:36.429711    2560 scope.go:117] "RemoveContainer" containerID="5ee2aa95d935a25666f2ec80d20bbe1d583b3e281ad041e59e8e1972d4ecd8ef"
Sep 11 21:23:36.443328 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:36.443095    2560 scope.go:117] "RemoveContainer" containerID="3d27750afacb5c9dae46baf31476d57ec4b2f9ce2085caac5d0b0b0297cef42e"
Sep 11 21:23:36.456958 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:36.456932    2560 scope.go:117] "RemoveContainer" containerID="5ee2aa95d935a25666f2ec80d20bbe1d583b3e281ad041e59e8e1972d4ecd8ef"
Sep 11 21:23:36.457434 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:23:36.457376    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ee2aa95d935a25666f2ec80d20bbe1d583b3e281ad041e59e8e1972d4ecd8ef\": container with ID starting with 5ee2aa95d935a25666f2ec80d20bbe1d583b3e281ad041e59e8e1972d4ecd8ef not found: ID does not exist" containerID="5ee2aa95d935a25666f2ec80d20bbe1d583b3e281ad041e59e8e1972d4ecd8ef"
Sep 11 21:23:36.457554 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:36.457447    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ee2aa95d935a25666f2ec80d20bbe1d583b3e281ad041e59e8e1972d4ecd8ef"} err="failed to get container status \"5ee2aa95d935a25666f2ec80d20bbe1d583b3e281ad041e59e8e1972d4ecd8ef\": rpc error: code = NotFound desc = could not find container \"5ee2aa95d935a25666f2ec80d20bbe1d583b3e281ad041e59e8e1972d4ecd8ef\": container with ID starting with 5ee2aa95d935a25666f2ec80d20bbe1d583b3e281ad041e59e8e1972d4ecd8ef not found: ID does not exist"
Sep 11 21:23:36.457554 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:36.457474    2560 scope.go:117] "RemoveContainer" containerID="3d27750afacb5c9dae46baf31476d57ec4b2f9ce2085caac5d0b0b0297cef42e"
Sep 11 21:23:36.457875 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:23:36.457855    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d27750afacb5c9dae46baf31476d57ec4b2f9ce2085caac5d0b0b0297cef42e\": container with ID starting with 3d27750afacb5c9dae46baf31476d57ec4b2f9ce2085caac5d0b0b0297cef42e not found: ID does not exist" containerID="3d27750afacb5c9dae46baf31476d57ec4b2f9ce2085caac5d0b0b0297cef42e"
Sep 11 21:23:36.457945 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:36.457884    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d27750afacb5c9dae46baf31476d57ec4b2f9ce2085caac5d0b0b0297cef42e"} err="failed to get container status \"3d27750afacb5c9dae46baf31476d57ec4b2f9ce2085caac5d0b0b0297cef42e\": rpc error: code = NotFound desc = could not find container \"3d27750afacb5c9dae46baf31476d57ec4b2f9ce2085caac5d0b0b0297cef42e\": container with ID starting with 3d27750afacb5c9dae46baf31476d57ec4b2f9ce2085caac5d0b0b0297cef42e not found: ID does not exist"
Sep 11 21:23:36.460759 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:36.460737    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh"]
Sep 11 21:23:36.464435 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:36.464405    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh"]
Sep 11 21:23:37.038743 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:37.038709    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d07f0c6e-53ed-4177-ae62-a74a27279132" path="/var/lib/kubelet/pods/d07f0c6e-53ed-4177-ae62-a74a27279132/volumes"
Sep 11 21:23:38.444494 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:38.444462    2560 generic.go:356] "Generic (PLEG): container finished" podID="83caeb6f-14a3-45c4-bd3f-7c74a376e34e" containerID="f4bf73ce221f2cc718316148a6c54926b0f6b15b2b8fd574a240f9e90aba49e5" exitCode=0
Sep 11 21:23:38.444935 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:38.444505    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k" event={"ID":"83caeb6f-14a3-45c4-bd3f-7c74a376e34e","Type":"ContainerDied","Data":"f4bf73ce221f2cc718316148a6c54926b0f6b15b2b8fd574a240f9e90aba49e5"}
Sep 11 21:23:38.445047 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:38.445028    2560 scope.go:117] "RemoveContainer" containerID="f4bf73ce221f2cc718316148a6c54926b0f6b15b2b8fd574a240f9e90aba49e5"
Sep 11 21:23:38.446090 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:38.446062    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:23:38.446174 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:38.446130    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:23:38.446174 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:38.446165    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:23:39.452162 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:39.452126    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k" event={"ID":"83caeb6f-14a3-45c4-bd3f-7c74a376e34e","Type":"ContainerStarted","Data":"923b7f27e1b1eb4d668eb7bdd98b4793243c69d368dcf70711b9f5210cbda213"}
Sep 11 21:23:40.333902 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:40.333860    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k"
Sep 11 21:23:40.334077 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:40.334055    2560 patch_prober.go:28] interesting pod/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 11 21:23:40.334131 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:40.334109    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k" podUID="83caeb6f-14a3-45c4-bd3f-7c74a376e34e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 11 21:23:41.333952 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:41.333920    2560 patch_prober.go:28] interesting pod/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 11 21:23:41.334316 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:41.333973    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k" podUID="83caeb6f-14a3-45c4-bd3f-7c74a376e34e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 11 21:23:42.334364 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:42.333981    2560 patch_prober.go:28] interesting pod/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 11 21:23:42.334364 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:42.334049    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k" podUID="83caeb6f-14a3-45c4-bd3f-7c74a376e34e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 11 21:23:43.334426 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:43.334366    2560 patch_prober.go:28] interesting pod/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 11 21:23:43.334820 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:43.334448    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k" podUID="83caeb6f-14a3-45c4-bd3f-7c74a376e34e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 11 21:23:44.334274 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:44.334235    2560 patch_prober.go:28] interesting pod/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 11 21:23:44.334474 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:44.334290    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k" podUID="83caeb6f-14a3-45c4-bd3f-7c74a376e34e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 11 21:23:45.338111 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:45.338065    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k"
Sep 11 21:23:45.338738 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:45.338712    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k"
Sep 11 21:23:45.339569 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:23:45.339549    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k"
Sep 11 21:24:00.177492 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:00.177447    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m"]
Sep 11 21:24:00.177951 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:00.177938    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d07f0c6e-53ed-4177-ae62-a74a27279132" containerName="istio-proxy"
Sep 11 21:24:00.177997 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:00.177956    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d07f0c6e-53ed-4177-ae62-a74a27279132" containerName="istio-proxy"
Sep 11 21:24:00.177997 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:00.177980    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d07f0c6e-53ed-4177-ae62-a74a27279132" containerName="istio-proxy"
Sep 11 21:24:00.177997 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:00.177986    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d07f0c6e-53ed-4177-ae62-a74a27279132" containerName="istio-proxy"
Sep 11 21:24:00.178095 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:00.178045    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d07f0c6e-53ed-4177-ae62-a74a27279132" containerName="istio-proxy"
Sep 11 21:24:00.178095 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:00.178057    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d07f0c6e-53ed-4177-ae62-a74a27279132" containerName="istio-proxy"
Sep 11 21:24:00.182784 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:00.182763    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m"
Sep 11 21:24:00.185341 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:00.185320    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-713791-openshift-default-dockercfg-7nmsw\""
Sep 11 21:24:00.193207 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:00.193182    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m"]
Sep 11 21:24:00.283172 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:00.283134    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05a61e7e-7ae9-49f8-9797-17c05529bd57-workload-socket\") pod \"e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m\" (UID: \"05a61e7e-7ae9-49f8-9797-17c05529bd57\") " pod="openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m"
Sep 11 21:24:00.283172 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:00.283178    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05a61e7e-7ae9-49f8-9797-17c05529bd57-credential-socket\") pod \"e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m\" (UID: \"05a61e7e-7ae9-49f8-9797-17c05529bd57\") " pod="openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m"
Sep 11 21:24:00.283478 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:00.283209    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk2f5\" (UniqueName: \"kubernetes.io/projected/05a61e7e-7ae9-49f8-9797-17c05529bd57-kube-api-access-hk2f5\") pod \"e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m\" (UID: \"05a61e7e-7ae9-49f8-9797-17c05529bd57\") " pod="openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m"
Sep 11 21:24:00.283478 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:00.283352    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05a61e7e-7ae9-49f8-9797-17c05529bd57-istio-data\") pod \"e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m\" (UID: \"05a61e7e-7ae9-49f8-9797-17c05529bd57\") " pod="openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m"
Sep 11 21:24:00.283478 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:00.283409    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05a61e7e-7ae9-49f8-9797-17c05529bd57-istio-podinfo\") pod \"e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m\" (UID: \"05a61e7e-7ae9-49f8-9797-17c05529bd57\") " pod="openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m"
Sep 11 21:24:00.283478 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:00.283449    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05a61e7e-7ae9-49f8-9797-17c05529bd57-istio-envoy\") pod \"e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m\" (UID: \"05a61e7e-7ae9-49f8-9797-17c05529bd57\") " pod="openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m"
Sep 11 21:24:00.283701 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:00.283483    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05a61e7e-7ae9-49f8-9797-17c05529bd57-istio-token\") pod \"e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m\" (UID: \"05a61e7e-7ae9-49f8-9797-17c05529bd57\") " pod="openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m"
Sep 11 21:24:00.283701 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:00.283573    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05a61e7e-7ae9-49f8-9797-17c05529bd57-workload-certs\") pod \"e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m\" (UID: \"05a61e7e-7ae9-49f8-9797-17c05529bd57\") " pod="openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m"
Sep 11 21:24:00.283701 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:00.283593    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05a61e7e-7ae9-49f8-9797-17c05529bd57-istiod-ca-cert\") pod \"e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m\" (UID: \"05a61e7e-7ae9-49f8-9797-17c05529bd57\") " pod="openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m"
Sep 11 21:24:00.385105 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:00.385052    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05a61e7e-7ae9-49f8-9797-17c05529bd57-workload-socket\") pod \"e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m\" (UID: \"05a61e7e-7ae9-49f8-9797-17c05529bd57\") " pod="openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m"
Sep 11 21:24:00.385105 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:00.385107    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05a61e7e-7ae9-49f8-9797-17c05529bd57-credential-socket\") pod \"e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m\" (UID: \"05a61e7e-7ae9-49f8-9797-17c05529bd57\") " pod="openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m"
Sep 11 21:24:00.385417 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:00.385149    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk2f5\" (UniqueName: \"kubernetes.io/projected/05a61e7e-7ae9-49f8-9797-17c05529bd57-kube-api-access-hk2f5\") pod \"e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m\" (UID: \"05a61e7e-7ae9-49f8-9797-17c05529bd57\") " pod="openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m"
Sep 11 21:24:00.385417 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:00.385221    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05a61e7e-7ae9-49f8-9797-17c05529bd57-istio-data\") pod \"e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m\" (UID: \"05a61e7e-7ae9-49f8-9797-17c05529bd57\") " pod="openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m"
Sep 11 21:24:00.385417 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:00.385262    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05a61e7e-7ae9-49f8-9797-17c05529bd57-istio-podinfo\") pod \"e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m\" (UID: \"05a61e7e-7ae9-49f8-9797-17c05529bd57\") " pod="openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m"
Sep 11 21:24:00.385417 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:00.385310    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05a61e7e-7ae9-49f8-9797-17c05529bd57-istio-envoy\") pod \"e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m\" (UID: \"05a61e7e-7ae9-49f8-9797-17c05529bd57\") " pod="openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m"
Sep 11 21:24:00.385417 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:00.385349    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05a61e7e-7ae9-49f8-9797-17c05529bd57-istio-token\") pod \"e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m\" (UID: \"05a61e7e-7ae9-49f8-9797-17c05529bd57\") " pod="openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m"
Sep 11 21:24:00.385695 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:00.385468    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05a61e7e-7ae9-49f8-9797-17c05529bd57-workload-certs\") pod \"e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m\" (UID: \"05a61e7e-7ae9-49f8-9797-17c05529bd57\") " pod="openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m"
Sep 11 21:24:00.385695 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:00.385498    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05a61e7e-7ae9-49f8-9797-17c05529bd57-istiod-ca-cert\") pod \"e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m\" (UID: \"05a61e7e-7ae9-49f8-9797-17c05529bd57\") " pod="openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m"
Sep 11 21:24:00.385695 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:00.385618    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05a61e7e-7ae9-49f8-9797-17c05529bd57-credential-socket\") pod \"e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m\" (UID: \"05a61e7e-7ae9-49f8-9797-17c05529bd57\") " pod="openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m"
Sep 11 21:24:00.385863 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:00.385730    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05a61e7e-7ae9-49f8-9797-17c05529bd57-workload-socket\") pod \"e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m\" (UID: \"05a61e7e-7ae9-49f8-9797-17c05529bd57\") " pod="openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m"
Sep 11 21:24:00.385863 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:00.385754    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05a61e7e-7ae9-49f8-9797-17c05529bd57-istio-data\") pod \"e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m\" (UID: \"05a61e7e-7ae9-49f8-9797-17c05529bd57\") " pod="openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m"
Sep 11 21:24:00.385863 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:00.385846    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05a61e7e-7ae9-49f8-9797-17c05529bd57-workload-certs\") pod \"e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m\" (UID: \"05a61e7e-7ae9-49f8-9797-17c05529bd57\") " pod="openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m"
Sep 11 21:24:00.386196 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:00.386176    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05a61e7e-7ae9-49f8-9797-17c05529bd57-istiod-ca-cert\") pod \"e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m\" (UID: \"05a61e7e-7ae9-49f8-9797-17c05529bd57\") " pod="openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m"
Sep 11 21:24:00.387795 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:00.387770    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05a61e7e-7ae9-49f8-9797-17c05529bd57-istio-envoy\") pod \"e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m\" (UID: \"05a61e7e-7ae9-49f8-9797-17c05529bd57\") " pod="openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m"
Sep 11 21:24:00.387946 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:00.387930    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05a61e7e-7ae9-49f8-9797-17c05529bd57-istio-podinfo\") pod \"e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m\" (UID: \"05a61e7e-7ae9-49f8-9797-17c05529bd57\") " pod="openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m"
Sep 11 21:24:00.393570 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:00.393544    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05a61e7e-7ae9-49f8-9797-17c05529bd57-istio-token\") pod \"e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m\" (UID: \"05a61e7e-7ae9-49f8-9797-17c05529bd57\") " pod="openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m"
Sep 11 21:24:00.394480 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:00.394438    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk2f5\" (UniqueName: \"kubernetes.io/projected/05a61e7e-7ae9-49f8-9797-17c05529bd57-kube-api-access-hk2f5\") pod \"e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m\" (UID: \"05a61e7e-7ae9-49f8-9797-17c05529bd57\") " pod="openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m"
Sep 11 21:24:00.495169 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:00.495077    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m"
Sep 11 21:24:00.775652 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:00.775522    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m"]
Sep 11 21:24:00.778700 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:24:00.778669    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05a61e7e_7ae9_49f8_9797_17c05529bd57.slice/crio-138ddbab4411bd90af002a942b3e98060b6749c420e5433b3f713e44d3238372 WatchSource:0}: Error finding container 138ddbab4411bd90af002a942b3e98060b6749c420e5433b3f713e44d3238372: Status 404 returned error can't find the container with id 138ddbab4411bd90af002a942b3e98060b6749c420e5433b3f713e44d3238372
Sep 11 21:24:00.780994 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:00.780960    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:24:00.781130 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:00.781028    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:24:00.781130 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:00.781059    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:24:01.601909 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:01.601873    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m" event={"ID":"05a61e7e-7ae9-49f8-9797-17c05529bd57","Type":"ContainerStarted","Data":"3db16ab6863b9a04016c0829a64985d4d74d9d29ccef42e57d40b53e8e608376"}
Sep 11 21:24:01.602307 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:01.601940    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m" event={"ID":"05a61e7e-7ae9-49f8-9797-17c05529bd57","Type":"ContainerStarted","Data":"138ddbab4411bd90af002a942b3e98060b6749c420e5433b3f713e44d3238372"}
Sep 11 21:24:01.627425 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:01.627350    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m" podStartSLOduration=1.627331908 podStartE2EDuration="1.627331908s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:24:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:24:01.626232256 +0000 UTC m=+1087.104544123" watchObservedRunningTime="2026-09-11 21:24:01.627331908 +0000 UTC m=+1087.105643751"
Sep 11 21:24:02.495312 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:02.495267    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m"
Sep 11 21:24:02.501021 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:02.500992    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m"
Sep 11 21:24:02.608145 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:02.608109    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m"
Sep 11 21:24:02.609400 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:02.609362    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m"
Sep 11 21:24:08.312263 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:08.312169    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-713791-fc47fc45-vlb4h"]
Sep 11 21:24:08.316306 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:08.316281    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-713791-fc47fc45-vlb4h"
Sep 11 21:24:08.318982 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:08.318957    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-713791\""
Sep 11 21:24:08.319160 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:08.319136    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-713791-dockercfg-kvhm4\""
Sep 11 21:24:08.329610 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:08.329586    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-713791-fc47fc45-vlb4h"]
Sep 11 21:24:08.472590 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:08.472549    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lsgc\" (UniqueName: \"kubernetes.io/projected/b9ac5d67-65b2-4f92-a7af-00e39c5c53ef-kube-api-access-6lsgc\") pod \"payload-processing-e2e-shared-b-w3-713791-fc47fc45-vlb4h\" (UID: \"b9ac5d67-65b2-4f92-a7af-00e39c5c53ef\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-713791-fc47fc45-vlb4h"
Sep 11 21:24:08.472772 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:08.472669    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9ac5d67-65b2-4f92-a7af-00e39c5c53ef-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-713791-fc47fc45-vlb4h\" (UID: \"b9ac5d67-65b2-4f92-a7af-00e39c5c53ef\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-713791-fc47fc45-vlb4h"
Sep 11 21:24:08.574350 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:08.574254    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9ac5d67-65b2-4f92-a7af-00e39c5c53ef-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-713791-fc47fc45-vlb4h\" (UID: \"b9ac5d67-65b2-4f92-a7af-00e39c5c53ef\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-713791-fc47fc45-vlb4h"
Sep 11 21:24:08.574539 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:08.574375    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lsgc\" (UniqueName: \"kubernetes.io/projected/b9ac5d67-65b2-4f92-a7af-00e39c5c53ef-kube-api-access-6lsgc\") pod \"payload-processing-e2e-shared-b-w3-713791-fc47fc45-vlb4h\" (UID: \"b9ac5d67-65b2-4f92-a7af-00e39c5c53ef\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-713791-fc47fc45-vlb4h"
Sep 11 21:24:08.574968 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:08.574947    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9ac5d67-65b2-4f92-a7af-00e39c5c53ef-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-713791-fc47fc45-vlb4h\" (UID: \"b9ac5d67-65b2-4f92-a7af-00e39c5c53ef\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-713791-fc47fc45-vlb4h"
Sep 11 21:24:08.582904 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:08.582871    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lsgc\" (UniqueName: \"kubernetes.io/projected/b9ac5d67-65b2-4f92-a7af-00e39c5c53ef-kube-api-access-6lsgc\") pod \"payload-processing-e2e-shared-b-w3-713791-fc47fc45-vlb4h\" (UID: \"b9ac5d67-65b2-4f92-a7af-00e39c5c53ef\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-713791-fc47fc45-vlb4h"
Sep 11 21:24:08.629616 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:08.629586    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-713791-fc47fc45-vlb4h"
Sep 11 21:24:08.911864 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:08.911830    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-713791-fc47fc45-vlb4h"]
Sep 11 21:24:08.914118 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:24:08.914089    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9ac5d67_65b2_4f92_a7af_00e39c5c53ef.slice/crio-f789cb755703227eca7e0eddc3705194b9039cd5b1c3cc4ce23f1e489ed8e7ae WatchSource:0}: Error finding container f789cb755703227eca7e0eddc3705194b9039cd5b1c3cc4ce23f1e489ed8e7ae: Status 404 returned error can't find the container with id f789cb755703227eca7e0eddc3705194b9039cd5b1c3cc4ce23f1e489ed8e7ae
Sep 11 21:24:09.649518 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:09.649481    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-713791-fc47fc45-vlb4h" event={"ID":"b9ac5d67-65b2-4f92-a7af-00e39c5c53ef","Type":"ContainerStarted","Data":"80427c1de0dcc0392bfd3c29bc0b26ba39abbded7c3fd7149495d84c22c1d10b"}
Sep 11 21:24:09.649963 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:09.649541    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-713791-fc47fc45-vlb4h" event={"ID":"b9ac5d67-65b2-4f92-a7af-00e39c5c53ef","Type":"ContainerStarted","Data":"f789cb755703227eca7e0eddc3705194b9039cd5b1c3cc4ce23f1e489ed8e7ae"}
Sep 11 21:24:09.649963 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:09.649571    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-713791-fc47fc45-vlb4h"
Sep 11 21:24:09.669039 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:09.668978    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-713791-fc47fc45-vlb4h" podStartSLOduration=1.668961886 podStartE2EDuration="1.668961886s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:24:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:24:09.666635303 +0000 UTC m=+1095.144947152" watchObservedRunningTime="2026-09-11 21:24:09.668961886 +0000 UTC m=+1095.147273729"
Sep 11 21:24:20.658245 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:20.657514    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-713791-fc47fc45-vlb4h"
Sep 11 21:24:25.750828 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:25.750794    2560 generic.go:356] "Generic (PLEG): container finished" podID="05a61e7e-7ae9-49f8-9797-17c05529bd57" containerID="3db16ab6863b9a04016c0829a64985d4d74d9d29ccef42e57d40b53e8e608376" exitCode=0
Sep 11 21:24:25.751588 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:25.750867    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m" event={"ID":"05a61e7e-7ae9-49f8-9797-17c05529bd57","Type":"ContainerDied","Data":"3db16ab6863b9a04016c0829a64985d4d74d9d29ccef42e57d40b53e8e608376"}
Sep 11 21:24:25.751588 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:25.751341    2560 scope.go:117] "RemoveContainer" containerID="3db16ab6863b9a04016c0829a64985d4d74d9d29ccef42e57d40b53e8e608376"
Sep 11 21:24:25.752535 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:25.752508    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:24:25.752611 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:25.752573    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:24:25.752611 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:25.752606    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:24:26.761108 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:26.761066    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m" event={"ID":"05a61e7e-7ae9-49f8-9797-17c05529bd57","Type":"ContainerStarted","Data":"c19ab69a6a2de038acec389075a0b8746da6d360b180af30c3968ea0b0b2d272"}
Sep 11 21:24:27.495847 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:27.495817    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m"
Sep 11 21:24:27.496042 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:27.495969    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 11 21:24:27.496042 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:27.496026    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m" podUID="05a61e7e-7ae9-49f8-9797-17c05529bd57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 11 21:24:28.496518 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:28.496481    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 11 21:24:28.497006 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:28.496547    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m" podUID="05a61e7e-7ae9-49f8-9797-17c05529bd57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 11 21:24:29.495912 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:29.495870    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 11 21:24:29.496093 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:29.495933    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m" podUID="05a61e7e-7ae9-49f8-9797-17c05529bd57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 11 21:24:30.495972 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:30.495932    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 11 21:24:30.496369 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:30.496006    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m" podUID="05a61e7e-7ae9-49f8-9797-17c05529bd57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 11 21:24:31.495494 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:31.495459    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 11 21:24:31.495678 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:31.495536    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m" podUID="05a61e7e-7ae9-49f8-9797-17c05529bd57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 11 21:24:32.499970 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:32.499935    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m"
Sep 11 21:24:32.500462 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:32.500326    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m"
Sep 11 21:24:32.500926 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:32.500905    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m"
Sep 11 21:24:40.065102 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:40.065064    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-908a1435-mc628"]
Sep 11 21:24:40.069409 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:40.069371    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-908a1435-mc628"
Sep 11 21:24:40.072049 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:40.072019    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 21:24:40.072200 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:40.072081    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bfm9g\""
Sep 11 21:24:40.076788 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:40.076764    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-908a1435-mc628"]
Sep 11 21:24:40.227967 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:40.227919    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aaf80354-f043-4634-aa28-4be7a5118fba-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-908a1435-mc628\" (UID: \"aaf80354-f043-4634-aa28-4be7a5118fba\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-908a1435-mc628"
Sep 11 21:24:40.328867 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:40.328778    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aaf80354-f043-4634-aa28-4be7a5118fba-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-908a1435-mc628\" (UID: \"aaf80354-f043-4634-aa28-4be7a5118fba\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-908a1435-mc628"
Sep 11 21:24:40.329420 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:40.329375    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aaf80354-f043-4634-aa28-4be7a5118fba-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-908a1435-mc628\" (UID: \"aaf80354-f043-4634-aa28-4be7a5118fba\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-908a1435-mc628"
Sep 11 21:24:40.381858 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:40.381821    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-908a1435-mc628"
Sep 11 21:24:40.657535 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:40.657509    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-908a1435-mc628"]
Sep 11 21:24:40.659796 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:24:40.659762    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaf80354_f043_4634_aa28_4be7a5118fba.slice/crio-946084430ecf49d7c978d813133ff191ff4dd50693f0c3022de39beb88d8d45e WatchSource:0}: Error finding container 946084430ecf49d7c978d813133ff191ff4dd50693f0c3022de39beb88d8d45e: Status 404 returned error can't find the container with id 946084430ecf49d7c978d813133ff191ff4dd50693f0c3022de39beb88d8d45e
Sep 11 21:24:40.856955 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:40.856914    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-908a1435-mc628" event={"ID":"aaf80354-f043-4634-aa28-4be7a5118fba","Type":"ContainerStarted","Data":"946084430ecf49d7c978d813133ff191ff4dd50693f0c3022de39beb88d8d45e"}
Sep 11 21:24:41.867025 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:41.866919    2560 generic.go:356] "Generic (PLEG): container finished" podID="aaf80354-f043-4634-aa28-4be7a5118fba" containerID="3355078acd8e93e6ef90aeee7c8aa7cfc017affe4ae91417f534848404d99f74" exitCode=0
Sep 11 21:24:41.867025 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:41.867007    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-908a1435-mc628" event={"ID":"aaf80354-f043-4634-aa28-4be7a5118fba","Type":"ContainerDied","Data":"3355078acd8e93e6ef90aeee7c8aa7cfc017affe4ae91417f534848404d99f74"}
Sep 11 21:24:43.021268 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:43.021242    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-908a1435-mc628"
Sep 11 21:24:43.163298 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:43.163160    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aaf80354-f043-4634-aa28-4be7a5118fba-maas-api-service-ca\") pod \"aaf80354-f043-4634-aa28-4be7a5118fba\" (UID: \"aaf80354-f043-4634-aa28-4be7a5118fba\") "
Sep 11 21:24:43.163684 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:43.163645    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aaf80354-f043-4634-aa28-4be7a5118fba-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "aaf80354-f043-4634-aa28-4be7a5118fba" (UID: "aaf80354-f043-4634-aa28-4be7a5118fba"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:24:43.264951 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:43.264883    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aaf80354-f043-4634-aa28-4be7a5118fba-maas-api-service-ca\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:24:43.880372 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:43.880339    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-908a1435-mc628"
Sep 11 21:24:43.880563 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:43.880366    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-908a1435-mc628" event={"ID":"aaf80354-f043-4634-aa28-4be7a5118fba","Type":"ContainerDied","Data":"946084430ecf49d7c978d813133ff191ff4dd50693f0c3022de39beb88d8d45e"}
Sep 11 21:24:43.880563 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:43.880454    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="946084430ecf49d7c978d813133ff191ff4dd50693f0c3022de39beb88d8d45e"
Sep 11 21:24:55.210770 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:55.210737    2560 scope.go:117] "RemoveContainer" containerID="43628ff6ddbb1324b100b80ca966dace7d875127bd9a9c94fa35770766008e9d"
Sep 11 21:24:56.023978 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:56.023932    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-908a1435-76bdf8d7b5-lq7k6"]
Sep 11 21:24:56.024323 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:56.024236    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-908a1435-76bdf8d7b5-lq7k6" podUID="ea471c43-5b57-4d62-904b-688718d7a94d" containerName="payload-processing" containerID="cri-o://296f185bb0fa29e54184bc9168f830d8a1c42d37ee59ae286f375fe5dacc48d8" gracePeriod=30
Sep 11 21:24:56.215837 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:56.215806    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-908a1435-mc628"]
Sep 11 21:24:56.219344 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:56.219316    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-908a1435-mc628"]
Sep 11 21:24:56.290463 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:56.290048    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-908a1435-76bdf8d7b5-lq7k6"
Sep 11 21:24:56.409490 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:56.409457    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gl2vk\" (UniqueName: \"kubernetes.io/projected/ea471c43-5b57-4d62-904b-688718d7a94d-kube-api-access-gl2vk\") pod \"ea471c43-5b57-4d62-904b-688718d7a94d\" (UID: \"ea471c43-5b57-4d62-904b-688718d7a94d\") "
Sep 11 21:24:56.409663 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:56.409605    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea471c43-5b57-4d62-904b-688718d7a94d-plugins-config-volume\") pod \"ea471c43-5b57-4d62-904b-688718d7a94d\" (UID: \"ea471c43-5b57-4d62-904b-688718d7a94d\") "
Sep 11 21:24:56.410970 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:56.410304    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea471c43-5b57-4d62-904b-688718d7a94d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ea471c43-5b57-4d62-904b-688718d7a94d" (UID: "ea471c43-5b57-4d62-904b-688718d7a94d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:24:56.410970 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:56.410613    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea471c43-5b57-4d62-904b-688718d7a94d-plugins-config-volume\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:24:56.418465 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:56.418415    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea471c43-5b57-4d62-904b-688718d7a94d-kube-api-access-gl2vk" (OuterVolumeSpecName: "kube-api-access-gl2vk") pod "ea471c43-5b57-4d62-904b-688718d7a94d" (UID: "ea471c43-5b57-4d62-904b-688718d7a94d"). InnerVolumeSpecName "kube-api-access-gl2vk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:24:56.511786 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:56.511744    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gl2vk\" (UniqueName: \"kubernetes.io/projected/ea471c43-5b57-4d62-904b-688718d7a94d-kube-api-access-gl2vk\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:24:56.962068 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:56.962032    2560 generic.go:356] "Generic (PLEG): container finished" podID="ea471c43-5b57-4d62-904b-688718d7a94d" containerID="296f185bb0fa29e54184bc9168f830d8a1c42d37ee59ae286f375fe5dacc48d8" exitCode=0
Sep 11 21:24:56.962256 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:56.962088    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-908a1435-76bdf8d7b5-lq7k6"
Sep 11 21:24:56.962256 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:56.962120    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-908a1435-76bdf8d7b5-lq7k6" event={"ID":"ea471c43-5b57-4d62-904b-688718d7a94d","Type":"ContainerDied","Data":"296f185bb0fa29e54184bc9168f830d8a1c42d37ee59ae286f375fe5dacc48d8"}
Sep 11 21:24:56.962256 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:56.962213    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-908a1435-76bdf8d7b5-lq7k6" event={"ID":"ea471c43-5b57-4d62-904b-688718d7a94d","Type":"ContainerDied","Data":"855e5dbd59d16bef1935ce9ee86a7ab84a8e12fd2af2e986c76d4981cf8fe2ee"}
Sep 11 21:24:56.962256 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:56.962242    2560 scope.go:117] "RemoveContainer" containerID="296f185bb0fa29e54184bc9168f830d8a1c42d37ee59ae286f375fe5dacc48d8"
Sep 11 21:24:56.972519 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:56.972498    2560 scope.go:117] "RemoveContainer" containerID="296f185bb0fa29e54184bc9168f830d8a1c42d37ee59ae286f375fe5dacc48d8"
Sep 11 21:24:56.972851 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:24:56.972831    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"296f185bb0fa29e54184bc9168f830d8a1c42d37ee59ae286f375fe5dacc48d8\": container with ID starting with 296f185bb0fa29e54184bc9168f830d8a1c42d37ee59ae286f375fe5dacc48d8 not found: ID does not exist" containerID="296f185bb0fa29e54184bc9168f830d8a1c42d37ee59ae286f375fe5dacc48d8"
Sep 11 21:24:56.972911 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:56.972864    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"296f185bb0fa29e54184bc9168f830d8a1c42d37ee59ae286f375fe5dacc48d8"} err="failed to get container status \"296f185bb0fa29e54184bc9168f830d8a1c42d37ee59ae286f375fe5dacc48d8\": rpc error: code = NotFound desc = could not find container \"296f185bb0fa29e54184bc9168f830d8a1c42d37ee59ae286f375fe5dacc48d8\": container with ID starting with 296f185bb0fa29e54184bc9168f830d8a1c42d37ee59ae286f375fe5dacc48d8 not found: ID does not exist"
Sep 11 21:24:56.988118 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:56.988085    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-908a1435-76bdf8d7b5-lq7k6"]
Sep 11 21:24:56.994323 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:56.994293    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-908a1435-76bdf8d7b5-lq7k6"]
Sep 11 21:24:57.038413 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:57.038365    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aaf80354-f043-4634-aa28-4be7a5118fba" path="/var/lib/kubelet/pods/aaf80354-f043-4634-aa28-4be7a5118fba/volumes"
Sep 11 21:24:57.038826 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:24:57.038812    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea471c43-5b57-4d62-904b-688718d7a94d" path="/var/lib/kubelet/pods/ea471c43-5b57-4d62-904b-688718d7a94d/volumes"
Sep 11 21:25:18.026818 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:25:18.026730    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-713791/auth-test-model-713791-kserve-79bccd8599-4chq6"]
Sep 11 21:25:18.027267 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:25:18.027250    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea471c43-5b57-4d62-904b-688718d7a94d" containerName="payload-processing"
Sep 11 21:25:18.027321 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:25:18.027269    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea471c43-5b57-4d62-904b-688718d7a94d" containerName="payload-processing"
Sep 11 21:25:18.027321 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:25:18.027292    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaf80354-f043-4634-aa28-4be7a5118fba" containerName="revoke-keys"
Sep 11 21:25:18.027321 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:25:18.027299    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaf80354-f043-4634-aa28-4be7a5118fba" containerName="revoke-keys"
Sep 11 21:25:18.027447 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:25:18.027407    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="aaf80354-f043-4634-aa28-4be7a5118fba" containerName="revoke-keys"
Sep 11 21:25:18.027447 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:25:18.027421    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea471c43-5b57-4d62-904b-688718d7a94d" containerName="payload-processing"
Sep 11 21:25:18.032363 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:25:18.032331    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-713791/auth-test-model-713791-kserve-79bccd8599-4chq6"
Sep 11 21:25:18.035652 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:25:18.035618    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-713791\"/\"auth-test-model-713791-kserve-self-signed-certs\""
Sep 11 21:25:18.035652 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:25:18.035618    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-713791\"/\"kube-root-ca.crt\""
Sep 11 21:25:18.035869 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:25:18.035622    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-713791\"/\"openshift-service-ca.crt\""
Sep 11 21:25:18.035869 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:25:18.035695    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-713791\"/\"default-dockercfg-bhxr5\""
Sep 11 21:25:18.044743 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:25:18.044716    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-713791/auth-test-model-713791-kserve-79bccd8599-4chq6"]
Sep 11 21:25:18.054401 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:25:18.054344    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe0caa4a-9215-464f-8823-f70b1114659d-tls-certs\") pod \"auth-test-model-713791-kserve-79bccd8599-4chq6\" (UID: \"fe0caa4a-9215-464f-8823-f70b1114659d\") " pod="ai-tenant-e2e-shared-b-w3-713791/auth-test-model-713791-kserve-79bccd8599-4chq6"
Sep 11 21:25:18.054590 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:25:18.054491    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe0caa4a-9215-464f-8823-f70b1114659d-tmp-dir\") pod \"auth-test-model-713791-kserve-79bccd8599-4chq6\" (UID: \"fe0caa4a-9215-464f-8823-f70b1114659d\") " pod="ai-tenant-e2e-shared-b-w3-713791/auth-test-model-713791-kserve-79bccd8599-4chq6"
Sep 11 21:25:18.054590 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:25:18.054545    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe0caa4a-9215-464f-8823-f70b1114659d-dshm\") pod \"auth-test-model-713791-kserve-79bccd8599-4chq6\" (UID: \"fe0caa4a-9215-464f-8823-f70b1114659d\") " pod="ai-tenant-e2e-shared-b-w3-713791/auth-test-model-713791-kserve-79bccd8599-4chq6"
Sep 11 21:25:18.054707 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:25:18.054690    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe0caa4a-9215-464f-8823-f70b1114659d-home\") pod \"auth-test-model-713791-kserve-79bccd8599-4chq6\" (UID: \"fe0caa4a-9215-464f-8823-f70b1114659d\") " pod="ai-tenant-e2e-shared-b-w3-713791/auth-test-model-713791-kserve-79bccd8599-4chq6"
Sep 11 21:25:18.054745 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:25:18.054725    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe0caa4a-9215-464f-8823-f70b1114659d-model-cache\") pod \"auth-test-model-713791-kserve-79bccd8599-4chq6\" (UID: \"fe0caa4a-9215-464f-8823-f70b1114659d\") " pod="ai-tenant-e2e-shared-b-w3-713791/auth-test-model-713791-kserve-79bccd8599-4chq6"
Sep 11 21:25:18.054792 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:25:18.054764    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4chj8\" (UniqueName: \"kubernetes.io/projected/fe0caa4a-9215-464f-8823-f70b1114659d-kube-api-access-4chj8\") pod \"auth-test-model-713791-kserve-79bccd8599-4chq6\" (UID: \"fe0caa4a-9215-464f-8823-f70b1114659d\") " pod="ai-tenant-e2e-shared-b-w3-713791/auth-test-model-713791-kserve-79bccd8599-4chq6"
Sep 11 21:25:18.155823 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:25:18.155785    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe0caa4a-9215-464f-8823-f70b1114659d-home\") pod \"auth-test-model-713791-kserve-79bccd8599-4chq6\" (UID: \"fe0caa4a-9215-464f-8823-f70b1114659d\") " pod="ai-tenant-e2e-shared-b-w3-713791/auth-test-model-713791-kserve-79bccd8599-4chq6"
Sep 11 21:25:18.155823 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:25:18.155826    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe0caa4a-9215-464f-8823-f70b1114659d-model-cache\") pod \"auth-test-model-713791-kserve-79bccd8599-4chq6\" (UID: \"fe0caa4a-9215-464f-8823-f70b1114659d\") " pod="ai-tenant-e2e-shared-b-w3-713791/auth-test-model-713791-kserve-79bccd8599-4chq6"
Sep 11 21:25:18.156095 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:25:18.155848    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4chj8\" (UniqueName: \"kubernetes.io/projected/fe0caa4a-9215-464f-8823-f70b1114659d-kube-api-access-4chj8\") pod \"auth-test-model-713791-kserve-79bccd8599-4chq6\" (UID: \"fe0caa4a-9215-464f-8823-f70b1114659d\") " pod="ai-tenant-e2e-shared-b-w3-713791/auth-test-model-713791-kserve-79bccd8599-4chq6"
Sep 11 21:25:18.156095 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:25:18.155878    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe0caa4a-9215-464f-8823-f70b1114659d-tls-certs\") pod \"auth-test-model-713791-kserve-79bccd8599-4chq6\" (UID: \"fe0caa4a-9215-464f-8823-f70b1114659d\") " pod="ai-tenant-e2e-shared-b-w3-713791/auth-test-model-713791-kserve-79bccd8599-4chq6"
Sep 11 21:25:18.156095 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:25:18.155926    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe0caa4a-9215-464f-8823-f70b1114659d-tmp-dir\") pod \"auth-test-model-713791-kserve-79bccd8599-4chq6\" (UID: \"fe0caa4a-9215-464f-8823-f70b1114659d\") " pod="ai-tenant-e2e-shared-b-w3-713791/auth-test-model-713791-kserve-79bccd8599-4chq6"
Sep 11 21:25:18.156095 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:25:18.155953    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe0caa4a-9215-464f-8823-f70b1114659d-dshm\") pod \"auth-test-model-713791-kserve-79bccd8599-4chq6\" (UID: \"fe0caa4a-9215-464f-8823-f70b1114659d\") " pod="ai-tenant-e2e-shared-b-w3-713791/auth-test-model-713791-kserve-79bccd8599-4chq6"
Sep 11 21:25:18.156313 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:25:18.156261    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe0caa4a-9215-464f-8823-f70b1114659d-home\") pod \"auth-test-model-713791-kserve-79bccd8599-4chq6\" (UID: \"fe0caa4a-9215-464f-8823-f70b1114659d\") " pod="ai-tenant-e2e-shared-b-w3-713791/auth-test-model-713791-kserve-79bccd8599-4chq6"
Sep 11 21:25:18.156368 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:25:18.156317    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe0caa4a-9215-464f-8823-f70b1114659d-model-cache\") pod \"auth-test-model-713791-kserve-79bccd8599-4chq6\" (UID: \"fe0caa4a-9215-464f-8823-f70b1114659d\") " pod="ai-tenant-e2e-shared-b-w3-713791/auth-test-model-713791-kserve-79bccd8599-4chq6"
Sep 11 21:25:18.156368 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:25:18.156356    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe0caa4a-9215-464f-8823-f70b1114659d-tmp-dir\") pod \"auth-test-model-713791-kserve-79bccd8599-4chq6\" (UID: \"fe0caa4a-9215-464f-8823-f70b1114659d\") " pod="ai-tenant-e2e-shared-b-w3-713791/auth-test-model-713791-kserve-79bccd8599-4chq6"
Sep 11 21:25:18.158394 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:25:18.158344    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe0caa4a-9215-464f-8823-f70b1114659d-dshm\") pod \"auth-test-model-713791-kserve-79bccd8599-4chq6\" (UID: \"fe0caa4a-9215-464f-8823-f70b1114659d\") " pod="ai-tenant-e2e-shared-b-w3-713791/auth-test-model-713791-kserve-79bccd8599-4chq6"
Sep 11 21:25:18.158986 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:25:18.158966    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe0caa4a-9215-464f-8823-f70b1114659d-tls-certs\") pod \"auth-test-model-713791-kserve-79bccd8599-4chq6\" (UID: \"fe0caa4a-9215-464f-8823-f70b1114659d\") " pod="ai-tenant-e2e-shared-b-w3-713791/auth-test-model-713791-kserve-79bccd8599-4chq6"
Sep 11 21:25:18.165120 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:25:18.165090    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4chj8\" (UniqueName: \"kubernetes.io/projected/fe0caa4a-9215-464f-8823-f70b1114659d-kube-api-access-4chj8\") pod \"auth-test-model-713791-kserve-79bccd8599-4chq6\" (UID: \"fe0caa4a-9215-464f-8823-f70b1114659d\") " pod="ai-tenant-e2e-shared-b-w3-713791/auth-test-model-713791-kserve-79bccd8599-4chq6"
Sep 11 21:25:18.346279 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:25:18.346174    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-713791/auth-test-model-713791-kserve-79bccd8599-4chq6"
Sep 11 21:25:18.625846 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:25:18.625818    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-713791/auth-test-model-713791-kserve-79bccd8599-4chq6"]
Sep 11 21:25:18.627366 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:25:18.627341    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfe0caa4a_9215_464f_8823_f70b1114659d.slice/crio-82c4686740612ab64399f8cfb86b40a450cf389106cbfba303312979a66f1ebf WatchSource:0}: Error finding container 82c4686740612ab64399f8cfb86b40a450cf389106cbfba303312979a66f1ebf: Status 404 returned error can't find the container with id 82c4686740612ab64399f8cfb86b40a450cf389106cbfba303312979a66f1ebf
Sep 11 21:25:19.101679 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:25:19.101584    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-713791/auth-test-model-713791-kserve-79bccd8599-4chq6" event={"ID":"fe0caa4a-9215-464f-8823-f70b1114659d","Type":"ContainerStarted","Data":"9c8d4388ae82531eff48155ffaa0b084286c22e70e4e254e903859b4a50a61fb"}
Sep 11 21:25:19.101679 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:25:19.101630    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-713791/auth-test-model-713791-kserve-79bccd8599-4chq6" event={"ID":"fe0caa4a-9215-464f-8823-f70b1114659d","Type":"ContainerStarted","Data":"82c4686740612ab64399f8cfb86b40a450cf389106cbfba303312979a66f1ebf"}
Sep 11 21:25:19.122721 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:25:19.122657    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-713791/auth-test-model-713791-kserve-79bccd8599-4chq6" podStartSLOduration=1.122636803 podStartE2EDuration="1.122636803s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:25:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:25:19.120587266 +0000 UTC m=+1164.598899110" watchObservedRunningTime="2026-09-11 21:25:19.122636803 +0000 UTC m=+1164.600948646"
Sep 11 21:25:28.346461 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:25:28.346424    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-713791/auth-test-model-713791-kserve-79bccd8599-4chq6"
Sep 11 21:25:28.346963 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:25:28.346481    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-713791/auth-test-model-713791-kserve-79bccd8599-4chq6"
Sep 11 21:25:28.359164 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:25:28.359136    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-713791/auth-test-model-713791-kserve-79bccd8599-4chq6"
Sep 11 21:25:29.175376 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:25:29.175336    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-713791/auth-test-model-713791-kserve-79bccd8599-4chq6"
Sep 11 21:25:55.235689 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:25:55.234193    2560 scope.go:117] "RemoveContainer" containerID="ee02ebce362436d3478f01f3322b2ff21288224840e26fa46d70e0e931d9369a"
Sep 11 21:26:02.475830 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:02.475785    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k"]
Sep 11 21:26:02.476359 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:02.476067    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k" podUID="83caeb6f-14a3-45c4-bd3f-7c74a376e34e" containerName="istio-proxy" containerID="cri-o://923b7f27e1b1eb4d668eb7bdd98b4793243c69d368dcf70711b9f5210cbda213" gracePeriod=30
Sep 11 21:26:07.728622 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:07.728592    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k"
Sep 11 21:26:07.897879 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:07.897846    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83caeb6f-14a3-45c4-bd3f-7c74a376e34e-istiod-ca-cert\") pod \"83caeb6f-14a3-45c4-bd3f-7c74a376e34e\" (UID: \"83caeb6f-14a3-45c4-bd3f-7c74a376e34e\") "
Sep 11 21:26:07.898063 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:07.897888    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83caeb6f-14a3-45c4-bd3f-7c74a376e34e-istio-podinfo\") pod \"83caeb6f-14a3-45c4-bd3f-7c74a376e34e\" (UID: \"83caeb6f-14a3-45c4-bd3f-7c74a376e34e\") "
Sep 11 21:26:07.898063 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:07.897915    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83caeb6f-14a3-45c4-bd3f-7c74a376e34e-workload-socket\") pod \"83caeb6f-14a3-45c4-bd3f-7c74a376e34e\" (UID: \"83caeb6f-14a3-45c4-bd3f-7c74a376e34e\") "
Sep 11 21:26:07.898063 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:07.897954    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83caeb6f-14a3-45c4-bd3f-7c74a376e34e-credential-socket\") pod \"83caeb6f-14a3-45c4-bd3f-7c74a376e34e\" (UID: \"83caeb6f-14a3-45c4-bd3f-7c74a376e34e\") "
Sep 11 21:26:07.898204 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:07.898155    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83caeb6f-14a3-45c4-bd3f-7c74a376e34e-istio-envoy\") pod \"83caeb6f-14a3-45c4-bd3f-7c74a376e34e\" (UID: \"83caeb6f-14a3-45c4-bd3f-7c74a376e34e\") "
Sep 11 21:26:07.898264 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:07.898220    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83caeb6f-14a3-45c4-bd3f-7c74a376e34e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "83caeb6f-14a3-45c4-bd3f-7c74a376e34e" (UID: "83caeb6f-14a3-45c4-bd3f-7c74a376e34e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:26:07.898264 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:07.898250    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83caeb6f-14a3-45c4-bd3f-7c74a376e34e-workload-certs\") pod \"83caeb6f-14a3-45c4-bd3f-7c74a376e34e\" (UID: \"83caeb6f-14a3-45c4-bd3f-7c74a376e34e\") "
Sep 11 21:26:07.898375 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:07.898276    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83caeb6f-14a3-45c4-bd3f-7c74a376e34e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "83caeb6f-14a3-45c4-bd3f-7c74a376e34e" (UID: "83caeb6f-14a3-45c4-bd3f-7c74a376e34e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:26:07.898375 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:07.898327    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tq6v2\" (UniqueName: \"kubernetes.io/projected/83caeb6f-14a3-45c4-bd3f-7c74a376e34e-kube-api-access-tq6v2\") pod \"83caeb6f-14a3-45c4-bd3f-7c74a376e34e\" (UID: \"83caeb6f-14a3-45c4-bd3f-7c74a376e34e\") "
Sep 11 21:26:07.898375 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:07.898328    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83caeb6f-14a3-45c4-bd3f-7c74a376e34e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "83caeb6f-14a3-45c4-bd3f-7c74a376e34e" (UID: "83caeb6f-14a3-45c4-bd3f-7c74a376e34e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:26:07.898571 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:07.898473    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83caeb6f-14a3-45c4-bd3f-7c74a376e34e-istio-token\") pod \"83caeb6f-14a3-45c4-bd3f-7c74a376e34e\" (UID: \"83caeb6f-14a3-45c4-bd3f-7c74a376e34e\") "
Sep 11 21:26:07.898571 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:07.898522    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83caeb6f-14a3-45c4-bd3f-7c74a376e34e-istio-data\") pod \"83caeb6f-14a3-45c4-bd3f-7c74a376e34e\" (UID: \"83caeb6f-14a3-45c4-bd3f-7c74a376e34e\") "
Sep 11 21:26:07.898571 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:07.898530    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83caeb6f-14a3-45c4-bd3f-7c74a376e34e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "83caeb6f-14a3-45c4-bd3f-7c74a376e34e" (UID: "83caeb6f-14a3-45c4-bd3f-7c74a376e34e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:26:07.898812 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:07.898782    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83caeb6f-14a3-45c4-bd3f-7c74a376e34e-istio-data" (OuterVolumeSpecName: "istio-data") pod "83caeb6f-14a3-45c4-bd3f-7c74a376e34e" (UID: "83caeb6f-14a3-45c4-bd3f-7c74a376e34e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:26:07.899014 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:07.898996    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83caeb6f-14a3-45c4-bd3f-7c74a376e34e-istio-data\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:26:07.899124 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:07.899021    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83caeb6f-14a3-45c4-bd3f-7c74a376e34e-istiod-ca-cert\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:26:07.899124 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:07.899036    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83caeb6f-14a3-45c4-bd3f-7c74a376e34e-workload-socket\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:26:07.899124 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:07.899050    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83caeb6f-14a3-45c4-bd3f-7c74a376e34e-credential-socket\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:26:07.899124 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:07.899063    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83caeb6f-14a3-45c4-bd3f-7c74a376e34e-workload-certs\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:26:07.900372 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:07.900344    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/83caeb6f-14a3-45c4-bd3f-7c74a376e34e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "83caeb6f-14a3-45c4-bd3f-7c74a376e34e" (UID: "83caeb6f-14a3-45c4-bd3f-7c74a376e34e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 21:26:07.900550 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:07.900531    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83caeb6f-14a3-45c4-bd3f-7c74a376e34e-istio-token" (OuterVolumeSpecName: "istio-token") pod "83caeb6f-14a3-45c4-bd3f-7c74a376e34e" (UID: "83caeb6f-14a3-45c4-bd3f-7c74a376e34e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:26:07.900609 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:07.900567    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83caeb6f-14a3-45c4-bd3f-7c74a376e34e-kube-api-access-tq6v2" (OuterVolumeSpecName: "kube-api-access-tq6v2") pod "83caeb6f-14a3-45c4-bd3f-7c74a376e34e" (UID: "83caeb6f-14a3-45c4-bd3f-7c74a376e34e"). InnerVolumeSpecName "kube-api-access-tq6v2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:26:07.900671 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:07.900623    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83caeb6f-14a3-45c4-bd3f-7c74a376e34e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "83caeb6f-14a3-45c4-bd3f-7c74a376e34e" (UID: "83caeb6f-14a3-45c4-bd3f-7c74a376e34e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:26:07.999733 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:07.999694    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83caeb6f-14a3-45c4-bd3f-7c74a376e34e-istio-token\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:26:07.999733 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:07.999724    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83caeb6f-14a3-45c4-bd3f-7c74a376e34e-istio-podinfo\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:26:07.999733 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:07.999733    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83caeb6f-14a3-45c4-bd3f-7c74a376e34e-istio-envoy\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:26:07.999733 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:07.999743    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tq6v2\" (UniqueName: \"kubernetes.io/projected/83caeb6f-14a3-45c4-bd3f-7c74a376e34e-kube-api-access-tq6v2\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:26:08.400650 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:08.400607    2560 generic.go:356] "Generic (PLEG): container finished" podID="83caeb6f-14a3-45c4-bd3f-7c74a376e34e" containerID="923b7f27e1b1eb4d668eb7bdd98b4793243c69d368dcf70711b9f5210cbda213" exitCode=0
Sep 11 21:26:08.400878 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:08.400667    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k" event={"ID":"83caeb6f-14a3-45c4-bd3f-7c74a376e34e","Type":"ContainerDied","Data":"923b7f27e1b1eb4d668eb7bdd98b4793243c69d368dcf70711b9f5210cbda213"}
Sep 11 21:26:08.400878 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:08.400697    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k"
Sep 11 21:26:08.400878 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:08.400729    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k" event={"ID":"83caeb6f-14a3-45c4-bd3f-7c74a376e34e","Type":"ContainerDied","Data":"17f574c580add66063ba490c6aa8bfb3eba7bd5003488296219855035e7e97bd"}
Sep 11 21:26:08.400878 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:08.400761    2560 scope.go:117] "RemoveContainer" containerID="923b7f27e1b1eb4d668eb7bdd98b4793243c69d368dcf70711b9f5210cbda213"
Sep 11 21:26:08.412940 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:08.412921    2560 scope.go:117] "RemoveContainer" containerID="f4bf73ce221f2cc718316148a6c54926b0f6b15b2b8fd574a240f9e90aba49e5"
Sep 11 21:26:08.422468 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:08.422446    2560 scope.go:117] "RemoveContainer" containerID="923b7f27e1b1eb4d668eb7bdd98b4793243c69d368dcf70711b9f5210cbda213"
Sep 11 21:26:08.422822 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:26:08.422803    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"923b7f27e1b1eb4d668eb7bdd98b4793243c69d368dcf70711b9f5210cbda213\": container with ID starting with 923b7f27e1b1eb4d668eb7bdd98b4793243c69d368dcf70711b9f5210cbda213 not found: ID does not exist" containerID="923b7f27e1b1eb4d668eb7bdd98b4793243c69d368dcf70711b9f5210cbda213"
Sep 11 21:26:08.422959 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:08.422882    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"923b7f27e1b1eb4d668eb7bdd98b4793243c69d368dcf70711b9f5210cbda213"} err="failed to get container status \"923b7f27e1b1eb4d668eb7bdd98b4793243c69d368dcf70711b9f5210cbda213\": rpc error: code = NotFound desc = could not find container \"923b7f27e1b1eb4d668eb7bdd98b4793243c69d368dcf70711b9f5210cbda213\": container with ID starting with 923b7f27e1b1eb4d668eb7bdd98b4793243c69d368dcf70711b9f5210cbda213 not found: ID does not exist"
Sep 11 21:26:08.422959 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:08.422903    2560 scope.go:117] "RemoveContainer" containerID="f4bf73ce221f2cc718316148a6c54926b0f6b15b2b8fd574a240f9e90aba49e5"
Sep 11 21:26:08.423332 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:26:08.423301    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4bf73ce221f2cc718316148a6c54926b0f6b15b2b8fd574a240f9e90aba49e5\": container with ID starting with f4bf73ce221f2cc718316148a6c54926b0f6b15b2b8fd574a240f9e90aba49e5 not found: ID does not exist" containerID="f4bf73ce221f2cc718316148a6c54926b0f6b15b2b8fd574a240f9e90aba49e5"
Sep 11 21:26:08.423463 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:08.423340    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4bf73ce221f2cc718316148a6c54926b0f6b15b2b8fd574a240f9e90aba49e5"} err="failed to get container status \"f4bf73ce221f2cc718316148a6c54926b0f6b15b2b8fd574a240f9e90aba49e5\": rpc error: code = NotFound desc = could not find container \"f4bf73ce221f2cc718316148a6c54926b0f6b15b2b8fd574a240f9e90aba49e5\": container with ID starting with f4bf73ce221f2cc718316148a6c54926b0f6b15b2b8fd574a240f9e90aba49e5 not found: ID does not exist"
Sep 11 21:26:08.426190 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:08.426157    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k"]
Sep 11 21:26:08.430905 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:08.430869    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k"]
Sep 11 21:26:09.037795 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:09.037754    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83caeb6f-14a3-45c4-bd3f-7c74a376e34e" path="/var/lib/kubelet/pods/83caeb6f-14a3-45c4-bd3f-7c74a376e34e/volumes"
Sep 11 21:26:55.272440 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:55.272343    2560 scope.go:117] "RemoveContainer" containerID="476346dff178283d6feaeea5f978d34390569601d15b013828723f118f303deb"
Sep 11 21:26:55.281757 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:55.281739    2560 scope.go:117] "RemoveContainer" containerID="036cfa205b7ff310a66699bb9a59dc3f28ff8f673c3edb17ccdda597a800231a"
Sep 11 21:26:57.829459 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:57.829417    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl"]
Sep 11 21:26:57.829942 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:57.829928    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83caeb6f-14a3-45c4-bd3f-7c74a376e34e" containerName="istio-proxy"
Sep 11 21:26:57.829989 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:57.829943    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="83caeb6f-14a3-45c4-bd3f-7c74a376e34e" containerName="istio-proxy"
Sep 11 21:26:57.830074 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:57.830031    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="83caeb6f-14a3-45c4-bd3f-7c74a376e34e" containerName="istio-proxy"
Sep 11 21:26:57.830074 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:57.830044    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="83caeb6f-14a3-45c4-bd3f-7c74a376e34e" containerName="istio-proxy"
Sep 11 21:26:57.834970 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:57.834939    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl"
Sep 11 21:26:57.840179 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:57.840145    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-354c80-openshift-default-dockercfg-shlfw\""
Sep 11 21:26:57.893528 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:57.893490    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl"]
Sep 11 21:26:57.958773 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:57.958729    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f882ef92-ae11-4f7c-8acb-ab3efc938ddd-istiod-ca-cert\") pod \"e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl\" (UID: \"f882ef92-ae11-4f7c-8acb-ab3efc938ddd\") " pod="openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl"
Sep 11 21:26:57.958773 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:57.958791    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f882ef92-ae11-4f7c-8acb-ab3efc938ddd-workload-socket\") pod \"e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl\" (UID: \"f882ef92-ae11-4f7c-8acb-ab3efc938ddd\") " pod="openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl"
Sep 11 21:26:57.959037 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:57.958808    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f882ef92-ae11-4f7c-8acb-ab3efc938ddd-credential-socket\") pod \"e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl\" (UID: \"f882ef92-ae11-4f7c-8acb-ab3efc938ddd\") " pod="openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl"
Sep 11 21:26:57.959037 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:57.958923    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f882ef92-ae11-4f7c-8acb-ab3efc938ddd-istio-data\") pod \"e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl\" (UID: \"f882ef92-ae11-4f7c-8acb-ab3efc938ddd\") " pod="openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl"
Sep 11 21:26:57.959124 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:57.959035    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b77x7\" (UniqueName: \"kubernetes.io/projected/f882ef92-ae11-4f7c-8acb-ab3efc938ddd-kube-api-access-b77x7\") pod \"e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl\" (UID: \"f882ef92-ae11-4f7c-8acb-ab3efc938ddd\") " pod="openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl"
Sep 11 21:26:57.959124 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:57.959111    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f882ef92-ae11-4f7c-8acb-ab3efc938ddd-istio-podinfo\") pod \"e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl\" (UID: \"f882ef92-ae11-4f7c-8acb-ab3efc938ddd\") " pod="openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl"
Sep 11 21:26:57.959206 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:57.959139    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f882ef92-ae11-4f7c-8acb-ab3efc938ddd-workload-certs\") pod \"e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl\" (UID: \"f882ef92-ae11-4f7c-8acb-ab3efc938ddd\") " pod="openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl"
Sep 11 21:26:57.959206 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:57.959166    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f882ef92-ae11-4f7c-8acb-ab3efc938ddd-istio-token\") pod \"e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl\" (UID: \"f882ef92-ae11-4f7c-8acb-ab3efc938ddd\") " pod="openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl"
Sep 11 21:26:57.959285 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:57.959215    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f882ef92-ae11-4f7c-8acb-ab3efc938ddd-istio-envoy\") pod \"e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl\" (UID: \"f882ef92-ae11-4f7c-8acb-ab3efc938ddd\") " pod="openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl"
Sep 11 21:26:58.060280 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:58.060241    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f882ef92-ae11-4f7c-8acb-ab3efc938ddd-istio-podinfo\") pod \"e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl\" (UID: \"f882ef92-ae11-4f7c-8acb-ab3efc938ddd\") " pod="openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl"
Sep 11 21:26:58.060280 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:58.060283    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f882ef92-ae11-4f7c-8acb-ab3efc938ddd-workload-certs\") pod \"e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl\" (UID: \"f882ef92-ae11-4f7c-8acb-ab3efc938ddd\") " pod="openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl"
Sep 11 21:26:58.060574 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:58.060314    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f882ef92-ae11-4f7c-8acb-ab3efc938ddd-istio-token\") pod \"e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl\" (UID: \"f882ef92-ae11-4f7c-8acb-ab3efc938ddd\") " pod="openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl"
Sep 11 21:26:58.060574 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:58.060354    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f882ef92-ae11-4f7c-8acb-ab3efc938ddd-istio-envoy\") pod \"e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl\" (UID: \"f882ef92-ae11-4f7c-8acb-ab3efc938ddd\") " pod="openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl"
Sep 11 21:26:58.060574 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:58.060466    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f882ef92-ae11-4f7c-8acb-ab3efc938ddd-istiod-ca-cert\") pod \"e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl\" (UID: \"f882ef92-ae11-4f7c-8acb-ab3efc938ddd\") " pod="openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl"
Sep 11 21:26:58.060574 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:58.060497    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f882ef92-ae11-4f7c-8acb-ab3efc938ddd-workload-socket\") pod \"e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl\" (UID: \"f882ef92-ae11-4f7c-8acb-ab3efc938ddd\") " pod="openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl"
Sep 11 21:26:58.060574 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:58.060521    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f882ef92-ae11-4f7c-8acb-ab3efc938ddd-credential-socket\") pod \"e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl\" (UID: \"f882ef92-ae11-4f7c-8acb-ab3efc938ddd\") " pod="openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl"
Sep 11 21:26:58.060838 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:58.060599    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f882ef92-ae11-4f7c-8acb-ab3efc938ddd-istio-data\") pod \"e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl\" (UID: \"f882ef92-ae11-4f7c-8acb-ab3efc938ddd\") " pod="openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl"
Sep 11 21:26:58.060838 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:58.060687    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b77x7\" (UniqueName: \"kubernetes.io/projected/f882ef92-ae11-4f7c-8acb-ab3efc938ddd-kube-api-access-b77x7\") pod \"e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl\" (UID: \"f882ef92-ae11-4f7c-8acb-ab3efc938ddd\") " pod="openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl"
Sep 11 21:26:58.060838 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:58.060802    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f882ef92-ae11-4f7c-8acb-ab3efc938ddd-workload-certs\") pod \"e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl\" (UID: \"f882ef92-ae11-4f7c-8acb-ab3efc938ddd\") " pod="openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl"
Sep 11 21:26:58.061045 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:58.061005    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f882ef92-ae11-4f7c-8acb-ab3efc938ddd-credential-socket\") pod \"e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl\" (UID: \"f882ef92-ae11-4f7c-8acb-ab3efc938ddd\") " pod="openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl"
Sep 11 21:26:58.061113 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:58.061059    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f882ef92-ae11-4f7c-8acb-ab3efc938ddd-workload-socket\") pod \"e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl\" (UID: \"f882ef92-ae11-4f7c-8acb-ab3efc938ddd\") " pod="openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl"
Sep 11 21:26:58.061208 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:58.061187    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f882ef92-ae11-4f7c-8acb-ab3efc938ddd-istio-data\") pod \"e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl\" (UID: \"f882ef92-ae11-4f7c-8acb-ab3efc938ddd\") " pod="openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl"
Sep 11 21:26:58.061282 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:58.061257    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f882ef92-ae11-4f7c-8acb-ab3efc938ddd-istiod-ca-cert\") pod \"e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl\" (UID: \"f882ef92-ae11-4f7c-8acb-ab3efc938ddd\") " pod="openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl"
Sep 11 21:26:58.063160 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:58.063134    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f882ef92-ae11-4f7c-8acb-ab3efc938ddd-istio-envoy\") pod \"e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl\" (UID: \"f882ef92-ae11-4f7c-8acb-ab3efc938ddd\") " pod="openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl"
Sep 11 21:26:58.063477 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:58.063460    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f882ef92-ae11-4f7c-8acb-ab3efc938ddd-istio-podinfo\") pod \"e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl\" (UID: \"f882ef92-ae11-4f7c-8acb-ab3efc938ddd\") " pod="openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl"
Sep 11 21:26:58.072761 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:58.072728    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f882ef92-ae11-4f7c-8acb-ab3efc938ddd-istio-token\") pod \"e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl\" (UID: \"f882ef92-ae11-4f7c-8acb-ab3efc938ddd\") " pod="openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl"
Sep 11 21:26:58.074851 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:58.074817    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b77x7\" (UniqueName: \"kubernetes.io/projected/f882ef92-ae11-4f7c-8acb-ab3efc938ddd-kube-api-access-b77x7\") pod \"e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl\" (UID: \"f882ef92-ae11-4f7c-8acb-ab3efc938ddd\") " pod="openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl"
Sep 11 21:26:58.147782 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:58.147738    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl"
Sep 11 21:26:58.441709 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:58.441677    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl"]
Sep 11 21:26:58.444359 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:26:58.444331    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf882ef92_ae11_4f7c_8acb_ab3efc938ddd.slice/crio-a6c1987c83a7d43566d49c17b61bca17113dec18fad2309682cc678a5cd49704 WatchSource:0}: Error finding container a6c1987c83a7d43566d49c17b61bca17113dec18fad2309682cc678a5cd49704: Status 404 returned error can't find the container with id a6c1987c83a7d43566d49c17b61bca17113dec18fad2309682cc678a5cd49704
Sep 11 21:26:58.447288 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:58.447246    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:26:58.447455 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:58.447343    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:26:58.447455 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:58.447431    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:26:58.705292 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:58.705184    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl" event={"ID":"f882ef92-ae11-4f7c-8acb-ab3efc938ddd","Type":"ContainerStarted","Data":"26e468c727b79193c5c1a975376529fafbf95e842c01c14cf7dfa9191bf8c411"}
Sep 11 21:26:58.705292 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:58.705246    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl" event={"ID":"f882ef92-ae11-4f7c-8acb-ab3efc938ddd","Type":"ContainerStarted","Data":"a6c1987c83a7d43566d49c17b61bca17113dec18fad2309682cc678a5cd49704"}
Sep 11 21:26:58.737673 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:58.737605    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl" podStartSLOduration=1.737579329 podStartE2EDuration="1.737579329s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:26:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:26:58.735192688 +0000 UTC m=+1264.213504558" watchObservedRunningTime="2026-09-11 21:26:58.737579329 +0000 UTC m=+1264.215891175"
Sep 11 21:26:59.148688 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:59.148647    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl"
Sep 11 21:26:59.154886 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:59.154855    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl"
Sep 11 21:26:59.715715 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:59.715677    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl"
Sep 11 21:26:59.716762 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:26:59.716742    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl"
Sep 11 21:27:06.883566 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:06.883519    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-354c80-b556f688b-mfbw4"]
Sep 11 21:27:06.884141 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:06.884123    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83caeb6f-14a3-45c4-bd3f-7c74a376e34e" containerName="istio-proxy"
Sep 11 21:27:06.884141 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:06.884138    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="83caeb6f-14a3-45c4-bd3f-7c74a376e34e" containerName="istio-proxy"
Sep 11 21:27:06.887837 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:06.887812    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-354c80-b556f688b-mfbw4"
Sep 11 21:27:06.891462 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:06.891430    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-354c80\""
Sep 11 21:27:06.891680 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:06.891506    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-354c80-dockercfg-4mzd7\""
Sep 11 21:27:06.900711 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:06.900673    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-354c80-b556f688b-mfbw4"]
Sep 11 21:27:07.061449 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:07.061404    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc52j\" (UniqueName: \"kubernetes.io/projected/dde7503e-5d31-4661-b50a-61a5d9dcf344-kube-api-access-fc52j\") pod \"payload-pre-processing-e2e-api-a-354c80-b556f688b-mfbw4\" (UID: \"dde7503e-5d31-4661-b50a-61a5d9dcf344\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-354c80-b556f688b-mfbw4"
Sep 11 21:27:07.061649 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:07.061518    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dde7503e-5d31-4661-b50a-61a5d9dcf344-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-354c80-b556f688b-mfbw4\" (UID: \"dde7503e-5d31-4661-b50a-61a5d9dcf344\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-354c80-b556f688b-mfbw4"
Sep 11 21:27:07.162481 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:07.162336    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc52j\" (UniqueName: \"kubernetes.io/projected/dde7503e-5d31-4661-b50a-61a5d9dcf344-kube-api-access-fc52j\") pod \"payload-pre-processing-e2e-api-a-354c80-b556f688b-mfbw4\" (UID: \"dde7503e-5d31-4661-b50a-61a5d9dcf344\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-354c80-b556f688b-mfbw4"
Sep 11 21:27:07.162481 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:07.162436    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dde7503e-5d31-4661-b50a-61a5d9dcf344-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-354c80-b556f688b-mfbw4\" (UID: \"dde7503e-5d31-4661-b50a-61a5d9dcf344\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-354c80-b556f688b-mfbw4"
Sep 11 21:27:07.163531 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:07.163501    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dde7503e-5d31-4661-b50a-61a5d9dcf344-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-354c80-b556f688b-mfbw4\" (UID: \"dde7503e-5d31-4661-b50a-61a5d9dcf344\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-354c80-b556f688b-mfbw4"
Sep 11 21:27:07.172126 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:07.172080    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc52j\" (UniqueName: \"kubernetes.io/projected/dde7503e-5d31-4661-b50a-61a5d9dcf344-kube-api-access-fc52j\") pod \"payload-pre-processing-e2e-api-a-354c80-b556f688b-mfbw4\" (UID: \"dde7503e-5d31-4661-b50a-61a5d9dcf344\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-354c80-b556f688b-mfbw4"
Sep 11 21:27:07.202899 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:07.202861    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-354c80-b556f688b-mfbw4"
Sep 11 21:27:07.488656 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:07.488624    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-354c80-b556f688b-mfbw4"]
Sep 11 21:27:07.491094 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:27:07.491062    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddde7503e_5d31_4661_b50a_61a5d9dcf344.slice/crio-548e5e87d81704ca4e298dad1cbdc3dfbef2aee9af80a6e3ce38376787912727 WatchSource:0}: Error finding container 548e5e87d81704ca4e298dad1cbdc3dfbef2aee9af80a6e3ce38376787912727: Status 404 returned error can't find the container with id 548e5e87d81704ca4e298dad1cbdc3dfbef2aee9af80a6e3ce38376787912727
Sep 11 21:27:07.770434 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:07.770316    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-354c80-b556f688b-mfbw4" event={"ID":"dde7503e-5d31-4661-b50a-61a5d9dcf344","Type":"ContainerStarted","Data":"6c1ea2556e9d7b3049b353bf4e411d539955b9f8738989ac9870c2b40c2ce358"}
Sep 11 21:27:07.770434 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:07.770424    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-354c80-b556f688b-mfbw4" event={"ID":"dde7503e-5d31-4661-b50a-61a5d9dcf344","Type":"ContainerStarted","Data":"548e5e87d81704ca4e298dad1cbdc3dfbef2aee9af80a6e3ce38376787912727"}
Sep 11 21:27:07.770672 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:07.770448    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-354c80-b556f688b-mfbw4"
Sep 11 21:27:07.801823 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:07.801749    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-354c80-b556f688b-mfbw4" podStartSLOduration=1.8017258219999999 podStartE2EDuration="1.801725822s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:27:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:27:07.799438165 +0000 UTC m=+1273.277750013" watchObservedRunningTime="2026-09-11 21:27:07.801725822 +0000 UTC m=+1273.280037668"
Sep 11 21:27:18.782604 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:18.782561    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-354c80-b556f688b-mfbw4"
Sep 11 21:27:26.887947 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:26.887911    2560 generic.go:356] "Generic (PLEG): container finished" podID="f882ef92-ae11-4f7c-8acb-ab3efc938ddd" containerID="26e468c727b79193c5c1a975376529fafbf95e842c01c14cf7dfa9191bf8c411" exitCode=0
Sep 11 21:27:26.888444 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:26.887996    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl" event={"ID":"f882ef92-ae11-4f7c-8acb-ab3efc938ddd","Type":"ContainerDied","Data":"26e468c727b79193c5c1a975376529fafbf95e842c01c14cf7dfa9191bf8c411"}
Sep 11 21:27:26.888555 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:26.888539    2560 scope.go:117] "RemoveContainer" containerID="26e468c727b79193c5c1a975376529fafbf95e842c01c14cf7dfa9191bf8c411"
Sep 11 21:27:26.889867 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:26.889838    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:27:26.889947 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:26.889915    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:27:26.889984 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:26.889949    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:27:27.896279 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:27.896240    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl" event={"ID":"f882ef92-ae11-4f7c-8acb-ab3efc938ddd","Type":"ContainerStarted","Data":"794c08ebca223becf79d933d1dd44cdb6d2274e2bfb9c82d6baf4b239fe0397e"}
Sep 11 21:27:28.148359 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:28.148250    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl"
Sep 11 21:27:28.149746 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:28.149717    2560 patch_prober.go:28] interesting pod/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Sep 11 21:27:28.149857 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:28.149781    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl" podUID="f882ef92-ae11-4f7c-8acb-ab3efc938ddd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Sep 11 21:27:29.148286 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:29.148237    2560 patch_prober.go:28] interesting pod/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Sep 11 21:27:29.148832 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:29.148317    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl" podUID="f882ef92-ae11-4f7c-8acb-ab3efc938ddd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Sep 11 21:27:29.715842 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:29.715793    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl"
Sep 11 21:27:30.148166 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:30.148130    2560 patch_prober.go:28] interesting pod/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Sep 11 21:27:30.148431 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:30.148194    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl" podUID="f882ef92-ae11-4f7c-8acb-ab3efc938ddd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Sep 11 21:27:31.148688 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:31.148655    2560 patch_prober.go:28] interesting pod/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Sep 11 21:27:31.149093 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:31.148710    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl" podUID="f882ef92-ae11-4f7c-8acb-ab3efc938ddd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Sep 11 21:27:31.781409 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:31.780512    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8"]
Sep 11 21:27:31.784891 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:31.784861    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8"
Sep 11 21:27:31.788787 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:31.788756    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-2748c5-openshift-default-dockercfg-p266f\""
Sep 11 21:27:31.814958 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:31.814928    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8"]
Sep 11 21:27:31.953338 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:31.953301    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3a580f2-32b5-446f-9174-893b4aef56ad-istiod-ca-cert\") pod \"e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8\" (UID: \"b3a580f2-32b5-446f-9174-893b4aef56ad\") " pod="openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8"
Sep 11 21:27:31.953338 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:31.953348    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3a580f2-32b5-446f-9174-893b4aef56ad-istio-token\") pod \"e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8\" (UID: \"b3a580f2-32b5-446f-9174-893b4aef56ad\") " pod="openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8"
Sep 11 21:27:31.953665 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:31.953485    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3a580f2-32b5-446f-9174-893b4aef56ad-workload-socket\") pod \"e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8\" (UID: \"b3a580f2-32b5-446f-9174-893b4aef56ad\") " pod="openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8"
Sep 11 21:27:31.953665 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:31.953561    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3a580f2-32b5-446f-9174-893b4aef56ad-credential-socket\") pod \"e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8\" (UID: \"b3a580f2-32b5-446f-9174-893b4aef56ad\") " pod="openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8"
Sep 11 21:27:31.953665 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:31.953611    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3a580f2-32b5-446f-9174-893b4aef56ad-istio-envoy\") pod \"e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8\" (UID: \"b3a580f2-32b5-446f-9174-893b4aef56ad\") " pod="openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8"
Sep 11 21:27:31.953665 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:31.953639    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3a580f2-32b5-446f-9174-893b4aef56ad-istio-podinfo\") pod \"e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8\" (UID: \"b3a580f2-32b5-446f-9174-893b4aef56ad\") " pod="openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8"
Sep 11 21:27:31.953665 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:31.953664    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3a580f2-32b5-446f-9174-893b4aef56ad-workload-certs\") pod \"e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8\" (UID: \"b3a580f2-32b5-446f-9174-893b4aef56ad\") " pod="openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8"
Sep 11 21:27:31.953928 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:31.953732    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vln56\" (UniqueName: \"kubernetes.io/projected/b3a580f2-32b5-446f-9174-893b4aef56ad-kube-api-access-vln56\") pod \"e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8\" (UID: \"b3a580f2-32b5-446f-9174-893b4aef56ad\") " pod="openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8"
Sep 11 21:27:31.953928 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:31.953765    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3a580f2-32b5-446f-9174-893b4aef56ad-istio-data\") pod \"e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8\" (UID: \"b3a580f2-32b5-446f-9174-893b4aef56ad\") " pod="openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8"
Sep 11 21:27:32.054739 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:32.054635    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3a580f2-32b5-446f-9174-893b4aef56ad-credential-socket\") pod \"e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8\" (UID: \"b3a580f2-32b5-446f-9174-893b4aef56ad\") " pod="openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8"
Sep 11 21:27:32.054739 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:32.054682    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3a580f2-32b5-446f-9174-893b4aef56ad-istio-envoy\") pod \"e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8\" (UID: \"b3a580f2-32b5-446f-9174-893b4aef56ad\") " pod="openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8"
Sep 11 21:27:32.054739 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:32.054700    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3a580f2-32b5-446f-9174-893b4aef56ad-istio-podinfo\") pod \"e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8\" (UID: \"b3a580f2-32b5-446f-9174-893b4aef56ad\") " pod="openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8"
Sep 11 21:27:32.054739 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:32.054719    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3a580f2-32b5-446f-9174-893b4aef56ad-workload-certs\") pod \"e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8\" (UID: \"b3a580f2-32b5-446f-9174-893b4aef56ad\") " pod="openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8"
Sep 11 21:27:32.055089 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:32.054753    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vln56\" (UniqueName: \"kubernetes.io/projected/b3a580f2-32b5-446f-9174-893b4aef56ad-kube-api-access-vln56\") pod \"e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8\" (UID: \"b3a580f2-32b5-446f-9174-893b4aef56ad\") " pod="openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8"
Sep 11 21:27:32.055089 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:32.054770    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3a580f2-32b5-446f-9174-893b4aef56ad-istio-data\") pod \"e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8\" (UID: \"b3a580f2-32b5-446f-9174-893b4aef56ad\") " pod="openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8"
Sep 11 21:27:32.055089 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:32.054805    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3a580f2-32b5-446f-9174-893b4aef56ad-istiod-ca-cert\") pod \"e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8\" (UID: \"b3a580f2-32b5-446f-9174-893b4aef56ad\") " pod="openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8"
Sep 11 21:27:32.055089 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:32.054823    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3a580f2-32b5-446f-9174-893b4aef56ad-istio-token\") pod \"e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8\" (UID: \"b3a580f2-32b5-446f-9174-893b4aef56ad\") " pod="openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8"
Sep 11 21:27:32.055089 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:32.054879    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3a580f2-32b5-446f-9174-893b4aef56ad-workload-socket\") pod \"e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8\" (UID: \"b3a580f2-32b5-446f-9174-893b4aef56ad\") " pod="openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8"
Sep 11 21:27:32.055089 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:32.055016    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3a580f2-32b5-446f-9174-893b4aef56ad-credential-socket\") pod \"e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8\" (UID: \"b3a580f2-32b5-446f-9174-893b4aef56ad\") " pod="openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8"
Sep 11 21:27:32.055410 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:32.055137    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3a580f2-32b5-446f-9174-893b4aef56ad-workload-socket\") pod \"e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8\" (UID: \"b3a580f2-32b5-446f-9174-893b4aef56ad\") " pod="openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8"
Sep 11 21:27:32.055410 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:32.055301    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3a580f2-32b5-446f-9174-893b4aef56ad-istio-data\") pod \"e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8\" (UID: \"b3a580f2-32b5-446f-9174-893b4aef56ad\") " pod="openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8"
Sep 11 21:27:32.055520 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:32.055477    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3a580f2-32b5-446f-9174-893b4aef56ad-workload-certs\") pod \"e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8\" (UID: \"b3a580f2-32b5-446f-9174-893b4aef56ad\") " pod="openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8"
Sep 11 21:27:32.055806 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:32.055785    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3a580f2-32b5-446f-9174-893b4aef56ad-istiod-ca-cert\") pod \"e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8\" (UID: \"b3a580f2-32b5-446f-9174-893b4aef56ad\") " pod="openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8"
Sep 11 21:27:32.060410 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:32.057347    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3a580f2-32b5-446f-9174-893b4aef56ad-istio-envoy\") pod \"e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8\" (UID: \"b3a580f2-32b5-446f-9174-893b4aef56ad\") " pod="openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8"
Sep 11 21:27:32.060410 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:32.059217    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3a580f2-32b5-446f-9174-893b4aef56ad-istio-podinfo\") pod \"e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8\" (UID: \"b3a580f2-32b5-446f-9174-893b4aef56ad\") " pod="openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8"
Sep 11 21:27:32.073015 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:32.072977    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vln56\" (UniqueName: \"kubernetes.io/projected/b3a580f2-32b5-446f-9174-893b4aef56ad-kube-api-access-vln56\") pod \"e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8\" (UID: \"b3a580f2-32b5-446f-9174-893b4aef56ad\") " pod="openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8"
Sep 11 21:27:32.076310 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:32.076256    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3a580f2-32b5-446f-9174-893b4aef56ad-istio-token\") pod \"e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8\" (UID: \"b3a580f2-32b5-446f-9174-893b4aef56ad\") " pod="openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8"
Sep 11 21:27:32.099107 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:32.099079    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8"
Sep 11 21:27:32.148738 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:32.148625    2560 patch_prober.go:28] interesting pod/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Sep 11 21:27:32.148738 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:32.148689    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl" podUID="f882ef92-ae11-4f7c-8acb-ab3efc938ddd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Sep 11 21:27:32.394065 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:32.394017    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8"]
Sep 11 21:27:32.394683 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:27:32.394643    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3a580f2_32b5_446f_9174_893b4aef56ad.slice/crio-a1da6075c3a3a9b968d91547febea0ef1f45f3632bd91937bd9b11b451814b11 WatchSource:0}: Error finding container a1da6075c3a3a9b968d91547febea0ef1f45f3632bd91937bd9b11b451814b11: Status 404 returned error can't find the container with id a1da6075c3a3a9b968d91547febea0ef1f45f3632bd91937bd9b11b451814b11
Sep 11 21:27:32.397089 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:32.397061    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:27:32.397234 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:32.397220    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:27:32.397322 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:32.397311    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:27:32.929591 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:32.929550    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8" event={"ID":"b3a580f2-32b5-446f-9174-893b4aef56ad","Type":"ContainerStarted","Data":"720ee37293285761a63047eb1690014353713bb0b228b359ed661e87f31a9a8a"}
Sep 11 21:27:32.929835 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:32.929615    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8" event={"ID":"b3a580f2-32b5-446f-9174-893b4aef56ad","Type":"ContainerStarted","Data":"a1da6075c3a3a9b968d91547febea0ef1f45f3632bd91937bd9b11b451814b11"}
Sep 11 21:27:33.100547 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:33.100506    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8"
Sep 11 21:27:33.102533 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:33.102503    2560 patch_prober.go:28] interesting pod/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Sep 11 21:27:33.102801 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:33.102757    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8" podUID="b3a580f2-32b5-446f-9174-893b4aef56ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Sep 11 21:27:33.149077 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:33.149039    2560 patch_prober.go:28] interesting pod/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Sep 11 21:27:33.149539 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:33.149102    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl" podUID="f882ef92-ae11-4f7c-8acb-ab3efc938ddd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Sep 11 21:27:34.104622 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:34.104590    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8"
Sep 11 21:27:34.135399 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:34.135339    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8" podStartSLOduration=3.135319541 podStartE2EDuration="3.135319541s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:27:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:27:32.971102925 +0000 UTC m=+1298.449414794" watchObservedRunningTime="2026-09-11 21:27:34.135319541 +0000 UTC m=+1299.613631473"
Sep 11 21:27:34.153303 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:34.153272    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl"
Sep 11 21:27:34.154516 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:34.154492    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl"
Sep 11 21:27:34.947229 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:34.947191    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8"
Sep 11 21:27:34.948106 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:34.948088    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8"
Sep 11 21:27:36.372013 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:36.371965    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-713791/auth-test-model-713791-kserve-79bccd8599-4chq6"]
Sep 11 21:27:51.393759 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:51.393703    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-713791/auth-test-model-713791-kserve-79bccd8599-4chq6" podUID="fe0caa4a-9215-464f-8823-f70b1114659d" containerName="main" containerID="cri-o://9c8d4388ae82531eff48155ffaa0b084286c22e70e4e254e903859b4a50a61fb" gracePeriod=45
Sep 11 21:27:51.702564 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:51.702532    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-713791/auth-test-model-713791-kserve-79bccd8599-4chq6"
Sep 11 21:27:51.812080 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:51.812041    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe0caa4a-9215-464f-8823-f70b1114659d-home\") pod \"fe0caa4a-9215-464f-8823-f70b1114659d\" (UID: \"fe0caa4a-9215-464f-8823-f70b1114659d\") "
Sep 11 21:27:51.812255 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:51.812191    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe0caa4a-9215-464f-8823-f70b1114659d-tmp-dir\") pod \"fe0caa4a-9215-464f-8823-f70b1114659d\" (UID: \"fe0caa4a-9215-464f-8823-f70b1114659d\") "
Sep 11 21:27:51.812255 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:51.812237    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe0caa4a-9215-464f-8823-f70b1114659d-dshm\") pod \"fe0caa4a-9215-464f-8823-f70b1114659d\" (UID: \"fe0caa4a-9215-464f-8823-f70b1114659d\") "
Sep 11 21:27:51.812330 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:51.812288    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe0caa4a-9215-464f-8823-f70b1114659d-model-cache\") pod \"fe0caa4a-9215-464f-8823-f70b1114659d\" (UID: \"fe0caa4a-9215-464f-8823-f70b1114659d\") "
Sep 11 21:27:51.812370 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:51.812331    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe0caa4a-9215-464f-8823-f70b1114659d-tls-certs\") pod \"fe0caa4a-9215-464f-8823-f70b1114659d\" (UID: \"fe0caa4a-9215-464f-8823-f70b1114659d\") "
Sep 11 21:27:51.812370 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:51.812363    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4chj8\" (UniqueName: \"kubernetes.io/projected/fe0caa4a-9215-464f-8823-f70b1114659d-kube-api-access-4chj8\") pod \"fe0caa4a-9215-464f-8823-f70b1114659d\" (UID: \"fe0caa4a-9215-464f-8823-f70b1114659d\") "
Sep 11 21:27:51.812471 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:51.812365    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe0caa4a-9215-464f-8823-f70b1114659d-home" (OuterVolumeSpecName: "home") pod "fe0caa4a-9215-464f-8823-f70b1114659d" (UID: "fe0caa4a-9215-464f-8823-f70b1114659d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:27:51.812569 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:51.812519    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe0caa4a-9215-464f-8823-f70b1114659d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fe0caa4a-9215-464f-8823-f70b1114659d" (UID: "fe0caa4a-9215-464f-8823-f70b1114659d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:27:51.812607 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:51.812554    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe0caa4a-9215-464f-8823-f70b1114659d-model-cache" (OuterVolumeSpecName: "model-cache") pod "fe0caa4a-9215-464f-8823-f70b1114659d" (UID: "fe0caa4a-9215-464f-8823-f70b1114659d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:27:51.812892 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:51.812873    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe0caa4a-9215-464f-8823-f70b1114659d-tmp-dir\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:27:51.812892 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:51.812892    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe0caa4a-9215-464f-8823-f70b1114659d-model-cache\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:27:51.813048 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:51.812901    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe0caa4a-9215-464f-8823-f70b1114659d-home\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:27:51.814670 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:51.814644    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe0caa4a-9215-464f-8823-f70b1114659d-dshm" (OuterVolumeSpecName: "dshm") pod "fe0caa4a-9215-464f-8823-f70b1114659d" (UID: "fe0caa4a-9215-464f-8823-f70b1114659d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:27:51.814761 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:51.814710    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe0caa4a-9215-464f-8823-f70b1114659d-kube-api-access-4chj8" (OuterVolumeSpecName: "kube-api-access-4chj8") pod "fe0caa4a-9215-464f-8823-f70b1114659d" (UID: "fe0caa4a-9215-464f-8823-f70b1114659d"). InnerVolumeSpecName "kube-api-access-4chj8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:27:51.814805 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:51.814749    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe0caa4a-9215-464f-8823-f70b1114659d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fe0caa4a-9215-464f-8823-f70b1114659d" (UID: "fe0caa4a-9215-464f-8823-f70b1114659d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:27:51.913824 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:51.913724    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe0caa4a-9215-464f-8823-f70b1114659d-dshm\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:27:51.913824 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:51.913760    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe0caa4a-9215-464f-8823-f70b1114659d-tls-certs\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:27:51.913824 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:51.913771    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4chj8\" (UniqueName: \"kubernetes.io/projected/fe0caa4a-9215-464f-8823-f70b1114659d-kube-api-access-4chj8\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:27:52.059202 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:52.057132    2560 generic.go:356] "Generic (PLEG): container finished" podID="fe0caa4a-9215-464f-8823-f70b1114659d" containerID="9c8d4388ae82531eff48155ffaa0b084286c22e70e4e254e903859b4a50a61fb" exitCode=0
Sep 11 21:27:52.059202 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:52.057352    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-713791/auth-test-model-713791-kserve-79bccd8599-4chq6" event={"ID":"fe0caa4a-9215-464f-8823-f70b1114659d","Type":"ContainerDied","Data":"9c8d4388ae82531eff48155ffaa0b084286c22e70e4e254e903859b4a50a61fb"}
Sep 11 21:27:52.059202 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:52.057412    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-713791/auth-test-model-713791-kserve-79bccd8599-4chq6" event={"ID":"fe0caa4a-9215-464f-8823-f70b1114659d","Type":"ContainerDied","Data":"82c4686740612ab64399f8cfb86b40a450cf389106cbfba303312979a66f1ebf"}
Sep 11 21:27:52.059202 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:52.057436    2560 scope.go:117] "RemoveContainer" containerID="9c8d4388ae82531eff48155ffaa0b084286c22e70e4e254e903859b4a50a61fb"
Sep 11 21:27:52.059202 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:52.057607    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-713791/auth-test-model-713791-kserve-79bccd8599-4chq6"
Sep 11 21:27:52.080088 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:52.080061    2560 scope.go:117] "RemoveContainer" containerID="9c8d4388ae82531eff48155ffaa0b084286c22e70e4e254e903859b4a50a61fb"
Sep 11 21:27:52.080754 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:27:52.080654    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c8d4388ae82531eff48155ffaa0b084286c22e70e4e254e903859b4a50a61fb\": container with ID starting with 9c8d4388ae82531eff48155ffaa0b084286c22e70e4e254e903859b4a50a61fb not found: ID does not exist" containerID="9c8d4388ae82531eff48155ffaa0b084286c22e70e4e254e903859b4a50a61fb"
Sep 11 21:27:52.080754 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:52.080694    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c8d4388ae82531eff48155ffaa0b084286c22e70e4e254e903859b4a50a61fb"} err="failed to get container status \"9c8d4388ae82531eff48155ffaa0b084286c22e70e4e254e903859b4a50a61fb\": rpc error: code = NotFound desc = could not find container \"9c8d4388ae82531eff48155ffaa0b084286c22e70e4e254e903859b4a50a61fb\": container with ID starting with 9c8d4388ae82531eff48155ffaa0b084286c22e70e4e254e903859b4a50a61fb not found: ID does not exist"
Sep 11 21:27:52.103361 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:52.103328    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-713791/auth-test-model-713791-kserve-79bccd8599-4chq6"]
Sep 11 21:27:52.109003 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:52.108974    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-713791/auth-test-model-713791-kserve-79bccd8599-4chq6"]
Sep 11 21:27:53.038950 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:53.038911    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe0caa4a-9215-464f-8823-f70b1114659d" path="/var/lib/kubelet/pods/fe0caa4a-9215-464f-8823-f70b1114659d/volumes"
Sep 11 21:27:55.312717 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:27:55.312676    2560 scope.go:117] "RemoveContainer" containerID="c4cca0e4b9cdcbba034011ed3515b809adc7bf092ea90b63aec06bdfed3146d6"
Sep 11 21:28:00.127337 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:00.127301    2560 generic.go:356] "Generic (PLEG): container finished" podID="b3a580f2-32b5-446f-9174-893b4aef56ad" containerID="720ee37293285761a63047eb1690014353713bb0b228b359ed661e87f31a9a8a" exitCode=0
Sep 11 21:28:00.127811 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:00.127371    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8" event={"ID":"b3a580f2-32b5-446f-9174-893b4aef56ad","Type":"ContainerDied","Data":"720ee37293285761a63047eb1690014353713bb0b228b359ed661e87f31a9a8a"}
Sep 11 21:28:00.127861 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:00.127835    2560 scope.go:117] "RemoveContainer" containerID="720ee37293285761a63047eb1690014353713bb0b228b359ed661e87f31a9a8a"
Sep 11 21:28:00.129128 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:00.129092    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:28:00.129203 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:00.129187    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:28:00.129244 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:00.129223    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:28:01.135293 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:01.135257    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8" event={"ID":"b3a580f2-32b5-446f-9174-893b4aef56ad","Type":"ContainerStarted","Data":"d3117c0abd8d511080bae0b714e7ad469f4aafa294b2dd334cdb4167677bfcc6"}
Sep 11 21:28:02.100295 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:02.100253    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8"
Sep 11 21:28:02.101671 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:02.101641    2560 patch_prober.go:28] interesting pod/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Sep 11 21:28:02.101808 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:02.101708    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8" podUID="b3a580f2-32b5-446f-9174-893b4aef56ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Sep 11 21:28:03.099631 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:03.099590    2560 patch_prober.go:28] interesting pod/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Sep 11 21:28:03.100125 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:03.099661    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8" podUID="b3a580f2-32b5-446f-9174-893b4aef56ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Sep 11 21:28:04.100350 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:04.100304    2560 patch_prober.go:28] interesting pod/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Sep 11 21:28:04.100791 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:04.100406    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8" podUID="b3a580f2-32b5-446f-9174-893b4aef56ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Sep 11 21:28:04.947110 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:04.947078    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8"
Sep 11 21:28:05.099883 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:05.099845    2560 patch_prober.go:28] interesting pod/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Sep 11 21:28:05.100071 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:05.099930    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8" podUID="b3a580f2-32b5-446f-9174-893b4aef56ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Sep 11 21:28:06.099655 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:06.099617    2560 patch_prober.go:28] interesting pod/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Sep 11 21:28:06.100138 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:06.099693    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8" podUID="b3a580f2-32b5-446f-9174-893b4aef56ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Sep 11 21:28:07.104121 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:07.104089    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8"
Sep 11 21:28:07.105349 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:07.105328    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8"
Sep 11 21:28:08.195468 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:08.195432    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-354c80-5cckg"]
Sep 11 21:28:08.195958 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:08.195944    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe0caa4a-9215-464f-8823-f70b1114659d" containerName="main"
Sep 11 21:28:08.196011 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:08.195960    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe0caa4a-9215-464f-8823-f70b1114659d" containerName="main"
Sep 11 21:28:08.196052 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:08.196026    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe0caa4a-9215-464f-8823-f70b1114659d" containerName="main"
Sep 11 21:28:08.198647 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:08.198630    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-354c80-5cckg"
Sep 11 21:28:08.201701 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:08.201674    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 21:28:08.201701 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:08.201697    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bfm9g\""
Sep 11 21:28:08.219283 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:08.219245    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-354c80-5cckg"]
Sep 11 21:28:08.319910 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:08.319871    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e4186c4-14d5-4168-928d-eeb140a03919-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-354c80-5cckg\" (UID: \"0e4186c4-14d5-4168-928d-eeb140a03919\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-354c80-5cckg"
Sep 11 21:28:08.421473 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:08.421433    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e4186c4-14d5-4168-928d-eeb140a03919-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-354c80-5cckg\" (UID: \"0e4186c4-14d5-4168-928d-eeb140a03919\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-354c80-5cckg"
Sep 11 21:28:08.422073 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:08.422053    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e4186c4-14d5-4168-928d-eeb140a03919-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-354c80-5cckg\" (UID: \"0e4186c4-14d5-4168-928d-eeb140a03919\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-354c80-5cckg"
Sep 11 21:28:08.510599 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:08.510500    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-354c80-5cckg"
Sep 11 21:28:08.792982 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:08.792955    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-354c80-5cckg"]
Sep 11 21:28:08.795454 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:28:08.795425    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e4186c4_14d5_4168_928d_eeb140a03919.slice/crio-8b2cd0ba03fc8bfd20a966fedb88117f1059e9d28514412c779c60360133b53d WatchSource:0}: Error finding container 8b2cd0ba03fc8bfd20a966fedb88117f1059e9d28514412c779c60360133b53d: Status 404 returned error can't find the container with id 8b2cd0ba03fc8bfd20a966fedb88117f1059e9d28514412c779c60360133b53d
Sep 11 21:28:09.187858 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:09.187823    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-354c80-5cckg" event={"ID":"0e4186c4-14d5-4168-928d-eeb140a03919","Type":"ContainerStarted","Data":"edd762d50cf09880dcb406316440d41d4c0376ed0fbd5341f290e79916ea6ca9"}
Sep 11 21:28:09.188051 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:09.187888    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-354c80-5cckg" event={"ID":"0e4186c4-14d5-4168-928d-eeb140a03919","Type":"ContainerStarted","Data":"8b2cd0ba03fc8bfd20a966fedb88117f1059e9d28514412c779c60360133b53d"}
Sep 11 21:28:09.215853 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:09.215794    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-354c80-5cckg" podStartSLOduration=1.215773807 podStartE2EDuration="1.215773807s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:28:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:28:09.213550851 +0000 UTC m=+1334.691862696" watchObservedRunningTime="2026-09-11 21:28:09.215773807 +0000 UTC m=+1334.694085651"
Sep 11 21:28:10.196126 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:10.196089    2560 generic.go:356] "Generic (PLEG): container finished" podID="0e4186c4-14d5-4168-928d-eeb140a03919" containerID="edd762d50cf09880dcb406316440d41d4c0376ed0fbd5341f290e79916ea6ca9" exitCode=0
Sep 11 21:28:10.196315 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:10.196171    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-354c80-5cckg" event={"ID":"0e4186c4-14d5-4168-928d-eeb140a03919","Type":"ContainerDied","Data":"edd762d50cf09880dcb406316440d41d4c0376ed0fbd5341f290e79916ea6ca9"}
Sep 11 21:28:11.345351 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:11.345327    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-354c80-5cckg"
Sep 11 21:28:11.453727 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:11.453641    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e4186c4-14d5-4168-928d-eeb140a03919-maas-api-service-ca\") pod \"0e4186c4-14d5-4168-928d-eeb140a03919\" (UID: \"0e4186c4-14d5-4168-928d-eeb140a03919\") "
Sep 11 21:28:11.454005 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:11.453981    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e4186c4-14d5-4168-928d-eeb140a03919-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0e4186c4-14d5-4168-928d-eeb140a03919" (UID: "0e4186c4-14d5-4168-928d-eeb140a03919"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:28:11.554756 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:11.554719    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e4186c4-14d5-4168-928d-eeb140a03919-maas-api-service-ca\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:28:12.209953 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:12.209917    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-354c80-5cckg"
Sep 11 21:28:12.209953 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:12.209939    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-354c80-5cckg" event={"ID":"0e4186c4-14d5-4168-928d-eeb140a03919","Type":"ContainerDied","Data":"8b2cd0ba03fc8bfd20a966fedb88117f1059e9d28514412c779c60360133b53d"}
Sep 11 21:28:12.210172 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:12.209988    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8b2cd0ba03fc8bfd20a966fedb88117f1059e9d28514412c779c60360133b53d"
Sep 11 21:28:24.596891 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:24.596852    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-354c80-b556f688b-mfbw4"]
Sep 11 21:28:24.597572 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:24.597111    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-354c80-b556f688b-mfbw4" podUID="dde7503e-5d31-4661-b50a-61a5d9dcf344" containerName="payload-pre-processing" containerID="cri-o://6c1ea2556e9d7b3049b353bf4e411d539955b9f8738989ac9870c2b40c2ce358" gracePeriod=30
Sep 11 21:28:24.889686 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:24.889645    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-354c80-b556f688b-mfbw4"
Sep 11 21:28:24.993690 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:24.993645    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-354c80-5cckg"]
Sep 11 21:28:24.999899 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:24.999863    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-354c80-5cckg"]
Sep 11 21:28:25.007464 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:25.007431    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dde7503e-5d31-4661-b50a-61a5d9dcf344-plugins-config-volume\") pod \"dde7503e-5d31-4661-b50a-61a5d9dcf344\" (UID: \"dde7503e-5d31-4661-b50a-61a5d9dcf344\") "
Sep 11 21:28:25.007641 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:25.007559    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fc52j\" (UniqueName: \"kubernetes.io/projected/dde7503e-5d31-4661-b50a-61a5d9dcf344-kube-api-access-fc52j\") pod \"dde7503e-5d31-4661-b50a-61a5d9dcf344\" (UID: \"dde7503e-5d31-4661-b50a-61a5d9dcf344\") "
Sep 11 21:28:25.010229 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:25.007882    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dde7503e-5d31-4661-b50a-61a5d9dcf344-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "dde7503e-5d31-4661-b50a-61a5d9dcf344" (UID: "dde7503e-5d31-4661-b50a-61a5d9dcf344"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:28:25.010916 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:25.010889    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dde7503e-5d31-4661-b50a-61a5d9dcf344-kube-api-access-fc52j" (OuterVolumeSpecName: "kube-api-access-fc52j") pod "dde7503e-5d31-4661-b50a-61a5d9dcf344" (UID: "dde7503e-5d31-4661-b50a-61a5d9dcf344"). InnerVolumeSpecName "kube-api-access-fc52j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:28:25.038756 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:25.038720    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e4186c4-14d5-4168-928d-eeb140a03919" path="/var/lib/kubelet/pods/0e4186c4-14d5-4168-928d-eeb140a03919/volumes"
Sep 11 21:28:25.109063 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:25.109021    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fc52j\" (UniqueName: \"kubernetes.io/projected/dde7503e-5d31-4661-b50a-61a5d9dcf344-kube-api-access-fc52j\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:28:25.109063 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:25.109059    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dde7503e-5d31-4661-b50a-61a5d9dcf344-plugins-config-volume\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:28:25.285084 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:25.284984    2560 generic.go:356] "Generic (PLEG): container finished" podID="dde7503e-5d31-4661-b50a-61a5d9dcf344" containerID="6c1ea2556e9d7b3049b353bf4e411d539955b9f8738989ac9870c2b40c2ce358" exitCode=0
Sep 11 21:28:25.285084 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:25.285032    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-354c80-b556f688b-mfbw4"
Sep 11 21:28:25.285336 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:25.285074    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-354c80-b556f688b-mfbw4" event={"ID":"dde7503e-5d31-4661-b50a-61a5d9dcf344","Type":"ContainerDied","Data":"6c1ea2556e9d7b3049b353bf4e411d539955b9f8738989ac9870c2b40c2ce358"}
Sep 11 21:28:25.285336 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:25.285137    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-354c80-b556f688b-mfbw4" event={"ID":"dde7503e-5d31-4661-b50a-61a5d9dcf344","Type":"ContainerDied","Data":"548e5e87d81704ca4e298dad1cbdc3dfbef2aee9af80a6e3ce38376787912727"}
Sep 11 21:28:25.285336 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:25.285167    2560 scope.go:117] "RemoveContainer" containerID="6c1ea2556e9d7b3049b353bf4e411d539955b9f8738989ac9870c2b40c2ce358"
Sep 11 21:28:25.294711 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:25.294689    2560 scope.go:117] "RemoveContainer" containerID="6c1ea2556e9d7b3049b353bf4e411d539955b9f8738989ac9870c2b40c2ce358"
Sep 11 21:28:25.294988 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:28:25.294969    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c1ea2556e9d7b3049b353bf4e411d539955b9f8738989ac9870c2b40c2ce358\": container with ID starting with 6c1ea2556e9d7b3049b353bf4e411d539955b9f8738989ac9870c2b40c2ce358 not found: ID does not exist" containerID="6c1ea2556e9d7b3049b353bf4e411d539955b9f8738989ac9870c2b40c2ce358"
Sep 11 21:28:25.295037 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:25.294998    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c1ea2556e9d7b3049b353bf4e411d539955b9f8738989ac9870c2b40c2ce358"} err="failed to get container status \"6c1ea2556e9d7b3049b353bf4e411d539955b9f8738989ac9870c2b40c2ce358\": rpc error: code = NotFound desc = could not find container \"6c1ea2556e9d7b3049b353bf4e411d539955b9f8738989ac9870c2b40c2ce358\": container with ID starting with 6c1ea2556e9d7b3049b353bf4e411d539955b9f8738989ac9870c2b40c2ce358 not found: ID does not exist"
Sep 11 21:28:25.324909 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:25.324849    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-354c80-b556f688b-mfbw4"]
Sep 11 21:28:25.332116 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:25.332079    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-354c80-b556f688b-mfbw4"]
Sep 11 21:28:27.038288 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:27.038251    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dde7503e-5d31-4661-b50a-61a5d9dcf344" path="/var/lib/kubelet/pods/dde7503e-5d31-4661-b50a-61a5d9dcf344/volumes"
Sep 11 21:28:34.540632 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:34.540595    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl"]
Sep 11 21:28:34.541078 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:34.540888    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl" podUID="f882ef92-ae11-4f7c-8acb-ab3efc938ddd" containerName="istio-proxy" containerID="cri-o://794c08ebca223becf79d933d1dd44cdb6d2274e2bfb9c82d6baf4b239fe0397e" gracePeriod=30
Sep 11 21:28:34.924871 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:34.924825    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2748c5-psxfr"]
Sep 11 21:28:34.925458 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:34.925438    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e4186c4-14d5-4168-928d-eeb140a03919" containerName="revoke-keys"
Sep 11 21:28:34.925458 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:34.925457    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e4186c4-14d5-4168-928d-eeb140a03919" containerName="revoke-keys"
Sep 11 21:28:34.925598 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:34.925486    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dde7503e-5d31-4661-b50a-61a5d9dcf344" containerName="payload-pre-processing"
Sep 11 21:28:34.925598 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:34.925492    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="dde7503e-5d31-4661-b50a-61a5d9dcf344" containerName="payload-pre-processing"
Sep 11 21:28:34.925598 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:34.925575    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e4186c4-14d5-4168-928d-eeb140a03919" containerName="revoke-keys"
Sep 11 21:28:34.925598 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:34.925583    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="dde7503e-5d31-4661-b50a-61a5d9dcf344" containerName="payload-pre-processing"
Sep 11 21:28:34.928203 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:34.928178    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2748c5-psxfr"
Sep 11 21:28:34.931285 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:34.931255    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bfm9g\""
Sep 11 21:28:34.931285 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:34.931256    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 21:28:34.940119 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:34.940089    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2748c5-psxfr"]
Sep 11 21:28:35.018059 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:35.018018    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e2434da-8632-49f6-90a1-3edfae6a1afd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-2748c5-psxfr\" (UID: \"0e2434da-8632-49f6-90a1-3edfae6a1afd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2748c5-psxfr"
Sep 11 21:28:35.119776 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:35.119733    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e2434da-8632-49f6-90a1-3edfae6a1afd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-2748c5-psxfr\" (UID: \"0e2434da-8632-49f6-90a1-3edfae6a1afd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2748c5-psxfr"
Sep 11 21:28:35.120732 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:35.120702    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e2434da-8632-49f6-90a1-3edfae6a1afd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-2748c5-psxfr\" (UID: \"0e2434da-8632-49f6-90a1-3edfae6a1afd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2748c5-psxfr"
Sep 11 21:28:35.241598 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:35.241505    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2748c5-psxfr"
Sep 11 21:28:35.541895 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:35.541804    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2748c5-psxfr"]
Sep 11 21:28:35.545042 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:28:35.545016    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e2434da_8632_49f6_90a1_3edfae6a1afd.slice/crio-d87801766614a75348255381064e524cd3c6ab72201cd1e13d9bf3bff4cc8391 WatchSource:0}: Error finding container d87801766614a75348255381064e524cd3c6ab72201cd1e13d9bf3bff4cc8391: Status 404 returned error can't find the container with id d87801766614a75348255381064e524cd3c6ab72201cd1e13d9bf3bff4cc8391
Sep 11 21:28:36.354835 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:36.354738    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2748c5-psxfr" event={"ID":"0e2434da-8632-49f6-90a1-3edfae6a1afd","Type":"ContainerStarted","Data":"8aac5b2ea6c98c0f1b5b8ed4bb46572d158cbbf8597ec9b7e3c2b49278c00d1d"}
Sep 11 21:28:36.354835 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:36.354806    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2748c5-psxfr" event={"ID":"0e2434da-8632-49f6-90a1-3edfae6a1afd","Type":"ContainerStarted","Data":"d87801766614a75348255381064e524cd3c6ab72201cd1e13d9bf3bff4cc8391"}
Sep 11 21:28:36.391093 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:36.391041    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2748c5-psxfr" podStartSLOduration=2.391021445 podStartE2EDuration="2.391021445s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:28:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:28:36.389227913 +0000 UTC m=+1361.867539758" watchObservedRunningTime="2026-09-11 21:28:36.391021445 +0000 UTC m=+1361.869333289"
Sep 11 21:28:37.363054 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:37.363015    2560 generic.go:356] "Generic (PLEG): container finished" podID="0e2434da-8632-49f6-90a1-3edfae6a1afd" containerID="8aac5b2ea6c98c0f1b5b8ed4bb46572d158cbbf8597ec9b7e3c2b49278c00d1d" exitCode=0
Sep 11 21:28:37.363529 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:37.363091    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2748c5-psxfr" event={"ID":"0e2434da-8632-49f6-90a1-3edfae6a1afd","Type":"ContainerDied","Data":"8aac5b2ea6c98c0f1b5b8ed4bb46572d158cbbf8597ec9b7e3c2b49278c00d1d"}
Sep 11 21:28:38.512413 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:38.512351    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2748c5-psxfr"
Sep 11 21:28:38.560483 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:38.560452    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e2434da-8632-49f6-90a1-3edfae6a1afd-maas-api-service-ca\") pod \"0e2434da-8632-49f6-90a1-3edfae6a1afd\" (UID: \"0e2434da-8632-49f6-90a1-3edfae6a1afd\") "
Sep 11 21:28:38.560855 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:38.560830    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e2434da-8632-49f6-90a1-3edfae6a1afd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0e2434da-8632-49f6-90a1-3edfae6a1afd" (UID: "0e2434da-8632-49f6-90a1-3edfae6a1afd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:28:38.561079 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:38.561064    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e2434da-8632-49f6-90a1-3edfae6a1afd-maas-api-service-ca\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:28:39.378058 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:39.378011    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2748c5-psxfr" event={"ID":"0e2434da-8632-49f6-90a1-3edfae6a1afd","Type":"ContainerDied","Data":"d87801766614a75348255381064e524cd3c6ab72201cd1e13d9bf3bff4cc8391"}
Sep 11 21:28:39.378058 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:39.378038    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2748c5-psxfr"
Sep 11 21:28:39.378284 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:39.378077    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d87801766614a75348255381064e524cd3c6ab72201cd1e13d9bf3bff4cc8391"
Sep 11 21:28:39.809144 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:39.809119    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl"
Sep 11 21:28:39.877173 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:39.877136    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f882ef92-ae11-4f7c-8acb-ab3efc938ddd-istio-token\") pod \"f882ef92-ae11-4f7c-8acb-ab3efc938ddd\" (UID: \"f882ef92-ae11-4f7c-8acb-ab3efc938ddd\") "
Sep 11 21:28:39.877358 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:39.877185    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b77x7\" (UniqueName: \"kubernetes.io/projected/f882ef92-ae11-4f7c-8acb-ab3efc938ddd-kube-api-access-b77x7\") pod \"f882ef92-ae11-4f7c-8acb-ab3efc938ddd\" (UID: \"f882ef92-ae11-4f7c-8acb-ab3efc938ddd\") "
Sep 11 21:28:39.877358 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:39.877288    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f882ef92-ae11-4f7c-8acb-ab3efc938ddd-istiod-ca-cert\") pod \"f882ef92-ae11-4f7c-8acb-ab3efc938ddd\" (UID: \"f882ef92-ae11-4f7c-8acb-ab3efc938ddd\") "
Sep 11 21:28:39.877358 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:39.877319    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f882ef92-ae11-4f7c-8acb-ab3efc938ddd-workload-socket\") pod \"f882ef92-ae11-4f7c-8acb-ab3efc938ddd\" (UID: \"f882ef92-ae11-4f7c-8acb-ab3efc938ddd\") "
Sep 11 21:28:39.877358 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:39.877355    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f882ef92-ae11-4f7c-8acb-ab3efc938ddd-istio-data\") pod \"f882ef92-ae11-4f7c-8acb-ab3efc938ddd\" (UID: \"f882ef92-ae11-4f7c-8acb-ab3efc938ddd\") "
Sep 11 21:28:39.877612 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:39.877443    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f882ef92-ae11-4f7c-8acb-ab3efc938ddd-credential-socket\") pod \"f882ef92-ae11-4f7c-8acb-ab3efc938ddd\" (UID: \"f882ef92-ae11-4f7c-8acb-ab3efc938ddd\") "
Sep 11 21:28:39.877612 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:39.877485    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f882ef92-ae11-4f7c-8acb-ab3efc938ddd-istio-envoy\") pod \"f882ef92-ae11-4f7c-8acb-ab3efc938ddd\" (UID: \"f882ef92-ae11-4f7c-8acb-ab3efc938ddd\") "
Sep 11 21:28:39.877612 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:39.877539    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f882ef92-ae11-4f7c-8acb-ab3efc938ddd-istio-podinfo\") pod \"f882ef92-ae11-4f7c-8acb-ab3efc938ddd\" (UID: \"f882ef92-ae11-4f7c-8acb-ab3efc938ddd\") "
Sep 11 21:28:39.877612 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:39.877564    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f882ef92-ae11-4f7c-8acb-ab3efc938ddd-workload-certs\") pod \"f882ef92-ae11-4f7c-8acb-ab3efc938ddd\" (UID: \"f882ef92-ae11-4f7c-8acb-ab3efc938ddd\") "
Sep 11 21:28:39.877797 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:39.877698    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f882ef92-ae11-4f7c-8acb-ab3efc938ddd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f882ef92-ae11-4f7c-8acb-ab3efc938ddd" (UID: "f882ef92-ae11-4f7c-8acb-ab3efc938ddd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:28:39.877797 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:39.877701    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f882ef92-ae11-4f7c-8acb-ab3efc938ddd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f882ef92-ae11-4f7c-8acb-ab3efc938ddd" (UID: "f882ef92-ae11-4f7c-8acb-ab3efc938ddd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:28:39.878256 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:39.877886    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f882ef92-ae11-4f7c-8acb-ab3efc938ddd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f882ef92-ae11-4f7c-8acb-ab3efc938ddd" (UID: "f882ef92-ae11-4f7c-8acb-ab3efc938ddd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:28:39.878256 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:39.878050    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f882ef92-ae11-4f7c-8acb-ab3efc938ddd-istiod-ca-cert\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:28:39.878256 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:39.878068    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f882ef92-ae11-4f7c-8acb-ab3efc938ddd-workload-socket\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:28:39.878256 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:39.878081    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f882ef92-ae11-4f7c-8acb-ab3efc938ddd-credential-socket\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:28:39.878256 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:39.878116    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f882ef92-ae11-4f7c-8acb-ab3efc938ddd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f882ef92-ae11-4f7c-8acb-ab3efc938ddd" (UID: "f882ef92-ae11-4f7c-8acb-ab3efc938ddd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:28:39.878256 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:39.878211    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f882ef92-ae11-4f7c-8acb-ab3efc938ddd-istio-data" (OuterVolumeSpecName: "istio-data") pod "f882ef92-ae11-4f7c-8acb-ab3efc938ddd" (UID: "f882ef92-ae11-4f7c-8acb-ab3efc938ddd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:28:39.880117 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:39.880056    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f882ef92-ae11-4f7c-8acb-ab3efc938ddd-istio-token" (OuterVolumeSpecName: "istio-token") pod "f882ef92-ae11-4f7c-8acb-ab3efc938ddd" (UID: "f882ef92-ae11-4f7c-8acb-ab3efc938ddd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:28:39.880117 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:39.880098    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f882ef92-ae11-4f7c-8acb-ab3efc938ddd-kube-api-access-b77x7" (OuterVolumeSpecName: "kube-api-access-b77x7") pod "f882ef92-ae11-4f7c-8acb-ab3efc938ddd" (UID: "f882ef92-ae11-4f7c-8acb-ab3efc938ddd"). InnerVolumeSpecName "kube-api-access-b77x7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:28:39.880319 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:39.880130    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f882ef92-ae11-4f7c-8acb-ab3efc938ddd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f882ef92-ae11-4f7c-8acb-ab3efc938ddd" (UID: "f882ef92-ae11-4f7c-8acb-ab3efc938ddd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 21:28:39.880549 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:39.880517    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f882ef92-ae11-4f7c-8acb-ab3efc938ddd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f882ef92-ae11-4f7c-8acb-ab3efc938ddd" (UID: "f882ef92-ae11-4f7c-8acb-ab3efc938ddd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:28:39.979181 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:39.979084    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f882ef92-ae11-4f7c-8acb-ab3efc938ddd-istio-data\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:28:39.979181 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:39.979120    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f882ef92-ae11-4f7c-8acb-ab3efc938ddd-istio-envoy\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:28:39.979181 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:39.979130    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f882ef92-ae11-4f7c-8acb-ab3efc938ddd-istio-podinfo\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:28:39.979181 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:39.979139    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f882ef92-ae11-4f7c-8acb-ab3efc938ddd-workload-certs\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:28:39.979181 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:39.979148    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f882ef92-ae11-4f7c-8acb-ab3efc938ddd-istio-token\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:28:39.979181 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:39.979156    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b77x7\" (UniqueName: \"kubernetes.io/projected/f882ef92-ae11-4f7c-8acb-ab3efc938ddd-kube-api-access-b77x7\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:28:40.385896 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:40.385864    2560 generic.go:356] "Generic (PLEG): container finished" podID="f882ef92-ae11-4f7c-8acb-ab3efc938ddd" containerID="794c08ebca223becf79d933d1dd44cdb6d2274e2bfb9c82d6baf4b239fe0397e" exitCode=0
Sep 11 21:28:40.386075 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:40.385917    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl"
Sep 11 21:28:40.386075 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:40.385928    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl" event={"ID":"f882ef92-ae11-4f7c-8acb-ab3efc938ddd","Type":"ContainerDied","Data":"794c08ebca223becf79d933d1dd44cdb6d2274e2bfb9c82d6baf4b239fe0397e"}
Sep 11 21:28:40.386075 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:40.385974    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl" event={"ID":"f882ef92-ae11-4f7c-8acb-ab3efc938ddd","Type":"ContainerDied","Data":"a6c1987c83a7d43566d49c17b61bca17113dec18fad2309682cc678a5cd49704"}
Sep 11 21:28:40.386075 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:40.385996    2560 scope.go:117] "RemoveContainer" containerID="794c08ebca223becf79d933d1dd44cdb6d2274e2bfb9c82d6baf4b239fe0397e"
Sep 11 21:28:40.397095 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:40.397071    2560 scope.go:117] "RemoveContainer" containerID="26e468c727b79193c5c1a975376529fafbf95e842c01c14cf7dfa9191bf8c411"
Sep 11 21:28:40.406263 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:40.406243    2560 scope.go:117] "RemoveContainer" containerID="794c08ebca223becf79d933d1dd44cdb6d2274e2bfb9c82d6baf4b239fe0397e"
Sep 11 21:28:40.406544 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:28:40.406522    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"794c08ebca223becf79d933d1dd44cdb6d2274e2bfb9c82d6baf4b239fe0397e\": container with ID starting with 794c08ebca223becf79d933d1dd44cdb6d2274e2bfb9c82d6baf4b239fe0397e not found: ID does not exist" containerID="794c08ebca223becf79d933d1dd44cdb6d2274e2bfb9c82d6baf4b239fe0397e"
Sep 11 21:28:40.406591 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:40.406557    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"794c08ebca223becf79d933d1dd44cdb6d2274e2bfb9c82d6baf4b239fe0397e"} err="failed to get container status \"794c08ebca223becf79d933d1dd44cdb6d2274e2bfb9c82d6baf4b239fe0397e\": rpc error: code = NotFound desc = could not find container \"794c08ebca223becf79d933d1dd44cdb6d2274e2bfb9c82d6baf4b239fe0397e\": container with ID starting with 794c08ebca223becf79d933d1dd44cdb6d2274e2bfb9c82d6baf4b239fe0397e not found: ID does not exist"
Sep 11 21:28:40.406591 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:40.406574    2560 scope.go:117] "RemoveContainer" containerID="26e468c727b79193c5c1a975376529fafbf95e842c01c14cf7dfa9191bf8c411"
Sep 11 21:28:40.406861 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:28:40.406840    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26e468c727b79193c5c1a975376529fafbf95e842c01c14cf7dfa9191bf8c411\": container with ID starting with 26e468c727b79193c5c1a975376529fafbf95e842c01c14cf7dfa9191bf8c411 not found: ID does not exist" containerID="26e468c727b79193c5c1a975376529fafbf95e842c01c14cf7dfa9191bf8c411"
Sep 11 21:28:40.406945 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:40.406866    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26e468c727b79193c5c1a975376529fafbf95e842c01c14cf7dfa9191bf8c411"} err="failed to get container status \"26e468c727b79193c5c1a975376529fafbf95e842c01c14cf7dfa9191bf8c411\": rpc error: code = NotFound desc = could not find container \"26e468c727b79193c5c1a975376529fafbf95e842c01c14cf7dfa9191bf8c411\": container with ID starting with 26e468c727b79193c5c1a975376529fafbf95e842c01c14cf7dfa9191bf8c411 not found: ID does not exist"
Sep 11 21:28:40.443825 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:40.443797    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl"]
Sep 11 21:28:40.453826 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:40.453799    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl"]
Sep 11 21:28:41.038662 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:41.038623    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f882ef92-ae11-4f7c-8acb-ab3efc938ddd" path="/var/lib/kubelet/pods/f882ef92-ae11-4f7c-8acb-ab3efc938ddd/volumes"
Sep 11 21:28:51.214404 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:51.214359    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2748c5-psxfr"]
Sep 11 21:28:51.226428 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:51.226376    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2748c5-psxfr"]
Sep 11 21:28:53.037837 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:53.037803    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e2434da-8632-49f6-90a1-3edfae6a1afd" path="/var/lib/kubelet/pods/0e2434da-8632-49f6-90a1-3edfae6a1afd/volumes"
Sep 11 21:28:55.344442 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:55.344415    2560 scope.go:117] "RemoveContainer" containerID="d18a2c17c5c338ee34bb690ada04890324ef287c03f2f1efacab95aff9b59155"
Sep 11 21:28:59.672011 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:59.671978    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8"]
Sep 11 21:28:59.672485 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:28:59.672195    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8" podUID="b3a580f2-32b5-446f-9174-893b4aef56ad" containerName="istio-proxy" containerID="cri-o://d3117c0abd8d511080bae0b714e7ad469f4aafa294b2dd334cdb4167677bfcc6" gracePeriod=30
Sep 11 21:29:00.021100 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:00.021008    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-1117b2-6pwtd"]
Sep 11 21:29:00.021643 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:00.021623    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e2434da-8632-49f6-90a1-3edfae6a1afd" containerName="revoke-keys"
Sep 11 21:29:00.021643 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:00.021644    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e2434da-8632-49f6-90a1-3edfae6a1afd" containerName="revoke-keys"
Sep 11 21:29:00.021815 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:00.021667    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f882ef92-ae11-4f7c-8acb-ab3efc938ddd" containerName="istio-proxy"
Sep 11 21:29:00.021815 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:00.021677    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f882ef92-ae11-4f7c-8acb-ab3efc938ddd" containerName="istio-proxy"
Sep 11 21:29:00.021815 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:00.021701    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f882ef92-ae11-4f7c-8acb-ab3efc938ddd" containerName="istio-proxy"
Sep 11 21:29:00.021815 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:00.021710    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f882ef92-ae11-4f7c-8acb-ab3efc938ddd" containerName="istio-proxy"
Sep 11 21:29:00.022011 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:00.021816    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f882ef92-ae11-4f7c-8acb-ab3efc938ddd" containerName="istio-proxy"
Sep 11 21:29:00.022011 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:00.021833    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e2434da-8632-49f6-90a1-3edfae6a1afd" containerName="revoke-keys"
Sep 11 21:29:00.025276 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:00.025255    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-1117b2-6pwtd"
Sep 11 21:29:00.029579 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:00.029558    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 21:29:00.029694 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:00.029651    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bfm9g\""
Sep 11 21:29:00.051314 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:00.051288    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-1117b2-6pwtd"]
Sep 11 21:29:00.099657 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:00.099629    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/778f0979-1de2-4277-b992-c4f34e2a6392-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-1117b2-6pwtd\" (UID: \"778f0979-1de2-4277-b992-c4f34e2a6392\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-1117b2-6pwtd"
Sep 11 21:29:00.200876 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:00.200840    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/778f0979-1de2-4277-b992-c4f34e2a6392-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-1117b2-6pwtd\" (UID: \"778f0979-1de2-4277-b992-c4f34e2a6392\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-1117b2-6pwtd"
Sep 11 21:29:00.201475 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:00.201454    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/778f0979-1de2-4277-b992-c4f34e2a6392-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-1117b2-6pwtd\" (UID: \"778f0979-1de2-4277-b992-c4f34e2a6392\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-1117b2-6pwtd"
Sep 11 21:29:00.335174 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:00.335091    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-1117b2-6pwtd"
Sep 11 21:29:00.636010 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:00.635986    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-1117b2-6pwtd"]
Sep 11 21:29:00.638211 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:29:00.638178    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod778f0979_1de2_4277_b992_c4f34e2a6392.slice/crio-7bf7a84e653a3ffa0467df7355d449525121524b0b4078399f98fbcd4c9732bb WatchSource:0}: Error finding container 7bf7a84e653a3ffa0467df7355d449525121524b0b4078399f98fbcd4c9732bb: Status 404 returned error can't find the container with id 7bf7a84e653a3ffa0467df7355d449525121524b0b4078399f98fbcd4c9732bb
Sep 11 21:29:01.514956 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:01.514922    2560 generic.go:356] "Generic (PLEG): container finished" podID="778f0979-1de2-4277-b992-c4f34e2a6392" containerID="ca13b49cae05eed38775e04f26bd51d12a95ed55d9be377f5abf12a8223f31ff" exitCode=0
Sep 11 21:29:01.514956 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:01.514957    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-1117b2-6pwtd" event={"ID":"778f0979-1de2-4277-b992-c4f34e2a6392","Type":"ContainerDied","Data":"ca13b49cae05eed38775e04f26bd51d12a95ed55d9be377f5abf12a8223f31ff"}
Sep 11 21:29:01.515478 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:01.514995    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-1117b2-6pwtd" event={"ID":"778f0979-1de2-4277-b992-c4f34e2a6392","Type":"ContainerStarted","Data":"7bf7a84e653a3ffa0467df7355d449525121524b0b4078399f98fbcd4c9732bb"}
Sep 11 21:29:02.663211 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:02.663179    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-1117b2-6pwtd"
Sep 11 21:29:02.727640 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:02.727590    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/778f0979-1de2-4277-b992-c4f34e2a6392-maas-api-service-ca\") pod \"778f0979-1de2-4277-b992-c4f34e2a6392\" (UID: \"778f0979-1de2-4277-b992-c4f34e2a6392\") "
Sep 11 21:29:02.727959 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:02.727930    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/778f0979-1de2-4277-b992-c4f34e2a6392-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "778f0979-1de2-4277-b992-c4f34e2a6392" (UID: "778f0979-1de2-4277-b992-c4f34e2a6392"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:29:02.828782 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:02.828686    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/778f0979-1de2-4277-b992-c4f34e2a6392-maas-api-service-ca\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:29:03.528212 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:03.528183    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-1117b2-6pwtd"
Sep 11 21:29:03.528427 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:03.528183    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-1117b2-6pwtd" event={"ID":"778f0979-1de2-4277-b992-c4f34e2a6392","Type":"ContainerDied","Data":"7bf7a84e653a3ffa0467df7355d449525121524b0b4078399f98fbcd4c9732bb"}
Sep 11 21:29:03.528427 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:03.528306    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7bf7a84e653a3ffa0467df7355d449525121524b0b4078399f98fbcd4c9732bb"
Sep 11 21:29:04.938528 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:04.938455    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8"
Sep 11 21:29:05.054378 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:05.054348    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3a580f2-32b5-446f-9174-893b4aef56ad-istio-token\") pod \"b3a580f2-32b5-446f-9174-893b4aef56ad\" (UID: \"b3a580f2-32b5-446f-9174-893b4aef56ad\") "
Sep 11 21:29:05.054378 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:05.054403    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vln56\" (UniqueName: \"kubernetes.io/projected/b3a580f2-32b5-446f-9174-893b4aef56ad-kube-api-access-vln56\") pod \"b3a580f2-32b5-446f-9174-893b4aef56ad\" (UID: \"b3a580f2-32b5-446f-9174-893b4aef56ad\") "
Sep 11 21:29:05.054646 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:05.054422    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3a580f2-32b5-446f-9174-893b4aef56ad-istio-data\") pod \"b3a580f2-32b5-446f-9174-893b4aef56ad\" (UID: \"b3a580f2-32b5-446f-9174-893b4aef56ad\") "
Sep 11 21:29:05.054646 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:05.054437    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3a580f2-32b5-446f-9174-893b4aef56ad-credential-socket\") pod \"b3a580f2-32b5-446f-9174-893b4aef56ad\" (UID: \"b3a580f2-32b5-446f-9174-893b4aef56ad\") "
Sep 11 21:29:05.054646 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:05.054456    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3a580f2-32b5-446f-9174-893b4aef56ad-istio-envoy\") pod \"b3a580f2-32b5-446f-9174-893b4aef56ad\" (UID: \"b3a580f2-32b5-446f-9174-893b4aef56ad\") "
Sep 11 21:29:05.054646 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:05.054472    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3a580f2-32b5-446f-9174-893b4aef56ad-workload-socket\") pod \"b3a580f2-32b5-446f-9174-893b4aef56ad\" (UID: \"b3a580f2-32b5-446f-9174-893b4aef56ad\") "
Sep 11 21:29:05.054646 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:05.054560    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3a580f2-32b5-446f-9174-893b4aef56ad-workload-certs\") pod \"b3a580f2-32b5-446f-9174-893b4aef56ad\" (UID: \"b3a580f2-32b5-446f-9174-893b4aef56ad\") "
Sep 11 21:29:05.054646 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:05.054596    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3a580f2-32b5-446f-9174-893b4aef56ad-istiod-ca-cert\") pod \"b3a580f2-32b5-446f-9174-893b4aef56ad\" (UID: \"b3a580f2-32b5-446f-9174-893b4aef56ad\") "
Sep 11 21:29:05.054953 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:05.054727    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3a580f2-32b5-446f-9174-893b4aef56ad-istio-podinfo\") pod \"b3a580f2-32b5-446f-9174-893b4aef56ad\" (UID: \"b3a580f2-32b5-446f-9174-893b4aef56ad\") "
Sep 11 21:29:05.054953 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:05.054755    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3a580f2-32b5-446f-9174-893b4aef56ad-istio-data" (OuterVolumeSpecName: "istio-data") pod "b3a580f2-32b5-446f-9174-893b4aef56ad" (UID: "b3a580f2-32b5-446f-9174-893b4aef56ad"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:29:05.054953 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:05.054848    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3a580f2-32b5-446f-9174-893b4aef56ad-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b3a580f2-32b5-446f-9174-893b4aef56ad" (UID: "b3a580f2-32b5-446f-9174-893b4aef56ad"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:29:05.054953 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:05.054868    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3a580f2-32b5-446f-9174-893b4aef56ad-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b3a580f2-32b5-446f-9174-893b4aef56ad" (UID: "b3a580f2-32b5-446f-9174-893b4aef56ad"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:29:05.054953 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:05.054921    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3a580f2-32b5-446f-9174-893b4aef56ad-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b3a580f2-32b5-446f-9174-893b4aef56ad" (UID: "b3a580f2-32b5-446f-9174-893b4aef56ad"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:29:05.055214 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:05.055075    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3a580f2-32b5-446f-9174-893b4aef56ad-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b3a580f2-32b5-446f-9174-893b4aef56ad" (UID: "b3a580f2-32b5-446f-9174-893b4aef56ad"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:29:05.055214 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:05.055119    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3a580f2-32b5-446f-9174-893b4aef56ad-workload-certs\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:29:05.055214 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:05.055141    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3a580f2-32b5-446f-9174-893b4aef56ad-istio-data\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:29:05.055214 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:05.055161    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3a580f2-32b5-446f-9174-893b4aef56ad-credential-socket\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:29:05.055214 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:05.055175    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3a580f2-32b5-446f-9174-893b4aef56ad-workload-socket\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:29:05.056849 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:05.056802    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3a580f2-32b5-446f-9174-893b4aef56ad-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b3a580f2-32b5-446f-9174-893b4aef56ad" (UID: "b3a580f2-32b5-446f-9174-893b4aef56ad"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:29:05.056849 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:05.056822    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3a580f2-32b5-446f-9174-893b4aef56ad-istio-token" (OuterVolumeSpecName: "istio-token") pod "b3a580f2-32b5-446f-9174-893b4aef56ad" (UID: "b3a580f2-32b5-446f-9174-893b4aef56ad"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:29:05.057007 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:05.056861    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3a580f2-32b5-446f-9174-893b4aef56ad-kube-api-access-vln56" (OuterVolumeSpecName: "kube-api-access-vln56") pod "b3a580f2-32b5-446f-9174-893b4aef56ad" (UID: "b3a580f2-32b5-446f-9174-893b4aef56ad"). InnerVolumeSpecName "kube-api-access-vln56". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:29:05.057007 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:05.056892    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b3a580f2-32b5-446f-9174-893b4aef56ad-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b3a580f2-32b5-446f-9174-893b4aef56ad" (UID: "b3a580f2-32b5-446f-9174-893b4aef56ad"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 21:29:05.156792 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:05.156759    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3a580f2-32b5-446f-9174-893b4aef56ad-istiod-ca-cert\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:29:05.156792 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:05.156786    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3a580f2-32b5-446f-9174-893b4aef56ad-istio-podinfo\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:29:05.156792 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:05.156795    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3a580f2-32b5-446f-9174-893b4aef56ad-istio-token\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:29:05.157029 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:05.156804    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vln56\" (UniqueName: \"kubernetes.io/projected/b3a580f2-32b5-446f-9174-893b4aef56ad-kube-api-access-vln56\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:29:05.157029 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:05.156813    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3a580f2-32b5-446f-9174-893b4aef56ad-istio-envoy\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:29:05.541219 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:05.541185    2560 generic.go:356] "Generic (PLEG): container finished" podID="b3a580f2-32b5-446f-9174-893b4aef56ad" containerID="d3117c0abd8d511080bae0b714e7ad469f4aafa294b2dd334cdb4167677bfcc6" exitCode=0
Sep 11 21:29:05.541418 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:05.541239    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8"
Sep 11 21:29:05.541418 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:05.541266    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8" event={"ID":"b3a580f2-32b5-446f-9174-893b4aef56ad","Type":"ContainerDied","Data":"d3117c0abd8d511080bae0b714e7ad469f4aafa294b2dd334cdb4167677bfcc6"}
Sep 11 21:29:05.541418 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:05.541333    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8" event={"ID":"b3a580f2-32b5-446f-9174-893b4aef56ad","Type":"ContainerDied","Data":"a1da6075c3a3a9b968d91547febea0ef1f45f3632bd91937bd9b11b451814b11"}
Sep 11 21:29:05.541418 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:05.541366    2560 scope.go:117] "RemoveContainer" containerID="d3117c0abd8d511080bae0b714e7ad469f4aafa294b2dd334cdb4167677bfcc6"
Sep 11 21:29:05.552320 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:05.552305    2560 scope.go:117] "RemoveContainer" containerID="720ee37293285761a63047eb1690014353713bb0b228b359ed661e87f31a9a8a"
Sep 11 21:29:05.561831 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:05.561807    2560 scope.go:117] "RemoveContainer" containerID="d3117c0abd8d511080bae0b714e7ad469f4aafa294b2dd334cdb4167677bfcc6"
Sep 11 21:29:05.562183 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:29:05.562162    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3117c0abd8d511080bae0b714e7ad469f4aafa294b2dd334cdb4167677bfcc6\": container with ID starting with d3117c0abd8d511080bae0b714e7ad469f4aafa294b2dd334cdb4167677bfcc6 not found: ID does not exist" containerID="d3117c0abd8d511080bae0b714e7ad469f4aafa294b2dd334cdb4167677bfcc6"
Sep 11 21:29:05.562273 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:05.562190    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3117c0abd8d511080bae0b714e7ad469f4aafa294b2dd334cdb4167677bfcc6"} err="failed to get container status \"d3117c0abd8d511080bae0b714e7ad469f4aafa294b2dd334cdb4167677bfcc6\": rpc error: code = NotFound desc = could not find container \"d3117c0abd8d511080bae0b714e7ad469f4aafa294b2dd334cdb4167677bfcc6\": container with ID starting with d3117c0abd8d511080bae0b714e7ad469f4aafa294b2dd334cdb4167677bfcc6 not found: ID does not exist"
Sep 11 21:29:05.562273 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:05.562208    2560 scope.go:117] "RemoveContainer" containerID="720ee37293285761a63047eb1690014353713bb0b228b359ed661e87f31a9a8a"
Sep 11 21:29:05.562583 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:29:05.562565    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"720ee37293285761a63047eb1690014353713bb0b228b359ed661e87f31a9a8a\": container with ID starting with 720ee37293285761a63047eb1690014353713bb0b228b359ed661e87f31a9a8a not found: ID does not exist" containerID="720ee37293285761a63047eb1690014353713bb0b228b359ed661e87f31a9a8a"
Sep 11 21:29:05.562664 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:05.562588    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"720ee37293285761a63047eb1690014353713bb0b228b359ed661e87f31a9a8a"} err="failed to get container status \"720ee37293285761a63047eb1690014353713bb0b228b359ed661e87f31a9a8a\": rpc error: code = NotFound desc = could not find container \"720ee37293285761a63047eb1690014353713bb0b228b359ed661e87f31a9a8a\": container with ID starting with 720ee37293285761a63047eb1690014353713bb0b228b359ed661e87f31a9a8a not found: ID does not exist"
Sep 11 21:29:05.571992 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:05.571970    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8"]
Sep 11 21:29:05.590285 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:05.590260    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8"]
Sep 11 21:29:07.044774 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:07.044737    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3a580f2-32b5-446f-9174-893b4aef56ad" path="/var/lib/kubelet/pods/b3a580f2-32b5-446f-9174-893b4aef56ad/volumes"
Sep 11 21:29:11.553745 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:11.553710    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-1117b2-6pwtd"]
Sep 11 21:29:11.563961 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:11.563927    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-1117b2-6pwtd"]
Sep 11 21:29:13.037498 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:13.037466    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="778f0979-1de2-4277-b992-c4f34e2a6392" path="/var/lib/kubelet/pods/778f0979-1de2-4277-b992-c4f34e2a6392/volumes"
Sep 11 21:29:19.296391 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:19.296342    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9"]
Sep 11 21:29:19.296784 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:19.296572    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9" podUID="e59f7272-4d6a-4c9e-ae1f-998f38f473a8" containerName="istio-proxy" containerID="cri-o://91fd58518ddf68d69392f95e6cc845d3f1a9adf26bc3134e303d38c6e7f6226e" gracePeriod=30
Sep 11 21:29:19.706548 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:19.706505    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-55fb09-d9gcc"]
Sep 11 21:29:19.707024 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:19.707008    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3a580f2-32b5-446f-9174-893b4aef56ad" containerName="istio-proxy"
Sep 11 21:29:19.707024 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:19.707024    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3a580f2-32b5-446f-9174-893b4aef56ad" containerName="istio-proxy"
Sep 11 21:29:19.707172 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:19.707046    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3a580f2-32b5-446f-9174-893b4aef56ad" containerName="istio-proxy"
Sep 11 21:29:19.707172 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:19.707054    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3a580f2-32b5-446f-9174-893b4aef56ad" containerName="istio-proxy"
Sep 11 21:29:19.707172 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:19.707076    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="778f0979-1de2-4277-b992-c4f34e2a6392" containerName="revoke-keys"
Sep 11 21:29:19.707172 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:19.707081    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="778f0979-1de2-4277-b992-c4f34e2a6392" containerName="revoke-keys"
Sep 11 21:29:19.707172 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:19.707168    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3a580f2-32b5-446f-9174-893b4aef56ad" containerName="istio-proxy"
Sep 11 21:29:19.707472 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:19.707178    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3a580f2-32b5-446f-9174-893b4aef56ad" containerName="istio-proxy"
Sep 11 21:29:19.707472 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:19.707186    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f882ef92-ae11-4f7c-8acb-ab3efc938ddd" containerName="istio-proxy"
Sep 11 21:29:19.707472 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:19.707192    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="778f0979-1de2-4277-b992-c4f34e2a6392" containerName="revoke-keys"
Sep 11 21:29:19.710543 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:19.710513    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-55fb09-d9gcc"
Sep 11 21:29:19.716243 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:19.716208    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 21:29:19.716406 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:19.716269    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bfm9g\""
Sep 11 21:29:19.742191 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:19.742164    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-55fb09-d9gcc"]
Sep 11 21:29:19.809326 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:19.809292    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/47d774fa-907b-4578-9f06-a18ef2b01189-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-55fb09-d9gcc\" (UID: \"47d774fa-907b-4578-9f06-a18ef2b01189\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-55fb09-d9gcc"
Sep 11 21:29:19.910746 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:19.910710    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/47d774fa-907b-4578-9f06-a18ef2b01189-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-55fb09-d9gcc\" (UID: \"47d774fa-907b-4578-9f06-a18ef2b01189\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-55fb09-d9gcc"
Sep 11 21:29:19.911330 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:19.911306    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/47d774fa-907b-4578-9f06-a18ef2b01189-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-55fb09-d9gcc\" (UID: \"47d774fa-907b-4578-9f06-a18ef2b01189\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-55fb09-d9gcc"
Sep 11 21:29:20.021516 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:20.021433    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-55fb09-d9gcc"
Sep 11 21:29:20.316156 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:20.316126    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-55fb09-d9gcc"]
Sep 11 21:29:20.316638 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:29:20.316615    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47d774fa_907b_4578_9f06_a18ef2b01189.slice/crio-b89807a356202bc32bb012d07e07bf67f7c126adb237f8dd781ee87e04572778 WatchSource:0}: Error finding container b89807a356202bc32bb012d07e07bf67f7c126adb237f8dd781ee87e04572778: Status 404 returned error can't find the container with id b89807a356202bc32bb012d07e07bf67f7c126adb237f8dd781ee87e04572778
Sep 11 21:29:20.629426 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:20.629369    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-55fb09-d9gcc" event={"ID":"47d774fa-907b-4578-9f06-a18ef2b01189","Type":"ContainerStarted","Data":"b89807a356202bc32bb012d07e07bf67f7c126adb237f8dd781ee87e04572778"}
Sep 11 21:29:21.636479 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:21.636448    2560 generic.go:356] "Generic (PLEG): container finished" podID="47d774fa-907b-4578-9f06-a18ef2b01189" containerID="d34c67a25aa7c9b4924ddf1de6b2397d72abfc735e6577caf80dc949c0fc44b9" exitCode=0
Sep 11 21:29:21.636858 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:21.636537    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-55fb09-d9gcc" event={"ID":"47d774fa-907b-4578-9f06-a18ef2b01189","Type":"ContainerDied","Data":"d34c67a25aa7c9b4924ddf1de6b2397d72abfc735e6577caf80dc949c0fc44b9"}
Sep 11 21:29:22.781537 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:22.781507    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-55fb09-d9gcc"
Sep 11 21:29:22.945402 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:22.945302    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/47d774fa-907b-4578-9f06-a18ef2b01189-maas-api-service-ca\") pod \"47d774fa-907b-4578-9f06-a18ef2b01189\" (UID: \"47d774fa-907b-4578-9f06-a18ef2b01189\") "
Sep 11 21:29:22.945651 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:22.945631    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47d774fa-907b-4578-9f06-a18ef2b01189-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "47d774fa-907b-4578-9f06-a18ef2b01189" (UID: "47d774fa-907b-4578-9f06-a18ef2b01189"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:29:23.046806 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:23.046786    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/47d774fa-907b-4578-9f06-a18ef2b01189-maas-api-service-ca\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:29:23.649124 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:23.649092    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-55fb09-d9gcc"
Sep 11 21:29:23.649286 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:23.649129    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-55fb09-d9gcc" event={"ID":"47d774fa-907b-4578-9f06-a18ef2b01189","Type":"ContainerDied","Data":"b89807a356202bc32bb012d07e07bf67f7c126adb237f8dd781ee87e04572778"}
Sep 11 21:29:23.649286 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:23.649182    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b89807a356202bc32bb012d07e07bf67f7c126adb237f8dd781ee87e04572778"
Sep 11 21:29:24.568784 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:24.568710    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9"
Sep 11 21:29:24.657151 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:24.657117    2560 generic.go:356] "Generic (PLEG): container finished" podID="e59f7272-4d6a-4c9e-ae1f-998f38f473a8" containerID="91fd58518ddf68d69392f95e6cc845d3f1a9adf26bc3134e303d38c6e7f6226e" exitCode=0
Sep 11 21:29:24.657334 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:24.657162    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9"
Sep 11 21:29:24.657334 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:24.657202    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9" event={"ID":"e59f7272-4d6a-4c9e-ae1f-998f38f473a8","Type":"ContainerDied","Data":"91fd58518ddf68d69392f95e6cc845d3f1a9adf26bc3134e303d38c6e7f6226e"}
Sep 11 21:29:24.657334 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:24.657259    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9" event={"ID":"e59f7272-4d6a-4c9e-ae1f-998f38f473a8","Type":"ContainerDied","Data":"a080f868ef3b8172d4a0b1e090d094de38fdcac48c2bb3c675b36a616ee2d455"}
Sep 11 21:29:24.657334 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:24.657285    2560 scope.go:117] "RemoveContainer" containerID="91fd58518ddf68d69392f95e6cc845d3f1a9adf26bc3134e303d38c6e7f6226e"
Sep 11 21:29:24.663638 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:24.663615    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e59f7272-4d6a-4c9e-ae1f-998f38f473a8-credential-socket\") pod \"e59f7272-4d6a-4c9e-ae1f-998f38f473a8\" (UID: \"e59f7272-4d6a-4c9e-ae1f-998f38f473a8\") "
Sep 11 21:29:24.663745 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:24.663658    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e59f7272-4d6a-4c9e-ae1f-998f38f473a8-istio-data\") pod \"e59f7272-4d6a-4c9e-ae1f-998f38f473a8\" (UID: \"e59f7272-4d6a-4c9e-ae1f-998f38f473a8\") "
Sep 11 21:29:24.663745 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:24.663697    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e59f7272-4d6a-4c9e-ae1f-998f38f473a8-istiod-ca-cert\") pod \"e59f7272-4d6a-4c9e-ae1f-998f38f473a8\" (UID: \"e59f7272-4d6a-4c9e-ae1f-998f38f473a8\") "
Sep 11 21:29:24.663745 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:24.663728    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e59f7272-4d6a-4c9e-ae1f-998f38f473a8-istio-podinfo\") pod \"e59f7272-4d6a-4c9e-ae1f-998f38f473a8\" (UID: \"e59f7272-4d6a-4c9e-ae1f-998f38f473a8\") "
Sep 11 21:29:24.663896 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:24.663769    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e59f7272-4d6a-4c9e-ae1f-998f38f473a8-workload-socket\") pod \"e59f7272-4d6a-4c9e-ae1f-998f38f473a8\" (UID: \"e59f7272-4d6a-4c9e-ae1f-998f38f473a8\") "
Sep 11 21:29:24.663896 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:24.663797    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e59f7272-4d6a-4c9e-ae1f-998f38f473a8-workload-certs\") pod \"e59f7272-4d6a-4c9e-ae1f-998f38f473a8\" (UID: \"e59f7272-4d6a-4c9e-ae1f-998f38f473a8\") "
Sep 11 21:29:24.663896 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:24.663884    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e59f7272-4d6a-4c9e-ae1f-998f38f473a8-istio-envoy\") pod \"e59f7272-4d6a-4c9e-ae1f-998f38f473a8\" (UID: \"e59f7272-4d6a-4c9e-ae1f-998f38f473a8\") "
Sep 11 21:29:24.664040 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:24.663896    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e59f7272-4d6a-4c9e-ae1f-998f38f473a8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e59f7272-4d6a-4c9e-ae1f-998f38f473a8" (UID: "e59f7272-4d6a-4c9e-ae1f-998f38f473a8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:29:24.664040 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:24.663941    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e59f7272-4d6a-4c9e-ae1f-998f38f473a8-istio-token\") pod \"e59f7272-4d6a-4c9e-ae1f-998f38f473a8\" (UID: \"e59f7272-4d6a-4c9e-ae1f-998f38f473a8\") "
Sep 11 21:29:24.664040 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:24.663966    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6bjsb\" (UniqueName: \"kubernetes.io/projected/e59f7272-4d6a-4c9e-ae1f-998f38f473a8-kube-api-access-6bjsb\") pod \"e59f7272-4d6a-4c9e-ae1f-998f38f473a8\" (UID: \"e59f7272-4d6a-4c9e-ae1f-998f38f473a8\") "
Sep 11 21:29:24.664040 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:24.663976    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e59f7272-4d6a-4c9e-ae1f-998f38f473a8-istio-data" (OuterVolumeSpecName: "istio-data") pod "e59f7272-4d6a-4c9e-ae1f-998f38f473a8" (UID: "e59f7272-4d6a-4c9e-ae1f-998f38f473a8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:29:24.664259 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:24.664105    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e59f7272-4d6a-4c9e-ae1f-998f38f473a8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e59f7272-4d6a-4c9e-ae1f-998f38f473a8" (UID: "e59f7272-4d6a-4c9e-ae1f-998f38f473a8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:29:24.664259 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:24.664131    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e59f7272-4d6a-4c9e-ae1f-998f38f473a8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e59f7272-4d6a-4c9e-ae1f-998f38f473a8" (UID: "e59f7272-4d6a-4c9e-ae1f-998f38f473a8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:29:24.664435 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:24.664411    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e59f7272-4d6a-4c9e-ae1f-998f38f473a8-workload-socket\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:29:24.664502 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:24.664444    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e59f7272-4d6a-4c9e-ae1f-998f38f473a8-credential-socket\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:29:24.664502 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:24.664449    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e59f7272-4d6a-4c9e-ae1f-998f38f473a8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e59f7272-4d6a-4c9e-ae1f-998f38f473a8" (UID: "e59f7272-4d6a-4c9e-ae1f-998f38f473a8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:29:24.664502 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:24.664462    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e59f7272-4d6a-4c9e-ae1f-998f38f473a8-istio-data\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:29:24.664502 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:24.664476    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e59f7272-4d6a-4c9e-ae1f-998f38f473a8-istiod-ca-cert\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:29:24.666084 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:24.666061    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e59f7272-4d6a-4c9e-ae1f-998f38f473a8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e59f7272-4d6a-4c9e-ae1f-998f38f473a8" (UID: "e59f7272-4d6a-4c9e-ae1f-998f38f473a8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 21:29:24.666084 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:24.666068    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e59f7272-4d6a-4c9e-ae1f-998f38f473a8-kube-api-access-6bjsb" (OuterVolumeSpecName: "kube-api-access-6bjsb") pod "e59f7272-4d6a-4c9e-ae1f-998f38f473a8" (UID: "e59f7272-4d6a-4c9e-ae1f-998f38f473a8"). InnerVolumeSpecName "kube-api-access-6bjsb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:29:24.666210 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:24.666198    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e59f7272-4d6a-4c9e-ae1f-998f38f473a8-istio-token" (OuterVolumeSpecName: "istio-token") pod "e59f7272-4d6a-4c9e-ae1f-998f38f473a8" (UID: "e59f7272-4d6a-4c9e-ae1f-998f38f473a8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:29:24.666371 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:24.666357    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e59f7272-4d6a-4c9e-ae1f-998f38f473a8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e59f7272-4d6a-4c9e-ae1f-998f38f473a8" (UID: "e59f7272-4d6a-4c9e-ae1f-998f38f473a8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:29:24.667865 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:24.667849    2560 scope.go:117] "RemoveContainer" containerID="7db1c7037f1da292f6a331b9e9586e91f04f5d839d687babb39f898513e2a880"
Sep 11 21:29:24.686795 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:24.686777    2560 scope.go:117] "RemoveContainer" containerID="91fd58518ddf68d69392f95e6cc845d3f1a9adf26bc3134e303d38c6e7f6226e"
Sep 11 21:29:24.687120 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:29:24.687095    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91fd58518ddf68d69392f95e6cc845d3f1a9adf26bc3134e303d38c6e7f6226e\": container with ID starting with 91fd58518ddf68d69392f95e6cc845d3f1a9adf26bc3134e303d38c6e7f6226e not found: ID does not exist" containerID="91fd58518ddf68d69392f95e6cc845d3f1a9adf26bc3134e303d38c6e7f6226e"
Sep 11 21:29:24.687176 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:24.687130    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91fd58518ddf68d69392f95e6cc845d3f1a9adf26bc3134e303d38c6e7f6226e"} err="failed to get container status \"91fd58518ddf68d69392f95e6cc845d3f1a9adf26bc3134e303d38c6e7f6226e\": rpc error: code = NotFound desc = could not find container \"91fd58518ddf68d69392f95e6cc845d3f1a9adf26bc3134e303d38c6e7f6226e\": container with ID starting with 91fd58518ddf68d69392f95e6cc845d3f1a9adf26bc3134e303d38c6e7f6226e not found: ID does not exist"
Sep 11 21:29:24.687176 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:24.687145    2560 scope.go:117] "RemoveContainer" containerID="7db1c7037f1da292f6a331b9e9586e91f04f5d839d687babb39f898513e2a880"
Sep 11 21:29:24.687459 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:29:24.687443    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7db1c7037f1da292f6a331b9e9586e91f04f5d839d687babb39f898513e2a880\": container with ID starting with 7db1c7037f1da292f6a331b9e9586e91f04f5d839d687babb39f898513e2a880 not found: ID does not exist" containerID="7db1c7037f1da292f6a331b9e9586e91f04f5d839d687babb39f898513e2a880"
Sep 11 21:29:24.687522 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:24.687464    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7db1c7037f1da292f6a331b9e9586e91f04f5d839d687babb39f898513e2a880"} err="failed to get container status \"7db1c7037f1da292f6a331b9e9586e91f04f5d839d687babb39f898513e2a880\": rpc error: code = NotFound desc = could not find container \"7db1c7037f1da292f6a331b9e9586e91f04f5d839d687babb39f898513e2a880\": container with ID starting with 7db1c7037f1da292f6a331b9e9586e91f04f5d839d687babb39f898513e2a880 not found: ID does not exist"
Sep 11 21:29:24.765483 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:24.765460    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e59f7272-4d6a-4c9e-ae1f-998f38f473a8-istio-podinfo\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:29:24.765483 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:24.765481    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e59f7272-4d6a-4c9e-ae1f-998f38f473a8-workload-certs\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:29:24.765623 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:24.765496    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e59f7272-4d6a-4c9e-ae1f-998f38f473a8-istio-envoy\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:29:24.765623 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:24.765504    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e59f7272-4d6a-4c9e-ae1f-998f38f473a8-istio-token\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:29:24.765623 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:24.765513    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6bjsb\" (UniqueName: \"kubernetes.io/projected/e59f7272-4d6a-4c9e-ae1f-998f38f473a8-kube-api-access-6bjsb\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:29:25.009976 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:25.009946    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9"]
Sep 11 21:29:25.024854 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:25.024826    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9"]
Sep 11 21:29:25.038188 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:25.038161    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e59f7272-4d6a-4c9e-ae1f-998f38f473a8" path="/var/lib/kubelet/pods/e59f7272-4d6a-4c9e-ae1f-998f38f473a8/volumes"
Sep 11 21:29:30.731991 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:30.731957    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-55fb09-74998c669-5g8x5"]
Sep 11 21:29:30.732522 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:30.732158    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-55fb09-74998c669-5g8x5" podUID="96aa0df2-4abc-4697-bb36-2827069e2325" containerName="payload-processing" containerID="cri-o://7ea9403c41701e6548ff53d3391340fe0ba5bcf66dfdcb75773473cf6e6b1a31" gracePeriod=30
Sep 11 21:29:30.993447 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:30.993375    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-55fb09-74998c669-5g8x5"
Sep 11 21:29:31.017504 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:31.017479    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-55fb09-d9gcc"]
Sep 11 21:29:31.025304 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:31.025279    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-55fb09-d9gcc"]
Sep 11 21:29:31.048666 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:31.048633    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47d774fa-907b-4578-9f06-a18ef2b01189" path="/var/lib/kubelet/pods/47d774fa-907b-4578-9f06-a18ef2b01189/volumes"
Sep 11 21:29:31.131103 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:31.131071    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96aa0df2-4abc-4697-bb36-2827069e2325-plugins-config-volume\") pod \"96aa0df2-4abc-4697-bb36-2827069e2325\" (UID: \"96aa0df2-4abc-4697-bb36-2827069e2325\") "
Sep 11 21:29:31.131313 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:31.131178    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qz4zw\" (UniqueName: \"kubernetes.io/projected/96aa0df2-4abc-4697-bb36-2827069e2325-kube-api-access-qz4zw\") pod \"96aa0df2-4abc-4697-bb36-2827069e2325\" (UID: \"96aa0df2-4abc-4697-bb36-2827069e2325\") "
Sep 11 21:29:31.131655 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:31.131605    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96aa0df2-4abc-4697-bb36-2827069e2325-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "96aa0df2-4abc-4697-bb36-2827069e2325" (UID: "96aa0df2-4abc-4697-bb36-2827069e2325"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:29:31.133300 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:31.133273    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96aa0df2-4abc-4697-bb36-2827069e2325-kube-api-access-qz4zw" (OuterVolumeSpecName: "kube-api-access-qz4zw") pod "96aa0df2-4abc-4697-bb36-2827069e2325" (UID: "96aa0df2-4abc-4697-bb36-2827069e2325"). InnerVolumeSpecName "kube-api-access-qz4zw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:29:31.232492 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:31.232448    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96aa0df2-4abc-4697-bb36-2827069e2325-plugins-config-volume\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:29:31.232492 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:31.232479    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qz4zw\" (UniqueName: \"kubernetes.io/projected/96aa0df2-4abc-4697-bb36-2827069e2325-kube-api-access-qz4zw\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:29:31.701610 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:31.701580    2560 generic.go:356] "Generic (PLEG): container finished" podID="96aa0df2-4abc-4697-bb36-2827069e2325" containerID="7ea9403c41701e6548ff53d3391340fe0ba5bcf66dfdcb75773473cf6e6b1a31" exitCode=0
Sep 11 21:29:31.701787 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:31.701637    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-55fb09-74998c669-5g8x5"
Sep 11 21:29:31.701787 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:31.701661    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-55fb09-74998c669-5g8x5" event={"ID":"96aa0df2-4abc-4697-bb36-2827069e2325","Type":"ContainerDied","Data":"7ea9403c41701e6548ff53d3391340fe0ba5bcf66dfdcb75773473cf6e6b1a31"}
Sep 11 21:29:31.701787 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:31.701714    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-55fb09-74998c669-5g8x5" event={"ID":"96aa0df2-4abc-4697-bb36-2827069e2325","Type":"ContainerDied","Data":"bff6a2646bd2390e9ad588e9fc0c18b6f0c7d5b6a39a89d1d26b30547be4e334"}
Sep 11 21:29:31.701787 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:31.701736    2560 scope.go:117] "RemoveContainer" containerID="7ea9403c41701e6548ff53d3391340fe0ba5bcf66dfdcb75773473cf6e6b1a31"
Sep 11 21:29:31.710698 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:31.710682    2560 scope.go:117] "RemoveContainer" containerID="7ea9403c41701e6548ff53d3391340fe0ba5bcf66dfdcb75773473cf6e6b1a31"
Sep 11 21:29:31.710950 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:29:31.710931    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ea9403c41701e6548ff53d3391340fe0ba5bcf66dfdcb75773473cf6e6b1a31\": container with ID starting with 7ea9403c41701e6548ff53d3391340fe0ba5bcf66dfdcb75773473cf6e6b1a31 not found: ID does not exist" containerID="7ea9403c41701e6548ff53d3391340fe0ba5bcf66dfdcb75773473cf6e6b1a31"
Sep 11 21:29:31.711005 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:31.710959    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ea9403c41701e6548ff53d3391340fe0ba5bcf66dfdcb75773473cf6e6b1a31"} err="failed to get container status \"7ea9403c41701e6548ff53d3391340fe0ba5bcf66dfdcb75773473cf6e6b1a31\": rpc error: code = NotFound desc = could not find container \"7ea9403c41701e6548ff53d3391340fe0ba5bcf66dfdcb75773473cf6e6b1a31\": container with ID starting with 7ea9403c41701e6548ff53d3391340fe0ba5bcf66dfdcb75773473cf6e6b1a31 not found: ID does not exist"
Sep 11 21:29:31.726591 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:31.726570    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-55fb09-74998c669-5g8x5"]
Sep 11 21:29:31.731680 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:31.731660    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-55fb09-74998c669-5g8x5"]
Sep 11 21:29:33.037546 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:33.037507    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96aa0df2-4abc-4697-bb36-2827069e2325" path="/var/lib/kubelet/pods/96aa0df2-4abc-4697-bb36-2827069e2325/volumes"
Sep 11 21:29:39.005788 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:39.005745    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh"]
Sep 11 21:29:39.006270 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:39.006019    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh" podUID="8835434a-feed-4a67-bbfa-7899cc5938aa" containerName="istio-proxy" containerID="cri-o://5fa8f94cd9cdbe5cff8bc58a66a8ee8c0291614a3095e8ba8b8f02b6cdd755b0" gracePeriod=30
Sep 11 21:29:44.259994 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:44.259965    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh"
Sep 11 21:29:44.358108 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:44.358022    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5sbf5\" (UniqueName: \"kubernetes.io/projected/8835434a-feed-4a67-bbfa-7899cc5938aa-kube-api-access-5sbf5\") pod \"8835434a-feed-4a67-bbfa-7899cc5938aa\" (UID: \"8835434a-feed-4a67-bbfa-7899cc5938aa\") "
Sep 11 21:29:44.358108 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:44.358063    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8835434a-feed-4a67-bbfa-7899cc5938aa-istiod-ca-cert\") pod \"8835434a-feed-4a67-bbfa-7899cc5938aa\" (UID: \"8835434a-feed-4a67-bbfa-7899cc5938aa\") "
Sep 11 21:29:44.358108 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:44.358095    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8835434a-feed-4a67-bbfa-7899cc5938aa-workload-certs\") pod \"8835434a-feed-4a67-bbfa-7899cc5938aa\" (UID: \"8835434a-feed-4a67-bbfa-7899cc5938aa\") "
Sep 11 21:29:44.358397 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:44.358136    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8835434a-feed-4a67-bbfa-7899cc5938aa-credential-socket\") pod \"8835434a-feed-4a67-bbfa-7899cc5938aa\" (UID: \"8835434a-feed-4a67-bbfa-7899cc5938aa\") "
Sep 11 21:29:44.358397 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:44.358154    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8835434a-feed-4a67-bbfa-7899cc5938aa-istio-envoy\") pod \"8835434a-feed-4a67-bbfa-7899cc5938aa\" (UID: \"8835434a-feed-4a67-bbfa-7899cc5938aa\") "
Sep 11 21:29:44.358397 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:44.358216    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8835434a-feed-4a67-bbfa-7899cc5938aa-istio-podinfo\") pod \"8835434a-feed-4a67-bbfa-7899cc5938aa\" (UID: \"8835434a-feed-4a67-bbfa-7899cc5938aa\") "
Sep 11 21:29:44.358397 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:44.358260    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8835434a-feed-4a67-bbfa-7899cc5938aa-istio-data\") pod \"8835434a-feed-4a67-bbfa-7899cc5938aa\" (UID: \"8835434a-feed-4a67-bbfa-7899cc5938aa\") "
Sep 11 21:29:44.358397 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:44.358308    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8835434a-feed-4a67-bbfa-7899cc5938aa-workload-socket\") pod \"8835434a-feed-4a67-bbfa-7899cc5938aa\" (UID: \"8835434a-feed-4a67-bbfa-7899cc5938aa\") "
Sep 11 21:29:44.358397 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:44.358336    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8835434a-feed-4a67-bbfa-7899cc5938aa-istio-token\") pod \"8835434a-feed-4a67-bbfa-7899cc5938aa\" (UID: \"8835434a-feed-4a67-bbfa-7899cc5938aa\") "
Sep 11 21:29:44.358701 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:44.358488    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8835434a-feed-4a67-bbfa-7899cc5938aa-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8835434a-feed-4a67-bbfa-7899cc5938aa" (UID: "8835434a-feed-4a67-bbfa-7899cc5938aa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:29:44.358701 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:44.358517    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8835434a-feed-4a67-bbfa-7899cc5938aa-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8835434a-feed-4a67-bbfa-7899cc5938aa" (UID: "8835434a-feed-4a67-bbfa-7899cc5938aa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:29:44.358701 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:44.358684    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8835434a-feed-4a67-bbfa-7899cc5938aa-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8835434a-feed-4a67-bbfa-7899cc5938aa" (UID: "8835434a-feed-4a67-bbfa-7899cc5938aa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:29:44.358853 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:44.358778    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8835434a-feed-4a67-bbfa-7899cc5938aa-workload-certs\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:29:44.358853 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:44.358801    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8835434a-feed-4a67-bbfa-7899cc5938aa-credential-socket\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:29:44.358853 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:44.358815    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8835434a-feed-4a67-bbfa-7899cc5938aa-workload-socket\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:29:44.359017 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:44.358846    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8835434a-feed-4a67-bbfa-7899cc5938aa-istio-data" (OuterVolumeSpecName: "istio-data") pod "8835434a-feed-4a67-bbfa-7899cc5938aa" (UID: "8835434a-feed-4a67-bbfa-7899cc5938aa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:29:44.359017 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:44.359005    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8835434a-feed-4a67-bbfa-7899cc5938aa-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8835434a-feed-4a67-bbfa-7899cc5938aa" (UID: "8835434a-feed-4a67-bbfa-7899cc5938aa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:29:44.360336 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:44.360302    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8835434a-feed-4a67-bbfa-7899cc5938aa-kube-api-access-5sbf5" (OuterVolumeSpecName: "kube-api-access-5sbf5") pod "8835434a-feed-4a67-bbfa-7899cc5938aa" (UID: "8835434a-feed-4a67-bbfa-7899cc5938aa"). InnerVolumeSpecName "kube-api-access-5sbf5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:29:44.360809 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:44.360781    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8835434a-feed-4a67-bbfa-7899cc5938aa-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8835434a-feed-4a67-bbfa-7899cc5938aa" (UID: "8835434a-feed-4a67-bbfa-7899cc5938aa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 21:29:44.360961 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:44.360937    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8835434a-feed-4a67-bbfa-7899cc5938aa-istio-token" (OuterVolumeSpecName: "istio-token") pod "8835434a-feed-4a67-bbfa-7899cc5938aa" (UID: "8835434a-feed-4a67-bbfa-7899cc5938aa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:29:44.361050 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:44.360976    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8835434a-feed-4a67-bbfa-7899cc5938aa-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8835434a-feed-4a67-bbfa-7899cc5938aa" (UID: "8835434a-feed-4a67-bbfa-7899cc5938aa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:29:44.460011 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:44.459984    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8835434a-feed-4a67-bbfa-7899cc5938aa-istio-data\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:29:44.460011 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:44.460005    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8835434a-feed-4a67-bbfa-7899cc5938aa-istio-token\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:29:44.460011 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:44.460014    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5sbf5\" (UniqueName: \"kubernetes.io/projected/8835434a-feed-4a67-bbfa-7899cc5938aa-kube-api-access-5sbf5\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:29:44.460201 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:44.460022    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8835434a-feed-4a67-bbfa-7899cc5938aa-istiod-ca-cert\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:29:44.460201 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:44.460030    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8835434a-feed-4a67-bbfa-7899cc5938aa-istio-envoy\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:29:44.460201 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:44.460039    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8835434a-feed-4a67-bbfa-7899cc5938aa-istio-podinfo\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:29:44.781511 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:44.781476    2560 generic.go:356] "Generic (PLEG): container finished" podID="8835434a-feed-4a67-bbfa-7899cc5938aa" containerID="5fa8f94cd9cdbe5cff8bc58a66a8ee8c0291614a3095e8ba8b8f02b6cdd755b0" exitCode=0
Sep 11 21:29:44.781658 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:44.781533    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh"
Sep 11 21:29:44.781658 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:44.781558    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh" event={"ID":"8835434a-feed-4a67-bbfa-7899cc5938aa","Type":"ContainerDied","Data":"5fa8f94cd9cdbe5cff8bc58a66a8ee8c0291614a3095e8ba8b8f02b6cdd755b0"}
Sep 11 21:29:44.781658 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:44.781611    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh" event={"ID":"8835434a-feed-4a67-bbfa-7899cc5938aa","Type":"ContainerDied","Data":"ad6285266c98828c28f483123ba82a4a3e1d8c5ae1dc670baf7eb5ac0ef67cb6"}
Sep 11 21:29:44.781658 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:44.781633    2560 scope.go:117] "RemoveContainer" containerID="5fa8f94cd9cdbe5cff8bc58a66a8ee8c0291614a3095e8ba8b8f02b6cdd755b0"
Sep 11 21:29:44.791143 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:44.791128    2560 scope.go:117] "RemoveContainer" containerID="40dcfa803f4f75e2238494c402703aa68121fc90367eef928366c3074ce5d3c9"
Sep 11 21:29:44.798948 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:44.798928    2560 scope.go:117] "RemoveContainer" containerID="5fa8f94cd9cdbe5cff8bc58a66a8ee8c0291614a3095e8ba8b8f02b6cdd755b0"
Sep 11 21:29:44.799205 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:29:44.799185    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fa8f94cd9cdbe5cff8bc58a66a8ee8c0291614a3095e8ba8b8f02b6cdd755b0\": container with ID starting with 5fa8f94cd9cdbe5cff8bc58a66a8ee8c0291614a3095e8ba8b8f02b6cdd755b0 not found: ID does not exist" containerID="5fa8f94cd9cdbe5cff8bc58a66a8ee8c0291614a3095e8ba8b8f02b6cdd755b0"
Sep 11 21:29:44.799255 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:44.799214    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fa8f94cd9cdbe5cff8bc58a66a8ee8c0291614a3095e8ba8b8f02b6cdd755b0"} err="failed to get container status \"5fa8f94cd9cdbe5cff8bc58a66a8ee8c0291614a3095e8ba8b8f02b6cdd755b0\": rpc error: code = NotFound desc = could not find container \"5fa8f94cd9cdbe5cff8bc58a66a8ee8c0291614a3095e8ba8b8f02b6cdd755b0\": container with ID starting with 5fa8f94cd9cdbe5cff8bc58a66a8ee8c0291614a3095e8ba8b8f02b6cdd755b0 not found: ID does not exist"
Sep 11 21:29:44.799255 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:44.799239    2560 scope.go:117] "RemoveContainer" containerID="40dcfa803f4f75e2238494c402703aa68121fc90367eef928366c3074ce5d3c9"
Sep 11 21:29:44.799488 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:29:44.799471    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40dcfa803f4f75e2238494c402703aa68121fc90367eef928366c3074ce5d3c9\": container with ID starting with 40dcfa803f4f75e2238494c402703aa68121fc90367eef928366c3074ce5d3c9 not found: ID does not exist" containerID="40dcfa803f4f75e2238494c402703aa68121fc90367eef928366c3074ce5d3c9"
Sep 11 21:29:44.799546 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:44.799492    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40dcfa803f4f75e2238494c402703aa68121fc90367eef928366c3074ce5d3c9"} err="failed to get container status \"40dcfa803f4f75e2238494c402703aa68121fc90367eef928366c3074ce5d3c9\": rpc error: code = NotFound desc = could not find container \"40dcfa803f4f75e2238494c402703aa68121fc90367eef928366c3074ce5d3c9\": container with ID starting with 40dcfa803f4f75e2238494c402703aa68121fc90367eef928366c3074ce5d3c9 not found: ID does not exist"
Sep 11 21:29:44.814780 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:44.814760    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh"]
Sep 11 21:29:44.816599 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:44.816581    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh"]
Sep 11 21:29:45.037533 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:45.037447    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8835434a-feed-4a67-bbfa-7899cc5938aa" path="/var/lib/kubelet/pods/8835434a-feed-4a67-bbfa-7899cc5938aa/volumes"
Sep 11 21:29:47.783369 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:47.783285    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-2bd772/rate-test-model-2bd772-kserve-775f595bdc-2bvph"]
Sep 11 21:29:47.783978 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:47.783954    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8835434a-feed-4a67-bbfa-7899cc5938aa" containerName="istio-proxy"
Sep 11 21:29:47.783978 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:47.783976    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8835434a-feed-4a67-bbfa-7899cc5938aa" containerName="istio-proxy"
Sep 11 21:29:47.784176 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:47.784002    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e59f7272-4d6a-4c9e-ae1f-998f38f473a8" containerName="istio-proxy"
Sep 11 21:29:47.784176 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:47.784011    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e59f7272-4d6a-4c9e-ae1f-998f38f473a8" containerName="istio-proxy"
Sep 11 21:29:47.784176 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:47.784026    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47d774fa-907b-4578-9f06-a18ef2b01189" containerName="revoke-keys"
Sep 11 21:29:47.784176 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:47.784034    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="47d774fa-907b-4578-9f06-a18ef2b01189" containerName="revoke-keys"
Sep 11 21:29:47.784176 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:47.784049    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96aa0df2-4abc-4697-bb36-2827069e2325" containerName="payload-processing"
Sep 11 21:29:47.784176 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:47.784057    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="96aa0df2-4abc-4697-bb36-2827069e2325" containerName="payload-processing"
Sep 11 21:29:47.784176 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:47.784155    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e59f7272-4d6a-4c9e-ae1f-998f38f473a8" containerName="istio-proxy"
Sep 11 21:29:47.784176 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:47.784167    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="8835434a-feed-4a67-bbfa-7899cc5938aa" containerName="istio-proxy"
Sep 11 21:29:47.784176 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:47.784177    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="96aa0df2-4abc-4697-bb36-2827069e2325" containerName="payload-processing"
Sep 11 21:29:47.784570 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:47.784189    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="47d774fa-907b-4578-9f06-a18ef2b01189" containerName="revoke-keys"
Sep 11 21:29:47.788909 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:47.788885    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-2bd772/rate-test-model-2bd772-kserve-775f595bdc-2bvph"
Sep 11 21:29:47.792982 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:47.792960    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-2bd772\"/\"default-dockercfg-fk6bh\""
Sep 11 21:29:47.793968 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:47.793947    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-2bd772\"/\"kube-root-ca.crt\""
Sep 11 21:29:47.794107 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:47.794084    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-2bd772\"/\"rate-test-model-2bd772-kserve-self-signed-certs\""
Sep 11 21:29:47.794192 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:47.793957    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-2bd772\"/\"openshift-service-ca.crt\""
Sep 11 21:29:47.810243 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:47.810211    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-2bd772/rate-test-model-2bd772-kserve-775f595bdc-2bvph"]
Sep 11 21:29:47.893106 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:47.893072    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/278c972b-6703-4de6-a579-ab5b52f64981-tmp-dir\") pod \"rate-test-model-2bd772-kserve-775f595bdc-2bvph\" (UID: \"278c972b-6703-4de6-a579-ab5b52f64981\") " pod="ai-tenant-e2e-shared-a-w3-2bd772/rate-test-model-2bd772-kserve-775f595bdc-2bvph"
Sep 11 21:29:47.893106 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:47.893107    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8w7xm\" (UniqueName: \"kubernetes.io/projected/278c972b-6703-4de6-a579-ab5b52f64981-kube-api-access-8w7xm\") pod \"rate-test-model-2bd772-kserve-775f595bdc-2bvph\" (UID: \"278c972b-6703-4de6-a579-ab5b52f64981\") " pod="ai-tenant-e2e-shared-a-w3-2bd772/rate-test-model-2bd772-kserve-775f595bdc-2bvph"
Sep 11 21:29:47.893310 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:47.893129    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/278c972b-6703-4de6-a579-ab5b52f64981-home\") pod \"rate-test-model-2bd772-kserve-775f595bdc-2bvph\" (UID: \"278c972b-6703-4de6-a579-ab5b52f64981\") " pod="ai-tenant-e2e-shared-a-w3-2bd772/rate-test-model-2bd772-kserve-775f595bdc-2bvph"
Sep 11 21:29:47.893310 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:47.893251    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/278c972b-6703-4de6-a579-ab5b52f64981-model-cache\") pod \"rate-test-model-2bd772-kserve-775f595bdc-2bvph\" (UID: \"278c972b-6703-4de6-a579-ab5b52f64981\") " pod="ai-tenant-e2e-shared-a-w3-2bd772/rate-test-model-2bd772-kserve-775f595bdc-2bvph"
Sep 11 21:29:47.893310 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:47.893281    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/278c972b-6703-4de6-a579-ab5b52f64981-tls-certs\") pod \"rate-test-model-2bd772-kserve-775f595bdc-2bvph\" (UID: \"278c972b-6703-4de6-a579-ab5b52f64981\") " pod="ai-tenant-e2e-shared-a-w3-2bd772/rate-test-model-2bd772-kserve-775f595bdc-2bvph"
Sep 11 21:29:47.893310 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:47.893310    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/278c972b-6703-4de6-a579-ab5b52f64981-dshm\") pod \"rate-test-model-2bd772-kserve-775f595bdc-2bvph\" (UID: \"278c972b-6703-4de6-a579-ab5b52f64981\") " pod="ai-tenant-e2e-shared-a-w3-2bd772/rate-test-model-2bd772-kserve-775f595bdc-2bvph"
Sep 11 21:29:47.994108 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:47.994076    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/278c972b-6703-4de6-a579-ab5b52f64981-model-cache\") pod \"rate-test-model-2bd772-kserve-775f595bdc-2bvph\" (UID: \"278c972b-6703-4de6-a579-ab5b52f64981\") " pod="ai-tenant-e2e-shared-a-w3-2bd772/rate-test-model-2bd772-kserve-775f595bdc-2bvph"
Sep 11 21:29:47.994108 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:47.994110    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/278c972b-6703-4de6-a579-ab5b52f64981-tls-certs\") pod \"rate-test-model-2bd772-kserve-775f595bdc-2bvph\" (UID: \"278c972b-6703-4de6-a579-ab5b52f64981\") " pod="ai-tenant-e2e-shared-a-w3-2bd772/rate-test-model-2bd772-kserve-775f595bdc-2bvph"
Sep 11 21:29:47.994347 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:47.994134    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/278c972b-6703-4de6-a579-ab5b52f64981-dshm\") pod \"rate-test-model-2bd772-kserve-775f595bdc-2bvph\" (UID: \"278c972b-6703-4de6-a579-ab5b52f64981\") " pod="ai-tenant-e2e-shared-a-w3-2bd772/rate-test-model-2bd772-kserve-775f595bdc-2bvph"
Sep 11 21:29:47.994347 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:47.994180    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/278c972b-6703-4de6-a579-ab5b52f64981-tmp-dir\") pod \"rate-test-model-2bd772-kserve-775f595bdc-2bvph\" (UID: \"278c972b-6703-4de6-a579-ab5b52f64981\") " pod="ai-tenant-e2e-shared-a-w3-2bd772/rate-test-model-2bd772-kserve-775f595bdc-2bvph"
Sep 11 21:29:47.994347 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:47.994195    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w7xm\" (UniqueName: \"kubernetes.io/projected/278c972b-6703-4de6-a579-ab5b52f64981-kube-api-access-8w7xm\") pod \"rate-test-model-2bd772-kserve-775f595bdc-2bvph\" (UID: \"278c972b-6703-4de6-a579-ab5b52f64981\") " pod="ai-tenant-e2e-shared-a-w3-2bd772/rate-test-model-2bd772-kserve-775f595bdc-2bvph"
Sep 11 21:29:47.994347 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:47.994216    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/278c972b-6703-4de6-a579-ab5b52f64981-home\") pod \"rate-test-model-2bd772-kserve-775f595bdc-2bvph\" (UID: \"278c972b-6703-4de6-a579-ab5b52f64981\") " pod="ai-tenant-e2e-shared-a-w3-2bd772/rate-test-model-2bd772-kserve-775f595bdc-2bvph"
Sep 11 21:29:47.994601 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:47.994581    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/278c972b-6703-4de6-a579-ab5b52f64981-model-cache\") pod \"rate-test-model-2bd772-kserve-775f595bdc-2bvph\" (UID: \"278c972b-6703-4de6-a579-ab5b52f64981\") " pod="ai-tenant-e2e-shared-a-w3-2bd772/rate-test-model-2bd772-kserve-775f595bdc-2bvph"
Sep 11 21:29:47.994650 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:47.994619    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/278c972b-6703-4de6-a579-ab5b52f64981-tmp-dir\") pod \"rate-test-model-2bd772-kserve-775f595bdc-2bvph\" (UID: \"278c972b-6703-4de6-a579-ab5b52f64981\") " pod="ai-tenant-e2e-shared-a-w3-2bd772/rate-test-model-2bd772-kserve-775f595bdc-2bvph"
Sep 11 21:29:47.994691 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:47.994648    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/278c972b-6703-4de6-a579-ab5b52f64981-home\") pod \"rate-test-model-2bd772-kserve-775f595bdc-2bvph\" (UID: \"278c972b-6703-4de6-a579-ab5b52f64981\") " pod="ai-tenant-e2e-shared-a-w3-2bd772/rate-test-model-2bd772-kserve-775f595bdc-2bvph"
Sep 11 21:29:47.996437 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:47.996414    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/278c972b-6703-4de6-a579-ab5b52f64981-dshm\") pod \"rate-test-model-2bd772-kserve-775f595bdc-2bvph\" (UID: \"278c972b-6703-4de6-a579-ab5b52f64981\") " pod="ai-tenant-e2e-shared-a-w3-2bd772/rate-test-model-2bd772-kserve-775f595bdc-2bvph"
Sep 11 21:29:47.996826 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:47.996804    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/278c972b-6703-4de6-a579-ab5b52f64981-tls-certs\") pod \"rate-test-model-2bd772-kserve-775f595bdc-2bvph\" (UID: \"278c972b-6703-4de6-a579-ab5b52f64981\") " pod="ai-tenant-e2e-shared-a-w3-2bd772/rate-test-model-2bd772-kserve-775f595bdc-2bvph"
Sep 11 21:29:48.015140 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:48.015116    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w7xm\" (UniqueName: \"kubernetes.io/projected/278c972b-6703-4de6-a579-ab5b52f64981-kube-api-access-8w7xm\") pod \"rate-test-model-2bd772-kserve-775f595bdc-2bvph\" (UID: \"278c972b-6703-4de6-a579-ab5b52f64981\") " pod="ai-tenant-e2e-shared-a-w3-2bd772/rate-test-model-2bd772-kserve-775f595bdc-2bvph"
Sep 11 21:29:48.100768 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:48.100702    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-2bd772/rate-test-model-2bd772-kserve-775f595bdc-2bvph"
Sep 11 21:29:48.391167 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:48.391142    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-2bd772/rate-test-model-2bd772-kserve-775f595bdc-2bvph"]
Sep 11 21:29:48.392473 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:29:48.392446    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod278c972b_6703_4de6_a579_ab5b52f64981.slice/crio-9ab7e4346c302640b84df398722b6a22a22d4df65bb9ca9bae1d80f6b5320211 WatchSource:0}: Error finding container 9ab7e4346c302640b84df398722b6a22a22d4df65bb9ca9bae1d80f6b5320211: Status 404 returned error can't find the container with id 9ab7e4346c302640b84df398722b6a22a22d4df65bb9ca9bae1d80f6b5320211
Sep 11 21:29:48.808795 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:48.808708    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-2bd772/rate-test-model-2bd772-kserve-775f595bdc-2bvph" event={"ID":"278c972b-6703-4de6-a579-ab5b52f64981","Type":"ContainerStarted","Data":"c1caa9686038027149667af5703f07bf4dfd0e4f2de72f98ccd357c2efababdb"}
Sep 11 21:29:48.808795 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:48.808757    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-2bd772/rate-test-model-2bd772-kserve-775f595bdc-2bvph" event={"ID":"278c972b-6703-4de6-a579-ab5b52f64981","Type":"ContainerStarted","Data":"9ab7e4346c302640b84df398722b6a22a22d4df65bb9ca9bae1d80f6b5320211"}
Sep 11 21:29:48.835227 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:48.835176    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-2bd772/rate-test-model-2bd772-kserve-775f595bdc-2bvph" podStartSLOduration=1.8351616480000001 podStartE2EDuration="1.835161648s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:29:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:29:48.833525088 +0000 UTC m=+1434.311836932" watchObservedRunningTime="2026-09-11 21:29:48.835161648 +0000 UTC m=+1434.313473491"
Sep 11 21:29:55.376105 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:55.376077    2560 scope.go:117] "RemoveContainer" containerID="c0e69eaa9453ecec944422d5f391b85bfdcf3b7c9ef8d37664b1b16b305e3136"
Sep 11 21:29:58.100963 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:58.100923    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-2bd772/rate-test-model-2bd772-kserve-775f595bdc-2bvph"
Sep 11 21:29:58.101370 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:58.100981    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-2bd772/rate-test-model-2bd772-kserve-775f595bdc-2bvph"
Sep 11 21:29:58.113176 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:58.113149    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-2bd772/rate-test-model-2bd772-kserve-775f595bdc-2bvph"
Sep 11 21:29:58.877614 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:29:58.877586    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-2bd772/rate-test-model-2bd772-kserve-775f595bdc-2bvph"
Sep 11 21:30:00.157267 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:00.157235    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-713791-29819370-g4q6l"]
Sep 11 21:30:00.157683 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:00.157670    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e59f7272-4d6a-4c9e-ae1f-998f38f473a8" containerName="istio-proxy"
Sep 11 21:30:00.157683 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:00.157685    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e59f7272-4d6a-4c9e-ae1f-998f38f473a8" containerName="istio-proxy"
Sep 11 21:30:00.157777 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:00.157721    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8835434a-feed-4a67-bbfa-7899cc5938aa" containerName="istio-proxy"
Sep 11 21:30:00.157777 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:00.157727    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8835434a-feed-4a67-bbfa-7899cc5938aa" containerName="istio-proxy"
Sep 11 21:30:00.157861 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:00.157821    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e59f7272-4d6a-4c9e-ae1f-998f38f473a8" containerName="istio-proxy"
Sep 11 21:30:00.157861 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:00.157832    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="8835434a-feed-4a67-bbfa-7899cc5938aa" containerName="istio-proxy"
Sep 11 21:30:00.162399 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:00.162365    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-713791-29819370-g4q6l"
Sep 11 21:30:00.164026 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:00.164005    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-2bd772-29819370-pfrpv"]
Sep 11 21:30:00.165736 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:00.165715    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bfm9g\""
Sep 11 21:30:00.167258 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:00.167243    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-2bd772-29819370-pfrpv"
Sep 11 21:30:00.173301 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:00.173284    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-713791-29819370-g4q6l"
Sep 11 21:30:00.181263 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:00.181244    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-2bd772-29819370-pfrpv"
Sep 11 21:30:00.193098 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:00.193078    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-2bd772-29819370-pfrpv"]
Sep 11 21:30:00.210071 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:00.209938    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-713791-29819370-g4q6l"]
Sep 11 21:30:00.466203 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:00.466177    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-713791-29819370-g4q6l"]
Sep 11 21:30:00.467664 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:30:00.467637    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8cf72f2_52a3_4b96_8199_ce69e7a47d86.slice/crio-3db9735ffb0b9d0782f22161ae7ab43940b1fce8b50cf4a57487a3676de34305 WatchSource:0}: Error finding container 3db9735ffb0b9d0782f22161ae7ab43940b1fce8b50cf4a57487a3676de34305: Status 404 returned error can't find the container with id 3db9735ffb0b9d0782f22161ae7ab43940b1fce8b50cf4a57487a3676de34305
Sep 11 21:30:00.472956 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:00.472934    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-2bd772-29819370-pfrpv"]
Sep 11 21:30:00.474628 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:30:00.474604    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1bfb8f2_dffb_4a49_99bc_6a08a4c40288.slice/crio-43a9e05a448a77ac57a6771d9a1da0ff14a7233ee41ebcd88635ae82830b0584 WatchSource:0}: Error finding container 43a9e05a448a77ac57a6771d9a1da0ff14a7233ee41ebcd88635ae82830b0584: Status 404 returned error can't find the container with id 43a9e05a448a77ac57a6771d9a1da0ff14a7233ee41ebcd88635ae82830b0584
Sep 11 21:30:00.878454 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:00.878422    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-713791-29819370-g4q6l" event={"ID":"a8cf72f2-52a3-4b96-8199-ce69e7a47d86","Type":"ContainerStarted","Data":"fa2ea0fb1ee585b6aabd2420a6e1eab6f6d1027fc7d59e59c8dc61dde32b33dd"}
Sep 11 21:30:00.878573 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:00.878480    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-713791-29819370-g4q6l" event={"ID":"a8cf72f2-52a3-4b96-8199-ce69e7a47d86","Type":"ContainerStarted","Data":"3db9735ffb0b9d0782f22161ae7ab43940b1fce8b50cf4a57487a3676de34305"}
Sep 11 21:30:00.880014 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:00.879991    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-2bd772-29819370-pfrpv" event={"ID":"e1bfb8f2-dffb-4a49-99bc-6a08a4c40288","Type":"ContainerStarted","Data":"83f907220cf4f57c22d556abc104d17c127c0dfd8eab8d620ce32912e07a4a55"}
Sep 11 21:30:00.880133 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:00.880032    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-2bd772-29819370-pfrpv" event={"ID":"e1bfb8f2-dffb-4a49-99bc-6a08a4c40288","Type":"ContainerStarted","Data":"43a9e05a448a77ac57a6771d9a1da0ff14a7233ee41ebcd88635ae82830b0584"}
Sep 11 21:30:00.897564 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:00.897524    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-713791-29819370-g4q6l" podStartSLOduration=0.897508883 podStartE2EDuration="897.508883ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:30:00.894827299 +0000 UTC m=+1446.373139143" watchObservedRunningTime="2026-09-11 21:30:00.897508883 +0000 UTC m=+1446.375820727"
Sep 11 21:30:00.913974 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:00.913934    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-2bd772-29819370-pfrpv" podStartSLOduration=0.913919988 podStartE2EDuration="913.919988ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:30:00.911892557 +0000 UTC m=+1446.390204400" watchObservedRunningTime="2026-09-11 21:30:00.913919988 +0000 UTC m=+1446.392231831"
Sep 11 21:30:01.886364 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:01.886328    2560 generic.go:356] "Generic (PLEG): container finished" podID="a8cf72f2-52a3-4b96-8199-ce69e7a47d86" containerID="fa2ea0fb1ee585b6aabd2420a6e1eab6f6d1027fc7d59e59c8dc61dde32b33dd" exitCode=0
Sep 11 21:30:01.886922 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:01.886406    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-713791-29819370-g4q6l" event={"ID":"a8cf72f2-52a3-4b96-8199-ce69e7a47d86","Type":"ContainerDied","Data":"fa2ea0fb1ee585b6aabd2420a6e1eab6f6d1027fc7d59e59c8dc61dde32b33dd"}
Sep 11 21:30:01.887856 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:01.887833    2560 generic.go:356] "Generic (PLEG): container finished" podID="e1bfb8f2-dffb-4a49-99bc-6a08a4c40288" containerID="83f907220cf4f57c22d556abc104d17c127c0dfd8eab8d620ce32912e07a4a55" exitCode=0
Sep 11 21:30:01.887956 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:01.887914    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-2bd772-29819370-pfrpv" event={"ID":"e1bfb8f2-dffb-4a49-99bc-6a08a4c40288","Type":"ContainerDied","Data":"83f907220cf4f57c22d556abc104d17c127c0dfd8eab8d620ce32912e07a4a55"}
Sep 11 21:30:03.019218 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:03.019190    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-713791-29819370-g4q6l"
Sep 11 21:30:03.051989 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:03.051966    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-2bd772-29819370-pfrpv"
Sep 11 21:30:03.899948 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:03.899924    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-713791-29819370-g4q6l"
Sep 11 21:30:03.900110 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:03.899962    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-713791-29819370-g4q6l" event={"ID":"a8cf72f2-52a3-4b96-8199-ce69e7a47d86","Type":"ContainerDied","Data":"3db9735ffb0b9d0782f22161ae7ab43940b1fce8b50cf4a57487a3676de34305"}
Sep 11 21:30:03.900110 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:03.900000    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3db9735ffb0b9d0782f22161ae7ab43940b1fce8b50cf4a57487a3676de34305"
Sep 11 21:30:03.901271 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:03.901245    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-2bd772-29819370-pfrpv" event={"ID":"e1bfb8f2-dffb-4a49-99bc-6a08a4c40288","Type":"ContainerDied","Data":"43a9e05a448a77ac57a6771d9a1da0ff14a7233ee41ebcd88635ae82830b0584"}
Sep 11 21:30:03.901271 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:03.901266    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-2bd772-29819370-pfrpv"
Sep 11 21:30:03.901484 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:03.901281    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="43a9e05a448a77ac57a6771d9a1da0ff14a7233ee41ebcd88635ae82830b0584"
Sep 11 21:30:50.856989 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:50.856943    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-2bd772/rate-test-model-2bd772-kserve-775f595bdc-2bvph"]
Sep 11 21:30:52.573155 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:52.573123    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56"]
Sep 11 21:30:52.573564 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:52.573551    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8cf72f2-52a3-4b96-8199-ce69e7a47d86" containerName="cleanup"
Sep 11 21:30:52.573564 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:52.573565    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8cf72f2-52a3-4b96-8199-ce69e7a47d86" containerName="cleanup"
Sep 11 21:30:52.573644 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:52.573593    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1bfb8f2-dffb-4a49-99bc-6a08a4c40288" containerName="cleanup"
Sep 11 21:30:52.573644 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:52.573599    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1bfb8f2-dffb-4a49-99bc-6a08a4c40288" containerName="cleanup"
Sep 11 21:30:52.573706 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:52.573663    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8cf72f2-52a3-4b96-8199-ce69e7a47d86" containerName="cleanup"
Sep 11 21:30:52.573706 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:52.573674    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1bfb8f2-dffb-4a49-99bc-6a08a4c40288" containerName="cleanup"
Sep 11 21:30:52.577108 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:52.577090    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56"
Sep 11 21:30:52.580878 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:52.580853    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-19ce3e-openshift-default-dockercfg-xg6kn\""
Sep 11 21:30:52.598343 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:52.598318    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56"]
Sep 11 21:30:52.676078 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:52.676041    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5kh9\" (UniqueName: \"kubernetes.io/projected/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d-kube-api-access-w5kh9\") pod \"e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56\" (UID: \"14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d\") " pod="openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56"
Sep 11 21:30:52.676281 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:52.676097    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d-istio-token\") pod \"e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56\" (UID: \"14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d\") " pod="openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56"
Sep 11 21:30:52.676281 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:52.676141    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d-istiod-ca-cert\") pod \"e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56\" (UID: \"14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d\") " pod="openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56"
Sep 11 21:30:52.676281 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:52.676212    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d-workload-socket\") pod \"e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56\" (UID: \"14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d\") " pod="openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56"
Sep 11 21:30:52.676281 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:52.676239    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d-istio-envoy\") pod \"e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56\" (UID: \"14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d\") " pod="openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56"
Sep 11 21:30:52.676281 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:52.676260    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d-istio-data\") pod \"e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56\" (UID: \"14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d\") " pod="openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56"
Sep 11 21:30:52.676605 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:52.676286    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d-workload-certs\") pod \"e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56\" (UID: \"14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d\") " pod="openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56"
Sep 11 21:30:52.676605 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:52.676319    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d-credential-socket\") pod \"e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56\" (UID: \"14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d\") " pod="openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56"
Sep 11 21:30:52.676605 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:52.676398    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d-istio-podinfo\") pod \"e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56\" (UID: \"14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d\") " pod="openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56"
Sep 11 21:30:52.777530 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:52.777495    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d-credential-socket\") pod \"e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56\" (UID: \"14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d\") " pod="openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56"
Sep 11 21:30:52.777692 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:52.777539    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d-istio-podinfo\") pod \"e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56\" (UID: \"14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d\") " pod="openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56"
Sep 11 21:30:52.777692 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:52.777603    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5kh9\" (UniqueName: \"kubernetes.io/projected/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d-kube-api-access-w5kh9\") pod \"e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56\" (UID: \"14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d\") " pod="openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56"
Sep 11 21:30:52.777692 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:52.777631    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d-istio-token\") pod \"e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56\" (UID: \"14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d\") " pod="openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56"
Sep 11 21:30:52.777692 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:52.777669    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d-istiod-ca-cert\") pod \"e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56\" (UID: \"14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d\") " pod="openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56"
Sep 11 21:30:52.777906 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:52.777843    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d-workload-socket\") pod \"e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56\" (UID: \"14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d\") " pod="openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56"
Sep 11 21:30:52.777906 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:52.777890    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d-istio-envoy\") pod \"e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56\" (UID: \"14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d\") " pod="openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56"
Sep 11 21:30:52.778022 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:52.777914    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d-istio-data\") pod \"e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56\" (UID: \"14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d\") " pod="openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56"
Sep 11 21:30:52.778022 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:52.777953    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d-workload-certs\") pod \"e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56\" (UID: \"14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d\") " pod="openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56"
Sep 11 21:30:52.778022 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:52.777892    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d-credential-socket\") pod \"e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56\" (UID: \"14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d\") " pod="openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56"
Sep 11 21:30:52.778179 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:52.778124    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d-workload-socket\") pod \"e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56\" (UID: \"14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d\") " pod="openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56"
Sep 11 21:30:52.778276 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:52.778252    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d-istio-data\") pod \"e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56\" (UID: \"14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d\") " pod="openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56"
Sep 11 21:30:52.778345 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:52.778275    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d-workload-certs\") pod \"e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56\" (UID: \"14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d\") " pod="openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56"
Sep 11 21:30:52.778482 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:52.778463    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d-istiod-ca-cert\") pod \"e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56\" (UID: \"14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d\") " pod="openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56"
Sep 11 21:30:52.779984 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:52.779962    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d-istio-envoy\") pod \"e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56\" (UID: \"14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d\") " pod="openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56"
Sep 11 21:30:52.780116 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:52.780098    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d-istio-podinfo\") pod \"e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56\" (UID: \"14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d\") " pod="openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56"
Sep 11 21:30:52.787476 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:52.787448    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d-istio-token\") pod \"e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56\" (UID: \"14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d\") " pod="openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56"
Sep 11 21:30:52.791404 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:52.787623    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5kh9\" (UniqueName: \"kubernetes.io/projected/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d-kube-api-access-w5kh9\") pod \"e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56\" (UID: \"14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d\") " pod="openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56"
Sep 11 21:30:52.887520 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:52.887492    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56"
Sep 11 21:30:53.169936 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:53.169910    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56"]
Sep 11 21:30:53.175050 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:30:53.175016    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14635d52_8b1d_49b9_b4d9_e8aa3a27ff5d.slice/crio-9be22f6fa95a7db9b3ce6e67a4b76f0aff1d546a389d5f9798058f524b517486 WatchSource:0}: Error finding container 9be22f6fa95a7db9b3ce6e67a4b76f0aff1d546a389d5f9798058f524b517486: Status 404 returned error can't find the container with id 9be22f6fa95a7db9b3ce6e67a4b76f0aff1d546a389d5f9798058f524b517486
Sep 11 21:30:53.177233 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:53.177199    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:30:53.177334 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:53.177274    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:30:53.177334 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:53.177316    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:30:54.189118 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:54.189084    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56" event={"ID":"14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d","Type":"ContainerStarted","Data":"6ba32e8862eda804d1b22bb2ea72a8d5df36dce97685e4da13b2f7eaa5a83e46"}
Sep 11 21:30:54.189605 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:54.189142    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56" event={"ID":"14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d","Type":"ContainerStarted","Data":"9be22f6fa95a7db9b3ce6e67a4b76f0aff1d546a389d5f9798058f524b517486"}
Sep 11 21:30:54.219452 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:54.219398    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56" podStartSLOduration=2.219366836 podStartE2EDuration="2.219366836s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:30:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:30:54.217810665 +0000 UTC m=+1499.696122533" watchObservedRunningTime="2026-09-11 21:30:54.219366836 +0000 UTC m=+1499.697678679"
Sep 11 21:30:54.888333 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:54.888301    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56"
Sep 11 21:30:54.893470 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:54.893446    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56"
Sep 11 21:30:55.193877 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:55.193806    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56"
Sep 11 21:30:55.194837 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:55.194814    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56"
Sep 11 21:30:55.411854 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:55.411823    2560 scope.go:117] "RemoveContainer" containerID="3355078acd8e93e6ef90aeee7c8aa7cfc017affe4ae91417f534848404d99f74"
Sep 11 21:30:59.281177 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:59.281147    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-19ce3e-585cfdb4d9-s7zlj"]
Sep 11 21:30:59.286098 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:59.286074    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-19ce3e-585cfdb4d9-s7zlj"
Sep 11 21:30:59.291597 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:59.291575    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-19ce3e\""
Sep 11 21:30:59.313948 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:59.313924    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-19ce3e-585cfdb4d9-s7zlj"]
Sep 11 21:30:59.341123 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:59.341099    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b84t8\" (UniqueName: \"kubernetes.io/projected/cbd4d268-efec-43c4-8c56-be10e8cc9b79-kube-api-access-b84t8\") pod \"payload-processing-e2e-ipp-a-19ce3e-585cfdb4d9-s7zlj\" (UID: \"cbd4d268-efec-43c4-8c56-be10e8cc9b79\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-19ce3e-585cfdb4d9-s7zlj"
Sep 11 21:30:59.341246 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:59.341142    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cbd4d268-efec-43c4-8c56-be10e8cc9b79-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-19ce3e-585cfdb4d9-s7zlj\" (UID: \"cbd4d268-efec-43c4-8c56-be10e8cc9b79\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-19ce3e-585cfdb4d9-s7zlj"
Sep 11 21:30:59.359535 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:59.359509    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-19ce3e-f6fdfdd94-lfbnn"]
Sep 11 21:30:59.363366 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:59.363350    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-19ce3e-f6fdfdd94-lfbnn"
Sep 11 21:30:59.369765 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:59.369602    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-19ce3e-dockercfg-p96sv\""
Sep 11 21:30:59.442600 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:59.442555    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c74cfae8-516b-4b63-82b0-b2dba70c37cb-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-19ce3e-f6fdfdd94-lfbnn\" (UID: \"c74cfae8-516b-4b63-82b0-b2dba70c37cb\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-19ce3e-f6fdfdd94-lfbnn"
Sep 11 21:30:59.442790 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:59.442629    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b84t8\" (UniqueName: \"kubernetes.io/projected/cbd4d268-efec-43c4-8c56-be10e8cc9b79-kube-api-access-b84t8\") pod \"payload-processing-e2e-ipp-a-19ce3e-585cfdb4d9-s7zlj\" (UID: \"cbd4d268-efec-43c4-8c56-be10e8cc9b79\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-19ce3e-585cfdb4d9-s7zlj"
Sep 11 21:30:59.442790 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:59.442693    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cbd4d268-efec-43c4-8c56-be10e8cc9b79-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-19ce3e-585cfdb4d9-s7zlj\" (UID: \"cbd4d268-efec-43c4-8c56-be10e8cc9b79\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-19ce3e-585cfdb4d9-s7zlj"
Sep 11 21:30:59.442790 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:59.442733    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k5hk\" (UniqueName: \"kubernetes.io/projected/c74cfae8-516b-4b63-82b0-b2dba70c37cb-kube-api-access-6k5hk\") pod \"payload-pre-processing-e2e-ipp-a-19ce3e-f6fdfdd94-lfbnn\" (UID: \"c74cfae8-516b-4b63-82b0-b2dba70c37cb\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-19ce3e-f6fdfdd94-lfbnn"
Sep 11 21:30:59.443660 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:59.443636    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cbd4d268-efec-43c4-8c56-be10e8cc9b79-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-19ce3e-585cfdb4d9-s7zlj\" (UID: \"cbd4d268-efec-43c4-8c56-be10e8cc9b79\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-19ce3e-585cfdb4d9-s7zlj"
Sep 11 21:30:59.476344 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:59.476319    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b84t8\" (UniqueName: \"kubernetes.io/projected/cbd4d268-efec-43c4-8c56-be10e8cc9b79-kube-api-access-b84t8\") pod \"payload-processing-e2e-ipp-a-19ce3e-585cfdb4d9-s7zlj\" (UID: \"cbd4d268-efec-43c4-8c56-be10e8cc9b79\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-19ce3e-585cfdb4d9-s7zlj"
Sep 11 21:30:59.482061 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:59.482033    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-19ce3e-f6fdfdd94-lfbnn"]
Sep 11 21:30:59.543794 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:59.543729    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c74cfae8-516b-4b63-82b0-b2dba70c37cb-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-19ce3e-f6fdfdd94-lfbnn\" (UID: \"c74cfae8-516b-4b63-82b0-b2dba70c37cb\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-19ce3e-f6fdfdd94-lfbnn"
Sep 11 21:30:59.543911 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:59.543801    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k5hk\" (UniqueName: \"kubernetes.io/projected/c74cfae8-516b-4b63-82b0-b2dba70c37cb-kube-api-access-6k5hk\") pod \"payload-pre-processing-e2e-ipp-a-19ce3e-f6fdfdd94-lfbnn\" (UID: \"c74cfae8-516b-4b63-82b0-b2dba70c37cb\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-19ce3e-f6fdfdd94-lfbnn"
Sep 11 21:30:59.544426 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:59.544373    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c74cfae8-516b-4b63-82b0-b2dba70c37cb-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-19ce3e-f6fdfdd94-lfbnn\" (UID: \"c74cfae8-516b-4b63-82b0-b2dba70c37cb\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-19ce3e-f6fdfdd94-lfbnn"
Sep 11 21:30:59.555212 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:59.555188    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k5hk\" (UniqueName: \"kubernetes.io/projected/c74cfae8-516b-4b63-82b0-b2dba70c37cb-kube-api-access-6k5hk\") pod \"payload-pre-processing-e2e-ipp-a-19ce3e-f6fdfdd94-lfbnn\" (UID: \"c74cfae8-516b-4b63-82b0-b2dba70c37cb\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-19ce3e-f6fdfdd94-lfbnn"
Sep 11 21:30:59.597124 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:59.597099    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-19ce3e-585cfdb4d9-s7zlj"
Sep 11 21:30:59.673704 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:59.673655    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-19ce3e-f6fdfdd94-lfbnn"
Sep 11 21:30:59.881820 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:59.881797    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-19ce3e-585cfdb4d9-s7zlj"]
Sep 11 21:30:59.882504 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:30:59.882462    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbd4d268_efec_43c4_8c56_be10e8cc9b79.slice/crio-05289946665b20ce0c78c10624b56aed324eb3e6cdf06c89d450516bbd1a7746 WatchSource:0}: Error finding container 05289946665b20ce0c78c10624b56aed324eb3e6cdf06c89d450516bbd1a7746: Status 404 returned error can't find the container with id 05289946665b20ce0c78c10624b56aed324eb3e6cdf06c89d450516bbd1a7746
Sep 11 21:30:59.961888 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:30:59.961863    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-19ce3e-f6fdfdd94-lfbnn"]
Sep 11 21:30:59.964536 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:30:59.964511    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc74cfae8_516b_4b63_82b0_b2dba70c37cb.slice/crio-c1f96dcee5a75c25fe3e8db62d8577c5285820abfdb5e0270eb9bd2a370368fd WatchSource:0}: Error finding container c1f96dcee5a75c25fe3e8db62d8577c5285820abfdb5e0270eb9bd2a370368fd: Status 404 returned error can't find the container with id c1f96dcee5a75c25fe3e8db62d8577c5285820abfdb5e0270eb9bd2a370368fd
Sep 11 21:31:00.221975 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:00.221893    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-19ce3e-f6fdfdd94-lfbnn" event={"ID":"c74cfae8-516b-4b63-82b0-b2dba70c37cb","Type":"ContainerStarted","Data":"09d3e2c0e17664383fec029ba605edbc57eccd64cc2f0c9c6cd710eca7405d00"}
Sep 11 21:31:00.221975 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:00.221954    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-19ce3e-f6fdfdd94-lfbnn" event={"ID":"c74cfae8-516b-4b63-82b0-b2dba70c37cb","Type":"ContainerStarted","Data":"c1f96dcee5a75c25fe3e8db62d8577c5285820abfdb5e0270eb9bd2a370368fd"}
Sep 11 21:31:00.222203 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:00.222056    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-19ce3e-f6fdfdd94-lfbnn"
Sep 11 21:31:00.223674 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:00.223648    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-19ce3e-585cfdb4d9-s7zlj" event={"ID":"cbd4d268-efec-43c4-8c56-be10e8cc9b79","Type":"ContainerStarted","Data":"4bc380dbb26c6d5d5cc4eefc0ae68af752d33e8206a5162aceec5518f6439233"}
Sep 11 21:31:00.223774 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:00.223694    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-19ce3e-585cfdb4d9-s7zlj" event={"ID":"cbd4d268-efec-43c4-8c56-be10e8cc9b79","Type":"ContainerStarted","Data":"05289946665b20ce0c78c10624b56aed324eb3e6cdf06c89d450516bbd1a7746"}
Sep 11 21:31:00.223774 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:00.223723    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-19ce3e-585cfdb4d9-s7zlj"
Sep 11 21:31:00.244158 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:00.244114    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-19ce3e-f6fdfdd94-lfbnn" podStartSLOduration=1.244099335 podStartE2EDuration="1.244099335s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:30:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:31:00.242810171 +0000 UTC m=+1505.721122014" watchObservedRunningTime="2026-09-11 21:31:00.244099335 +0000 UTC m=+1505.722411180"
Sep 11 21:31:00.269595 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:00.269552    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-19ce3e-585cfdb4d9-s7zlj" podStartSLOduration=1.269537723 podStartE2EDuration="1.269537723s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:30:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:31:00.268367958 +0000 UTC m=+1505.746679806" watchObservedRunningTime="2026-09-11 21:31:00.269537723 +0000 UTC m=+1505.747849572"
Sep 11 21:31:05.877952 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:05.877897    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-2bd772/rate-test-model-2bd772-kserve-775f595bdc-2bvph" podUID="278c972b-6703-4de6-a579-ab5b52f64981" containerName="main" containerID="cri-o://c1caa9686038027149667af5703f07bf4dfd0e4f2de72f98ccd357c2efababdb" gracePeriod=45
Sep 11 21:31:06.155629 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:06.155605    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-2bd772/rate-test-model-2bd772-kserve-775f595bdc-2bvph"
Sep 11 21:31:06.206031 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:06.206002    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/278c972b-6703-4de6-a579-ab5b52f64981-tmp-dir\") pod \"278c972b-6703-4de6-a579-ab5b52f64981\" (UID: \"278c972b-6703-4de6-a579-ab5b52f64981\") "
Sep 11 21:31:06.206186 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:06.206123    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/278c972b-6703-4de6-a579-ab5b52f64981-dshm\") pod \"278c972b-6703-4de6-a579-ab5b52f64981\" (UID: \"278c972b-6703-4de6-a579-ab5b52f64981\") "
Sep 11 21:31:06.206186 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:06.206167    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8w7xm\" (UniqueName: \"kubernetes.io/projected/278c972b-6703-4de6-a579-ab5b52f64981-kube-api-access-8w7xm\") pod \"278c972b-6703-4de6-a579-ab5b52f64981\" (UID: \"278c972b-6703-4de6-a579-ab5b52f64981\") "
Sep 11 21:31:06.206310 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:06.206217    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/278c972b-6703-4de6-a579-ab5b52f64981-model-cache\") pod \"278c972b-6703-4de6-a579-ab5b52f64981\" (UID: \"278c972b-6703-4de6-a579-ab5b52f64981\") "
Sep 11 21:31:06.206310 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:06.206249    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/278c972b-6703-4de6-a579-ab5b52f64981-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "278c972b-6703-4de6-a579-ab5b52f64981" (UID: "278c972b-6703-4de6-a579-ab5b52f64981"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:31:06.206310 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:06.206276    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/278c972b-6703-4de6-a579-ab5b52f64981-home\") pod \"278c972b-6703-4de6-a579-ab5b52f64981\" (UID: \"278c972b-6703-4de6-a579-ab5b52f64981\") "
Sep 11 21:31:06.206310 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:06.206306    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/278c972b-6703-4de6-a579-ab5b52f64981-tls-certs\") pod \"278c972b-6703-4de6-a579-ab5b52f64981\" (UID: \"278c972b-6703-4de6-a579-ab5b52f64981\") "
Sep 11 21:31:06.206542 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:06.206500    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/278c972b-6703-4de6-a579-ab5b52f64981-model-cache" (OuterVolumeSpecName: "model-cache") pod "278c972b-6703-4de6-a579-ab5b52f64981" (UID: "278c972b-6703-4de6-a579-ab5b52f64981"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:31:06.206542 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:06.206527    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/278c972b-6703-4de6-a579-ab5b52f64981-home" (OuterVolumeSpecName: "home") pod "278c972b-6703-4de6-a579-ab5b52f64981" (UID: "278c972b-6703-4de6-a579-ab5b52f64981"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:31:06.206757 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:06.206735    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/278c972b-6703-4de6-a579-ab5b52f64981-home\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:31:06.206757 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:06.206756    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/278c972b-6703-4de6-a579-ab5b52f64981-tmp-dir\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:31:06.206933 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:06.206766    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/278c972b-6703-4de6-a579-ab5b52f64981-model-cache\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:31:06.208565 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:06.208538    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/278c972b-6703-4de6-a579-ab5b52f64981-kube-api-access-8w7xm" (OuterVolumeSpecName: "kube-api-access-8w7xm") pod "278c972b-6703-4de6-a579-ab5b52f64981" (UID: "278c972b-6703-4de6-a579-ab5b52f64981"). InnerVolumeSpecName "kube-api-access-8w7xm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:31:06.208748 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:06.208715    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/278c972b-6703-4de6-a579-ab5b52f64981-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "278c972b-6703-4de6-a579-ab5b52f64981" (UID: "278c972b-6703-4de6-a579-ab5b52f64981"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:31:06.208748 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:06.208736    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/278c972b-6703-4de6-a579-ab5b52f64981-dshm" (OuterVolumeSpecName: "dshm") pod "278c972b-6703-4de6-a579-ab5b52f64981" (UID: "278c972b-6703-4de6-a579-ab5b52f64981"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:31:06.277405 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:06.276984    2560 generic.go:356] "Generic (PLEG): container finished" podID="278c972b-6703-4de6-a579-ab5b52f64981" containerID="c1caa9686038027149667af5703f07bf4dfd0e4f2de72f98ccd357c2efababdb" exitCode=0
Sep 11 21:31:06.277405 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:06.277068    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-2bd772/rate-test-model-2bd772-kserve-775f595bdc-2bvph" event={"ID":"278c972b-6703-4de6-a579-ab5b52f64981","Type":"ContainerDied","Data":"c1caa9686038027149667af5703f07bf4dfd0e4f2de72f98ccd357c2efababdb"}
Sep 11 21:31:06.277405 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:06.277103    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-2bd772/rate-test-model-2bd772-kserve-775f595bdc-2bvph" event={"ID":"278c972b-6703-4de6-a579-ab5b52f64981","Type":"ContainerDied","Data":"9ab7e4346c302640b84df398722b6a22a22d4df65bb9ca9bae1d80f6b5320211"}
Sep 11 21:31:06.277405 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:06.277125    2560 scope.go:117] "RemoveContainer" containerID="c1caa9686038027149667af5703f07bf4dfd0e4f2de72f98ccd357c2efababdb"
Sep 11 21:31:06.277405 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:06.277293    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-2bd772/rate-test-model-2bd772-kserve-775f595bdc-2bvph"
Sep 11 21:31:06.296526 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:06.296508    2560 scope.go:117] "RemoveContainer" containerID="c1caa9686038027149667af5703f07bf4dfd0e4f2de72f98ccd357c2efababdb"
Sep 11 21:31:06.296792 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:31:06.296776    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1caa9686038027149667af5703f07bf4dfd0e4f2de72f98ccd357c2efababdb\": container with ID starting with c1caa9686038027149667af5703f07bf4dfd0e4f2de72f98ccd357c2efababdb not found: ID does not exist" containerID="c1caa9686038027149667af5703f07bf4dfd0e4f2de72f98ccd357c2efababdb"
Sep 11 21:31:06.296845 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:06.296801    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1caa9686038027149667af5703f07bf4dfd0e4f2de72f98ccd357c2efababdb"} err="failed to get container status \"c1caa9686038027149667af5703f07bf4dfd0e4f2de72f98ccd357c2efababdb\": rpc error: code = NotFound desc = could not find container \"c1caa9686038027149667af5703f07bf4dfd0e4f2de72f98ccd357c2efababdb\": container with ID starting with c1caa9686038027149667af5703f07bf4dfd0e4f2de72f98ccd357c2efababdb not found: ID does not exist"
Sep 11 21:31:06.307572 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:06.307550    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-2bd772/rate-test-model-2bd772-kserve-775f595bdc-2bvph"]
Sep 11 21:31:06.307894 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:06.307878    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/278c972b-6703-4de6-a579-ab5b52f64981-dshm\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:31:06.307957 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:06.307898    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8w7xm\" (UniqueName: \"kubernetes.io/projected/278c972b-6703-4de6-a579-ab5b52f64981-kube-api-access-8w7xm\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:31:06.307957 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:06.307908    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/278c972b-6703-4de6-a579-ab5b52f64981-tls-certs\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:31:06.313760 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:06.313740    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-2bd772/rate-test-model-2bd772-kserve-775f595bdc-2bvph"]
Sep 11 21:31:07.037691 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:07.037660    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="278c972b-6703-4de6-a579-ab5b52f64981" path="/var/lib/kubelet/pods/278c972b-6703-4de6-a579-ab5b52f64981/volumes"
Sep 11 21:31:11.232288 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:11.232251    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-19ce3e-585cfdb4d9-s7zlj"
Sep 11 21:31:11.232724 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:11.232430    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-19ce3e-f6fdfdd94-lfbnn"
Sep 11 21:31:11.237493 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:11.237471    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 21:31:11.237559 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:11.237513    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56" podUID="14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 21:31:13.334721 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:13.334625    2560 generic.go:356] "Generic (PLEG): container finished" podID="14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d" containerID="6ba32e8862eda804d1b22bb2ea72a8d5df36dce97685e4da13b2f7eaa5a83e46" exitCode=0
Sep 11 21:31:13.334721 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:13.334698    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56" event={"ID":"14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d","Type":"ContainerDied","Data":"6ba32e8862eda804d1b22bb2ea72a8d5df36dce97685e4da13b2f7eaa5a83e46"}
Sep 11 21:31:13.335202 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:13.335073    2560 scope.go:117] "RemoveContainer" containerID="6ba32e8862eda804d1b22bb2ea72a8d5df36dce97685e4da13b2f7eaa5a83e46"
Sep 11 21:31:13.336070 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:13.336044    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:31:13.336136 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:13.336115    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:31:13.336174 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:13.336146    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:31:14.342603 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:14.342565    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56" event={"ID":"14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d","Type":"ContainerStarted","Data":"e351d3abe390a3a44200983c1172122f746e621d79352f3aef6325eb34d65476"}
Sep 11 21:31:14.888560 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:14.888526    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56"
Sep 11 21:31:14.888820 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:14.888797    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Sep 11 21:31:14.888885 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:14.888859    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56" podUID="14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Sep 11 21:31:15.888244 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:15.888205    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Sep 11 21:31:15.888692 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:15.888276    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56" podUID="14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Sep 11 21:31:16.888478 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:16.888440    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Sep 11 21:31:16.888956 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:16.888498    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56" podUID="14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Sep 11 21:31:17.888170 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:17.888139    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Sep 11 21:31:17.888338 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:17.888198    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56" podUID="14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Sep 11 21:31:18.888699 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:18.888671    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Sep 11 21:31:18.889062 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:18.888738    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56" podUID="14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Sep 11 21:31:19.888618 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:19.888582    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Sep 11 21:31:19.888799 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:19.888637    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56" podUID="14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Sep 11 21:31:20.891630 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:20.891594    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56"
Sep 11 21:31:20.892014 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:20.891884    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56"
Sep 11 21:31:20.892512 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:20.892494    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56"
Sep 11 21:31:36.477425 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:36.477395    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-e9c558-697749df78-z4t65"]
Sep 11 21:31:36.477880 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:36.477867    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="278c972b-6703-4de6-a579-ab5b52f64981" containerName="main"
Sep 11 21:31:36.477926 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:36.477882    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="278c972b-6703-4de6-a579-ab5b52f64981" containerName="main"
Sep 11 21:31:36.477987 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:36.477978    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="278c972b-6703-4de6-a579-ab5b52f64981" containerName="main"
Sep 11 21:31:36.481542 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:36.481522    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e9c558-697749df78-z4t65"
Sep 11 21:31:36.484120 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:36.484098    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-e9c558-dockercfg-m7cnd\""
Sep 11 21:31:36.484211 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:36.484124    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-e9c558\""
Sep 11 21:31:36.492658 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:36.492637    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-e9c558-697749df78-z4t65"]
Sep 11 21:31:36.565463 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:36.565431    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-e9c558-c84df4dfc-g4nkr"]
Sep 11 21:31:36.569056 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:36.569035    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-e9c558-c84df4dfc-g4nkr"
Sep 11 21:31:36.581796 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:36.581772    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-e9c558-c84df4dfc-g4nkr"]
Sep 11 21:31:36.590613 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:36.590591    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxqwn\" (UniqueName: \"kubernetes.io/projected/73100955-d6f6-4c26-b8c9-039d5db084f2-kube-api-access-wxqwn\") pod \"payload-pre-processing-e2e-ipp-b-e9c558-697749df78-z4t65\" (UID: \"73100955-d6f6-4c26-b8c9-039d5db084f2\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e9c558-697749df78-z4t65"
Sep 11 21:31:36.590744 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:36.590728    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/73100955-d6f6-4c26-b8c9-039d5db084f2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-e9c558-697749df78-z4t65\" (UID: \"73100955-d6f6-4c26-b8c9-039d5db084f2\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e9c558-697749df78-z4t65"
Sep 11 21:31:36.691827 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:36.691805    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/73100955-d6f6-4c26-b8c9-039d5db084f2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-e9c558-697749df78-z4t65\" (UID: \"73100955-d6f6-4c26-b8c9-039d5db084f2\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e9c558-697749df78-z4t65"
Sep 11 21:31:36.691953 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:36.691857    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c4b435bb-de9d-4c7c-9484-ca377a931f67-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-e9c558-c84df4dfc-g4nkr\" (UID: \"c4b435bb-de9d-4c7c-9484-ca377a931f67\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-e9c558-c84df4dfc-g4nkr"
Sep 11 21:31:36.691953 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:36.691897    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxqwn\" (UniqueName: \"kubernetes.io/projected/73100955-d6f6-4c26-b8c9-039d5db084f2-kube-api-access-wxqwn\") pod \"payload-pre-processing-e2e-ipp-b-e9c558-697749df78-z4t65\" (UID: \"73100955-d6f6-4c26-b8c9-039d5db084f2\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e9c558-697749df78-z4t65"
Sep 11 21:31:36.692073 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:36.691969    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvxzj\" (UniqueName: \"kubernetes.io/projected/c4b435bb-de9d-4c7c-9484-ca377a931f67-kube-api-access-xvxzj\") pod \"payload-processing-e2e-ipp-b-e9c558-c84df4dfc-g4nkr\" (UID: \"c4b435bb-de9d-4c7c-9484-ca377a931f67\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-e9c558-c84df4dfc-g4nkr"
Sep 11 21:31:36.692587 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:36.692565    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/73100955-d6f6-4c26-b8c9-039d5db084f2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-e9c558-697749df78-z4t65\" (UID: \"73100955-d6f6-4c26-b8c9-039d5db084f2\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e9c558-697749df78-z4t65"
Sep 11 21:31:36.700728 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:36.700710    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxqwn\" (UniqueName: \"kubernetes.io/projected/73100955-d6f6-4c26-b8c9-039d5db084f2-kube-api-access-wxqwn\") pod \"payload-pre-processing-e2e-ipp-b-e9c558-697749df78-z4t65\" (UID: \"73100955-d6f6-4c26-b8c9-039d5db084f2\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e9c558-697749df78-z4t65"
Sep 11 21:31:36.792758 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:36.792697    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e9c558-697749df78-z4t65"
Sep 11 21:31:36.793027 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:36.793008    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c4b435bb-de9d-4c7c-9484-ca377a931f67-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-e9c558-c84df4dfc-g4nkr\" (UID: \"c4b435bb-de9d-4c7c-9484-ca377a931f67\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-e9c558-c84df4dfc-g4nkr"
Sep 11 21:31:36.793112 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:36.793098    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvxzj\" (UniqueName: \"kubernetes.io/projected/c4b435bb-de9d-4c7c-9484-ca377a931f67-kube-api-access-xvxzj\") pod \"payload-processing-e2e-ipp-b-e9c558-c84df4dfc-g4nkr\" (UID: \"c4b435bb-de9d-4c7c-9484-ca377a931f67\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-e9c558-c84df4dfc-g4nkr"
Sep 11 21:31:36.793722 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:36.793704    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c4b435bb-de9d-4c7c-9484-ca377a931f67-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-e9c558-c84df4dfc-g4nkr\" (UID: \"c4b435bb-de9d-4c7c-9484-ca377a931f67\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-e9c558-c84df4dfc-g4nkr"
Sep 11 21:31:36.802413 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:36.802378    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvxzj\" (UniqueName: \"kubernetes.io/projected/c4b435bb-de9d-4c7c-9484-ca377a931f67-kube-api-access-xvxzj\") pod \"payload-processing-e2e-ipp-b-e9c558-c84df4dfc-g4nkr\" (UID: \"c4b435bb-de9d-4c7c-9484-ca377a931f67\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-e9c558-c84df4dfc-g4nkr"
Sep 11 21:31:36.879729 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:36.879688    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-e9c558-c84df4dfc-g4nkr"
Sep 11 21:31:37.067892 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:37.067865    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-e9c558-697749df78-z4t65"]
Sep 11 21:31:37.069053 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:31:37.069028    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73100955_d6f6_4c26_b8c9_039d5db084f2.slice/crio-ba5132cf1be92fc5ce8045d2509e7eb366e395f4fac448b282479896d538767a WatchSource:0}: Error finding container ba5132cf1be92fc5ce8045d2509e7eb366e395f4fac448b282479896d538767a: Status 404 returned error can't find the container with id ba5132cf1be92fc5ce8045d2509e7eb366e395f4fac448b282479896d538767a
Sep 11 21:31:37.156688 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:37.156617    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-e9c558-c84df4dfc-g4nkr"]
Sep 11 21:31:37.158179 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:31:37.158152    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4b435bb_de9d_4c7c_9484_ca377a931f67.slice/crio-f31332bef61a89658373f97026fbabb43b63a0d7b8c21a5c2a42c31c1d65aef1 WatchSource:0}: Error finding container f31332bef61a89658373f97026fbabb43b63a0d7b8c21a5c2a42c31c1d65aef1: Status 404 returned error can't find the container with id f31332bef61a89658373f97026fbabb43b63a0d7b8c21a5c2a42c31c1d65aef1
Sep 11 21:31:37.491245 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:37.491207    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-e9c558-c84df4dfc-g4nkr" event={"ID":"c4b435bb-de9d-4c7c-9484-ca377a931f67","Type":"ContainerStarted","Data":"3cdf7e8a3be7e0f0b1f6e4dab6052afcccd1c1a4956cf1aed020a72ea05cb574"}
Sep 11 21:31:37.491721 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:37.491369    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-e9c558-c84df4dfc-g4nkr"
Sep 11 21:31:37.491721 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:37.491418    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-e9c558-c84df4dfc-g4nkr" event={"ID":"c4b435bb-de9d-4c7c-9484-ca377a931f67","Type":"ContainerStarted","Data":"f31332bef61a89658373f97026fbabb43b63a0d7b8c21a5c2a42c31c1d65aef1"}
Sep 11 21:31:37.493005 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:37.492979    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e9c558-697749df78-z4t65" event={"ID":"73100955-d6f6-4c26-b8c9-039d5db084f2","Type":"ContainerStarted","Data":"3e7f22db30155fe0d1151cf603e75e931aaf2a16a830bc434e5b30db7b5d1def"}
Sep 11 21:31:37.493122 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:37.493032    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e9c558-697749df78-z4t65"
Sep 11 21:31:37.493122 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:37.493057    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e9c558-697749df78-z4t65" event={"ID":"73100955-d6f6-4c26-b8c9-039d5db084f2","Type":"ContainerStarted","Data":"ba5132cf1be92fc5ce8045d2509e7eb366e395f4fac448b282479896d538767a"}
Sep 11 21:31:37.510392 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:37.510318    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-e9c558-c84df4dfc-g4nkr" podStartSLOduration=1.5103012900000001 podStartE2EDuration="1.51030129s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:31:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:31:37.507849942 +0000 UTC m=+1542.986161787" watchObservedRunningTime="2026-09-11 21:31:37.51030129 +0000 UTC m=+1542.988613135"
Sep 11 21:31:37.525672 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:37.525630    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e9c558-697749df78-z4t65" podStartSLOduration=1.5256156060000001 podStartE2EDuration="1.525615606s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:31:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:31:37.524910903 +0000 UTC m=+1543.003222748" watchObservedRunningTime="2026-09-11 21:31:37.525615606 +0000 UTC m=+1543.003927449"
Sep 11 21:31:48.501742 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:48.501710    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-e9c558-c84df4dfc-g4nkr"
Sep 11 21:31:48.502207 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:31:48.501848    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e9c558-697749df78-z4t65"
Sep 11 21:32:06.126574 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:32:06.126539    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-62vnh_923b93fb-4af2-42e6-a2ef-eb36d7547f59/payload-processing/0.log"
Sep 11 21:32:06.250841 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:32:06.250815    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-e9c558-c84df4dfc-g4nkr_c4b435bb-de9d-4c7c-9484-ca377a931f67/payload-processing/0.log"
Sep 11 21:32:36.908233 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:32:36.908204    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-19ce3e-585cfdb4d9-s7zlj_cbd4d268-efec-43c4-8c56-be10e8cc9b79/payload-processing/0.log"
Sep 11 21:32:37.031217 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:32:37.031182    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-62vnh_923b93fb-4af2-42e6-a2ef-eb36d7547f59/payload-processing/0.log"
Sep 11 21:32:37.142507 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:32:37.142474    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-e9c558-c84df4dfc-g4nkr_c4b435bb-de9d-4c7c-9484-ca377a931f67/payload-processing/0.log"
Sep 11 21:32:37.711316 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:32:37.711287    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz"]
Sep 11 21:32:37.715172 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:32:37.715155    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz"
Sep 11 21:32:37.717706 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:32:37.717681    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-8a57ce-openshift-default-dockercfg-px4qp\""
Sep 11 21:32:37.727036 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:32:37.727013    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz"]
Sep 11 21:32:37.781362 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:32:37.781328    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bf2be11-9325-4d49-95b7-4d2f3d48d03e-istio-podinfo\") pod \"e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz\" (UID: \"9bf2be11-9325-4d49-95b7-4d2f3d48d03e\") " pod="openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz"
Sep 11 21:32:37.781362 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:32:37.781366    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bf2be11-9325-4d49-95b7-4d2f3d48d03e-workload-certs\") pod \"e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz\" (UID: \"9bf2be11-9325-4d49-95b7-4d2f3d48d03e\") " pod="openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz"
Sep 11 21:32:37.781621 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:32:37.781428    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bf2be11-9325-4d49-95b7-4d2f3d48d03e-istio-data\") pod \"e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz\" (UID: \"9bf2be11-9325-4d49-95b7-4d2f3d48d03e\") " pod="openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz"
Sep 11 21:32:37.781621 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:32:37.781475    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bf2be11-9325-4d49-95b7-4d2f3d48d03e-credential-socket\") pod \"e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz\" (UID: \"9bf2be11-9325-4d49-95b7-4d2f3d48d03e\") " pod="openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz"
Sep 11 21:32:37.781621 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:32:37.781570    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bf2be11-9325-4d49-95b7-4d2f3d48d03e-istio-envoy\") pod \"e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz\" (UID: \"9bf2be11-9325-4d49-95b7-4d2f3d48d03e\") " pod="openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz"
Sep 11 21:32:37.781766 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:32:37.781642    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bf2be11-9325-4d49-95b7-4d2f3d48d03e-workload-socket\") pod \"e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz\" (UID: \"9bf2be11-9325-4d49-95b7-4d2f3d48d03e\") " pod="openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz"
Sep 11 21:32:37.781766 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:32:37.781679    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bf2be11-9325-4d49-95b7-4d2f3d48d03e-istiod-ca-cert\") pod \"e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz\" (UID: \"9bf2be11-9325-4d49-95b7-4d2f3d48d03e\") " pod="openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz"
Sep 11 21:32:37.781766 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:32:37.781727    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bf2be11-9325-4d49-95b7-4d2f3d48d03e-istio-token\") pod \"e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz\" (UID: \"9bf2be11-9325-4d49-95b7-4d2f3d48d03e\") " pod="openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz"
Sep 11 21:32:37.781766 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:32:37.781752    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4qp6\" (UniqueName: \"kubernetes.io/projected/9bf2be11-9325-4d49-95b7-4d2f3d48d03e-kube-api-access-b4qp6\") pod \"e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz\" (UID: \"9bf2be11-9325-4d49-95b7-4d2f3d48d03e\") " pod="openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz"
Sep 11 21:32:37.882962 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:32:37.882928    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bf2be11-9325-4d49-95b7-4d2f3d48d03e-workload-socket\") pod \"e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz\" (UID: \"9bf2be11-9325-4d49-95b7-4d2f3d48d03e\") " pod="openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz"
Sep 11 21:32:37.883181 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:32:37.882976    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bf2be11-9325-4d49-95b7-4d2f3d48d03e-istiod-ca-cert\") pod \"e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz\" (UID: \"9bf2be11-9325-4d49-95b7-4d2f3d48d03e\") " pod="openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz"
Sep 11 21:32:37.883181 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:32:37.883013    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bf2be11-9325-4d49-95b7-4d2f3d48d03e-istio-token\") pod \"e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz\" (UID: \"9bf2be11-9325-4d49-95b7-4d2f3d48d03e\") " pod="openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz"
Sep 11 21:32:37.883181 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:32:37.883037    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4qp6\" (UniqueName: \"kubernetes.io/projected/9bf2be11-9325-4d49-95b7-4d2f3d48d03e-kube-api-access-b4qp6\") pod \"e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz\" (UID: \"9bf2be11-9325-4d49-95b7-4d2f3d48d03e\") " pod="openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz"
Sep 11 21:32:37.883181 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:32:37.883098    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bf2be11-9325-4d49-95b7-4d2f3d48d03e-istio-podinfo\") pod \"e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz\" (UID: \"9bf2be11-9325-4d49-95b7-4d2f3d48d03e\") " pod="openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz"
Sep 11 21:32:37.883181 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:32:37.883128    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bf2be11-9325-4d49-95b7-4d2f3d48d03e-workload-certs\") pod \"e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz\" (UID: \"9bf2be11-9325-4d49-95b7-4d2f3d48d03e\") " pod="openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz"
Sep 11 21:32:37.883554 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:32:37.883204    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bf2be11-9325-4d49-95b7-4d2f3d48d03e-istio-data\") pod \"e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz\" (UID: \"9bf2be11-9325-4d49-95b7-4d2f3d48d03e\") " pod="openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz"
Sep 11 21:32:37.883554 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:32:37.883236    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bf2be11-9325-4d49-95b7-4d2f3d48d03e-credential-socket\") pod \"e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz\" (UID: \"9bf2be11-9325-4d49-95b7-4d2f3d48d03e\") " pod="openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz"
Sep 11 21:32:37.883554 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:32:37.883303    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bf2be11-9325-4d49-95b7-4d2f3d48d03e-istio-envoy\") pod \"e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz\" (UID: \"9bf2be11-9325-4d49-95b7-4d2f3d48d03e\") " pod="openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz"
Sep 11 21:32:37.885142 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:32:37.883885    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bf2be11-9325-4d49-95b7-4d2f3d48d03e-istiod-ca-cert\") pod \"e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz\" (UID: \"9bf2be11-9325-4d49-95b7-4d2f3d48d03e\") " pod="openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz"
Sep 11 21:32:37.885142 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:32:37.884161    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bf2be11-9325-4d49-95b7-4d2f3d48d03e-istio-data\") pod \"e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz\" (UID: \"9bf2be11-9325-4d49-95b7-4d2f3d48d03e\") " pod="openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz"
Sep 11 21:32:37.885142 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:32:37.884444    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bf2be11-9325-4d49-95b7-4d2f3d48d03e-workload-certs\") pod \"e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz\" (UID: \"9bf2be11-9325-4d49-95b7-4d2f3d48d03e\") " pod="openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz"
Sep 11 21:32:37.885142 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:32:37.884946    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bf2be11-9325-4d49-95b7-4d2f3d48d03e-workload-socket\") pod \"e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz\" (UID: \"9bf2be11-9325-4d49-95b7-4d2f3d48d03e\") " pod="openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz"
Sep 11 21:32:37.885142 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:32:37.885076    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bf2be11-9325-4d49-95b7-4d2f3d48d03e-credential-socket\") pod \"e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz\" (UID: \"9bf2be11-9325-4d49-95b7-4d2f3d48d03e\") " pod="openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz"
Sep 11 21:32:37.886177 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:32:37.886151    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bf2be11-9325-4d49-95b7-4d2f3d48d03e-istio-envoy\") pod \"e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz\" (UID: \"9bf2be11-9325-4d49-95b7-4d2f3d48d03e\") " pod="openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz"
Sep 11 21:32:37.886337 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:32:37.886322    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bf2be11-9325-4d49-95b7-4d2f3d48d03e-istio-podinfo\") pod \"e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz\" (UID: \"9bf2be11-9325-4d49-95b7-4d2f3d48d03e\") " pod="openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz"
Sep 11 21:32:37.895823 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:32:37.895793    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4qp6\" (UniqueName: \"kubernetes.io/projected/9bf2be11-9325-4d49-95b7-4d2f3d48d03e-kube-api-access-b4qp6\") pod \"e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz\" (UID: \"9bf2be11-9325-4d49-95b7-4d2f3d48d03e\") " pod="openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz"
Sep 11 21:32:37.900094 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:32:37.900071    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bf2be11-9325-4d49-95b7-4d2f3d48d03e-istio-token\") pod \"e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz\" (UID: \"9bf2be11-9325-4d49-95b7-4d2f3d48d03e\") " pod="openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz"
Sep 11 21:32:38.026224 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:32:38.026125    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz"
Sep 11 21:32:38.312061 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:32:38.312030    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz"]
Sep 11 21:32:38.313662 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:32:38.313635    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bf2be11_9325_4d49_95b7_4d2f3d48d03e.slice/crio-ec27403b0736fc9e5b0db62bc321afb7fbb94f697e8d57e842446d4334bcdf4f WatchSource:0}: Error finding container ec27403b0736fc9e5b0db62bc321afb7fbb94f697e8d57e842446d4334bcdf4f: Status 404 returned error can't find the container with id ec27403b0736fc9e5b0db62bc321afb7fbb94f697e8d57e842446d4334bcdf4f
Sep 11 21:32:38.315875 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:32:38.315842    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:32:38.315951 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:32:38.315908    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:32:38.315951 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:32:38.315934    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:32:38.852799 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:32:38.852763    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz" event={"ID":"9bf2be11-9325-4d49-95b7-4d2f3d48d03e","Type":"ContainerStarted","Data":"b4b4028b4ce85f9b1d73963b7d75e4a64b074f4ff3fa61b1bf182438b946fd52"}
Sep 11 21:32:38.852978 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:32:38.852825    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz" event={"ID":"9bf2be11-9325-4d49-95b7-4d2f3d48d03e","Type":"ContainerStarted","Data":"ec27403b0736fc9e5b0db62bc321afb7fbb94f697e8d57e842446d4334bcdf4f"}
Sep 11 21:32:38.884018 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:32:38.883961    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz" podStartSLOduration=1.883940766 podStartE2EDuration="1.883940766s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:32:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:32:38.883058062 +0000 UTC m=+1604.361369899" watchObservedRunningTime="2026-09-11 21:32:38.883940766 +0000 UTC m=+1604.362252611"
Sep 11 21:32:39.027157 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:32:39.027122    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz"
Sep 11 21:32:39.028726 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:32:39.028701    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused" start-of-body=
Sep 11 21:32:39.028849 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:32:39.028744    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz" podUID="9bf2be11-9325-4d49-95b7-4d2f3d48d03e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused"
Sep 11 21:32:40.031063 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:32:40.031031    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz"
Sep 11 21:32:40.865830 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:32:40.865791    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz"
Sep 11 21:32:40.866856 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:32:40.866836    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz"
Sep 11 21:33:00.994560 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:00.994527    2560 generic.go:356] "Generic (PLEG): container finished" podID="9bf2be11-9325-4d49-95b7-4d2f3d48d03e" containerID="b4b4028b4ce85f9b1d73963b7d75e4a64b074f4ff3fa61b1bf182438b946fd52" exitCode=0
Sep 11 21:33:00.994962 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:00.994576    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz" event={"ID":"9bf2be11-9325-4d49-95b7-4d2f3d48d03e","Type":"ContainerDied","Data":"b4b4028b4ce85f9b1d73963b7d75e4a64b074f4ff3fa61b1bf182438b946fd52"}
Sep 11 21:33:00.994962 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:00.994935    2560 scope.go:117] "RemoveContainer" containerID="b4b4028b4ce85f9b1d73963b7d75e4a64b074f4ff3fa61b1bf182438b946fd52"
Sep 11 21:33:00.996020 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:00.995992    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:33:00.996072 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:00.996060    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:33:00.996130 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:00.996091    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 21:33:02.002631 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:02.002599    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz" event={"ID":"9bf2be11-9325-4d49-95b7-4d2f3d48d03e","Type":"ContainerStarted","Data":"0f50a90ccfa1d8b8c0dac3388e51c8a8da378f06e1e8597571c389614faa77d7"}
Sep 11 21:33:02.026477 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:02.026447    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz"
Sep 11 21:33:02.026850 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:02.026820    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused" start-of-body=
Sep 11 21:33:02.026983 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:02.026880    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz" podUID="9bf2be11-9325-4d49-95b7-4d2f3d48d03e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused"
Sep 11 21:33:03.027312 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:03.027278    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused" start-of-body=
Sep 11 21:33:03.027734 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:03.027343    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz" podUID="9bf2be11-9325-4d49-95b7-4d2f3d48d03e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused"
Sep 11 21:33:04.026542 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:04.026509    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused" start-of-body=
Sep 11 21:33:04.026719 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:04.026564    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz" podUID="9bf2be11-9325-4d49-95b7-4d2f3d48d03e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused"
Sep 11 21:33:05.026823 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:05.026793    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused" start-of-body=
Sep 11 21:33:05.027212 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:05.026845    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz" podUID="9bf2be11-9325-4d49-95b7-4d2f3d48d03e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused"
Sep 11 21:33:06.026789 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:06.026753    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused" start-of-body=
Sep 11 21:33:06.026961 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:06.026814    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz" podUID="9bf2be11-9325-4d49-95b7-4d2f3d48d03e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused"
Sep 11 21:33:07.026572 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:07.026541    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused" start-of-body=
Sep 11 21:33:07.026745 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:07.026591    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz" podUID="9bf2be11-9325-4d49-95b7-4d2f3d48d03e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused"
Sep 11 21:33:08.030792 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:08.030763    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz"
Sep 11 21:33:08.031418 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:08.031379    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz"
Sep 11 21:33:08.032055 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:08.032038    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz"
Sep 11 21:33:11.643999 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:11.643963    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8a57ce-5qzz6"]
Sep 11 21:33:11.647055 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:11.647033    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8a57ce-5qzz6"
Sep 11 21:33:11.649529 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:11.649504    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 21:33:11.649618 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:11.649526    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bfm9g\""
Sep 11 21:33:11.657657 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:11.657634    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8a57ce-5qzz6"]
Sep 11 21:33:11.746609 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:11.746576    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2060365-1678-4635-a899-76d81955b7fb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-8a57ce-5qzz6\" (UID: \"f2060365-1678-4635-a899-76d81955b7fb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8a57ce-5qzz6"
Sep 11 21:33:11.847176 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:11.847141    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2060365-1678-4635-a899-76d81955b7fb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-8a57ce-5qzz6\" (UID: \"f2060365-1678-4635-a899-76d81955b7fb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8a57ce-5qzz6"
Sep 11 21:33:11.847815 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:11.847792    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2060365-1678-4635-a899-76d81955b7fb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-8a57ce-5qzz6\" (UID: \"f2060365-1678-4635-a899-76d81955b7fb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8a57ce-5qzz6"
Sep 11 21:33:11.959017 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:11.958942    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8a57ce-5qzz6"
Sep 11 21:33:12.234439 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:12.234407    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8a57ce-5qzz6"]
Sep 11 21:33:12.235604 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:33:12.235574    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2060365_1678_4635_a899_76d81955b7fb.slice/crio-3b70b51bcc85348ee001a3da7f9dfe6ae8b09eadb04863aaaea4f93f1952ea8a WatchSource:0}: Error finding container 3b70b51bcc85348ee001a3da7f9dfe6ae8b09eadb04863aaaea4f93f1952ea8a: Status 404 returned error can't find the container with id 3b70b51bcc85348ee001a3da7f9dfe6ae8b09eadb04863aaaea4f93f1952ea8a
Sep 11 21:33:13.074691 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:13.074659    2560 generic.go:356] "Generic (PLEG): container finished" podID="f2060365-1678-4635-a899-76d81955b7fb" containerID="9d0065a3da23a985201dd191f53c04f74e19a586abd5eb7b1a6cb553e997ec77" exitCode=0
Sep 11 21:33:13.074691 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:13.074692    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8a57ce-5qzz6" event={"ID":"f2060365-1678-4635-a899-76d81955b7fb","Type":"ContainerDied","Data":"9d0065a3da23a985201dd191f53c04f74e19a586abd5eb7b1a6cb553e997ec77"}
Sep 11 21:33:13.075093 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:13.074724    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8a57ce-5qzz6" event={"ID":"f2060365-1678-4635-a899-76d81955b7fb","Type":"ContainerStarted","Data":"3b70b51bcc85348ee001a3da7f9dfe6ae8b09eadb04863aaaea4f93f1952ea8a"}
Sep 11 21:33:14.229169 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:14.229142    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8a57ce-5qzz6"
Sep 11 21:33:14.372084 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:14.372061    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2060365-1678-4635-a899-76d81955b7fb-maas-api-service-ca\") pod \"f2060365-1678-4635-a899-76d81955b7fb\" (UID: \"f2060365-1678-4635-a899-76d81955b7fb\") "
Sep 11 21:33:14.372407 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:14.372366    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2060365-1678-4635-a899-76d81955b7fb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f2060365-1678-4635-a899-76d81955b7fb" (UID: "f2060365-1678-4635-a899-76d81955b7fb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:33:14.473204 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:14.473179    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2060365-1678-4635-a899-76d81955b7fb-maas-api-service-ca\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:33:15.086997 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:15.086975    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8a57ce-5qzz6"
Sep 11 21:33:15.087147 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:15.087019    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8a57ce-5qzz6" event={"ID":"f2060365-1678-4635-a899-76d81955b7fb","Type":"ContainerDied","Data":"3b70b51bcc85348ee001a3da7f9dfe6ae8b09eadb04863aaaea4f93f1952ea8a"}
Sep 11 21:33:15.087147 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:15.087072    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b70b51bcc85348ee001a3da7f9dfe6ae8b09eadb04863aaaea4f93f1952ea8a"
Sep 11 21:33:23.152371 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:23.152333    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8a57ce-5qzz6"]
Sep 11 21:33:23.158301 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:23.158273    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8a57ce-5qzz6"]
Sep 11 21:33:25.037692 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:25.037657    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2060365-1678-4635-a899-76d81955b7fb" path="/var/lib/kubelet/pods/f2060365-1678-4635-a899-76d81955b7fb/volumes"
Sep 11 21:33:29.635844 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:29.635806    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz"]
Sep 11 21:33:29.636209 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:29.636058    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz" podUID="9bf2be11-9325-4d49-95b7-4d2f3d48d03e" containerName="istio-proxy" containerID="cri-o://0f50a90ccfa1d8b8c0dac3388e51c8a8da378f06e1e8597571c389614faa77d7" gracePeriod=30
Sep 11 21:33:34.900742 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:34.900688    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz"
Sep 11 21:33:35.071844 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:35.071819    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bf2be11-9325-4d49-95b7-4d2f3d48d03e-workload-certs\") pod \"9bf2be11-9325-4d49-95b7-4d2f3d48d03e\" (UID: \"9bf2be11-9325-4d49-95b7-4d2f3d48d03e\") "
Sep 11 21:33:35.072009 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:35.071855    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bf2be11-9325-4d49-95b7-4d2f3d48d03e-istio-envoy\") pod \"9bf2be11-9325-4d49-95b7-4d2f3d48d03e\" (UID: \"9bf2be11-9325-4d49-95b7-4d2f3d48d03e\") "
Sep 11 21:33:35.072009 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:35.071885    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bf2be11-9325-4d49-95b7-4d2f3d48d03e-credential-socket\") pod \"9bf2be11-9325-4d49-95b7-4d2f3d48d03e\" (UID: \"9bf2be11-9325-4d49-95b7-4d2f3d48d03e\") "
Sep 11 21:33:35.072009 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:35.071918    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b4qp6\" (UniqueName: \"kubernetes.io/projected/9bf2be11-9325-4d49-95b7-4d2f3d48d03e-kube-api-access-b4qp6\") pod \"9bf2be11-9325-4d49-95b7-4d2f3d48d03e\" (UID: \"9bf2be11-9325-4d49-95b7-4d2f3d48d03e\") "
Sep 11 21:33:35.072009 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:35.071980    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bf2be11-9325-4d49-95b7-4d2f3d48d03e-istio-token\") pod \"9bf2be11-9325-4d49-95b7-4d2f3d48d03e\" (UID: \"9bf2be11-9325-4d49-95b7-4d2f3d48d03e\") "
Sep 11 21:33:35.072234 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:35.072041    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bf2be11-9325-4d49-95b7-4d2f3d48d03e-istiod-ca-cert\") pod \"9bf2be11-9325-4d49-95b7-4d2f3d48d03e\" (UID: \"9bf2be11-9325-4d49-95b7-4d2f3d48d03e\") "
Sep 11 21:33:35.072234 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:35.072119    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bf2be11-9325-4d49-95b7-4d2f3d48d03e-istio-data\") pod \"9bf2be11-9325-4d49-95b7-4d2f3d48d03e\" (UID: \"9bf2be11-9325-4d49-95b7-4d2f3d48d03e\") "
Sep 11 21:33:35.072234 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:35.072139    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bf2be11-9325-4d49-95b7-4d2f3d48d03e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9bf2be11-9325-4d49-95b7-4d2f3d48d03e" (UID: "9bf2be11-9325-4d49-95b7-4d2f3d48d03e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:33:35.072234 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:35.072156    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bf2be11-9325-4d49-95b7-4d2f3d48d03e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9bf2be11-9325-4d49-95b7-4d2f3d48d03e" (UID: "9bf2be11-9325-4d49-95b7-4d2f3d48d03e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:33:35.072234 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:35.072219    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bf2be11-9325-4d49-95b7-4d2f3d48d03e-workload-socket\") pod \"9bf2be11-9325-4d49-95b7-4d2f3d48d03e\" (UID: \"9bf2be11-9325-4d49-95b7-4d2f3d48d03e\") "
Sep 11 21:33:35.072543 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:35.072250    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bf2be11-9325-4d49-95b7-4d2f3d48d03e-istio-podinfo\") pod \"9bf2be11-9325-4d49-95b7-4d2f3d48d03e\" (UID: \"9bf2be11-9325-4d49-95b7-4d2f3d48d03e\") "
Sep 11 21:33:35.072543 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:35.072431    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bf2be11-9325-4d49-95b7-4d2f3d48d03e-istio-data" (OuterVolumeSpecName: "istio-data") pod "9bf2be11-9325-4d49-95b7-4d2f3d48d03e" (UID: "9bf2be11-9325-4d49-95b7-4d2f3d48d03e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:33:35.072543 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:35.072449    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bf2be11-9325-4d49-95b7-4d2f3d48d03e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9bf2be11-9325-4d49-95b7-4d2f3d48d03e" (UID: "9bf2be11-9325-4d49-95b7-4d2f3d48d03e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:33:35.072703 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:35.072600    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bf2be11-9325-4d49-95b7-4d2f3d48d03e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9bf2be11-9325-4d49-95b7-4d2f3d48d03e" (UID: "9bf2be11-9325-4d49-95b7-4d2f3d48d03e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:33:35.072760 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:35.072726    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bf2be11-9325-4d49-95b7-4d2f3d48d03e-istiod-ca-cert\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:33:35.072760 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:35.072747    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bf2be11-9325-4d49-95b7-4d2f3d48d03e-istio-data\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:33:35.072864 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:35.072760    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bf2be11-9325-4d49-95b7-4d2f3d48d03e-workload-socket\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:33:35.072864 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:35.072773    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bf2be11-9325-4d49-95b7-4d2f3d48d03e-workload-certs\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:33:35.072864 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:35.072787    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bf2be11-9325-4d49-95b7-4d2f3d48d03e-credential-socket\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:33:35.074191 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:35.074157    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bf2be11-9325-4d49-95b7-4d2f3d48d03e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9bf2be11-9325-4d49-95b7-4d2f3d48d03e" (UID: "9bf2be11-9325-4d49-95b7-4d2f3d48d03e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:33:35.074321 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:35.074231    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bf2be11-9325-4d49-95b7-4d2f3d48d03e-kube-api-access-b4qp6" (OuterVolumeSpecName: "kube-api-access-b4qp6") pod "9bf2be11-9325-4d49-95b7-4d2f3d48d03e" (UID: "9bf2be11-9325-4d49-95b7-4d2f3d48d03e"). InnerVolumeSpecName "kube-api-access-b4qp6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:33:35.074321 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:35.074286    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bf2be11-9325-4d49-95b7-4d2f3d48d03e-istio-token" (OuterVolumeSpecName: "istio-token") pod "9bf2be11-9325-4d49-95b7-4d2f3d48d03e" (UID: "9bf2be11-9325-4d49-95b7-4d2f3d48d03e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:33:35.074478 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:35.074332    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9bf2be11-9325-4d49-95b7-4d2f3d48d03e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9bf2be11-9325-4d49-95b7-4d2f3d48d03e" (UID: "9bf2be11-9325-4d49-95b7-4d2f3d48d03e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 21:33:35.173692 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:35.173618    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bf2be11-9325-4d49-95b7-4d2f3d48d03e-istio-podinfo\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:33:35.173692 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:35.173643    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bf2be11-9325-4d49-95b7-4d2f3d48d03e-istio-envoy\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:33:35.173692 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:35.173653    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b4qp6\" (UniqueName: \"kubernetes.io/projected/9bf2be11-9325-4d49-95b7-4d2f3d48d03e-kube-api-access-b4qp6\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:33:35.173692 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:35.173661    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bf2be11-9325-4d49-95b7-4d2f3d48d03e-istio-token\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:33:35.199314 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:35.199288    2560 generic.go:356] "Generic (PLEG): container finished" podID="9bf2be11-9325-4d49-95b7-4d2f3d48d03e" containerID="0f50a90ccfa1d8b8c0dac3388e51c8a8da378f06e1e8597571c389614faa77d7" exitCode=0
Sep 11 21:33:35.199477 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:35.199351    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz"
Sep 11 21:33:35.199477 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:35.199376    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz" event={"ID":"9bf2be11-9325-4d49-95b7-4d2f3d48d03e","Type":"ContainerDied","Data":"0f50a90ccfa1d8b8c0dac3388e51c8a8da378f06e1e8597571c389614faa77d7"}
Sep 11 21:33:35.199477 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:35.199463    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz" event={"ID":"9bf2be11-9325-4d49-95b7-4d2f3d48d03e","Type":"ContainerDied","Data":"ec27403b0736fc9e5b0db62bc321afb7fbb94f697e8d57e842446d4334bcdf4f"}
Sep 11 21:33:35.199655 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:35.199486    2560 scope.go:117] "RemoveContainer" containerID="0f50a90ccfa1d8b8c0dac3388e51c8a8da378f06e1e8597571c389614faa77d7"
Sep 11 21:33:35.212065 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:35.211981    2560 scope.go:117] "RemoveContainer" containerID="b4b4028b4ce85f9b1d73963b7d75e4a64b074f4ff3fa61b1bf182438b946fd52"
Sep 11 21:33:35.220525 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:35.220510    2560 scope.go:117] "RemoveContainer" containerID="0f50a90ccfa1d8b8c0dac3388e51c8a8da378f06e1e8597571c389614faa77d7"
Sep 11 21:33:35.220774 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:33:35.220760    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f50a90ccfa1d8b8c0dac3388e51c8a8da378f06e1e8597571c389614faa77d7\": container with ID starting with 0f50a90ccfa1d8b8c0dac3388e51c8a8da378f06e1e8597571c389614faa77d7 not found: ID does not exist" containerID="0f50a90ccfa1d8b8c0dac3388e51c8a8da378f06e1e8597571c389614faa77d7"
Sep 11 21:33:35.220813 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:35.220781    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f50a90ccfa1d8b8c0dac3388e51c8a8da378f06e1e8597571c389614faa77d7"} err="failed to get container status \"0f50a90ccfa1d8b8c0dac3388e51c8a8da378f06e1e8597571c389614faa77d7\": rpc error: code = NotFound desc = could not find container \"0f50a90ccfa1d8b8c0dac3388e51c8a8da378f06e1e8597571c389614faa77d7\": container with ID starting with 0f50a90ccfa1d8b8c0dac3388e51c8a8da378f06e1e8597571c389614faa77d7 not found: ID does not exist"
Sep 11 21:33:35.220813 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:35.220796    2560 scope.go:117] "RemoveContainer" containerID="b4b4028b4ce85f9b1d73963b7d75e4a64b074f4ff3fa61b1bf182438b946fd52"
Sep 11 21:33:35.221011 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:33:35.220998    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4b4028b4ce85f9b1d73963b7d75e4a64b074f4ff3fa61b1bf182438b946fd52\": container with ID starting with b4b4028b4ce85f9b1d73963b7d75e4a64b074f4ff3fa61b1bf182438b946fd52 not found: ID does not exist" containerID="b4b4028b4ce85f9b1d73963b7d75e4a64b074f4ff3fa61b1bf182438b946fd52"
Sep 11 21:33:35.221047 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:35.221013    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4b4028b4ce85f9b1d73963b7d75e4a64b074f4ff3fa61b1bf182438b946fd52"} err="failed to get container status \"b4b4028b4ce85f9b1d73963b7d75e4a64b074f4ff3fa61b1bf182438b946fd52\": rpc error: code = NotFound desc = could not find container \"b4b4028b4ce85f9b1d73963b7d75e4a64b074f4ff3fa61b1bf182438b946fd52\": container with ID starting with b4b4028b4ce85f9b1d73963b7d75e4a64b074f4ff3fa61b1bf182438b946fd52 not found: ID does not exist"
Sep 11 21:33:35.225801 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:35.225780    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz"]
Sep 11 21:33:35.232108 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:35.232088    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz"]
Sep 11 21:33:37.039311 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:37.039280    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bf2be11-9325-4d49-95b7-4d2f3d48d03e" path="/var/lib/kubelet/pods/9bf2be11-9325-4d49-95b7-4d2f3d48d03e/volumes"
Sep 11 21:33:49.018291 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:49.018256    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-19ce3e-585cfdb4d9-s7zlj"]
Sep 11 21:33:49.018779 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:49.018546    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-19ce3e-585cfdb4d9-s7zlj" podUID="cbd4d268-efec-43c4-8c56-be10e8cc9b79" containerName="payload-processing" containerID="cri-o://4bc380dbb26c6d5d5cc4eefc0ae68af752d33e8206a5162aceec5518f6439233" gracePeriod=30
Sep 11 21:33:49.029400 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:49.029350    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-19ce3e-f6fdfdd94-lfbnn"]
Sep 11 21:33:49.029633 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:49.029590    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-19ce3e-f6fdfdd94-lfbnn" podUID="c74cfae8-516b-4b63-82b0-b2dba70c37cb" containerName="payload-pre-processing" containerID="cri-o://09d3e2c0e17664383fec029ba605edbc57eccd64cc2f0c9c6cd710eca7405d00" gracePeriod=30
Sep 11 21:33:49.275462 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:49.275402    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-19ce3e-585cfdb4d9-s7zlj"
Sep 11 21:33:49.291260 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:49.291236    2560 generic.go:356] "Generic (PLEG): container finished" podID="cbd4d268-efec-43c4-8c56-be10e8cc9b79" containerID="4bc380dbb26c6d5d5cc4eefc0ae68af752d33e8206a5162aceec5518f6439233" exitCode=0
Sep 11 21:33:49.291451 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:49.291287    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-19ce3e-585cfdb4d9-s7zlj"
Sep 11 21:33:49.291451 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:49.291316    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-19ce3e-585cfdb4d9-s7zlj" event={"ID":"cbd4d268-efec-43c4-8c56-be10e8cc9b79","Type":"ContainerDied","Data":"4bc380dbb26c6d5d5cc4eefc0ae68af752d33e8206a5162aceec5518f6439233"}
Sep 11 21:33:49.291451 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:49.291373    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-19ce3e-585cfdb4d9-s7zlj" event={"ID":"cbd4d268-efec-43c4-8c56-be10e8cc9b79","Type":"ContainerDied","Data":"05289946665b20ce0c78c10624b56aed324eb3e6cdf06c89d450516bbd1a7746"}
Sep 11 21:33:49.291451 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:49.291431    2560 scope.go:117] "RemoveContainer" containerID="4bc380dbb26c6d5d5cc4eefc0ae68af752d33e8206a5162aceec5518f6439233"
Sep 11 21:33:49.294063 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:49.294002    2560 generic.go:356] "Generic (PLEG): container finished" podID="c74cfae8-516b-4b63-82b0-b2dba70c37cb" containerID="09d3e2c0e17664383fec029ba605edbc57eccd64cc2f0c9c6cd710eca7405d00" exitCode=0
Sep 11 21:33:49.294235 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:49.294210    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-19ce3e-f6fdfdd94-lfbnn" event={"ID":"c74cfae8-516b-4b63-82b0-b2dba70c37cb","Type":"ContainerDied","Data":"09d3e2c0e17664383fec029ba605edbc57eccd64cc2f0c9c6cd710eca7405d00"}
Sep 11 21:33:49.304419 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:49.304369    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cbd4d268-efec-43c4-8c56-be10e8cc9b79-plugins-config-volume\") pod \"cbd4d268-efec-43c4-8c56-be10e8cc9b79\" (UID: \"cbd4d268-efec-43c4-8c56-be10e8cc9b79\") "
Sep 11 21:33:49.304662 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:49.304638    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b84t8\" (UniqueName: \"kubernetes.io/projected/cbd4d268-efec-43c4-8c56-be10e8cc9b79-kube-api-access-b84t8\") pod \"cbd4d268-efec-43c4-8c56-be10e8cc9b79\" (UID: \"cbd4d268-efec-43c4-8c56-be10e8cc9b79\") "
Sep 11 21:33:49.304809 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:49.304787    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbd4d268-efec-43c4-8c56-be10e8cc9b79-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cbd4d268-efec-43c4-8c56-be10e8cc9b79" (UID: "cbd4d268-efec-43c4-8c56-be10e8cc9b79"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:33:49.305117 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:49.305096    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cbd4d268-efec-43c4-8c56-be10e8cc9b79-plugins-config-volume\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:33:49.307279 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:49.307237    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbd4d268-efec-43c4-8c56-be10e8cc9b79-kube-api-access-b84t8" (OuterVolumeSpecName: "kube-api-access-b84t8") pod "cbd4d268-efec-43c4-8c56-be10e8cc9b79" (UID: "cbd4d268-efec-43c4-8c56-be10e8cc9b79"). InnerVolumeSpecName "kube-api-access-b84t8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:33:49.308458 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:49.308329    2560 scope.go:117] "RemoveContainer" containerID="4bc380dbb26c6d5d5cc4eefc0ae68af752d33e8206a5162aceec5518f6439233"
Sep 11 21:33:49.308657 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:33:49.308638    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bc380dbb26c6d5d5cc4eefc0ae68af752d33e8206a5162aceec5518f6439233\": container with ID starting with 4bc380dbb26c6d5d5cc4eefc0ae68af752d33e8206a5162aceec5518f6439233 not found: ID does not exist" containerID="4bc380dbb26c6d5d5cc4eefc0ae68af752d33e8206a5162aceec5518f6439233"
Sep 11 21:33:49.308706 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:49.308665    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bc380dbb26c6d5d5cc4eefc0ae68af752d33e8206a5162aceec5518f6439233"} err="failed to get container status \"4bc380dbb26c6d5d5cc4eefc0ae68af752d33e8206a5162aceec5518f6439233\": rpc error: code = NotFound desc = could not find container \"4bc380dbb26c6d5d5cc4eefc0ae68af752d33e8206a5162aceec5518f6439233\": container with ID starting with 4bc380dbb26c6d5d5cc4eefc0ae68af752d33e8206a5162aceec5518f6439233 not found: ID does not exist"
Sep 11 21:33:49.309604 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:49.309589    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-19ce3e-f6fdfdd94-lfbnn"
Sep 11 21:33:49.406485 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:49.406455    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6k5hk\" (UniqueName: \"kubernetes.io/projected/c74cfae8-516b-4b63-82b0-b2dba70c37cb-kube-api-access-6k5hk\") pod \"c74cfae8-516b-4b63-82b0-b2dba70c37cb\" (UID: \"c74cfae8-516b-4b63-82b0-b2dba70c37cb\") "
Sep 11 21:33:49.406682 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:49.406496    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c74cfae8-516b-4b63-82b0-b2dba70c37cb-plugins-config-volume\") pod \"c74cfae8-516b-4b63-82b0-b2dba70c37cb\" (UID: \"c74cfae8-516b-4b63-82b0-b2dba70c37cb\") "
Sep 11 21:33:49.406913 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:49.406884    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c74cfae8-516b-4b63-82b0-b2dba70c37cb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c74cfae8-516b-4b63-82b0-b2dba70c37cb" (UID: "c74cfae8-516b-4b63-82b0-b2dba70c37cb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:33:49.406981 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:49.406966    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b84t8\" (UniqueName: \"kubernetes.io/projected/cbd4d268-efec-43c4-8c56-be10e8cc9b79-kube-api-access-b84t8\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:33:49.408569 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:49.408550    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c74cfae8-516b-4b63-82b0-b2dba70c37cb-kube-api-access-6k5hk" (OuterVolumeSpecName: "kube-api-access-6k5hk") pod "c74cfae8-516b-4b63-82b0-b2dba70c37cb" (UID: "c74cfae8-516b-4b63-82b0-b2dba70c37cb"). InnerVolumeSpecName "kube-api-access-6k5hk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:33:49.508456 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:49.508431    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6k5hk\" (UniqueName: \"kubernetes.io/projected/c74cfae8-516b-4b63-82b0-b2dba70c37cb-kube-api-access-6k5hk\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:33:49.508456 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:49.508453    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c74cfae8-516b-4b63-82b0-b2dba70c37cb-plugins-config-volume\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:33:49.618279 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:49.618248    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-19ce3e-585cfdb4d9-s7zlj"]
Sep 11 21:33:49.620499 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:49.620479    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-19ce3e-585cfdb4d9-s7zlj"]
Sep 11 21:33:50.302122 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:50.302056    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-19ce3e-f6fdfdd94-lfbnn"
Sep 11 21:33:50.302122 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:50.302061    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-19ce3e-f6fdfdd94-lfbnn" event={"ID":"c74cfae8-516b-4b63-82b0-b2dba70c37cb","Type":"ContainerDied","Data":"c1f96dcee5a75c25fe3e8db62d8577c5285820abfdb5e0270eb9bd2a370368fd"}
Sep 11 21:33:50.302591 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:50.302148    2560 scope.go:117] "RemoveContainer" containerID="09d3e2c0e17664383fec029ba605edbc57eccd64cc2f0c9c6cd710eca7405d00"
Sep 11 21:33:50.324478 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:50.324441    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-19ce3e-f6fdfdd94-lfbnn"]
Sep 11 21:33:50.329835 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:50.329813    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-19ce3e-f6fdfdd94-lfbnn"]
Sep 11 21:33:51.037422 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:51.037369    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c74cfae8-516b-4b63-82b0-b2dba70c37cb" path="/var/lib/kubelet/pods/c74cfae8-516b-4b63-82b0-b2dba70c37cb/volumes"
Sep 11 21:33:51.037753 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:33:51.037740    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbd4d268-efec-43c4-8c56-be10e8cc9b79" path="/var/lib/kubelet/pods/cbd4d268-efec-43c4-8c56-be10e8cc9b79/volumes"
Sep 11 21:34:37.976608 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:37.976574    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56"]
Sep 11 21:34:37.977200 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:37.976799    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56" podUID="14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d" containerName="istio-proxy" containerID="cri-o://e351d3abe390a3a44200983c1172122f746e621d79352f3aef6325eb34d65476" gracePeriod=30
Sep 11 21:34:43.226716 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:43.226693    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56"
Sep 11 21:34:43.273865 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:43.273808    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d-workload-certs\") pod \"14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d\" (UID: \"14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d\") "
Sep 11 21:34:43.273865 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:43.273848    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d-istio-envoy\") pod \"14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d\" (UID: \"14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d\") "
Sep 11 21:34:43.274037 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:43.273880    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d-credential-socket\") pod \"14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d\" (UID: \"14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d\") "
Sep 11 21:34:43.274037 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:43.273916    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d-istio-token\") pod \"14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d\" (UID: \"14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d\") "
Sep 11 21:34:43.274037 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:43.273940    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w5kh9\" (UniqueName: \"kubernetes.io/projected/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d-kube-api-access-w5kh9\") pod \"14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d\" (UID: \"14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d\") "
Sep 11 21:34:43.274037 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:43.273982    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d-istio-podinfo\") pod \"14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d\" (UID: \"14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d\") "
Sep 11 21:34:43.274037 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:43.274010    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d-istio-data\") pod \"14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d\" (UID: \"14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d\") "
Sep 11 21:34:43.274304 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:43.274044    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d-workload-socket\") pod \"14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d\" (UID: \"14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d\") "
Sep 11 21:34:43.274304 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:43.274077    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d-istiod-ca-cert\") pod \"14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d\" (UID: \"14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d\") "
Sep 11 21:34:43.274304 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:43.274208    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d" (UID: "14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:34:43.274576 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:43.274461    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d" (UID: "14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:34:43.274576 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:43.274466    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d-credential-socket\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:34:43.274576 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:43.274549    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d-istio-data" (OuterVolumeSpecName: "istio-data") pod "14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d" (UID: "14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:34:43.274576 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:43.274562    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d" (UID: "14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:34:43.274885 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:43.274637    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d" (UID: "14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:34:43.276022 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:43.275999    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d" (UID: "14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:34:43.276194 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:43.276177    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d-kube-api-access-w5kh9" (OuterVolumeSpecName: "kube-api-access-w5kh9") pod "14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d" (UID: "14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d"). InnerVolumeSpecName "kube-api-access-w5kh9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:34:43.276268 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:43.276255    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d" (UID: "14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 21:34:43.276509 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:43.276488    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d-istio-token" (OuterVolumeSpecName: "istio-token") pod "14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d" (UID: "14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:34:43.374928 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:43.374909    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d-istio-token\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:34:43.374928 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:43.374929    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5kh9\" (UniqueName: \"kubernetes.io/projected/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d-kube-api-access-w5kh9\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:34:43.375049 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:43.374938    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d-istio-podinfo\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:34:43.375049 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:43.374946    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d-istio-data\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:34:43.375049 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:43.374955    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d-workload-socket\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:34:43.375049 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:43.374965    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d-istiod-ca-cert\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:34:43.375049 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:43.374977    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d-workload-certs\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:34:43.375049 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:43.374985    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d-istio-envoy\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:34:43.598771 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:43.598703    2560 generic.go:356] "Generic (PLEG): container finished" podID="14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d" containerID="e351d3abe390a3a44200983c1172122f746e621d79352f3aef6325eb34d65476" exitCode=0
Sep 11 21:34:43.598771 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:43.598749    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56"
Sep 11 21:34:43.598949 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:43.598793    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56" event={"ID":"14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d","Type":"ContainerDied","Data":"e351d3abe390a3a44200983c1172122f746e621d79352f3aef6325eb34d65476"}
Sep 11 21:34:43.598949 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:43.598851    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56" event={"ID":"14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d","Type":"ContainerDied","Data":"9be22f6fa95a7db9b3ce6e67a4b76f0aff1d546a389d5f9798058f524b517486"}
Sep 11 21:34:43.598949 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:43.598881    2560 scope.go:117] "RemoveContainer" containerID="e351d3abe390a3a44200983c1172122f746e621d79352f3aef6325eb34d65476"
Sep 11 21:34:43.608179 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:43.608157    2560 scope.go:117] "RemoveContainer" containerID="6ba32e8862eda804d1b22bb2ea72a8d5df36dce97685e4da13b2f7eaa5a83e46"
Sep 11 21:34:43.616057 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:43.616041    2560 scope.go:117] "RemoveContainer" containerID="e351d3abe390a3a44200983c1172122f746e621d79352f3aef6325eb34d65476"
Sep 11 21:34:43.616317 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:34:43.616299    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e351d3abe390a3a44200983c1172122f746e621d79352f3aef6325eb34d65476\": container with ID starting with e351d3abe390a3a44200983c1172122f746e621d79352f3aef6325eb34d65476 not found: ID does not exist" containerID="e351d3abe390a3a44200983c1172122f746e621d79352f3aef6325eb34d65476"
Sep 11 21:34:43.616367 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:43.616326    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e351d3abe390a3a44200983c1172122f746e621d79352f3aef6325eb34d65476"} err="failed to get container status \"e351d3abe390a3a44200983c1172122f746e621d79352f3aef6325eb34d65476\": rpc error: code = NotFound desc = could not find container \"e351d3abe390a3a44200983c1172122f746e621d79352f3aef6325eb34d65476\": container with ID starting with e351d3abe390a3a44200983c1172122f746e621d79352f3aef6325eb34d65476 not found: ID does not exist"
Sep 11 21:34:43.616367 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:43.616341    2560 scope.go:117] "RemoveContainer" containerID="6ba32e8862eda804d1b22bb2ea72a8d5df36dce97685e4da13b2f7eaa5a83e46"
Sep 11 21:34:43.616588 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:34:43.616570    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ba32e8862eda804d1b22bb2ea72a8d5df36dce97685e4da13b2f7eaa5a83e46\": container with ID starting with 6ba32e8862eda804d1b22bb2ea72a8d5df36dce97685e4da13b2f7eaa5a83e46 not found: ID does not exist" containerID="6ba32e8862eda804d1b22bb2ea72a8d5df36dce97685e4da13b2f7eaa5a83e46"
Sep 11 21:34:43.616631 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:43.616593    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ba32e8862eda804d1b22bb2ea72a8d5df36dce97685e4da13b2f7eaa5a83e46"} err="failed to get container status \"6ba32e8862eda804d1b22bb2ea72a8d5df36dce97685e4da13b2f7eaa5a83e46\": rpc error: code = NotFound desc = could not find container \"6ba32e8862eda804d1b22bb2ea72a8d5df36dce97685e4da13b2f7eaa5a83e46\": container with ID starting with 6ba32e8862eda804d1b22bb2ea72a8d5df36dce97685e4da13b2f7eaa5a83e46 not found: ID does not exist"
Sep 11 21:34:43.620342 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:43.620322    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56"]
Sep 11 21:34:43.624539 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:43.624521    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56"]
Sep 11 21:34:45.038803 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:45.038774    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d" path="/var/lib/kubelet/pods/14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d/volumes"
Sep 11 21:34:48.946437 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:48.946398    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-e9c558-c84df4dfc-g4nkr"]
Sep 11 21:34:48.946906 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:48.946648    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-e9c558-c84df4dfc-g4nkr" podUID="c4b435bb-de9d-4c7c-9484-ca377a931f67" containerName="payload-processing" containerID="cri-o://3cdf7e8a3be7e0f0b1f6e4dab6052afcccd1c1a4956cf1aed020a72ea05cb574" gracePeriod=30
Sep 11 21:34:48.960659 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:48.959689    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-e9c558-697749df78-z4t65"]
Sep 11 21:34:48.960659 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:48.959905    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e9c558-697749df78-z4t65" podUID="73100955-d6f6-4c26-b8c9-039d5db084f2" containerName="payload-pre-processing" containerID="cri-o://3e7f22db30155fe0d1151cf603e75e931aaf2a16a830bc434e5b30db7b5d1def" gracePeriod=30
Sep 11 21:34:49.208494 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:49.208437    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-e9c558-c84df4dfc-g4nkr"
Sep 11 21:34:49.240429 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:49.240404    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e9c558-697749df78-z4t65"
Sep 11 21:34:49.330014 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:49.329974    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c4b435bb-de9d-4c7c-9484-ca377a931f67-plugins-config-volume\") pod \"c4b435bb-de9d-4c7c-9484-ca377a931f67\" (UID: \"c4b435bb-de9d-4c7c-9484-ca377a931f67\") "
Sep 11 21:34:49.330194 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:49.330068    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvxzj\" (UniqueName: \"kubernetes.io/projected/c4b435bb-de9d-4c7c-9484-ca377a931f67-kube-api-access-xvxzj\") pod \"c4b435bb-de9d-4c7c-9484-ca377a931f67\" (UID: \"c4b435bb-de9d-4c7c-9484-ca377a931f67\") "
Sep 11 21:34:49.330194 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:49.330128    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/73100955-d6f6-4c26-b8c9-039d5db084f2-plugins-config-volume\") pod \"73100955-d6f6-4c26-b8c9-039d5db084f2\" (UID: \"73100955-d6f6-4c26-b8c9-039d5db084f2\") "
Sep 11 21:34:49.330194 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:49.330179    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxqwn\" (UniqueName: \"kubernetes.io/projected/73100955-d6f6-4c26-b8c9-039d5db084f2-kube-api-access-wxqwn\") pod \"73100955-d6f6-4c26-b8c9-039d5db084f2\" (UID: \"73100955-d6f6-4c26-b8c9-039d5db084f2\") "
Sep 11 21:34:49.330441 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:49.330362    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4b435bb-de9d-4c7c-9484-ca377a931f67-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c4b435bb-de9d-4c7c-9484-ca377a931f67" (UID: "c4b435bb-de9d-4c7c-9484-ca377a931f67"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:34:49.330566 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:49.330542    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73100955-d6f6-4c26-b8c9-039d5db084f2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "73100955-d6f6-4c26-b8c9-039d5db084f2" (UID: "73100955-d6f6-4c26-b8c9-039d5db084f2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:34:49.330618 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:49.330544    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c4b435bb-de9d-4c7c-9484-ca377a931f67-plugins-config-volume\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:34:49.331981 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:49.331963    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4b435bb-de9d-4c7c-9484-ca377a931f67-kube-api-access-xvxzj" (OuterVolumeSpecName: "kube-api-access-xvxzj") pod "c4b435bb-de9d-4c7c-9484-ca377a931f67" (UID: "c4b435bb-de9d-4c7c-9484-ca377a931f67"). InnerVolumeSpecName "kube-api-access-xvxzj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:34:49.332125 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:49.332107    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73100955-d6f6-4c26-b8c9-039d5db084f2-kube-api-access-wxqwn" (OuterVolumeSpecName: "kube-api-access-wxqwn") pod "73100955-d6f6-4c26-b8c9-039d5db084f2" (UID: "73100955-d6f6-4c26-b8c9-039d5db084f2"). InnerVolumeSpecName "kube-api-access-wxqwn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:34:49.431741 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:49.431713    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvxzj\" (UniqueName: \"kubernetes.io/projected/c4b435bb-de9d-4c7c-9484-ca377a931f67-kube-api-access-xvxzj\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:34:49.431741 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:49.431736    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/73100955-d6f6-4c26-b8c9-039d5db084f2-plugins-config-volume\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:34:49.431741 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:49.431745    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxqwn\" (UniqueName: \"kubernetes.io/projected/73100955-d6f6-4c26-b8c9-039d5db084f2-kube-api-access-wxqwn\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:34:49.634326 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:49.634297    2560 generic.go:356] "Generic (PLEG): container finished" podID="c4b435bb-de9d-4c7c-9484-ca377a931f67" containerID="3cdf7e8a3be7e0f0b1f6e4dab6052afcccd1c1a4956cf1aed020a72ea05cb574" exitCode=0
Sep 11 21:34:49.634501 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:49.634345    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-e9c558-c84df4dfc-g4nkr"
Sep 11 21:34:49.634501 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:49.634402    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-e9c558-c84df4dfc-g4nkr" event={"ID":"c4b435bb-de9d-4c7c-9484-ca377a931f67","Type":"ContainerDied","Data":"3cdf7e8a3be7e0f0b1f6e4dab6052afcccd1c1a4956cf1aed020a72ea05cb574"}
Sep 11 21:34:49.634501 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:49.634465    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-e9c558-c84df4dfc-g4nkr" event={"ID":"c4b435bb-de9d-4c7c-9484-ca377a931f67","Type":"ContainerDied","Data":"f31332bef61a89658373f97026fbabb43b63a0d7b8c21a5c2a42c31c1d65aef1"}
Sep 11 21:34:49.634501 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:49.634491    2560 scope.go:117] "RemoveContainer" containerID="3cdf7e8a3be7e0f0b1f6e4dab6052afcccd1c1a4956cf1aed020a72ea05cb574"
Sep 11 21:34:49.635802 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:49.635781    2560 generic.go:356] "Generic (PLEG): container finished" podID="73100955-d6f6-4c26-b8c9-039d5db084f2" containerID="3e7f22db30155fe0d1151cf603e75e931aaf2a16a830bc434e5b30db7b5d1def" exitCode=0
Sep 11 21:34:49.635917 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:49.635817    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e9c558-697749df78-z4t65"
Sep 11 21:34:49.635917 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:49.635831    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e9c558-697749df78-z4t65" event={"ID":"73100955-d6f6-4c26-b8c9-039d5db084f2","Type":"ContainerDied","Data":"3e7f22db30155fe0d1151cf603e75e931aaf2a16a830bc434e5b30db7b5d1def"}
Sep 11 21:34:49.635917 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:49.635865    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e9c558-697749df78-z4t65" event={"ID":"73100955-d6f6-4c26-b8c9-039d5db084f2","Type":"ContainerDied","Data":"ba5132cf1be92fc5ce8045d2509e7eb366e395f4fac448b282479896d538767a"}
Sep 11 21:34:49.644286 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:49.644269    2560 scope.go:117] "RemoveContainer" containerID="3cdf7e8a3be7e0f0b1f6e4dab6052afcccd1c1a4956cf1aed020a72ea05cb574"
Sep 11 21:34:49.644671 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:34:49.644629    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cdf7e8a3be7e0f0b1f6e4dab6052afcccd1c1a4956cf1aed020a72ea05cb574\": container with ID starting with 3cdf7e8a3be7e0f0b1f6e4dab6052afcccd1c1a4956cf1aed020a72ea05cb574 not found: ID does not exist" containerID="3cdf7e8a3be7e0f0b1f6e4dab6052afcccd1c1a4956cf1aed020a72ea05cb574"
Sep 11 21:34:49.644747 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:49.644678    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cdf7e8a3be7e0f0b1f6e4dab6052afcccd1c1a4956cf1aed020a72ea05cb574"} err="failed to get container status \"3cdf7e8a3be7e0f0b1f6e4dab6052afcccd1c1a4956cf1aed020a72ea05cb574\": rpc error: code = NotFound desc = could not find container \"3cdf7e8a3be7e0f0b1f6e4dab6052afcccd1c1a4956cf1aed020a72ea05cb574\": container with ID starting with 3cdf7e8a3be7e0f0b1f6e4dab6052afcccd1c1a4956cf1aed020a72ea05cb574 not found: ID does not exist"
Sep 11 21:34:49.644747 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:49.644703    2560 scope.go:117] "RemoveContainer" containerID="3e7f22db30155fe0d1151cf603e75e931aaf2a16a830bc434e5b30db7b5d1def"
Sep 11 21:34:49.652911 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:49.652894    2560 scope.go:117] "RemoveContainer" containerID="3e7f22db30155fe0d1151cf603e75e931aaf2a16a830bc434e5b30db7b5d1def"
Sep 11 21:34:49.653145 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:34:49.653128    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e7f22db30155fe0d1151cf603e75e931aaf2a16a830bc434e5b30db7b5d1def\": container with ID starting with 3e7f22db30155fe0d1151cf603e75e931aaf2a16a830bc434e5b30db7b5d1def not found: ID does not exist" containerID="3e7f22db30155fe0d1151cf603e75e931aaf2a16a830bc434e5b30db7b5d1def"
Sep 11 21:34:49.653197 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:49.653153    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e7f22db30155fe0d1151cf603e75e931aaf2a16a830bc434e5b30db7b5d1def"} err="failed to get container status \"3e7f22db30155fe0d1151cf603e75e931aaf2a16a830bc434e5b30db7b5d1def\": rpc error: code = NotFound desc = could not find container \"3e7f22db30155fe0d1151cf603e75e931aaf2a16a830bc434e5b30db7b5d1def\": container with ID starting with 3e7f22db30155fe0d1151cf603e75e931aaf2a16a830bc434e5b30db7b5d1def not found: ID does not exist"
Sep 11 21:34:49.657914 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:49.657885    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-e9c558-c84df4dfc-g4nkr"]
Sep 11 21:34:49.663307 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:49.663287    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-e9c558-c84df4dfc-g4nkr"]
Sep 11 21:34:49.674467 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:49.674447    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-e9c558-697749df78-z4t65"]
Sep 11 21:34:49.677870 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:49.677850    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-e9c558-697749df78-z4t65"]
Sep 11 21:34:51.037765 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:51.037734    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73100955-d6f6-4c26-b8c9-039d5db084f2" path="/var/lib/kubelet/pods/73100955-d6f6-4c26-b8c9-039d5db084f2/volumes"
Sep 11 21:34:51.038122 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:51.038083    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4b435bb-de9d-4c7c-9484-ca377a931f67" path="/var/lib/kubelet/pods/c4b435bb-de9d-4c7c-9484-ca377a931f67/volumes"
Sep 11 21:34:55.480247 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:55.480210    2560 scope.go:117] "RemoveContainer" containerID="edd762d50cf09880dcb406316440d41d4c0376ed0fbd5341f290e79916ea6ca9"
Sep 11 21:34:55.490091 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:55.490068    2560 scope.go:117] "RemoveContainer" containerID="8aac5b2ea6c98c0f1b5b8ed4bb46572d158cbbf8597ec9b7e3c2b49278c00d1d"
Sep 11 21:34:56.000975 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:56.000939    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-2bd772-mmd9l"]
Sep 11 21:34:56.001355 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:56.001342    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d" containerName="istio-proxy"
Sep 11 21:34:56.001355 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:56.001355    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d" containerName="istio-proxy"
Sep 11 21:34:56.001486 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:56.001364    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73100955-d6f6-4c26-b8c9-039d5db084f2" containerName="payload-pre-processing"
Sep 11 21:34:56.001486 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:56.001369    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="73100955-d6f6-4c26-b8c9-039d5db084f2" containerName="payload-pre-processing"
Sep 11 21:34:56.001486 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:56.001398    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c74cfae8-516b-4b63-82b0-b2dba70c37cb" containerName="payload-pre-processing"
Sep 11 21:34:56.001486 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:56.001404    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c74cfae8-516b-4b63-82b0-b2dba70c37cb" containerName="payload-pre-processing"
Sep 11 21:34:56.001486 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:56.001412    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bf2be11-9325-4d49-95b7-4d2f3d48d03e" containerName="istio-proxy"
Sep 11 21:34:56.001486 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:56.001417    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bf2be11-9325-4d49-95b7-4d2f3d48d03e" containerName="istio-proxy"
Sep 11 21:34:56.001486 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:56.001426    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbd4d268-efec-43c4-8c56-be10e8cc9b79" containerName="payload-processing"
Sep 11 21:34:56.001486 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:56.001431    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbd4d268-efec-43c4-8c56-be10e8cc9b79" containerName="payload-processing"
Sep 11 21:34:56.001486 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:56.001436    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4b435bb-de9d-4c7c-9484-ca377a931f67" containerName="payload-processing"
Sep 11 21:34:56.001486 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:56.001441    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4b435bb-de9d-4c7c-9484-ca377a931f67" containerName="payload-processing"
Sep 11 21:34:56.001486 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:56.001451    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bf2be11-9325-4d49-95b7-4d2f3d48d03e" containerName="istio-proxy"
Sep 11 21:34:56.001486 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:56.001456    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bf2be11-9325-4d49-95b7-4d2f3d48d03e" containerName="istio-proxy"
Sep 11 21:34:56.001486 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:56.001463    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2060365-1678-4635-a899-76d81955b7fb" containerName="revoke-keys"
Sep 11 21:34:56.001486 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:56.001468    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2060365-1678-4635-a899-76d81955b7fb" containerName="revoke-keys"
Sep 11 21:34:56.001950 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:56.001524    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bf2be11-9325-4d49-95b7-4d2f3d48d03e" containerName="istio-proxy"
Sep 11 21:34:56.001950 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:56.001531    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbd4d268-efec-43c4-8c56-be10e8cc9b79" containerName="payload-processing"
Sep 11 21:34:56.001950 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:56.001539    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d" containerName="istio-proxy"
Sep 11 21:34:56.001950 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:56.001544    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bf2be11-9325-4d49-95b7-4d2f3d48d03e" containerName="istio-proxy"
Sep 11 21:34:56.001950 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:56.001550    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="73100955-d6f6-4c26-b8c9-039d5db084f2" containerName="payload-pre-processing"
Sep 11 21:34:56.001950 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:56.001555    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2060365-1678-4635-a899-76d81955b7fb" containerName="revoke-keys"
Sep 11 21:34:56.001950 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:56.001560    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d" containerName="istio-proxy"
Sep 11 21:34:56.001950 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:56.001567    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c74cfae8-516b-4b63-82b0-b2dba70c37cb" containerName="payload-pre-processing"
Sep 11 21:34:56.001950 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:56.001572    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4b435bb-de9d-4c7c-9484-ca377a931f67" containerName="payload-processing"
Sep 11 21:34:56.004954 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:56.004934    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-2bd772-mmd9l"
Sep 11 21:34:56.007236 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:56.007215    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 21:34:56.007352 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:56.007339    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bfm9g\""
Sep 11 21:34:56.012227 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:56.012204    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-2bd772-mmd9l"]
Sep 11 21:34:56.085662 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:56.085640    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49230cd2-8e6f-4283-a3c6-3fa780576ccc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-2bd772-mmd9l\" (UID: \"49230cd2-8e6f-4283-a3c6-3fa780576ccc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-2bd772-mmd9l"
Sep 11 21:34:56.186716 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:56.186688    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49230cd2-8e6f-4283-a3c6-3fa780576ccc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-2bd772-mmd9l\" (UID: \"49230cd2-8e6f-4283-a3c6-3fa780576ccc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-2bd772-mmd9l"
Sep 11 21:34:56.187329 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:56.187311    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49230cd2-8e6f-4283-a3c6-3fa780576ccc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-2bd772-mmd9l\" (UID: \"49230cd2-8e6f-4283-a3c6-3fa780576ccc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-2bd772-mmd9l"
Sep 11 21:34:56.317244 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:56.317185    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-2bd772-mmd9l"
Sep 11 21:34:56.586960 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:56.586590    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-2bd772-mmd9l"]
Sep 11 21:34:56.589340 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:34:56.589302    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49230cd2_8e6f_4283_a3c6_3fa780576ccc.slice/crio-2739bd9b556556b7bea0b4326d87bd0c1589bd9795f4ff28cc111adb0174686d WatchSource:0}: Error finding container 2739bd9b556556b7bea0b4326d87bd0c1589bd9795f4ff28cc111adb0174686d: Status 404 returned error can't find the container with id 2739bd9b556556b7bea0b4326d87bd0c1589bd9795f4ff28cc111adb0174686d
Sep 11 21:34:56.684608 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:56.684571    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-2bd772-mmd9l" event={"ID":"49230cd2-8e6f-4283-a3c6-3fa780576ccc","Type":"ContainerStarted","Data":"2739bd9b556556b7bea0b4326d87bd0c1589bd9795f4ff28cc111adb0174686d"}
Sep 11 21:34:57.691079 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:57.691049    2560 generic.go:356] "Generic (PLEG): container finished" podID="49230cd2-8e6f-4283-a3c6-3fa780576ccc" containerID="c9b41c9a610bf09f0dafa646b978f41920db4ea25d8f305aea4c14fa844f8e71" exitCode=0
Sep 11 21:34:57.691473 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:57.691121    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-2bd772-mmd9l" event={"ID":"49230cd2-8e6f-4283-a3c6-3fa780576ccc","Type":"ContainerDied","Data":"c9b41c9a610bf09f0dafa646b978f41920db4ea25d8f305aea4c14fa844f8e71"}
Sep 11 21:34:58.831533 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:58.831505    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-2bd772-mmd9l"
Sep 11 21:34:58.910687 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:58.910663    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49230cd2-8e6f-4283-a3c6-3fa780576ccc-maas-api-service-ca\") pod \"49230cd2-8e6f-4283-a3c6-3fa780576ccc\" (UID: \"49230cd2-8e6f-4283-a3c6-3fa780576ccc\") "
Sep 11 21:34:58.911016 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:58.910991    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49230cd2-8e6f-4283-a3c6-3fa780576ccc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "49230cd2-8e6f-4283-a3c6-3fa780576ccc" (UID: "49230cd2-8e6f-4283-a3c6-3fa780576ccc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:34:59.012283 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:59.012217    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49230cd2-8e6f-4283-a3c6-3fa780576ccc-maas-api-service-ca\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:34:59.703413 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:59.703373    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-2bd772-mmd9l"
Sep 11 21:34:59.703559 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:59.703411    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-2bd772-mmd9l" event={"ID":"49230cd2-8e6f-4283-a3c6-3fa780576ccc","Type":"ContainerDied","Data":"2739bd9b556556b7bea0b4326d87bd0c1589bd9795f4ff28cc111adb0174686d"}
Sep 11 21:34:59.703559 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:34:59.703454    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2739bd9b556556b7bea0b4326d87bd0c1589bd9795f4ff28cc111adb0174686d"
Sep 11 21:35:06.603922 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:06.603878    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-2bd772-29819370-pfrpv"]
Sep 11 21:35:06.605910 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:06.605884    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-2bd772-29819370-pfrpv"]
Sep 11 21:35:06.810029 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:06.809993    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-2bd772-mmd9l"]
Sep 11 21:35:06.812446 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:06.812423    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-2bd772-mmd9l"]
Sep 11 21:35:07.038296 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:07.038264    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49230cd2-8e6f-4283-a3c6-3fa780576ccc" path="/var/lib/kubelet/pods/49230cd2-8e6f-4283-a3c6-3fa780576ccc/volumes"
Sep 11 21:35:07.038625 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:07.038610    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1bfb8f2-dffb-4a49-99bc-6a08a4c40288" path="/var/lib/kubelet/pods/e1bfb8f2-dffb-4a49-99bc-6a08a4c40288/volumes"
Sep 11 21:35:24.574732 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:24.574694    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-713791-29819370-g4q6l"]
Sep 11 21:35:24.577244 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:24.577216    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-713791-29819370-g4q6l"]
Sep 11 21:35:24.610635 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:24.610605    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-713791-fc47fc45-vlb4h"]
Sep 11 21:35:24.610880 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:24.610855    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-713791-fc47fc45-vlb4h" podUID="b9ac5d67-65b2-4f92-a7af-00e39c5c53ef" containerName="payload-processing" containerID="cri-o://80427c1de0dcc0392bfd3c29bc0b26ba39abbded7c3fd7149495d84c22c1d10b" gracePeriod=30
Sep 11 21:35:24.850518 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:24.850435    2560 generic.go:356] "Generic (PLEG): container finished" podID="b9ac5d67-65b2-4f92-a7af-00e39c5c53ef" containerID="80427c1de0dcc0392bfd3c29bc0b26ba39abbded7c3fd7149495d84c22c1d10b" exitCode=0
Sep 11 21:35:24.850674 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:24.850512    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-713791-fc47fc45-vlb4h" event={"ID":"b9ac5d67-65b2-4f92-a7af-00e39c5c53ef","Type":"ContainerDied","Data":"80427c1de0dcc0392bfd3c29bc0b26ba39abbded7c3fd7149495d84c22c1d10b"}
Sep 11 21:35:24.871728 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:24.871705    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-713791-fc47fc45-vlb4h"
Sep 11 21:35:24.942027 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:24.941997    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9ac5d67-65b2-4f92-a7af-00e39c5c53ef-plugins-config-volume\") pod \"b9ac5d67-65b2-4f92-a7af-00e39c5c53ef\" (UID: \"b9ac5d67-65b2-4f92-a7af-00e39c5c53ef\") "
Sep 11 21:35:24.942206 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:24.942053    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6lsgc\" (UniqueName: \"kubernetes.io/projected/b9ac5d67-65b2-4f92-a7af-00e39c5c53ef-kube-api-access-6lsgc\") pod \"b9ac5d67-65b2-4f92-a7af-00e39c5c53ef\" (UID: \"b9ac5d67-65b2-4f92-a7af-00e39c5c53ef\") "
Sep 11 21:35:24.942429 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:24.942363    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9ac5d67-65b2-4f92-a7af-00e39c5c53ef-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b9ac5d67-65b2-4f92-a7af-00e39c5c53ef" (UID: "b9ac5d67-65b2-4f92-a7af-00e39c5c53ef"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:35:24.944341 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:24.944309    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9ac5d67-65b2-4f92-a7af-00e39c5c53ef-kube-api-access-6lsgc" (OuterVolumeSpecName: "kube-api-access-6lsgc") pod "b9ac5d67-65b2-4f92-a7af-00e39c5c53ef" (UID: "b9ac5d67-65b2-4f92-a7af-00e39c5c53ef"). InnerVolumeSpecName "kube-api-access-6lsgc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:35:25.037168 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:25.037139    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8cf72f2-52a3-4b96-8199-ce69e7a47d86" path="/var/lib/kubelet/pods/a8cf72f2-52a3-4b96-8199-ce69e7a47d86/volumes"
Sep 11 21:35:25.043229 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:25.043203    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9ac5d67-65b2-4f92-a7af-00e39c5c53ef-plugins-config-volume\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:35:25.043342 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:25.043234    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6lsgc\" (UniqueName: \"kubernetes.io/projected/b9ac5d67-65b2-4f92-a7af-00e39c5c53ef-kube-api-access-6lsgc\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:35:25.856574 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:25.856547    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-713791-fc47fc45-vlb4h"
Sep 11 21:35:25.857054 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:25.856581    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-713791-fc47fc45-vlb4h" event={"ID":"b9ac5d67-65b2-4f92-a7af-00e39c5c53ef","Type":"ContainerDied","Data":"f789cb755703227eca7e0eddc3705194b9039cd5b1c3cc4ce23f1e489ed8e7ae"}
Sep 11 21:35:25.857054 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:25.856641    2560 scope.go:117] "RemoveContainer" containerID="80427c1de0dcc0392bfd3c29bc0b26ba39abbded7c3fd7149495d84c22c1d10b"
Sep 11 21:35:25.873611 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:25.873589    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-713791-fc47fc45-vlb4h"]
Sep 11 21:35:25.877774 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:25.877753    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-713791-fc47fc45-vlb4h"]
Sep 11 21:35:27.037143 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:27.037112    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9ac5d67-65b2-4f92-a7af-00e39c5c53ef" path="/var/lib/kubelet/pods/b9ac5d67-65b2-4f92-a7af-00e39c5c53ef/volumes"
Sep 11 21:35:31.974903 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:31.974871    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m"]
Sep 11 21:35:31.975366 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:31.975097    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m" podUID="05a61e7e-7ae9-49f8-9797-17c05529bd57" containerName="istio-proxy" containerID="cri-o://c19ab69a6a2de038acec389075a0b8746da6d360b180af30c3968ea0b0b2d272" gracePeriod=30
Sep 11 21:35:32.502328 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:32.502299    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 21:35:32.502490 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:32.502354    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m" podUID="05a61e7e-7ae9-49f8-9797-17c05529bd57" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 21:35:37.218682 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:37.218658    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m"
Sep 11 21:35:37.350490 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:37.350405    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05a61e7e-7ae9-49f8-9797-17c05529bd57-workload-socket\") pod \"05a61e7e-7ae9-49f8-9797-17c05529bd57\" (UID: \"05a61e7e-7ae9-49f8-9797-17c05529bd57\") "
Sep 11 21:35:37.350490 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:37.350455    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05a61e7e-7ae9-49f8-9797-17c05529bd57-workload-certs\") pod \"05a61e7e-7ae9-49f8-9797-17c05529bd57\" (UID: \"05a61e7e-7ae9-49f8-9797-17c05529bd57\") "
Sep 11 21:35:37.350490 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:37.350481    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05a61e7e-7ae9-49f8-9797-17c05529bd57-istio-podinfo\") pod \"05a61e7e-7ae9-49f8-9797-17c05529bd57\" (UID: \"05a61e7e-7ae9-49f8-9797-17c05529bd57\") "
Sep 11 21:35:37.350780 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:37.350517    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hk2f5\" (UniqueName: \"kubernetes.io/projected/05a61e7e-7ae9-49f8-9797-17c05529bd57-kube-api-access-hk2f5\") pod \"05a61e7e-7ae9-49f8-9797-17c05529bd57\" (UID: \"05a61e7e-7ae9-49f8-9797-17c05529bd57\") "
Sep 11 21:35:37.350780 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:37.350572    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05a61e7e-7ae9-49f8-9797-17c05529bd57-credential-socket\") pod \"05a61e7e-7ae9-49f8-9797-17c05529bd57\" (UID: \"05a61e7e-7ae9-49f8-9797-17c05529bd57\") "
Sep 11 21:35:37.350780 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:37.350613    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05a61e7e-7ae9-49f8-9797-17c05529bd57-istio-data\") pod \"05a61e7e-7ae9-49f8-9797-17c05529bd57\" (UID: \"05a61e7e-7ae9-49f8-9797-17c05529bd57\") "
Sep 11 21:35:37.350780 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:37.350640    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05a61e7e-7ae9-49f8-9797-17c05529bd57-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "05a61e7e-7ae9-49f8-9797-17c05529bd57" (UID: "05a61e7e-7ae9-49f8-9797-17c05529bd57"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:35:37.350780 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:37.350649    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05a61e7e-7ae9-49f8-9797-17c05529bd57-istio-envoy\") pod \"05a61e7e-7ae9-49f8-9797-17c05529bd57\" (UID: \"05a61e7e-7ae9-49f8-9797-17c05529bd57\") "
Sep 11 21:35:37.350780 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:37.350736    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05a61e7e-7ae9-49f8-9797-17c05529bd57-istiod-ca-cert\") pod \"05a61e7e-7ae9-49f8-9797-17c05529bd57\" (UID: \"05a61e7e-7ae9-49f8-9797-17c05529bd57\") "
Sep 11 21:35:37.350780 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:37.350752    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05a61e7e-7ae9-49f8-9797-17c05529bd57-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "05a61e7e-7ae9-49f8-9797-17c05529bd57" (UID: "05a61e7e-7ae9-49f8-9797-17c05529bd57"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:35:37.350780 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:37.350766    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05a61e7e-7ae9-49f8-9797-17c05529bd57-istio-token\") pod \"05a61e7e-7ae9-49f8-9797-17c05529bd57\" (UID: \"05a61e7e-7ae9-49f8-9797-17c05529bd57\") "
Sep 11 21:35:37.351198 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:37.350939    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05a61e7e-7ae9-49f8-9797-17c05529bd57-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "05a61e7e-7ae9-49f8-9797-17c05529bd57" (UID: "05a61e7e-7ae9-49f8-9797-17c05529bd57"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:35:37.351198 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:37.350985    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05a61e7e-7ae9-49f8-9797-17c05529bd57-istio-data" (OuterVolumeSpecName: "istio-data") pod "05a61e7e-7ae9-49f8-9797-17c05529bd57" (UID: "05a61e7e-7ae9-49f8-9797-17c05529bd57"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:35:37.351314 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:37.351235    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05a61e7e-7ae9-49f8-9797-17c05529bd57-workload-socket\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:35:37.351314 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:37.351256    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05a61e7e-7ae9-49f8-9797-17c05529bd57-workload-certs\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:35:37.351314 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:37.351266    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05a61e7e-7ae9-49f8-9797-17c05529bd57-credential-socket\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:35:37.351314 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:37.351274    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05a61e7e-7ae9-49f8-9797-17c05529bd57-istio-data\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:35:37.351522 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:37.351375    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05a61e7e-7ae9-49f8-9797-17c05529bd57-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "05a61e7e-7ae9-49f8-9797-17c05529bd57" (UID: "05a61e7e-7ae9-49f8-9797-17c05529bd57"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:35:37.353322 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:37.353284    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05a61e7e-7ae9-49f8-9797-17c05529bd57-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "05a61e7e-7ae9-49f8-9797-17c05529bd57" (UID: "05a61e7e-7ae9-49f8-9797-17c05529bd57"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:35:37.353322 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:37.353306    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/05a61e7e-7ae9-49f8-9797-17c05529bd57-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "05a61e7e-7ae9-49f8-9797-17c05529bd57" (UID: "05a61e7e-7ae9-49f8-9797-17c05529bd57"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 21:35:37.353504 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:37.353378    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05a61e7e-7ae9-49f8-9797-17c05529bd57-istio-token" (OuterVolumeSpecName: "istio-token") pod "05a61e7e-7ae9-49f8-9797-17c05529bd57" (UID: "05a61e7e-7ae9-49f8-9797-17c05529bd57"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:35:37.353504 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:37.353372    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05a61e7e-7ae9-49f8-9797-17c05529bd57-kube-api-access-hk2f5" (OuterVolumeSpecName: "kube-api-access-hk2f5") pod "05a61e7e-7ae9-49f8-9797-17c05529bd57" (UID: "05a61e7e-7ae9-49f8-9797-17c05529bd57"). InnerVolumeSpecName "kube-api-access-hk2f5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:35:37.452248 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:37.452228    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05a61e7e-7ae9-49f8-9797-17c05529bd57-istio-envoy\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:35:37.452248 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:37.452246    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05a61e7e-7ae9-49f8-9797-17c05529bd57-istiod-ca-cert\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:35:37.452378 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:37.452256    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05a61e7e-7ae9-49f8-9797-17c05529bd57-istio-token\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:35:37.452378 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:37.452263    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05a61e7e-7ae9-49f8-9797-17c05529bd57-istio-podinfo\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:35:37.452378 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:37.452271    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hk2f5\" (UniqueName: \"kubernetes.io/projected/05a61e7e-7ae9-49f8-9797-17c05529bd57-kube-api-access-hk2f5\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:35:37.933088 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:37.933056    2560 generic.go:356] "Generic (PLEG): container finished" podID="05a61e7e-7ae9-49f8-9797-17c05529bd57" containerID="c19ab69a6a2de038acec389075a0b8746da6d360b180af30c3968ea0b0b2d272" exitCode=0
Sep 11 21:35:37.933333 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:37.933110    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m"
Sep 11 21:35:37.933333 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:37.933138    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m" event={"ID":"05a61e7e-7ae9-49f8-9797-17c05529bd57","Type":"ContainerDied","Data":"c19ab69a6a2de038acec389075a0b8746da6d360b180af30c3968ea0b0b2d272"}
Sep 11 21:35:37.933333 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:37.933222    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m" event={"ID":"05a61e7e-7ae9-49f8-9797-17c05529bd57","Type":"ContainerDied","Data":"138ddbab4411bd90af002a942b3e98060b6749c420e5433b3f713e44d3238372"}
Sep 11 21:35:37.933333 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:37.933251    2560 scope.go:117] "RemoveContainer" containerID="c19ab69a6a2de038acec389075a0b8746da6d360b180af30c3968ea0b0b2d272"
Sep 11 21:35:37.945559 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:37.945538    2560 scope.go:117] "RemoveContainer" containerID="3db16ab6863b9a04016c0829a64985d4d74d9d29ccef42e57d40b53e8e608376"
Sep 11 21:35:37.954073 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:37.954058    2560 scope.go:117] "RemoveContainer" containerID="c19ab69a6a2de038acec389075a0b8746da6d360b180af30c3968ea0b0b2d272"
Sep 11 21:35:37.954319 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:35:37.954296    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c19ab69a6a2de038acec389075a0b8746da6d360b180af30c3968ea0b0b2d272\": container with ID starting with c19ab69a6a2de038acec389075a0b8746da6d360b180af30c3968ea0b0b2d272 not found: ID does not exist" containerID="c19ab69a6a2de038acec389075a0b8746da6d360b180af30c3968ea0b0b2d272"
Sep 11 21:35:37.954393 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:37.954335    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c19ab69a6a2de038acec389075a0b8746da6d360b180af30c3968ea0b0b2d272"} err="failed to get container status \"c19ab69a6a2de038acec389075a0b8746da6d360b180af30c3968ea0b0b2d272\": rpc error: code = NotFound desc = could not find container \"c19ab69a6a2de038acec389075a0b8746da6d360b180af30c3968ea0b0b2d272\": container with ID starting with c19ab69a6a2de038acec389075a0b8746da6d360b180af30c3968ea0b0b2d272 not found: ID does not exist"
Sep 11 21:35:37.954393 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:37.954358    2560 scope.go:117] "RemoveContainer" containerID="3db16ab6863b9a04016c0829a64985d4d74d9d29ccef42e57d40b53e8e608376"
Sep 11 21:35:37.954690 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:35:37.954663    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3db16ab6863b9a04016c0829a64985d4d74d9d29ccef42e57d40b53e8e608376\": container with ID starting with 3db16ab6863b9a04016c0829a64985d4d74d9d29ccef42e57d40b53e8e608376 not found: ID does not exist" containerID="3db16ab6863b9a04016c0829a64985d4d74d9d29ccef42e57d40b53e8e608376"
Sep 11 21:35:37.954753 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:37.954711    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3db16ab6863b9a04016c0829a64985d4d74d9d29ccef42e57d40b53e8e608376"} err="failed to get container status \"3db16ab6863b9a04016c0829a64985d4d74d9d29ccef42e57d40b53e8e608376\": rpc error: code = NotFound desc = could not find container \"3db16ab6863b9a04016c0829a64985d4d74d9d29ccef42e57d40b53e8e608376\": container with ID starting with 3db16ab6863b9a04016c0829a64985d4d74d9d29ccef42e57d40b53e8e608376 not found: ID does not exist"
Sep 11 21:35:37.961705 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:37.961685    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m"]
Sep 11 21:35:37.966579 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:37.966561    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m"]
Sep 11 21:35:39.036617 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:39.036584    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05a61e7e-7ae9-49f8-9797-17c05529bd57" path="/var/lib/kubelet/pods/05a61e7e-7ae9-49f8-9797-17c05529bd57/volumes"
Sep 11 21:35:55.525128 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:55.525093    2560 scope.go:117] "RemoveContainer" containerID="d34c67a25aa7c9b4924ddf1de6b2397d72abfc735e6577caf80dc949c0fc44b9"
Sep 11 21:35:55.532866 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:35:55.532835    2560 scope.go:117] "RemoveContainer" containerID="ca13b49cae05eed38775e04f26bd51d12a95ed55d9be377f5abf12a8223f31ff"
Sep 11 21:36:55.564608 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:36:55.564574    2560 scope.go:117] "RemoveContainer" containerID="83f907220cf4f57c22d556abc104d17c127c0dfd8eab8d620ce32912e07a4a55"
Sep 11 21:36:55.572905 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:36:55.572886    2560 scope.go:117] "RemoveContainer" containerID="fa2ea0fb1ee585b6aabd2420a6e1eab6f6d1027fc7d59e59c8dc61dde32b33dd"
Sep 11 21:38:24.934929 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:38:24.934895    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-tsv5x"]
Sep 11 21:38:24.937558 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:38:24.935113    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-tsv5x" podUID="9c8a9e63-523e-49ec-9f0d-d8e2e737c745" containerName="manager" containerID="cri-o://ca7c723b7fc4c44456171cf3b6031477f4f23f331786a7cba389317f54b7fabc" gracePeriod=10
Sep 11 21:38:25.189659 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:38:25.189598    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-tsv5x"
Sep 11 21:38:25.294496 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:38:25.294469    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42ppx\" (UniqueName: \"kubernetes.io/projected/9c8a9e63-523e-49ec-9f0d-d8e2e737c745-kube-api-access-42ppx\") pod \"9c8a9e63-523e-49ec-9f0d-d8e2e737c745\" (UID: \"9c8a9e63-523e-49ec-9f0d-d8e2e737c745\") "
Sep 11 21:38:25.294641 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:38:25.294522    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c8a9e63-523e-49ec-9f0d-d8e2e737c745-extensions-socket-volume\") pod \"9c8a9e63-523e-49ec-9f0d-d8e2e737c745\" (UID: \"9c8a9e63-523e-49ec-9f0d-d8e2e737c745\") "
Sep 11 21:38:25.294934 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:38:25.294906    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c8a9e63-523e-49ec-9f0d-d8e2e737c745-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9c8a9e63-523e-49ec-9f0d-d8e2e737c745" (UID: "9c8a9e63-523e-49ec-9f0d-d8e2e737c745"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:38:25.296542 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:38:25.296524    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c8a9e63-523e-49ec-9f0d-d8e2e737c745-kube-api-access-42ppx" (OuterVolumeSpecName: "kube-api-access-42ppx") pod "9c8a9e63-523e-49ec-9f0d-d8e2e737c745" (UID: "9c8a9e63-523e-49ec-9f0d-d8e2e737c745"). InnerVolumeSpecName "kube-api-access-42ppx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:38:25.395983 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:38:25.395959    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42ppx\" (UniqueName: \"kubernetes.io/projected/9c8a9e63-523e-49ec-9f0d-d8e2e737c745-kube-api-access-42ppx\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:38:25.395983 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:38:25.395981    2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c8a9e63-523e-49ec-9f0d-d8e2e737c745-extensions-socket-volume\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:38:25.798129 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:38:25.798095    2560 generic.go:356] "Generic (PLEG): container finished" podID="9c8a9e63-523e-49ec-9f0d-d8e2e737c745" containerID="ca7c723b7fc4c44456171cf3b6031477f4f23f331786a7cba389317f54b7fabc" exitCode=0
Sep 11 21:38:25.798249 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:38:25.798139    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-tsv5x"
Sep 11 21:38:25.798249 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:38:25.798183    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-tsv5x" event={"ID":"9c8a9e63-523e-49ec-9f0d-d8e2e737c745","Type":"ContainerDied","Data":"ca7c723b7fc4c44456171cf3b6031477f4f23f331786a7cba389317f54b7fabc"}
Sep 11 21:38:25.798350 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:38:25.798259    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-tsv5x" event={"ID":"9c8a9e63-523e-49ec-9f0d-d8e2e737c745","Type":"ContainerDied","Data":"e19853389ec4bc783a91e37ec00399201bbab77b35bfad3fdaa319680a0a0a89"}
Sep 11 21:38:25.798350 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:38:25.798282    2560 scope.go:117] "RemoveContainer" containerID="ca7c723b7fc4c44456171cf3b6031477f4f23f331786a7cba389317f54b7fabc"
Sep 11 21:38:25.808094 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:38:25.808076    2560 scope.go:117] "RemoveContainer" containerID="ca7c723b7fc4c44456171cf3b6031477f4f23f331786a7cba389317f54b7fabc"
Sep 11 21:38:25.808357 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:38:25.808335    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca7c723b7fc4c44456171cf3b6031477f4f23f331786a7cba389317f54b7fabc\": container with ID starting with ca7c723b7fc4c44456171cf3b6031477f4f23f331786a7cba389317f54b7fabc not found: ID does not exist" containerID="ca7c723b7fc4c44456171cf3b6031477f4f23f331786a7cba389317f54b7fabc"
Sep 11 21:38:25.808471 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:38:25.808363    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca7c723b7fc4c44456171cf3b6031477f4f23f331786a7cba389317f54b7fabc"} err="failed to get container status \"ca7c723b7fc4c44456171cf3b6031477f4f23f331786a7cba389317f54b7fabc\": rpc error: code = NotFound desc = could not find container \"ca7c723b7fc4c44456171cf3b6031477f4f23f331786a7cba389317f54b7fabc\": container with ID starting with ca7c723b7fc4c44456171cf3b6031477f4f23f331786a7cba389317f54b7fabc not found: ID does not exist"
Sep 11 21:38:25.819728 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:38:25.819700    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-tsv5x"]
Sep 11 21:38:25.823826 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:38:25.823806    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-tsv5x"]
Sep 11 21:38:27.037882 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:38:27.037844    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c8a9e63-523e-49ec-9f0d-d8e2e737c745" path="/var/lib/kubelet/pods/9c8a9e63-523e-49ec-9f0d-d8e2e737c745/volumes"
Sep 11 21:39:25.645786 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:39:25.645753    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8cv6w"]
Sep 11 21:39:25.646319 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:39:25.646208    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05a61e7e-7ae9-49f8-9797-17c05529bd57" containerName="istio-proxy"
Sep 11 21:39:25.646319 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:39:25.646222    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="05a61e7e-7ae9-49f8-9797-17c05529bd57" containerName="istio-proxy"
Sep 11 21:39:25.646319 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:39:25.646231    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c8a9e63-523e-49ec-9f0d-d8e2e737c745" containerName="manager"
Sep 11 21:39:25.646319 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:39:25.646236    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c8a9e63-523e-49ec-9f0d-d8e2e737c745" containerName="manager"
Sep 11 21:39:25.646319 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:39:25.646247    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d" containerName="istio-proxy"
Sep 11 21:39:25.646319 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:39:25.646253    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="14635d52-8b1d-49b9-b4d9-e8aa3a27ff5d" containerName="istio-proxy"
Sep 11 21:39:25.646319 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:39:25.646262    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49230cd2-8e6f-4283-a3c6-3fa780576ccc" containerName="revoke-keys"
Sep 11 21:39:25.646319 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:39:25.646271    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="49230cd2-8e6f-4283-a3c6-3fa780576ccc" containerName="revoke-keys"
Sep 11 21:39:25.646319 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:39:25.646292    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9ac5d67-65b2-4f92-a7af-00e39c5c53ef" containerName="payload-processing"
Sep 11 21:39:25.646319 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:39:25.646297    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9ac5d67-65b2-4f92-a7af-00e39c5c53ef" containerName="payload-processing"
Sep 11 21:39:25.646781 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:39:25.646366    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="49230cd2-8e6f-4283-a3c6-3fa780576ccc" containerName="revoke-keys"
Sep 11 21:39:25.646781 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:39:25.646379    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c8a9e63-523e-49ec-9f0d-d8e2e737c745" containerName="manager"
Sep 11 21:39:25.646781 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:39:25.646404    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="05a61e7e-7ae9-49f8-9797-17c05529bd57" containerName="istio-proxy"
Sep 11 21:39:25.646781 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:39:25.646411    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="05a61e7e-7ae9-49f8-9797-17c05529bd57" containerName="istio-proxy"
Sep 11 21:39:25.646781 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:39:25.646420    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9ac5d67-65b2-4f92-a7af-00e39c5c53ef" containerName="payload-processing"
Sep 11 21:39:25.649743 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:39:25.649721    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8cv6w"
Sep 11 21:39:25.654096 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:39:25.654076    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-gv44l\""
Sep 11 21:39:25.668197 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:39:25.668175    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8cv6w"]
Sep 11 21:39:25.691614 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:39:25.691591    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8cd0d49d-99eb-438b-b4a9-c75314533f04-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-8cv6w\" (UID: \"8cd0d49d-99eb-438b-b4a9-c75314533f04\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8cv6w"
Sep 11 21:39:25.691711 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:39:25.691620    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrbp8\" (UniqueName: \"kubernetes.io/projected/8cd0d49d-99eb-438b-b4a9-c75314533f04-kube-api-access-hrbp8\") pod \"kuadrant-operator-controller-manager-5769f99d9f-8cv6w\" (UID: \"8cd0d49d-99eb-438b-b4a9-c75314533f04\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8cv6w"
Sep 11 21:39:25.792365 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:39:25.792342    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8cd0d49d-99eb-438b-b4a9-c75314533f04-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-8cv6w\" (UID: \"8cd0d49d-99eb-438b-b4a9-c75314533f04\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8cv6w"
Sep 11 21:39:25.792462 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:39:25.792369    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrbp8\" (UniqueName: \"kubernetes.io/projected/8cd0d49d-99eb-438b-b4a9-c75314533f04-kube-api-access-hrbp8\") pod \"kuadrant-operator-controller-manager-5769f99d9f-8cv6w\" (UID: \"8cd0d49d-99eb-438b-b4a9-c75314533f04\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8cv6w"
Sep 11 21:39:25.792689 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:39:25.792663    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8cd0d49d-99eb-438b-b4a9-c75314533f04-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-8cv6w\" (UID: \"8cd0d49d-99eb-438b-b4a9-c75314533f04\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8cv6w"
Sep 11 21:39:25.804698 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:39:25.804675    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrbp8\" (UniqueName: \"kubernetes.io/projected/8cd0d49d-99eb-438b-b4a9-c75314533f04-kube-api-access-hrbp8\") pod \"kuadrant-operator-controller-manager-5769f99d9f-8cv6w\" (UID: \"8cd0d49d-99eb-438b-b4a9-c75314533f04\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8cv6w"
Sep 11 21:39:25.962196 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:39:25.962138    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8cv6w"
Sep 11 21:39:26.248022 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:39:26.247993    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8cv6w"]
Sep 11 21:39:26.249357 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:39:26.249331    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cd0d49d_99eb_438b_b4a9_c75314533f04.slice/crio-2d33f695e33106b640d017a60775ed96a358d605c8aaa6033ca26a59182c54a1 WatchSource:0}: Error finding container 2d33f695e33106b640d017a60775ed96a358d605c8aaa6033ca26a59182c54a1: Status 404 returned error can't find the container with id 2d33f695e33106b640d017a60775ed96a358d605c8aaa6033ca26a59182c54a1
Sep 11 21:39:27.125799 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:39:27.125758    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8cv6w" event={"ID":"8cd0d49d-99eb-438b-b4a9-c75314533f04","Type":"ContainerStarted","Data":"010693836f94199fe5ecde1b079192e8409820328e1ec2163c9eb9018af47cdb"}
Sep 11 21:39:27.126242 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:39:27.125825    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8cv6w" event={"ID":"8cd0d49d-99eb-438b-b4a9-c75314533f04","Type":"ContainerStarted","Data":"2d33f695e33106b640d017a60775ed96a358d605c8aaa6033ca26a59182c54a1"}
Sep 11 21:39:27.126242 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:39:27.125854    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8cv6w"
Sep 11 21:39:27.169998 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:39:27.169949    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8cv6w" podStartSLOduration=2.169933655 podStartE2EDuration="2.169933655s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:39:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:39:27.169041944 +0000 UTC m=+2012.647353787" watchObservedRunningTime="2026-09-11 21:39:27.169933655 +0000 UTC m=+2012.648245498"
Sep 11 21:39:38.133883 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:39:38.133844    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8cv6w"
Sep 11 21:39:55.620479 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:39:55.620452    2560 scope.go:117] "RemoveContainer" containerID="9d0065a3da23a985201dd191f53c04f74e19a586abd5eb7b1a6cb553e997ec77"
Sep 11 21:40:54.682149 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:40:54.682118    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-84585bc567-kxdgc"]
Sep 11 21:40:54.682648 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:40:54.682615    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05a61e7e-7ae9-49f8-9797-17c05529bd57" containerName="istio-proxy"
Sep 11 21:40:54.682648 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:40:54.682639    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="05a61e7e-7ae9-49f8-9797-17c05529bd57" containerName="istio-proxy"
Sep 11 21:40:54.686057 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:40:54.686042    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-84585bc567-kxdgc"
Sep 11 21:40:54.689241 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:40:54.689214    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 11 21:40:54.689365 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:40:54.689264    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-4pvmq\""
Sep 11 21:40:54.689365 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:40:54.689292    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 21:40:54.689365 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:40:54.689329    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 11 21:40:54.689365 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:40:54.689333    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 11 21:40:54.695273 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:40:54.695250    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-84585bc567-kxdgc"]
Sep 11 21:40:54.801416 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:40:54.801370    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55-openshift-service-ca\") pod \"maas-api-84585bc567-kxdgc\" (UID: \"3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55\") " pod="odh-ai-gateway-infra/maas-api-84585bc567-kxdgc"
Sep 11 21:40:54.801530 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:40:54.801423    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55-maas-api-tls\") pod \"maas-api-84585bc567-kxdgc\" (UID: \"3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55\") " pod="odh-ai-gateway-infra/maas-api-84585bc567-kxdgc"
Sep 11 21:40:54.801530 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:40:54.801488    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55-metrics-certs\") pod \"maas-api-84585bc567-kxdgc\" (UID: \"3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55\") " pod="odh-ai-gateway-infra/maas-api-84585bc567-kxdgc"
Sep 11 21:40:54.801530 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:40:54.801514    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smf95\" (UniqueName: \"kubernetes.io/projected/3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55-kube-api-access-smf95\") pod \"maas-api-84585bc567-kxdgc\" (UID: \"3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55\") " pod="odh-ai-gateway-infra/maas-api-84585bc567-kxdgc"
Sep 11 21:40:54.901963 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:40:54.901931    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55-openshift-service-ca\") pod \"maas-api-84585bc567-kxdgc\" (UID: \"3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55\") " pod="odh-ai-gateway-infra/maas-api-84585bc567-kxdgc"
Sep 11 21:40:54.901963 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:40:54.901966    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55-maas-api-tls\") pod \"maas-api-84585bc567-kxdgc\" (UID: \"3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55\") " pod="odh-ai-gateway-infra/maas-api-84585bc567-kxdgc"
Sep 11 21:40:54.902123 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:40:54.902014    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55-metrics-certs\") pod \"maas-api-84585bc567-kxdgc\" (UID: \"3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55\") " pod="odh-ai-gateway-infra/maas-api-84585bc567-kxdgc"
Sep 11 21:40:54.902123 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:40:54.902036    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smf95\" (UniqueName: \"kubernetes.io/projected/3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55-kube-api-access-smf95\") pod \"maas-api-84585bc567-kxdgc\" (UID: \"3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55\") " pod="odh-ai-gateway-infra/maas-api-84585bc567-kxdgc"
Sep 11 21:40:54.902604 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:40:54.902584    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55-openshift-service-ca\") pod \"maas-api-84585bc567-kxdgc\" (UID: \"3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55\") " pod="odh-ai-gateway-infra/maas-api-84585bc567-kxdgc"
Sep 11 21:40:54.904503 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:40:54.904481    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55-metrics-certs\") pod \"maas-api-84585bc567-kxdgc\" (UID: \"3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55\") " pod="odh-ai-gateway-infra/maas-api-84585bc567-kxdgc"
Sep 11 21:40:54.904631 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:40:54.904610    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55-maas-api-tls\") pod \"maas-api-84585bc567-kxdgc\" (UID: \"3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55\") " pod="odh-ai-gateway-infra/maas-api-84585bc567-kxdgc"
Sep 11 21:40:54.909637 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:40:54.909615    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smf95\" (UniqueName: \"kubernetes.io/projected/3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55-kube-api-access-smf95\") pod \"maas-api-84585bc567-kxdgc\" (UID: \"3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55\") " pod="odh-ai-gateway-infra/maas-api-84585bc567-kxdgc"
Sep 11 21:40:55.000289 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:40:55.000223    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-4pvmq\""
Sep 11 21:40:55.008332 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:40:55.008307    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-84585bc567-kxdgc"
Sep 11 21:40:55.282855 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:40:55.282829    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-84585bc567-kxdgc"]
Sep 11 21:40:55.284590 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:40:55.284561    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b3f49ec_498f_4c5a_b7ff_1f1c40cbdc55.slice/crio-b84d2ea348767fb20e76aaf67d7cec1ad124f19364d655cae9c327313abeb4a9 WatchSource:0}: Error finding container b84d2ea348767fb20e76aaf67d7cec1ad124f19364d655cae9c327313abeb4a9: Status 404 returned error can't find the container with id b84d2ea348767fb20e76aaf67d7cec1ad124f19364d655cae9c327313abeb4a9
Sep 11 21:40:55.285887 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:40:55.285867    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 21:40:55.581199 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:40:55.581123    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-84585bc567-kxdgc" event={"ID":"3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55","Type":"ContainerStarted","Data":"b84d2ea348767fb20e76aaf67d7cec1ad124f19364d655cae9c327313abeb4a9"}
Sep 11 21:40:58.601473 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:40:58.601440    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-84585bc567-kxdgc" event={"ID":"3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55","Type":"ContainerStarted","Data":"2799481fccef1f052a684e625a717b7c400d5c48f152e4f402e32c290791a6dd"}
Sep 11 21:40:58.601838 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:40:58.601495    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-84585bc567-kxdgc"
Sep 11 21:40:58.622031 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:40:58.621978    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-84585bc567-kxdgc" podStartSLOduration=2.267812563 podStartE2EDuration="4.621961066s" totalImagesPullingTime="2.354148503s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:40:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:40:58.620569739 +0000 UTC m=+2104.098881587" watchObservedRunningTime="2026-09-11 21:40:58.621961066 +0000 UTC m=+2104.100272909"
Sep 11 21:41:03.170848 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:03.170811    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-84585bc567-kxdgc"]
Sep 11 21:41:03.171246 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:03.171036    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-84585bc567-kxdgc" podUID="3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55" containerName="maas-api" containerID="cri-o://2799481fccef1f052a684e625a717b7c400d5c48f152e4f402e32c290791a6dd" gracePeriod=30
Sep 11 21:41:03.176457 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:03.176434    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-84585bc567-kxdgc"
Sep 11 21:41:03.421815 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:03.421755    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-84585bc567-kxdgc"
Sep 11 21:41:03.472317 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:03.472296    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55-maas-api-tls\") pod \"3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55\" (UID: \"3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55\") "
Sep 11 21:41:03.472450 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:03.472321    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55-metrics-certs\") pod \"3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55\" (UID: \"3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55\") "
Sep 11 21:41:03.472499 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:03.472475    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smf95\" (UniqueName: \"kubernetes.io/projected/3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55-kube-api-access-smf95\") pod \"3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55\" (UID: \"3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55\") "
Sep 11 21:41:03.472537 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:03.472524    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55-openshift-service-ca\") pod \"3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55\" (UID: \"3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55\") "
Sep 11 21:41:03.473007 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:03.472974    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55" (UID: "3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:41:03.474673 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:03.474649    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55" (UID: "3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:41:03.474777 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:03.474671    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55" (UID: "3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:41:03.474777 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:03.474732    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55-kube-api-access-smf95" (OuterVolumeSpecName: "kube-api-access-smf95") pod "3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55" (UID: "3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55"). InnerVolumeSpecName "kube-api-access-smf95". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:41:03.574044 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:03.574017    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smf95\" (UniqueName: \"kubernetes.io/projected/3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55-kube-api-access-smf95\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:41:03.574044 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:03.574040    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55-openshift-service-ca\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:41:03.574209 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:03.574051    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55-maas-api-tls\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:41:03.574209 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:03.574059    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55-metrics-certs\") on node \"ip-10-0-137-163.ec2.internal\" DevicePath \"\""
Sep 11 21:41:03.628883 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:03.628850    2560 generic.go:356] "Generic (PLEG): container finished" podID="3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55" containerID="2799481fccef1f052a684e625a717b7c400d5c48f152e4f402e32c290791a6dd" exitCode=0
Sep 11 21:41:03.628982 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:03.628895    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-84585bc567-kxdgc"
Sep 11 21:41:03.628982 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:03.628938    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-84585bc567-kxdgc" event={"ID":"3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55","Type":"ContainerDied","Data":"2799481fccef1f052a684e625a717b7c400d5c48f152e4f402e32c290791a6dd"}
Sep 11 21:41:03.629066 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:03.628989    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-84585bc567-kxdgc" event={"ID":"3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55","Type":"ContainerDied","Data":"b84d2ea348767fb20e76aaf67d7cec1ad124f19364d655cae9c327313abeb4a9"}
Sep 11 21:41:03.629066 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:03.629015    2560 scope.go:117] "RemoveContainer" containerID="2799481fccef1f052a684e625a717b7c400d5c48f152e4f402e32c290791a6dd"
Sep 11 21:41:03.640627 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:03.640615    2560 scope.go:117] "RemoveContainer" containerID="2799481fccef1f052a684e625a717b7c400d5c48f152e4f402e32c290791a6dd"
Sep 11 21:41:03.641204 ip-10-0-137-163 kubenswrapper[2560]: E0911 21:41:03.641174    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2799481fccef1f052a684e625a717b7c400d5c48f152e4f402e32c290791a6dd\": container with ID starting with 2799481fccef1f052a684e625a717b7c400d5c48f152e4f402e32c290791a6dd not found: ID does not exist" containerID="2799481fccef1f052a684e625a717b7c400d5c48f152e4f402e32c290791a6dd"
Sep 11 21:41:03.641306 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:03.641212    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2799481fccef1f052a684e625a717b7c400d5c48f152e4f402e32c290791a6dd"} err="failed to get container status \"2799481fccef1f052a684e625a717b7c400d5c48f152e4f402e32c290791a6dd\": rpc error: code = NotFound desc = could not find container \"2799481fccef1f052a684e625a717b7c400d5c48f152e4f402e32c290791a6dd\": container with ID starting with 2799481fccef1f052a684e625a717b7c400d5c48f152e4f402e32c290791a6dd not found: ID does not exist"
Sep 11 21:41:03.651659 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:03.651637    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-84585bc567-kxdgc"]
Sep 11 21:41:03.655966 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:03.655945    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-84585bc567-kxdgc"]
Sep 11 21:41:05.037540 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:05.037509    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55" path="/var/lib/kubelet/pods/3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55/volumes"
Sep 11 21:41:30.262711 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:30.262674    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-sdtcl_e86be524-7e9c-4e39-9e86-d10c3305bd4d/manager/0.log"
Sep 11 21:41:30.736033 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:30.736000    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8457b95c77-5fx2k_dc0cf857-9126-4637-8d89-801895206e1e/manager/0.log"
Sep 11 21:41:30.742371 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:30.742345    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8457b95c77-5fx2k_dc0cf857-9126-4637-8d89-801895206e1e/copy-manifests/0.log"
Sep 11 21:41:31.593210 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:31.593180    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29819355-wr9h6_1b08603f-13e0-4456-bb5c-baf370799573/cleanup/0.log"
Sep 11 21:41:33.049067 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:33.049031    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-8cv6w_8cd0d49d-99eb-438b-b4a9-c75314533f04/manager/0.log"
Sep 11 21:41:33.294522 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:33.294494    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-jvr59_16f08edd-7ea0-424d-90f4-b42a402ae84d/manager/0.log"
Sep 11 21:41:33.658258 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:33.658229    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg_79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d/istio-proxy/0.log"
Sep 11 21:41:34.267054 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:34.267021    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-57cp9_1e776d2f-909f-40ad-90ae-a496399241b1/payload-pre-processing/0.log"
Sep 11 21:41:34.386802 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:34.386778    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-62vnh_923b93fb-4af2-42e6-a2ef-eb36d7547f59/payload-processing/0.log"
Sep 11 21:41:35.075626 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:35.075592    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-6bbbc_22ffb45d-7e38-43ef-9c1d-775a96b0f13d/main/0.log"
Sep 11 21:41:35.190238 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:35.190213    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-9bgjp_659fac49-bf98-4112-b32d-c674fae31b84/main/0.log"
Sep 11 21:41:41.449962 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:41.449928    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nrqhg/must-gather-mwd2w"]
Sep 11 21:41:41.450521 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:41.450496    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55" containerName="maas-api"
Sep 11 21:41:41.450521 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:41.450520    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55" containerName="maas-api"
Sep 11 21:41:41.450735 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:41.450616    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b3f49ec-498f-4c5a-b7ff-1f1c40cbdc55" containerName="maas-api"
Sep 11 21:41:41.455699 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:41.455680    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nrqhg/must-gather-mwd2w"
Sep 11 21:41:41.458415 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:41.458394    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nrqhg\"/\"kube-root-ca.crt\""
Sep 11 21:41:41.459050 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:41.459030    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-nrqhg\"/\"default-dockercfg-bjkff\""
Sep 11 21:41:41.459162 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:41.459037    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nrqhg\"/\"openshift-service-ca.crt\""
Sep 11 21:41:41.466362 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:41.466339    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nrqhg/must-gather-mwd2w"]
Sep 11 21:41:41.590272 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:41.590247    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rtz8\" (UniqueName: \"kubernetes.io/projected/e88aedd3-9c65-49c8-8804-19a82fc94cae-kube-api-access-6rtz8\") pod \"must-gather-mwd2w\" (UID: \"e88aedd3-9c65-49c8-8804-19a82fc94cae\") " pod="openshift-must-gather-nrqhg/must-gather-mwd2w"
Sep 11 21:41:41.590435 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:41.590294    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e88aedd3-9c65-49c8-8804-19a82fc94cae-must-gather-output\") pod \"must-gather-mwd2w\" (UID: \"e88aedd3-9c65-49c8-8804-19a82fc94cae\") " pod="openshift-must-gather-nrqhg/must-gather-mwd2w"
Sep 11 21:41:41.691604 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:41.691580    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e88aedd3-9c65-49c8-8804-19a82fc94cae-must-gather-output\") pod \"must-gather-mwd2w\" (UID: \"e88aedd3-9c65-49c8-8804-19a82fc94cae\") " pod="openshift-must-gather-nrqhg/must-gather-mwd2w"
Sep 11 21:41:41.691735 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:41.691674    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rtz8\" (UniqueName: \"kubernetes.io/projected/e88aedd3-9c65-49c8-8804-19a82fc94cae-kube-api-access-6rtz8\") pod \"must-gather-mwd2w\" (UID: \"e88aedd3-9c65-49c8-8804-19a82fc94cae\") " pod="openshift-must-gather-nrqhg/must-gather-mwd2w"
Sep 11 21:41:41.691990 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:41.691968    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e88aedd3-9c65-49c8-8804-19a82fc94cae-must-gather-output\") pod \"must-gather-mwd2w\" (UID: \"e88aedd3-9c65-49c8-8804-19a82fc94cae\") " pod="openshift-must-gather-nrqhg/must-gather-mwd2w"
Sep 11 21:41:41.700008 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:41.699946    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rtz8\" (UniqueName: \"kubernetes.io/projected/e88aedd3-9c65-49c8-8804-19a82fc94cae-kube-api-access-6rtz8\") pod \"must-gather-mwd2w\" (UID: \"e88aedd3-9c65-49c8-8804-19a82fc94cae\") " pod="openshift-must-gather-nrqhg/must-gather-mwd2w"
Sep 11 21:41:41.766782 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:41.766753    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nrqhg/must-gather-mwd2w"
Sep 11 21:41:42.042349 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:42.042323    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nrqhg/must-gather-mwd2w"]
Sep 11 21:41:42.044104 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:41:42.044084    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode88aedd3_9c65_49c8_8804_19a82fc94cae.slice/crio-6b92b75127dfdcfea7c8e0258a2c9cfcedd4e081ab8614c32291143d954183fa WatchSource:0}: Error finding container 6b92b75127dfdcfea7c8e0258a2c9cfcedd4e081ab8614c32291143d954183fa: Status 404 returned error can't find the container with id 6b92b75127dfdcfea7c8e0258a2c9cfcedd4e081ab8614c32291143d954183fa
Sep 11 21:41:42.838622 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:42.838586    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nrqhg/must-gather-mwd2w" event={"ID":"e88aedd3-9c65-49c8-8804-19a82fc94cae","Type":"ContainerStarted","Data":"6b92b75127dfdcfea7c8e0258a2c9cfcedd4e081ab8614c32291143d954183fa"}
Sep 11 21:41:43.849878 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:43.849844    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nrqhg/must-gather-mwd2w" event={"ID":"e88aedd3-9c65-49c8-8804-19a82fc94cae","Type":"ContainerStarted","Data":"1ddf5ddcf7edcbe41b451d9dc955efadaa6386581a899c00ab39b2f29333da47"}
Sep 11 21:41:43.850249 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:43.849888    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nrqhg/must-gather-mwd2w" event={"ID":"e88aedd3-9c65-49c8-8804-19a82fc94cae","Type":"ContainerStarted","Data":"c0b9dec7b096e22dababede5a9033e4c34b01385a831ba4018b9742f384bfd44"}
Sep 11 21:41:43.869350 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:43.869291    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-nrqhg/must-gather-mwd2w" podStartSLOduration=2.062670926 podStartE2EDuration="2.869266337s" totalImagesPullingTime="806.595411ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:41:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:41:43.866623755 +0000 UTC m=+2149.344935622" watchObservedRunningTime="2026-09-11 21:41:43.869266337 +0000 UTC m=+2149.347578182"
Sep 11 21:41:44.498207 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:44.498171    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vxlb2_0af5ea62-b0cd-4a1e-ad1e-91f527a2e1fc/global-pull-secret-syncer/0.log"
Sep 11 21:41:44.591239 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:44.591207    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7d7s4_6159eecf-1d1a-4d36-9c12-906f8b272142/konnectivity-agent/0.log"
Sep 11 21:41:44.669755 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:44.669712    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-163.ec2.internal_75a23667c2d6b01bd21de457ebee8e0a/haproxy/0.log"
Sep 11 21:41:49.546129 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:49.546090    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-8cv6w_8cd0d49d-99eb-438b-b4a9-c75314533f04/manager/0.log"
Sep 11 21:41:49.640880 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:49.640844    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-jvr59_16f08edd-7ea0-424d-90f4-b42a402ae84d/manager/0.log"
Sep 11 21:41:51.213981 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:51.213943    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d7fd3e1c-67ab-43e7-b405-ab8fced3c872/alertmanager/0.log"
Sep 11 21:41:51.243359 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:51.243323    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d7fd3e1c-67ab-43e7-b405-ab8fced3c872/config-reloader/0.log"
Sep 11 21:41:51.285689 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:51.285660    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d7fd3e1c-67ab-43e7-b405-ab8fced3c872/kube-rbac-proxy-web/0.log"
Sep 11 21:41:51.340214 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:51.340158    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d7fd3e1c-67ab-43e7-b405-ab8fced3c872/kube-rbac-proxy/0.log"
Sep 11 21:41:51.373627 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:51.373538    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d7fd3e1c-67ab-43e7-b405-ab8fced3c872/kube-rbac-proxy-metric/0.log"
Sep 11 21:41:51.401324 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:51.401150    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d7fd3e1c-67ab-43e7-b405-ab8fced3c872/prom-label-proxy/0.log"
Sep 11 21:41:51.430426 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:51.430272    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d7fd3e1c-67ab-43e7-b405-ab8fced3c872/init-config-reloader/0.log"
Sep 11 21:41:51.510586 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:51.510538    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-mg2bk_85cfef09-44c0-4cb4-97d1-97bce96e79c3/kube-state-metrics/0.log"
Sep 11 21:41:51.538509 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:51.538449    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-mg2bk_85cfef09-44c0-4cb4-97d1-97bce96e79c3/kube-rbac-proxy-main/0.log"
Sep 11 21:41:51.570030 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:51.569974    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-mg2bk_85cfef09-44c0-4cb4-97d1-97bce96e79c3/kube-rbac-proxy-self/0.log"
Sep 11 21:41:51.601451 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:51.601404    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-66f4bd5b6-fggr7_ead66865-003d-43f6-b361-92d2676c4a93/metrics-server/0.log"
Sep 11 21:41:51.636625 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:51.636578    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-kzkz6_d4be4c17-b9be-40b0-b9f7-e0869b578a28/monitoring-plugin/0.log"
Sep 11 21:41:51.672413 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:51.672303    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2t2wn_77d51833-213b-47d4-8179-7d871d60a85f/node-exporter/0.log"
Sep 11 21:41:51.697555 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:51.697512    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2t2wn_77d51833-213b-47d4-8179-7d871d60a85f/kube-rbac-proxy/0.log"
Sep 11 21:41:51.734633 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:51.734610    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2t2wn_77d51833-213b-47d4-8179-7d871d60a85f/init-textfile/0.log"
Sep 11 21:41:51.998896 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:51.998799    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-rhcd6_c3c7a33a-d572-4476-83cc-941b5bba5804/kube-rbac-proxy-main/0.log"
Sep 11 21:41:52.033196 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:52.033149    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-rhcd6_c3c7a33a-d572-4476-83cc-941b5bba5804/kube-rbac-proxy-self/0.log"
Sep 11 21:41:52.067778 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:52.063883    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-rhcd6_c3c7a33a-d572-4476-83cc-941b5bba5804/openshift-state-metrics/0.log"
Sep 11 21:41:52.111991 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:52.111965    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bd936aef-bea6-4735-8f72-83f0218c5551/prometheus/0.log"
Sep 11 21:41:52.138611 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:52.138583    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bd936aef-bea6-4735-8f72-83f0218c5551/config-reloader/0.log"
Sep 11 21:41:52.166805 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:52.166774    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bd936aef-bea6-4735-8f72-83f0218c5551/thanos-sidecar/0.log"
Sep 11 21:41:52.192828 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:52.192801    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bd936aef-bea6-4735-8f72-83f0218c5551/kube-rbac-proxy-web/0.log"
Sep 11 21:41:52.221730 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:52.221692    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bd936aef-bea6-4735-8f72-83f0218c5551/kube-rbac-proxy/0.log"
Sep 11 21:41:52.246978 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:52.246941    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bd936aef-bea6-4735-8f72-83f0218c5551/kube-rbac-proxy-thanos/0.log"
Sep 11 21:41:52.280186 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:52.280083    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bd936aef-bea6-4735-8f72-83f0218c5551/init-config-reloader/0.log"
Sep 11 21:41:52.312816 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:52.312778    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-9g9nr_d1ebbfa3-a39f-4298-bd0d-f0668131e8ca/prometheus-operator/0.log"
Sep 11 21:41:52.348557 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:52.348520    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-9g9nr_d1ebbfa3-a39f-4298-bd0d-f0668131e8ca/kube-rbac-proxy/0.log"
Sep 11 21:41:52.422400 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:52.422363    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-684cbc884-fv8sf_29ab3f71-aaf7-4e7c-a66a-575ab8ddae03/telemeter-client/0.log"
Sep 11 21:41:52.447474 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:52.447440    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-684cbc884-fv8sf_29ab3f71-aaf7-4e7c-a66a-575ab8ddae03/reload/0.log"
Sep 11 21:41:52.471921 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:52.471889    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-684cbc884-fv8sf_29ab3f71-aaf7-4e7c-a66a-575ab8ddae03/kube-rbac-proxy/0.log"
Sep 11 21:41:52.506073 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:52.505976    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74fff8fc89-c86nr_10f1b472-a3b1-4f05-a9ad-8e189031e75c/thanos-query/0.log"
Sep 11 21:41:52.530056 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:52.529924    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74fff8fc89-c86nr_10f1b472-a3b1-4f05-a9ad-8e189031e75c/kube-rbac-proxy-web/0.log"
Sep 11 21:41:52.553364 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:52.553259    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74fff8fc89-c86nr_10f1b472-a3b1-4f05-a9ad-8e189031e75c/kube-rbac-proxy/0.log"
Sep 11 21:41:52.585371 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:52.585222    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74fff8fc89-c86nr_10f1b472-a3b1-4f05-a9ad-8e189031e75c/prom-label-proxy/0.log"
Sep 11 21:41:52.618534 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:52.618506    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74fff8fc89-c86nr_10f1b472-a3b1-4f05-a9ad-8e189031e75c/kube-rbac-proxy-rules/0.log"
Sep 11 21:41:52.645198 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:52.645011    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74fff8fc89-c86nr_10f1b472-a3b1-4f05-a9ad-8e189031e75c/kube-rbac-proxy-metrics/0.log"
Sep 11 21:41:55.195176 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:55.195143    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nrqhg/perf-node-gather-daemonset-6jp5t"]
Sep 11 21:41:55.200839 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:55.200811    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nrqhg/perf-node-gather-daemonset-6jp5t"
Sep 11 21:41:55.214906 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:55.214881    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nrqhg/perf-node-gather-daemonset-6jp5t"]
Sep 11 21:41:55.252586 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:55.252544    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/29cdab47-1def-400d-bcbb-bdaab85a31ea-proc\") pod \"perf-node-gather-daemonset-6jp5t\" (UID: \"29cdab47-1def-400d-bcbb-bdaab85a31ea\") " pod="openshift-must-gather-nrqhg/perf-node-gather-daemonset-6jp5t"
Sep 11 21:41:55.252783 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:55.252680    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zngn\" (UniqueName: \"kubernetes.io/projected/29cdab47-1def-400d-bcbb-bdaab85a31ea-kube-api-access-6zngn\") pod \"perf-node-gather-daemonset-6jp5t\" (UID: \"29cdab47-1def-400d-bcbb-bdaab85a31ea\") " pod="openshift-must-gather-nrqhg/perf-node-gather-daemonset-6jp5t"
Sep 11 21:41:55.252853 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:55.252786    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/29cdab47-1def-400d-bcbb-bdaab85a31ea-lib-modules\") pod \"perf-node-gather-daemonset-6jp5t\" (UID: \"29cdab47-1def-400d-bcbb-bdaab85a31ea\") " pod="openshift-must-gather-nrqhg/perf-node-gather-daemonset-6jp5t"
Sep 11 21:41:55.252853 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:55.252827    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29cdab47-1def-400d-bcbb-bdaab85a31ea-sys\") pod \"perf-node-gather-daemonset-6jp5t\" (UID: \"29cdab47-1def-400d-bcbb-bdaab85a31ea\") " pod="openshift-must-gather-nrqhg/perf-node-gather-daemonset-6jp5t"
Sep 11 21:41:55.252963 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:55.252858    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/29cdab47-1def-400d-bcbb-bdaab85a31ea-podres\") pod \"perf-node-gather-daemonset-6jp5t\" (UID: \"29cdab47-1def-400d-bcbb-bdaab85a31ea\") " pod="openshift-must-gather-nrqhg/perf-node-gather-daemonset-6jp5t"
Sep 11 21:41:55.283497 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:55.283470    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-545b6cc544-cj66x_37f4ca1a-eab9-4c79-ae6b-5150b8d2e853/console/0.log"
Sep 11 21:41:55.354267 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:55.354225    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/29cdab47-1def-400d-bcbb-bdaab85a31ea-lib-modules\") pod \"perf-node-gather-daemonset-6jp5t\" (UID: \"29cdab47-1def-400d-bcbb-bdaab85a31ea\") " pod="openshift-must-gather-nrqhg/perf-node-gather-daemonset-6jp5t"
Sep 11 21:41:55.354486 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:55.354280    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29cdab47-1def-400d-bcbb-bdaab85a31ea-sys\") pod \"perf-node-gather-daemonset-6jp5t\" (UID: \"29cdab47-1def-400d-bcbb-bdaab85a31ea\") " pod="openshift-must-gather-nrqhg/perf-node-gather-daemonset-6jp5t"
Sep 11 21:41:55.354486 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:55.354360    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29cdab47-1def-400d-bcbb-bdaab85a31ea-sys\") pod \"perf-node-gather-daemonset-6jp5t\" (UID: \"29cdab47-1def-400d-bcbb-bdaab85a31ea\") " pod="openshift-must-gather-nrqhg/perf-node-gather-daemonset-6jp5t"
Sep 11 21:41:55.354486 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:55.354412    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/29cdab47-1def-400d-bcbb-bdaab85a31ea-podres\") pod \"perf-node-gather-daemonset-6jp5t\" (UID: \"29cdab47-1def-400d-bcbb-bdaab85a31ea\") " pod="openshift-must-gather-nrqhg/perf-node-gather-daemonset-6jp5t"
Sep 11 21:41:55.354486 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:55.354472    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/29cdab47-1def-400d-bcbb-bdaab85a31ea-lib-modules\") pod \"perf-node-gather-daemonset-6jp5t\" (UID: \"29cdab47-1def-400d-bcbb-bdaab85a31ea\") " pod="openshift-must-gather-nrqhg/perf-node-gather-daemonset-6jp5t"
Sep 11 21:41:55.354734 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:55.354505    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/29cdab47-1def-400d-bcbb-bdaab85a31ea-proc\") pod \"perf-node-gather-daemonset-6jp5t\" (UID: \"29cdab47-1def-400d-bcbb-bdaab85a31ea\") " pod="openshift-must-gather-nrqhg/perf-node-gather-daemonset-6jp5t"
Sep 11 21:41:55.354734 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:55.354580    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zngn\" (UniqueName: \"kubernetes.io/projected/29cdab47-1def-400d-bcbb-bdaab85a31ea-kube-api-access-6zngn\") pod \"perf-node-gather-daemonset-6jp5t\" (UID: \"29cdab47-1def-400d-bcbb-bdaab85a31ea\") " pod="openshift-must-gather-nrqhg/perf-node-gather-daemonset-6jp5t"
Sep 11 21:41:55.354734 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:55.354596    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/29cdab47-1def-400d-bcbb-bdaab85a31ea-podres\") pod \"perf-node-gather-daemonset-6jp5t\" (UID: \"29cdab47-1def-400d-bcbb-bdaab85a31ea\") " pod="openshift-must-gather-nrqhg/perf-node-gather-daemonset-6jp5t"
Sep 11 21:41:55.354734 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:55.354694    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/29cdab47-1def-400d-bcbb-bdaab85a31ea-proc\") pod \"perf-node-gather-daemonset-6jp5t\" (UID: \"29cdab47-1def-400d-bcbb-bdaab85a31ea\") " pod="openshift-must-gather-nrqhg/perf-node-gather-daemonset-6jp5t"
Sep 11 21:41:55.365183 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:55.365152    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zngn\" (UniqueName: \"kubernetes.io/projected/29cdab47-1def-400d-bcbb-bdaab85a31ea-kube-api-access-6zngn\") pod \"perf-node-gather-daemonset-6jp5t\" (UID: \"29cdab47-1def-400d-bcbb-bdaab85a31ea\") " pod="openshift-must-gather-nrqhg/perf-node-gather-daemonset-6jp5t"
Sep 11 21:41:55.516085 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:55.516006    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nrqhg/perf-node-gather-daemonset-6jp5t"
Sep 11 21:41:55.647464 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:55.647431    2560 scope.go:117] "RemoveContainer" containerID="c9b41c9a610bf09f0dafa646b978f41920db4ea25d8f305aea4c14fa844f8e71"
Sep 11 21:41:55.803359 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:55.803325    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nrqhg/perf-node-gather-daemonset-6jp5t"]
Sep 11 21:41:55.812260 ip-10-0-137-163 kubenswrapper[2560]: W0911 21:41:55.812228    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod29cdab47_1def_400d_bcbb_bdaab85a31ea.slice/crio-c671e4241f9946b2d46b5edcb12e5aee217238fdf5aaacb8aed541d6a14c9aee WatchSource:0}: Error finding container c671e4241f9946b2d46b5edcb12e5aee217238fdf5aaacb8aed541d6a14c9aee: Status 404 returned error can't find the container with id c671e4241f9946b2d46b5edcb12e5aee217238fdf5aaacb8aed541d6a14c9aee
Sep 11 21:41:55.946363 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:55.946328    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nrqhg/perf-node-gather-daemonset-6jp5t" event={"ID":"29cdab47-1def-400d-bcbb-bdaab85a31ea","Type":"ContainerStarted","Data":"c671e4241f9946b2d46b5edcb12e5aee217238fdf5aaacb8aed541d6a14c9aee"}
Sep 11 21:41:56.955241 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:56.955196    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nrqhg/perf-node-gather-daemonset-6jp5t" event={"ID":"29cdab47-1def-400d-bcbb-bdaab85a31ea","Type":"ContainerStarted","Data":"13a99ce30097a1d96a420f31b2afb21e62362f8eba42fcd9fd293be23efe5b15"}
Sep 11 21:41:56.956131 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:56.956104    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-nrqhg/perf-node-gather-daemonset-6jp5t"
Sep 11 21:41:56.977449 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:56.977401    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-nrqhg/perf-node-gather-daemonset-6jp5t" podStartSLOduration=1.977367295 podStartE2EDuration="1.977367295s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:41:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:41:56.974425943 +0000 UTC m=+2162.452737788" watchObservedRunningTime="2026-09-11 21:41:56.977367295 +0000 UTC m=+2162.455679413"
Sep 11 21:41:57.171866 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:57.171841    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gjb5r_a0e1e0d4-3580-41ab-8521-ea2881163256/dns/0.log"
Sep 11 21:41:57.192155 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:57.192132    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gjb5r_a0e1e0d4-3580-41ab-8521-ea2881163256/kube-rbac-proxy/0.log"
Sep 11 21:41:57.469947 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:57.469907    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wwnsp_52734055-1949-4e54-a2dc-623f80a5c1ac/dns-node-resolver/0.log"
Sep 11 21:41:58.015830 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:58.015790    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-d6c5fdb9f-hsmww_35f8548d-cfd3-4665-a6d7-5953767772dd/registry/0.log"
Sep 11 21:41:58.057870 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:58.057842    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b7sx4_9e88e074-d628-4e0b-a23c-ce95b8a44c21/node-ca/0.log"
Sep 11 21:41:58.994373 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:58.994346    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg_79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d/istio-proxy/0.log"
Sep 11 21:41:59.440693 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:59.440657    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-57cp9_1e776d2f-909f-40ad-90ae-a496399241b1/payload-pre-processing/0.log"
Sep 11 21:41:59.479681 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:41:59.479656    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-62vnh_923b93fb-4af2-42e6-a2ef-eb36d7547f59/payload-processing/0.log"
Sep 11 21:42:00.403908 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:42:00.403877    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hpv5x_e1ff2609-425e-4d14-93a4-b85b5b3bb3c9/serve-healthcheck-canary/0.log"
Sep 11 21:42:01.038230 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:42:01.038200    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wn4bh_27ff1327-d08c-4a2e-b1c5-4fef5a22362e/kube-rbac-proxy/0.log"
Sep 11 21:42:01.060789 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:42:01.060764    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wn4bh_27ff1327-d08c-4a2e-b1c5-4fef5a22362e/exporter/0.log"
Sep 11 21:42:01.082443 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:42:01.082417    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wn4bh_27ff1327-d08c-4a2e-b1c5-4fef5a22362e/extractor/0.log"
Sep 11 21:42:03.463814 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:42:03.463787    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-sdtcl_e86be524-7e9c-4e39-9e86-d10c3305bd4d/manager/0.log"
Sep 11 21:42:03.635271 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:42:03.635245    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8457b95c77-5fx2k_dc0cf857-9126-4637-8d89-801895206e1e/manager/0.log"
Sep 11 21:42:03.656260 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:42:03.656235    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8457b95c77-5fx2k_dc0cf857-9126-4637-8d89-801895206e1e/copy-manifests/0.log"
Sep 11 21:42:03.980419 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:42:03.980371    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-nrqhg/perf-node-gather-daemonset-6jp5t"
Sep 11 21:42:04.827546 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:42:04.827485    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg_79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d/istio-proxy/0.log"
Sep 11 21:42:04.999559 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:42:04.999532    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-65cc4f94dc-hz7qj_252bc330-8472-4403-8b79-f79d44371014/manager/0.log"
Sep 11 21:42:05.228428 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:42:05.228394    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-57cp9_1e776d2f-909f-40ad-90ae-a496399241b1/payload-pre-processing/0.log"
Sep 11 21:42:05.252089 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:42:05.252063    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-62vnh_923b93fb-4af2-42e6-a2ef-eb36d7547f59/payload-processing/0.log"
Sep 11 21:42:06.866259 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:42:06.866191    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg_79dd5c97-fcb7-4d9a-9f8c-884d10ee9b6d/istio-proxy/0.log"
Sep 11 21:42:07.326092 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:42:07.326059    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-57cp9_1e776d2f-909f-40ad-90ae-a496399241b1/payload-pre-processing/0.log"
Sep 11 21:42:07.371163 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:42:07.371131    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-62vnh_923b93fb-4af2-42e6-a2ef-eb36d7547f59/payload-processing/0.log"
Sep 11 21:42:12.177236 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:42:12.177204    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v4sq2_61773d0c-6a2a-4a1b-8d98-30897e76ae6b/kube-multus-additional-cni-plugins/0.log"
Sep 11 21:42:12.198636 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:42:12.198607    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v4sq2_61773d0c-6a2a-4a1b-8d98-30897e76ae6b/egress-router-binary-copy/0.log"
Sep 11 21:42:12.219224 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:42:12.219196    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v4sq2_61773d0c-6a2a-4a1b-8d98-30897e76ae6b/cni-plugins/0.log"
Sep 11 21:42:12.239105 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:42:12.239074    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v4sq2_61773d0c-6a2a-4a1b-8d98-30897e76ae6b/bond-cni-plugin/0.log"
Sep 11 21:42:12.258975 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:42:12.258950    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v4sq2_61773d0c-6a2a-4a1b-8d98-30897e76ae6b/routeoverride-cni/0.log"
Sep 11 21:42:12.279850 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:42:12.279822    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v4sq2_61773d0c-6a2a-4a1b-8d98-30897e76ae6b/whereabouts-cni-bincopy/0.log"
Sep 11 21:42:12.301014 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:42:12.300974    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v4sq2_61773d0c-6a2a-4a1b-8d98-30897e76ae6b/whereabouts-cni/0.log"
Sep 11 21:42:12.433330 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:42:12.433193    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-xzdlq_585342c4-6023-45ad-b2b3-b68072a36bca/kube-multus/0.log"
Sep 11 21:42:12.500595 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:42:12.500560    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6nwfd_5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3/network-metrics-daemon/0.log"
Sep 11 21:42:12.516814 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:42:12.516789    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6nwfd_5b1a2772-837e-4a37-bfa3-a2a3dda2c8d3/kube-rbac-proxy/0.log"
Sep 11 21:42:13.647517 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:42:13.647486    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qpwdk_17493773-1416-44a9-8a25-b05d1daccc37/ovn-controller/0.log"
Sep 11 21:42:13.665028 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:42:13.665000    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qpwdk_17493773-1416-44a9-8a25-b05d1daccc37/ovn-acl-logging/0.log"
Sep 11 21:42:13.691583 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:42:13.691548    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qpwdk_17493773-1416-44a9-8a25-b05d1daccc37/kube-rbac-proxy-node/0.log"
Sep 11 21:42:13.713801 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:42:13.713765    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qpwdk_17493773-1416-44a9-8a25-b05d1daccc37/kube-rbac-proxy-ovn-metrics/0.log"
Sep 11 21:42:13.735480 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:42:13.735445    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qpwdk_17493773-1416-44a9-8a25-b05d1daccc37/northd/0.log"
Sep 11 21:42:13.760715 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:42:13.760682    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qpwdk_17493773-1416-44a9-8a25-b05d1daccc37/nbdb/0.log"
Sep 11 21:42:13.811172 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:42:13.811136    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qpwdk_17493773-1416-44a9-8a25-b05d1daccc37/sbdb/0.log"
Sep 11 21:42:13.903654 ip-10-0-137-163 kubenswrapper[2560]: I0911 21:42:13.903549    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qpwdk_17493773-1416-44a9-8a25-b05d1daccc37/ovnkube-controller/0.log"